climateprediction.net home page
Task 22300453

Task 22300453

Name oifs_43r3_ps_0615_1985050100_123_954_12171259_1
Workunit 12171259
Created 20 Jan 2023, 12:25:05 UTC
Sent 20 Jan 2023, 12:45:44 UTC
Report deadline 21 Mar 2023, 12:45:44 UTC
Received 21 Jan 2023, 12:35:29 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1506322
Run time 23 hours 16 min 14 sec
CPU time 21 hours 48 min 49 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.34 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,398.73 MB
Peak swap size 4,978.05 MB
Peak disk usage 2,023.82 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
ectory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:50:36 STEP 2425 H=2425:00 +CPU= 21.537
  23:50:59 STEP 2426 H=2426:00 +CPU= 22.411
  23:51:37 STEP 2427 H=2427:00 +CPU= 34.301
  23:52:00 STEP 2428 H=2428:00 +CPU= 22.525
  23:52:23 STEP 2429 H=2429:00 +CPU= 21.790
  23:53:02 STEP 2430 H=2430:00 +CPU= 35.287
  23:53:24 STEP 2431 H=2431:00 +CPU= 21.778
  23:53:50 STEP 2432 H=2432:00 +CPU= 22.504
  23:54:24 STEP 2433 H=2433:00 +CPU= 33.843
  23:54:49 STEP 2434 H=2434:00 +CPU= 22.465
  23:55:10 STEP 2435 H=2435:00 +CPU= 21.470
  23:55:48 STEP 2436 H=2436:00 +CPU= 37.577
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002436
  23:56:09 STEP 2437 H=2437:00 +CPU= 21.609
  23:56:32 STEP 2438 H=2438:00 +CPU= 22.415
  23:57:07 STEP 2439 H=2439:00 +CPU= 34.654
  23:57:31 STEP 2440 H=2440:00 +CPU= 22.342
  23:57:53 STEP 2441 H=2441:00 +CPU= 21.902
  23:58:29 STEP 2442 H=2442:00 +CPU= 34.984
  23:58:52 STEP 2443 H=2443:00 +CPU= 21.976
  23:59:16 STEP 2444 H=2444:00 +CPU= 22.474
  23:59:53 STEP 2445 H=2445:00 +CPU= 34.161
  00:00:17 STEP 2446 H=2446:00 +CPU= 22.390
  00:00:41 STEP 2447 H=2447:00 +CPU= 22.364
  00:01:30 STEP 2448 H=2448:00 +CPU= 40.516
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:01:53 STEP 2449 H=2449:00 +CPU= 22.003
  00:02:17 STEP 2450 H=2450:00 +CPU= 22.480
  00:02:53 STEP 2451 H=2451:00 +CPU= 34.087
  00:03:16 STEP 2452 H=2452:00 +CPU= 22.749
  00:03:38 STEP 2453 H=2453:00 +CPU= 22.117
  00:04:13 STEP 2454 H=2454:00 +CPU= 35.350
  00:04:35 STEP 2455 H=2455:00 +CPU= 21.912
  00:04:59 STEP 2456 H=2456:00 +CPU= 22.511
  00:05:35 STEP 2457 H=2457:00 +CPU= 34.117
  00:06:00 STEP 2458 H=2458:00 +CPU= 22.713
  00:06:23 STEP 2459 H=2459:00 +CPU= 21.915
  00:07:04 STEP 2460 H=2460:00 +CPU= 38.024
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002460
  00:07:25 STEP 2461 H=2461:00 +CPU= 21.644
  00:07:48 STEP 2462 H=2462:00 +CPU= 22.324
  00:08:22 STEP 2463 H=2463:00 +CPU= 34.402
  00:08:45 STEP 2464 H=2464:00 +CPU= 22.896
  00:09:07 STEP 2465 H=2465:00 +CPU= 21.801
  00:09:42 STEP 2466 H=2466:00 +CPU= 34.915
  00:10:04 STEP 2467 H=2467:00 +CPU= 22.099
  00:10:27 STEP 2468 H=2468:00 +CPU= 22.845
  00:11:02 STEP 2469 H=2469:00 +CPU= 34.655
  00:11:24 STEP 2470 H=2470:00 +CPU= 22.376
  00:11:47 STEP 2471 H=2471:00 +CPU= 22.421
  00:12:34 STEP 2472 H=2472:00 +CPU= 40.866
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:12:56 STEP 2473 H=2473:00 +CPU= 21.802
  00:13:18 STEP 2474 H=2474:00 +CPU= 22.409
  00:13:53 STEP 2475 H=2475:00 +CPU= 34.045
  00:14:17 STEP 2476 H=2476:00 +CPU= 22.679
  00:14:38 STEP 2477 H=2477:00 +CPU= 21.709
  00:15:15 STEP 2478 H=2478:00 +CPU= 35.378
  00:15:37 STEP 2479 H=2479:00 +CPU= 21.913
  00:16:01 STEP 2480 H=2480:00 +CPU= 22.537
  00:16:37 STEP 2481 H=2481:00 +CPU= 34.120
  00:17:01 STEP 2482 H=2482:00 +CPU= 22.286
  00:17:23 STEP 2483 H=2483:00 +CPU= 21.723
  00:18:02 STEP 2484 H=2484:00 +CPU= 37.935
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002484
  00:18:26 STEP 2485 H=2485:00 +CPU= 21.755
  00:18:51 STEP 2486 H=2486:00 +CPU= 22.811
  00:19:26 STEP 2487 H=2487:00 +CPU= 33.922
  00:19:49 STEP 2488 H=2488:00 +CPU= 22.623
  00:20:13 STEP 2489 H=2489:00 +CPU= 21.783
  00:20:48 STEP 2490 H=2490:00 +CPU= 35.079
  00:21:10 STEP 2491 H=2491:00 +CPU= 21.647
  00:21:33 STEP 2492 H=2492:00 +CPU= 22.345
  00:22:07 STEP 2493 H=2493:00 +CPU= 34.169
  00:22:29 STEP 2494 H=2494:00 +CPU= 22.324
  00:22:52 STEP 2495 H=2495:00 +CPU= 22.561
  00:23:38 STEP 2496 H=2496:00 +CPU= 40.273
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:24:00 STEP 2497 H=2497:00 +CPU= 21.635
  00:24:23 STEP 2498 H=2498:00 +CPU= 22.332
  00:24:57 STEP 2499 H=2499:00 +CPU= 34.023
  00:25:20 STEP 2500 H=2500:00 +CPU= 22.595
  00:25:43 STEP 2501 H=2501:00 +CPU= 21.611
  00:26:20 STEP 2502 H=2502:00 +CPU= 34.969
  00:26:42 STEP 2503 H=2503:00 +CPU= 21.735
  00:27:06 STEP 2504 H=2504:00 +CPU= 22.355
  00:27:41 STEP 2505 H=2505:00 +CPU= 34.374
  00:28:03 STEP 2506 H=2506:00 +CPU= 22.747
  00:28:25 STEP 2507 H=2507:00 +CPU= 21.776
  00:29:03 STEP 2508 H=2508:00 +CPU= 38.236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002508
  00:29:25 STEP 2509 H=2509:00 +CPU= 21.599
  00:29:48 STEP 2510 H=2510:00 +CPU= 22.621
  00:30:23 STEP 2511 H=2511:00 +CPU= 34.010
  00:30:47 STEP 2512 H=2512:00 +CPU= 22.575
  00:31:11 STEP 2513 H=2513:00 +CPU= 22.024
  00:31:48 STEP 2514 H=2514:00 +CPU= 35.206
  00:32:11 STEP 2515 H=2515:00 +CPU= 21.772
  00:32:35 STEP 2516 H=2516:00 +CPU= 22.394
  00:33:12 STEP 2517 H=2517:00 +CPU= 33.903
  00:33:36 STEP 2518 H=2518:00 +CPU= 22.709
  00:33:59 STEP 2519 H=2519:00 +CPU= 22.385
  00:34:47 STEP 2520 H=2520:00 +CPU= 40.065
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:35:11 STEP 2521 H=2521:00 +CPU= 21.737
  00:35:34 STEP 2522 H=2522:00 +CPU= 22.348
  00:36:08 STEP 2523 H=2523:00 +CPU= 34.122
  00:36:31 STEP 2524 H=2524:00 +CPU= 22.139
  00:36:54 STEP 2525 H=2525:00 +CPU= 21.650
  00:37:31 STEP 2526 H=2526:00 +CPU= 35.331
  00:37:52 STEP 2527 H=2527:00 +CPU= 21.608
  00:38:15 STEP 2528 H=2528:00 +CPU= 22.417
  00:38:50 STEP 2529 H=2529:00 +CPU= 33.920
  00:39:13 STEP 2530 H=2530:00 +CPU= 22.354
  00:39:34 STEP 2531 H=2531:00 +CPU= 21.522
  00:40:13 STEP 2532 H=2532:00 +CPU= 37.638
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002532
  00:40:35 STEP 2533 H=2533:00 +CPU= 21.540
  00:40:58 STEP 2534 H=2534:00 +CPU= 22.665
  00:41:33 STEP 2535 H=2535:00 +CPU= 33.874
  00:41:57 STEP 2536 H=2536:00 +CPU= 22.396
  00:42:19 STEP 2537 H=2537:00 +CPU= 21.545
  00:42:54 STEP 2538 H=2538:00 +CPU= 34.770
  00:43:16 STEP 2539 H=2539:00 +CPU= 21.787
  00:43:39 STEP 2540 H=2540:00 +CPU= 22.311
  00:44:16 STEP 2541 H=2541:00 +CPU= 34.103
  00:44:39 STEP 2542 H=2542:00 +CPU= 22.859
  00:45:02 STEP 2543 H=2543:00 +CPU= 22.703
  00:45:49 STEP 2544 H=2544:00 +CPU= 40.277
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:46:11 STEP 2545 H=2545:00 +CPU= 21.777
  00:46:34 STEP 2546 H=2546:00 +CPU= 22.172
  00:47:11 STEP 2547 H=2547:00 +CPU= 34.342
  00:47:34 STEP 2548 H=2548:00 +CPU= 22.836
  00:47:57 STEP 2549 H=2549:00 +CPU= 21.810
  00:48:32 STEP 2550 H=2550:00 +CPU= 34.566
  00:48:54 STEP 2551 H=2551:00 +CPU= 21.580
  00:49:17 STEP 2552 H=2552:00 +CPU= 22.210
  00:49:51 STEP 2553 H=2553:00 +CPU= 33.811
  00:50:14 STEP 2554 H=2554:00 +CPU= 22.536
  00:50:36 STEP 2555 H=2555:00 +CPU= 21.969
  00:51:16 STEP 2556 H=2556:00 +CPU= 37.613
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002556
  00:51:37 STEP 2557 H=2557:00 +CPU= 21.689
  00:52:02 STEP 2558 H=2558:00 +CPU= 22.474
  00:52:37 STEP 2559 H=2559:00 +CPU= 34.001
  00:53:02 STEP 2560 H=2560:00 +CPU= 22.229
  00:53:24 STEP 2561 H=2561:00 +CPU= 21.512
  00:54:02 STEP 2562 H=2562:00 +CPU= 34.659
  00:54:25 STEP 2563 H=2563:00 +CPU= 21.884
  00:54:47 STEP 2564 H=2564:00 +CPU= 22.076
  00:55:22 STEP 2565 H=2565:00 +CPU= 34.484
  00:55:45 STEP 2566 H=2566:00 +CPU= 22.662
  00:56:07 STEP 2567 H=2567:00 +CPU= 22.112
  00:56:53 STEP 2568 H=2568:00 +CPU= 39.814
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:57:16 STEP 2569 H=2569:00 +CPU= 21.716
  00:57:39 STEP 2570 H=2570:00 +CPU= 22.505
  00:58:14 STEP 2571 H=2571:00 +CPU= 34.513
  00:58:38 STEP 2572 H=2572:00 +CPU= 22.405
  00:59:00 STEP 2573 H=2573:00 +CPU= 21.566
  00:59:35 STEP 2574 H=2574:00 +CPU= 35.494
  00:59:57 STEP 2575 H=2575:00 +CPU= 21.604
  01:00:21 STEP 2576 H=2576:00 +CPU= 22.423
  01:00:56 STEP 2577 H=2577:00 +CPU= 34.097
  01:01:19 STEP 2578 H=2578:00 +CPU= 22.919
  01:01:41 STEP 2579 H=2579:00 +CPU= 22.060
  01:02:20 STEP 2580 H=2580:00 +CPU= 37.699
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002580
  01:02:41 STEP 2581 H=2581:00 +CPU= 21.626
  01:03:04 STEP 2582 H=2582:00 +CPU= 22.415
  01:03:41 STEP 2583 H=2583:00 +CPU= 34.470
  01:04:03 STEP 2584 H=2584:00 +CPU= 22.610
  01:04:25 STEP 2585 H=2585:00 +CPU= 21.734
  01:05:00 STEP 2586 H=2586:00 +CPU= 34.949
  01:05:22 STEP 2587 H=2587:00 +CPU= 22.130
  01:05:47 STEP 2588 H=2588:00 +CPU= 22.468
  01:06:22 STEP 2589 H=2589:00 +CPU= 34.134
  01:06:44 STEP 2590 H=2590:00 +CPU= 22.322
  01:07:07 STEP 2591 H=2591:00 +CPU= 22.400
  01:07:53 STEP 2592 H=2592:00 +CPU= 40.477
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:08:15 STEP 2593 H=2593:00 +CPU= 21.495
  01:08:41 STEP 2594 H=2594:00 +CPU= 22.322
  01:09:19 STEP 2595 H=2595:00 +CPU= 34.152
  01:09:42 STEP 2596 H=2596:00 +CPU= 22.227
  01:10:04 STEP 2597 H=2597:00 +CPU= 21.524
  01:10:40 STEP 2598 H=2598:00 +CPU= 34.785
  01:11:02 STEP 2599 H=2599:00 +CPU= 21.597
  01:11:27 STEP 2600 H=2600:00 +CPU= 22.640
  01:12:03 STEP 2601 H=2601:00 +CPU= 34.090
  01:12:26 STEP 2602 H=2602:00 +CPU= 22.485
  01:12:48 STEP 2603 H=2603:00 +CPU= 21.537
  01:13:26 STEP 2604 H=2604:00 +CPU= 38.265
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002604
  01:13:50 STEP 2605 H=2605:00 +CPU= 21.481
  01:14:12 STEP 2606 H=2606:00 +CPU= 22.842
  01:14:47 STEP 2607 H=2607:00 +CPU= 34.029
  01:15:11 STEP 2608 H=2608:00 +CPU= 22.202
  01:15:33 STEP 2609 H=2609:00 +CPU= 22.031
  01:16:11 STEP 2610 H=2610:00 +CPU= 35.154
  01:16:34 STEP 2611 H=2611:00 +CPU= 21.968
  01:16:56 STEP 2612 H=2612:00 +CPU= 22.406
  01:17:30 STEP 2613 H=2613:00 +CPU= 34.294
  01:17:53 STEP 2614 H=2614:00 +CPU= 22.418
  01:18:16 STEP 2615 H=2615:00 +CPU= 22.369
  01:19:07 STEP 2616 H=2616:00 +CPU= 40.315
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:19:29 STEP 2617 H=2617:00 +CPU= 21.678
  01:19:52 STEP 2618 H=2618:00 +CPU= 22.155
  01:20:27 STEP 2619 H=2619:00 +CPU= 33.797
  01:20:49 STEP 2620 H=2620:00 +CPU= 22.324
  01:21:12 STEP 2621 H=2621:00 +CPU= 22.093
  01:21:47 STEP 2622 H=2622:00 +CPU= 35.595
  01:22:10 STEP 2623 H=2623:00 +CPU= 21.890
  01:22:33 STEP 2624 H=2624:00 +CPU= 22.612
  01:23:09 STEP 2625 H=2625:00 +CPU= 34.024
  01:23:33 STEP 2626 H=2626:00 +CPU= 22.565
  01:23:56 STEP 2627 H=2627:00 +CPU= 21.943
  01:24:36 STEP 2628 H=2628:00 +CPU= 38.349
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002628
  01:24:58 STEP 2629 H=2629:00 +CPU= 21.541
  01:25:24 STEP 2630 H=2630:00 +CPU= 22.450
  01:25:59 STEP 2631 H=2631:00 +CPU= 34.408
  01:26:21 STEP 2632 H=2632:00 +CPU= 22.192
  01:26:44 STEP 2633 H=2633:00 +CPU= 21.523
  01:27:21 STEP 2634 H=2634:00 +CPU= 35.060
  01:27:42 STEP 2635 H=2635:00 +CPU= 21.452
  01:28:05 STEP 2636 H=2636:00 +CPU= 22.288
  01:28:39 STEP 2637 H=2637:00 +CPU= 34.258
  01:29:01 STEP 2638 H=2638:00 +CPU= 22.382
  01:29:23 STEP 2639 H=2639:00 +CPU= 21.998
  01:30:11 STEP 2640 H=2640:00 +CPU= 40.200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:30:33 STEP 2641 H=2641:00 +CPU= 21.543
Uploading trickle at timestep: 9504000
  01:30:58 STEP 2642 H=2642:00 +CPU= 22.543
  01:31:33 STEP 2643 H=2643:00 +CPU= 34.175
  01:31:56 STEP 2644 H=2644:00 +CPU= 22.651
  01:32:17 STEP 2645 H=2645:00 +CPU= 21.740
  01:32:55 STEP 2646 H=2646:00 +CPU= 34.588
  01:33:19 STEP 2647 H=2647:00 +CPU= 21.433
  01:33:43 STEP 2648 H=2648:00 +CPU= 22.610
  01:34:20 STEP 2649 H=2649:00 +CPU= 34.503
  01:34:42 STEP 2650 H=2650:00 +CPU= 22.264
  01:35:06 STEP 2651 H=2651:00 +CPU= 21.577
  01:35:48 STEP 2652 H=2652:00 +CPU= 37.853
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002652
  01:36:12 STEP 2653 H=2653:00 +CPU= 21.826
  01:36:35 STEP 2654 H=2654:00 +CPU= 22.276
  01:37:10 STEP 2655 H=2655:00 +CPU= 34.188
  01:37:33 STEP 2656 H=2656:00 +CPU= 22.363
  01:37:55 STEP 2657 H=2657:00 +CPU= 21.742
  01:38:35 STEP 2658 H=2658:00 +CPU= 35.071
  01:38:56 STEP 2659 H=2659:00 +CPU= 21.543
  01:39:20 STEP 2660 H=2660:00 +CPU= 22.302
  01:39:56 STEP 2661 H=2661:00 +CPU= 34.183
  01:40:21 STEP 2662 H=2662:00 +CPU= 22.166
  01:40:45 STEP 2663 H=2663:00 +CPU= 22.186
  01:41:49 STEP 2664 H=2664:00 +CPU= 40.103
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:42:10 STEP 2665 H=2665:00 +CPU= 21.590
  01:42:33 STEP 2666 H=2666:00 +CPU= 22.400
  01:43:07 STEP 2667 H=2667:00 +CPU= 33.878
  01:43:32 STEP 2668 H=2668:00 +CPU= 22.228
  01:43:53 STEP 2669 H=2669:00 +CPU= 21.550
  01:44:30 STEP 2670 H=2670:00 +CPU= 34.735
  01:44:51 STEP 2671 H=2671:00 +CPU= 21.495
  01:45:17 STEP 2672 H=2672:00 +CPU= 22.274
  01:45:54 STEP 2673 H=2673:00 +CPU= 33.812
  01:46:17 STEP 2674 H=2674:00 +CPU= 22.242
  01:46:40 STEP 2675 H=2675:00 +CPU= 21.641
  01:47:23 STEP 2676 H=2676:00 +CPU= 37.774
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002676
  01:47:50 STEP 2677 H=2677:00 +CPU= 21.694
  01:48:12 STEP 2678 H=2678:00 +CPU= 22.332
  01:48:50 STEP 2679 H=2679:00 +CPU= 33.904
  01:49:14 STEP 2680 H=2680:00 +CPU= 22.220
  01:49:36 STEP 2681 H=2681:00 +CPU= 21.494
  01:50:11 STEP 2682 H=2682:00 +CPU= 34.653
  01:50:33 STEP 2683 H=2683:00 +CPU= 21.583
  01:50:55 STEP 2684 H=2684:00 +CPU= 22.470
  01:51:29 STEP 2685 H=2685:00 +CPU= 33.936
  01:51:52 STEP 2686 H=2686:00 +CPU= 22.341
  01:52:15 STEP 2687 H=2687:00 +CPU= 22.514
  01:53:10 STEP 2688 H=2688:00 +CPU= 40.223
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:53:34 STEP 2689 H=2689:00 +CPU= 21.699
  01:53:58 STEP 2690 H=2690:00 +CPU= 22.348
  01:54:33 STEP 2691 H=2691:00 +CPU= 33.850
  01:54:55 STEP 2692 H=2692:00 +CPU= 22.261
  01:55:20 STEP 2693 H=2693:00 +CPU= 21.569
  01:55:56 STEP 2694 H=2694:00 +CPU= 34.594
  01:56:17 STEP 2695 H=2695:00 +CPU= 21.564
  01:56:45 STEP 2696 H=2696:00 +CPU= 22.301
  01:57:22 STEP 2697 H=2697:00 +CPU= 33.903
  01:57:46 STEP 2698 H=2698:00 +CPU= 22.273
  01:58:08 STEP 2699 H=2699:00 +CPU= 21.577
  01:58:46 STEP 2700 H=2700:00 +CPU= 38.023
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002700
  01:59:08 STEP 2701 H=2701:00 +CPU= 21.521
  01:59:31 STEP 2702 H=2702:00 +CPU= 22.509
  02:00:05 STEP 2703 H=2703:00 +CPU= 33.889
  02:00:27 STEP 2704 H=2704:00 +CPU= 22.105
  02:00:49 STEP 2705 H=2705:00 +CPU= 21.354
  02:01:24 STEP 2706 H=2706:00 +CPU= 34.533
  02:01:46 STEP 2707 H=2707:00 +CPU= 21.896
  02:02:09 STEP 2708 H=2708:00 +CPU= 22.814
  02:02:43 STEP 2709 H=2709:00 +CPU= 33.915
  02:03:06 STEP 2710 H=2710:00 +CPU= 22.519
  02:03:29 STEP 2711 H=2711:00 +CPU= 22.083
  02:04:22 STEP 2712 H=2712:00 +CPU= 39.828
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:04:45 STEP 2713 H=2713:00 +CPU= 21.622
  02:05:07 STEP 2714 H=2714:00 +CPU= 22.443
  02:05:41 STEP 2715 H=2715:00 +CPU= 34.255
  02:06:04 STEP 2716 H=2716:00 +CPU= 22.272
  02:06:26 STEP 2717 H=2717:00 +CPU= 21.511
  02:07:01 STEP 2718 H=2718:00 +CPU= 33.903
  02:07:25 STEP 2719 H=2719:00 +CPU= 21.504
  02:07:47 STEP 2720 H=2720:00 +CPU= 22.151
  02:20:30 STEP 2721 H=2721:00 +CPU= 35.917
  02:20:54 STEP 2722 H=2722:00 +CPU= 22.297
  02:21:16 STEP 2723 H=2723:00 +CPU= 21.512
  02:21:58 STEP 2724 H=2724:00 +CPU= 37.673
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002724
  02:22:20 STEP 2725 H=2725:00 +CPU= 21.549
  02:22:43 STEP 2726 H=2726:00 +CPU= 22.327
  02:23:18 STEP 2727 H=2727:00 +CPU= 33.890
  02:23:42 STEP 2728 H=2728:00 +CPU= 22.276
  02:24:06 STEP 2729 H=2729:00 +CPU= 21.525
  02:24:42 STEP 2730 H=2730:00 +CPU= 34.656
  02:25:04 STEP 2731 H=2731:00 +CPU= 21.442
  02:25:26 STEP 2732 H=2732:00 +CPU= 22.293
  02:26:01 STEP 2733 H=2733:00 +CPU= 33.772
  02:26:24 STEP 2734 H=2734:00 +CPU= 22.252
  02:26:48 STEP 2735 H=2735:00 +CPU= 22.209
  02:27:37 STEP 2736 H=2736:00 +CPU= 39.897
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:27:59 STEP 2737 H=2737:00 +CPU= 21.512
  02:28:23 STEP 2738 H=2738:00 +CPU= 22.240
  02:28:59 STEP 2739 H=2739:00 +CPU= 33.793
  02:29:22 STEP 2740 H=2740:00 +CPU= 22.317
  02:29:44 STEP 2741 H=2741:00 +CPU= 21.615
  02:30:21 STEP 2742 H=2742:00 +CPU= 34.783
  02:30:42 STEP 2743 H=2743:00 +CPU= 21.561
  02:31:05 STEP 2744 H=2744:00 +CPU= 22.265
  02:31:39 STEP 2745 H=2745:00 +CPU= 33.903
  02:32:01 STEP 2746 H=2746:00 +CPU= 22.319
  02:32:24 STEP 2747 H=2747:00 +CPU= 21.474
  02:33:04 STEP 2748 H=2748:00 +CPU= 37.551
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002748
  02:33:26 STEP 2749 H=2749:00 +CPU= 21.413
  02:33:51 STEP 2750 H=2750:00 +CPU= 22.273
  02:34:28 STEP 2751 H=2751:00 +CPU= 33.754
  02:34:51 STEP 2752 H=2752:00 +CPU= 22.309
  02:35:13 STEP 2753 H=2753:00 +CPU= 21.532
  02:35:51 STEP 2754 H=2754:00 +CPU= 34.519
  02:36:14 STEP 2755 H=2755:00 +CPU= 21.496
  02:36:38 STEP 2756 H=2756:00 +CPU= 22.171
  02:37:14 STEP 2757 H=2757:00 +CPU= 33.727
  02:37:37 STEP 2758 H=2758:00 +CPU= 22.161
  02:38:00 STEP 2759 H=2759:00 +CPU= 22.156
  02:38:49 STEP 2760 H=2760:00 +CPU= 39.892
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:39:11 STEP 2761 H=2761:00 +CPU= 21.468
  02:39:34 STEP 2762 H=2762:00 +CPU= 22.120
  02:40:12 STEP 2763 H=2763:00 +CPU= 33.787
  02:40:35 STEP 2764 H=2764:00 +CPU= 22.209
  02:40:57 STEP 2765 H=2765:00 +CPU= 21.451
  02:41:32 STEP 2766 H=2766:00 +CPU= 34.709
  02:41:54 STEP 2767 H=2767:00 +CPU= 21.505
  02:42:17 STEP 2768 H=2768:00 +CPU= 22.204
  02:42:52 STEP 2769 H=2769:00 +CPU= 33.816
  02:43:14 STEP 2770 H=2770:00 +CPU= 22.323
  02:43:37 STEP 2771 H=2771:00 +CPU= 21.511
  02:44:16 STEP 2772 H=2772:00 +CPU= 37.668
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002772
  02:44:37 STEP 2773 H=2773:00 +CPU= 21.574
  02:45:00 STEP 2774 H=2774:00 +CPU= 22.157
  02:45:33 STEP 2775 H=2775:00 +CPU= 33.744
  02:45:56 STEP 2776 H=2776:00 +CPU= 22.172
  02:46:18 STEP 2777 H=2777:00 +CPU= 21.506
  02:46:53 STEP 2778 H=2778:00 +CPU= 34.554
  02:47:15 STEP 2779 H=2779:00 +CPU= 21.544
  02:47:39 STEP 2780 H=2780:00 +CPU= 22.174
  02:48:14 STEP 2781 H=2781:00 +CPU= 33.778
  02:48:36 STEP 2782 H=2782:00 +CPU= 22.161
  02:49:00 STEP 2783 H=2783:00 +CPU= 22.182
  02:49:51 STEP 2784 H=2784:00 +CPU= 39.704
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:50:12 STEP 2785 H=2785:00 +CPU= 21.458
  02:50:34 STEP 2786 H=2786:00 +CPU= 22.066
  02:51:08 STEP 2787 H=2787:00 +CPU= 33.929
  02:51:31 STEP 2788 H=2788:00 +CPU= 22.215
  02:51:53 STEP 2789 H=2789:00 +CPU= 21.533
  02:52:30 STEP 2790 H=2790:00 +CPU= 34.636
  02:52:52 STEP 2791 H=2791:00 +CPU= 21.526
  02:53:15 STEP 2792 H=2792:00 +CPU= 22.216
  02:53:51 STEP 2793 H=2793:00 +CPU= 33.805
  02:54:16 STEP 2794 H=2794:00 +CPU= 22.215
  02:54:40 STEP 2795 H=2795:00 +CPU= 21.528
  02:55:17 STEP 2796 H=2796:00 +CPU= 37.641
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002796
  02:55:40 STEP 2797 H=2797:00 +CPU= 21.476
  02:56:02 STEP 2798 H=2798:00 +CPU= 22.160
  02:56:36 STEP 2799 H=2799:00 +CPU= 33.954
  02:56:58 STEP 2800 H=2800:00 +CPU= 22.280
  02:57:20 STEP 2801 H=2801:00 +CPU= 21.507
  02:57:55 STEP 2802 H=2802:00 +CPU= 34.740
  02:58:17 STEP 2803 H=2803:00 +CPU= 21.425
  02:58:39 STEP 2804 H=2804:00 +CPU= 21.998
  02:59:18 STEP 2805 H=2805:00 +CPU= 33.772
  02:59:40 STEP 2806 H=2806:00 +CPU= 22.161
  03:00:02 STEP 2807 H=2807:00 +CPU= 22.062
  03:00:52 STEP 2808 H=2808:00 +CPU= 39.966
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_116.zip
Uploading the intermediate file: upload_file_116.zip
  03:01:14 STEP 2809 H=2809:00 +CPU= 21.507
  03:01:36 STEP 2810 H=2810:00 +CPU= 22.276
  03:02:10 STEP 2811 H=2811:00 +CPU= 33.939
  03:02:33 STEP 2812 H=2812:00 +CPU= 22.194
  03:02:55 STEP 2813 H=2813:00 +CPU= 21.391
  03:03:32 STEP 2814 H=2814:00 +CPU= 34.649
  03:03:54 STEP 2815 H=2815:00 +CPU= 21.642
  03:04:16 STEP 2816 H=2816:00 +CPU= 22.349
  03:04:51 STEP 2817 H=2817:00 +CPU= 34.031
  03:05:13 STEP 2818 H=2818:00 +CPU= 22.321
  03:05:37 STEP 2819 H=2819:00 +CPU= 21.515
  03:06:16 STEP 2820 H=2820:00 +CPU= 37.652
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002820
  03:06:38 STEP 2821 H=2821:00 +CPU= 21.527
  03:07:02 STEP 2822 H=2822:00 +CPU= 22.222
  03:07:38 STEP 2823 H=2823:00 +CPU= 33.863
  03:08:00 STEP 2824 H=2824:00 +CPU= 22.148
  03:08:23 STEP 2825 H=2825:00 +CPU= 21.492
  03:09:01 STEP 2826 H=2826:00 +CPU= 34.648
  03:09:23 STEP 2827 H=2827:00 +CPU= 21.466
  03:09:46 STEP 2828 H=2828:00 +CPU= 22.286
  03:10:21 STEP 2829 H=2829:00 +CPU= 33.812
  03:10:44 STEP 2830 H=2830:00 +CPU= 22.190
  03:11:08 STEP 2831 H=2831:00 +CPU= 22.125
  03:11:57 STEP 2832 H=2832:00 +CPU= 39.847
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_117.zip
Uploading the intermediate file: upload_file_117.zip
  03:12:19 STEP 2833 H=2833:00 +CPU= 21.423
  03:12:41 STEP 2834 H=2834:00 +CPU= 22.278
  03:13:18 STEP 2835 H=2835:00 +CPU= 33.903
  03:13:40 STEP 2836 H=2836:00 +CPU= 22.193
  03:14:02 STEP 2837 H=2837:00 +CPU= 21.527
  03:14:37 STEP 2838 H=2838:00 +CPU= 34.793
  03:14:59 STEP 2839 H=2839:00 +CPU= 21.326
  03:15:21 STEP 2840 H=2840:00 +CPU= 22.296
  03:15:56 STEP 2841 H=2841:00 +CPU= 34.028
  03:16:19 STEP 2842 H=2842:00 +CPU= 22.206
  03:16:41 STEP 2843 H=2843:00 +CPU= 21.548
  03:17:20 STEP 2844 H=2844:00 +CPU= 37.644
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002844
  03:17:43 STEP 2845 H=2845:00 +CPU= 21.530
  03:18:05 STEP 2846 H=2846:00 +CPU= 22.375
  03:18:41 STEP 2847 H=2847:00 +CPU= 33.778
  03:19:05 STEP 2848 H=2848:00 +CPU= 22.474
  03:19:28 STEP 2849 H=2849:00 +CPU= 21.503
  03:20:04 STEP 2850 H=2850:00 +CPU= 35.008
  03:20:28 STEP 2851 H=2851:00 +CPU= 21.533
  03:20:51 STEP 2852 H=2852:00 +CPU= 22.666
  03:21:25 STEP 2853 H=2853:00 +CPU= 34.302
  03:21:48 STEP 2854 H=2854:00 +CPU= 22.341
  03:22:10 STEP 2855 H=2855:00 +CPU= 22.183
  03:22:57 STEP 2856 H=2856:00 +CPU= 39.970
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:23:21 STEP 2857 H=2857:00 +CPU= 21.690
  03:23:43 STEP 2858 H=2858:00 +CPU= 22.614
  03:24:19 STEP 2859 H=2859:00 +CPU= 34.253
  03:24:45 STEP 2860 H=2860:00 +CPU= 22.591
  03:25:08 STEP 2861 H=2861:00 +CPU= 21.525
  03:25:45 STEP 2862 H=2862:00 +CPU= 35.103
  03:26:07 STEP 2863 H=2863:00 +CPU= 21.979
  03:26:30 STEP 2864 H=2864:00 +CPU= 22.260
  03:27:07 STEP 2865 H=2865:00 +CPU= 34.421
  03:27:32 STEP 2866 H=2866:00 +CPU= 22.694
  03:27:57 STEP 2867 H=2867:00 +CPU= 21.797
  03:28:37 STEP 2868 H=2868:00 +CPU= 38.023
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002868
  03:29:00 STEP 2869 H=2869:00 +CPU= 21.791
  03:29:22 STEP 2870 H=2870:00 +CPU= 22.316
  03:29:59 STEP 2871 H=2871:00 +CPU= 34.047
  03:30:22 STEP 2872 H=2872:00 +CPU= 22.735
  03:30:44 STEP 2873 H=2873:00 +CPU= 21.964
  03:31:20 STEP 2874 H=2874:00 +CPU= 35.201
  03:31:43 STEP 2875 H=2875:00 +CPU= 21.974
  03:32:06 STEP 2876 H=2876:00 +CPU= 22.453
  03:32:41 STEP 2877 H=2877:00 +CPU= 34.573
  03:33:03 STEP 2878 H=2878:00 +CPU= 22.332
  03:33:25 STEP 2879 H=2879:00 +CPU= 22.310
  03:34:11 STEP 2880 H=2880:00 +CPU= 40.230
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:34:33 STEP 2881 H=2881:00 +CPU= 21.539
Uploading trickle at timestep: 10368000
  03:34:56 STEP 2882 H=2882:00 +CPU= 22.481
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1985050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0615
(argv4) batchid: 954
(argv5) wuid: 12171259
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_68a06ee5d5bfc143f82dc09a2ca32dcd to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0615_1985050100_123_954_12171259.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0615_1985050100_123_954_12171259.zip
ic_ancil_file: ic_ancil_12171259
ifsdata_file: ifsdata_12171259
climate_data_file: clim_data_12171259
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d2c7d47e25195c92b552ba79b08724fc to: /var/lib/boinc-client/slots/9/ic_ancil_12171259.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12171259.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c8ab96a5c774ca34db2bb804b2e87a78 to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12171259.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12171259.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12171259.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12171259.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12171259.xml
Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12171259.xml
-- Model is restarting --
Adjusting last_iter, 2883, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12171259.xml
last_cpu_time: 76619
upload_file_number: 120
last_iter: 2879
last_upload: 10368000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487
The child process has been launched with process id: 2483402
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-HP-Z230:1:1:2483402:2483402] [20230121:033619:1674300979:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  03:42:14 STEP 2880 H=2880:00 +CPU= 29.805
  03:42:33 STEP 2881 H=2881:00 +CPU= 15.044
  03:42:48 STEP 2882 H=2882:00 +CPU= 15.306
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           29  MAX ETADOT VERTICAL VEL.=   2.807764418202049E-007
  LON  =    51.2500000000000       degrees
  LAT  =   -37.5698795904715       degrees
  03:43:17 STEP 2883 H=2883:00 +CPU= 26.456
  03:43:36 STEP 2884 H=2884:00 +CPU= 18.635
  03:43:55 STEP 2885 H=2885:00 +CPU= 18.557
  03:44:25 STEP 2886 H=2886:00 +CPU= 30.470
  03:44:47 STEP 2887 H=2887:00 +CPU= 21.034
  03:45:12 STEP 2888 H=2888:00 +CPU= 22.365
  03:45:46 STEP 2889 H=2889:00 +CPU= 34.005
  03:46:08 STEP 2890 H=2890:00 +CPU= 22.725
  03:46:30 STEP 2891 H=2891:00 +CPU= 21.965
  03:47:10 STEP 2892 H=2892:00 +CPU= 37.650
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002892
  03:47:33 STEP 2893 H=2893:00 +CPU= 21.471
  03:47:58 STEP 2894 H=2894:00 +CPU= 22.263
  03:48:33 STEP 2895 H=2895:00 +CPU= 33.851
  03:48:56 STEP 2896 H=2896:00 +CPU= 22.583
  03:49:17 STEP 2897 H=2897:00 +CPU= 21.685
  03:49:52 STEP 2898 H=2898:00 +CPU= 34.716
  03:50:14 STEP 2899 H=2899:00 +CPU= 21.963
  03:50:37 STEP 2900 H=2900:00 +CPU= 22.474
  03:51:10 STEP 2901 H=2901:00 +CPU= 33.745
  03:51:34 STEP 2902 H=2902:00 +CPU= 22.594
  03:51:57 STEP 2903 H=2903:00 +CPU= 22.634
  03:52:44 STEP 2904 H=2904:00 +CPU= 40.100
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:53:06 STEP 2905 H=2905:00 +CPU= 21.686
  03:53:30 STEP 2906 H=2906:00 +CPU= 22.517
  03:54:06 STEP 2907 H=2907:00 +CPU= 33.874
  03:54:30 STEP 2908 H=2908:00 +CPU= 22.432
  03:54:53 STEP 2909 H=2909:00 +CPU= 21.741
  03:55:29 STEP 2910 H=2910:00 +CPU= 34.573
  03:55:54 STEP 2911 H=2911:00 +CPU= 21.905
  03:56:18 STEP 2912 H=2912:00 +CPU= 22.528
  03:56:53 STEP 2913 H=2913:00 +CPU= 34.525
  03:57:17 STEP 2914 H=2914:00 +CPU= 22.652
  03:57:40 STEP 2915 H=2915:00 +CPU= 21.772
  03:58:18 STEP 2916 H=2916:00 +CPU= 37.493
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002916
  03:58:40 STEP 2917 H=2917:00 +CPU= 21.803
  03:59:03 STEP 2918 H=2918:00 +CPU= 22.327
  03:59:37 STEP 2919 H=2919:00 +CPU= 33.693
  04:00:00 STEP 2920 H=2920:00 +CPU= 22.297
  04:00:22 STEP 2921 H=2921:00 +CPU= 21.785
  04:00:59 STEP 2922 H=2922:00 +CPU= 34.794
  04:01:21 STEP 2923 H=2923:00 +CPU= 22.021
  04:01:44 STEP 2924 H=2924:00 +CPU= 22.725
  04:02:21 STEP 2925 H=2925:00 +CPU= 33.936
  04:02:45 STEP 2926 H=2926:00 +CPU= 22.218
  04:03:11 STEP 2927 H=2927:00 +CPU= 22.652
  04:03:58 STEP 2928 H=2928:00 +CPU= 39.783
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_121.zip
Uploading the intermediate file: upload_file_121.zip
  04:04:20 STEP 2929 H=2929:00 +CPU= 21.517
  04:04:44 STEP 2930 H=2930:00 +CPU= 22.433
  04:05:22 STEP 2931 H=2931:00 +CPU= 34.132
  04:05:46 STEP 2932 H=2932:00 +CPU= 22.449
  04:06:09 STEP 2933 H=2933:00 +CPU= 21.646
  04:06:45 STEP 2934 H=2934:00 +CPU= 34.736
  04:07:07 STEP 2935 H=2935:00 +CPU= 21.988
  04:07:31 STEP 2936 H=2936:00 +CPU= 22.634
  04:08:06 STEP 2937 H=2937:00 +CPU= 33.914
  04:08:28 STEP 2938 H=2938:00 +CPU= 22.212
  04:08:51 STEP 2939 H=2939:00 +CPU= 21.607
  04:09:29 STEP 2940 H=2940:00 +CPU= 37.899
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002940
  04:09:51 STEP 2941 H=2941:00 +CPU= 21.689
  04:10:14 STEP 2942 H=2942:00 +CPU= 22.247
  04:10:49 STEP 2943 H=2943:00 +CPU= 34.097
  04:11:12 STEP 2944 H=2944:00 +CPU= 22.375
  04:11:35 STEP 2945 H=2945:00 +CPU= 21.616
  04:12:12 STEP 2946 H=2946:00 +CPU= 34.767
  04:12:34 STEP 2947 H=2947:00 +CPU= 21.841
  04:12:57 STEP 2948 H=2948:00 +CPU= 22.352
  04:13:32 STEP 2949 H=2949:00 +CPU= 33.995
  04:13:55 STEP 2950 H=2950:00 +CPU= 22.616
  04:14:18 STEP 2951 H=2951:00 +CPU= 22.426
  04:15:03 STEP 2952 H=2952:00 +CPU= 38.631
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171259/ICMGGhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0615_1985050100_123_954_12171259_1_r1630243487_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
04:18:27 (2483399): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:33:11 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 10,623,600 78,529 0.0074
09 May 2023 16:33:05 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 10,368,000 76,568 0.0074
09 May 2023 16:32:53 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 9,504,000 70,221 0.0074
09 May 2023 16:32:42 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 8,640,000 63,827 0.0074
09 May 2023 16:32:32 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 7,776,000 57,423 0.0074
09 May 2023 16:32:21 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 6,912,000 51,051 0.0074
09 May 2023 16:32:11 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 6,048,000 44,681 0.0074
09 May 2023 16:31:59 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 5,184,000 38,321 0.0074
09 May 2023 16:31:48 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 4,320,000 31,977 0.0074
09 May 2023 16:31:37 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 3,456,000 25,597 0.0074
09 May 2023 16:31:26 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 2,592,000 19,163 0.0074
09 May 2023 16:31:13 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 1,728,000 12,778 0.0074
09 May 2023 16:31:03 1506322 22300453 oifs_43r3_ps_0615_1985050100_123_954_12171259_1 864,000 6,402 0.0074


©2024 cpdn.org