climateprediction.net home page
Task 22293492

Task 22293492

Name oifs_43r3_ps_0152_1995050100_123_964_12180796_1
Workunit 12180796
Created 25 Dec 2022, 19:32:28 UTC
Sent 25 Dec 2022, 19:38:06 UTC
Report deadline 24 Jan 2023, 19:38:06 UTC
Received 14 Jan 2023, 13:45:23 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1529705
Run time 12 hours 25 min 40 sec
CPU time 11 hours 53 min 25 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 9.20 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.21 MB
Peak swap size 4,978.07 MB
Peak disk usage 5,373.29 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_101.zip
Uploading the intermediate file: upload_file_101.zip
  17:23:57 STEP 2449 H=2449:00 +CPU= 10.584
  17:24:08 STEP 2450 H=2450:00 +CPU= 10.783
  17:24:26 STEP 2451 H=2451:00 +CPU= 16.673
  17:24:37 STEP 2452 H=2452:00 +CPU= 10.793
  17:24:48 STEP 2453 H=2453:00 +CPU= 10.529
  17:25:06 STEP 2454 H=2454:00 +CPU= 17.023
  17:25:17 STEP 2455 H=2455:00 +CPU= 10.545
  17:25:29 STEP 2456 H=2456:00 +CPU= 10.853
  17:25:46 STEP 2457 H=2457:00 +CPU= 16.768
  17:25:58 STEP 2458 H=2458:00 +CPU= 10.857
  17:26:09 STEP 2459 H=2459:00 +CPU= 10.631
  17:26:28 STEP 2460 H=2460:00 +CPU= 18.609
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002460
  17:26:40 STEP 2461 H=2461:00 +CPU= 10.551
  17:26:51 STEP 2462 H=2462:00 +CPU= 10.877
  17:27:09 STEP 2463 H=2463:00 +CPU= 16.649
  17:27:20 STEP 2464 H=2464:00 +CPU= 10.928
  17:27:32 STEP 2465 H=2465:00 +CPU= 10.752
  17:27:50 STEP 2466 H=2466:00 +CPU= 17.178
  17:28:01 STEP 2467 H=2467:00 +CPU= 10.547
  17:28:12 STEP 2468 H=2468:00 +CPU= 10.925
  17:28:30 STEP 2469 H=2469:00 +CPU= 16.749
  17:28:42 STEP 2470 H=2470:00 +CPU= 10.833
  17:28:53 STEP 2471 H=2471:00 +CPU= 11.055
  17:29:14 STEP 2472 H=2472:00 +CPU= 19.471
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:29:24 STEP 2473 H=2473:00 +CPU= 10.341
  17:29:36 STEP 2474 H=2474:00 +CPU= 10.907
  17:29:54 STEP 2475 H=2475:00 +CPU= 16.730
  17:30:05 STEP 2476 H=2476:00 +CPU= 10.922
  17:30:16 STEP 2477 H=2477:00 +CPU= 10.511
  17:30:35 STEP 2478 H=2478:00 +CPU= 17.180
  17:30:46 STEP 2479 H=2479:00 +CPU= 10.543
  17:30:57 STEP 2480 H=2480:00 +CPU= 11.021
  17:31:15 STEP 2481 H=2481:00 +CPU= 16.895
  17:31:27 STEP 2482 H=2482:00 +CPU= 10.869
  17:31:38 STEP 2483 H=2483:00 +CPU= 10.606
  17:31:58 STEP 2484 H=2484:00 +CPU= 18.640
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002484
  17:32:09 STEP 2485 H=2485:00 +CPU= 10.719
  17:32:21 STEP 2486 H=2486:00 +CPU= 10.931
  17:32:38 STEP 2487 H=2487:00 +CPU= 16.665
  17:32:49 STEP 2488 H=2488:00 +CPU= 10.814
  17:33:01 STEP 2489 H=2489:00 +CPU= 10.577
  17:33:19 STEP 2490 H=2490:00 +CPU= 17.047
  17:33:29 STEP 2491 H=2491:00 +CPU= 10.414
  17:33:41 STEP 2492 H=2492:00 +CPU= 10.824
  17:33:59 STEP 2493 H=2493:00 +CPU= 16.821
  17:34:10 STEP 2494 H=2494:00 +CPU= 10.817
  17:34:22 STEP 2495 H=2495:00 +CPU= 10.935
  17:34:43 STEP 2496 H=2496:00 +CPU= 20.029
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:34:54 STEP 2497 H=2497:00 +CPU= 10.742
  17:35:06 STEP 2498 H=2498:00 +CPU= 10.916
  17:35:24 STEP 2499 H=2499:00 +CPU= 16.757
  17:35:35 STEP 2500 H=2500:00 +CPU= 10.735
  17:35:46 STEP 2501 H=2501:00 +CPU= 10.695
  17:36:05 STEP 2502 H=2502:00 +CPU= 17.296
  17:36:16 STEP 2503 H=2503:00 +CPU= 10.557
  17:36:27 STEP 2504 H=2504:00 +CPU= 10.867
  17:36:45 STEP 2505 H=2505:00 +CPU= 16.740
  17:36:56 STEP 2506 H=2506:00 +CPU= 10.715
  17:37:07 STEP 2507 H=2507:00 +CPU= 10.501
  17:37:27 STEP 2508 H=2508:00 +CPU= 18.635
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002508
  17:37:38 STEP 2509 H=2509:00 +CPU= 10.630
  17:37:50 STEP 2510 H=2510:00 +CPU= 10.916
  17:38:07 STEP 2511 H=2511:00 +CPU= 16.813
  17:38:19 STEP 2512 H=2512:00 +CPU= 10.852
  17:38:30 STEP 2513 H=2513:00 +CPU= 10.547
  17:38:48 STEP 2514 H=2514:00 +CPU= 17.141
  17:38:59 STEP 2515 H=2515:00 +CPU= 10.512
  17:39:11 STEP 2516 H=2516:00 +CPU= 10.820
  17:39:29 STEP 2517 H=2517:00 +CPU= 16.939
  17:39:40 STEP 2518 H=2518:00 +CPU= 10.921
  17:39:52 STEP 2519 H=2519:00 +CPU= 10.976
  17:40:14 STEP 2520 H=2520:00 +CPU= 20.262
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:40:25 STEP 2521 H=2521:00 +CPU= 10.674
  17:40:37 STEP 2522 H=2522:00 +CPU= 10.955
  17:40:55 STEP 2523 H=2523:00 +CPU= 17.043
  17:41:06 STEP 2524 H=2524:00 +CPU= 10.932
  17:41:18 STEP 2525 H=2525:00 +CPU= 10.697
  17:41:36 STEP 2526 H=2526:00 +CPU= 17.191
  17:41:47 STEP 2527 H=2527:00 +CPU= 10.689
  17:41:59 STEP 2528 H=2528:00 +CPU= 11.070
  17:42:17 STEP 2529 H=2529:00 +CPU= 17.044
  17:42:29 STEP 2530 H=2530:00 +CPU= 10.909
  17:42:40 STEP 2531 H=2531:00 +CPU= 10.758
  17:43:00 STEP 2532 H=2532:00 +CPU= 18.915
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002532
  17:43:11 STEP 2533 H=2533:00 +CPU= 10.740
  17:43:23 STEP 2534 H=2534:00 +CPU= 11.004
  17:43:41 STEP 2535 H=2535:00 +CPU= 16.754
  17:43:52 STEP 2536 H=2536:00 +CPU= 10.994
  17:44:04 STEP 2537 H=2537:00 +CPU= 10.746
  17:44:22 STEP 2538 H=2538:00 +CPU= 17.088
  17:44:33 STEP 2539 H=2539:00 +CPU= 10.726
  17:44:45 STEP 2540 H=2540:00 +CPU= 10.985
  17:45:03 STEP 2541 H=2541:00 +CPU= 16.970
  17:45:15 STEP 2542 H=2542:00 +CPU= 10.930
  17:45:26 STEP 2543 H=2543:00 +CPU= 11.011
  17:45:48 STEP 2544 H=2544:00 +CPU= 20.347
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:45:59 STEP 2545 H=2545:00 +CPU= 10.792
  17:46:11 STEP 2546 H=2546:00 +CPU= 11.014
Uploading trickle at timestep: 9158400
  17:46:29 STEP 2547 H=2547:00 +CPU= 17.037
  17:46:41 STEP 2548 H=2548:00 +CPU= 11.315
  17:46:54 STEP 2549 H=2549:00 +CPU= 12.079
  17:47:13 STEP 2550 H=2550:00 +CPU= 17.478
  17:47:24 STEP 2551 H=2551:00 +CPU= 10.686
  17:47:36 STEP 2552 H=2552:00 +CPU= 10.955
  17:47:54 STEP 2553 H=2553:00 +CPU= 16.997
  17:48:06 STEP 2554 H=2554:00 +CPU= 11.390
  17:48:19 STEP 2555 H=2555:00 +CPU= 12.283
  17:48:40 STEP 2556 H=2556:00 +CPU= 20.128
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002556
  17:48:52 STEP 2557 H=2557:00 +CPU= 10.742
  17:49:04 STEP 2558 H=2558:00 +CPU= 11.069
  17:49:21 STEP 2559 H=2559:00 +CPU= 16.665
  17:49:33 STEP 2560 H=2560:00 +CPU= 10.869
  17:49:44 STEP 2561 H=2561:00 +CPU= 10.703
  17:50:02 STEP 2562 H=2562:00 +CPU= 17.116
  17:50:13 STEP 2563 H=2563:00 +CPU= 10.610
  17:50:25 STEP 2564 H=2564:00 +CPU= 10.923
  17:50:43 STEP 2565 H=2565:00 +CPU= 16.677
  17:50:53 STEP 2566 H=2566:00 +CPU= 10.439
  17:51:04 STEP 2567 H=2567:00 +CPU= 10.612
  17:51:24 STEP 2568 H=2568:00 +CPU= 19.512
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:51:35 STEP 2569 H=2569:00 +CPU= 10.301
  17:51:46 STEP 2570 H=2570:00 +CPU= 10.461
  17:52:03 STEP 2571 H=2571:00 +CPU= 16.252
  17:52:13 STEP 2572 H=2572:00 +CPU= 10.533
  17:52:24 STEP 2573 H=2573:00 +CPU= 10.249
  17:52:41 STEP 2574 H=2574:00 +CPU= 16.548
  17:52:51 STEP 2575 H=2575:00 +CPU= 10.147
  17:53:02 STEP 2576 H=2576:00 +CPU= 10.583
  17:53:19 STEP 2577 H=2577:00 +CPU= 16.215
  17:53:30 STEP 2578 H=2578:00 +CPU= 10.532
  17:53:40 STEP 2579 H=2579:00 +CPU= 10.236
  17:53:59 STEP 2580 H=2580:00 +CPU= 18.031
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002580
  17:54:10 STEP 2581 H=2581:00 +CPU= 10.267
  17:54:20 STEP 2582 H=2582:00 +CPU= 10.674
  17:54:37 STEP 2583 H=2583:00 +CPU= 16.234
  17:54:48 STEP 2584 H=2584:00 +CPU= 10.495
  17:54:58 STEP 2585 H=2585:00 +CPU= 10.226
  17:55:15 STEP 2586 H=2586:00 +CPU= 16.377
  17:55:26 STEP 2587 H=2587:00 +CPU= 10.185
  17:55:36 STEP 2588 H=2588:00 +CPU= 10.410
  17:55:53 STEP 2589 H=2589:00 +CPU= 16.065
  17:56:04 STEP 2590 H=2590:00 +CPU= 10.370
  17:56:14 STEP 2591 H=2591:00 +CPU= 10.486
  17:56:34 STEP 2592 H=2592:00 +CPU= 19.278
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:56:45 STEP 2593 H=2593:00 +CPU= 10.166
  17:56:56 STEP 2594 H=2594:00 +CPU= 10.498
  17:57:12 STEP 2595 H=2595:00 +CPU= 16.271
  17:57:23 STEP 2596 H=2596:00 +CPU= 10.587
  17:57:34 STEP 2597 H=2597:00 +CPU= 10.265
  17:57:51 STEP 2598 H=2598:00 +CPU= 16.391
  17:58:01 STEP 2599 H=2599:00 +CPU= 10.272
  17:58:12 STEP 2600 H=2600:00 +CPU= 10.428
  17:58:30 STEP 2601 H=2601:00 +CPU= 16.743
  17:58:41 STEP 2602 H=2602:00 +CPU= 10.996
  17:58:53 STEP 2603 H=2603:00 +CPU= 10.710
  17:59:15 STEP 2604 H=2604:00 +CPU= 20.834
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002604
  17:59:30 STEP 2605 H=2605:00 +CPU= 13.378
  17:59:42 STEP 2606 H=2606:00 +CPU= 11.815
  18:00:02 STEP 2607 H=2607:00 +CPU= 18.695
  18:00:14 STEP 2608 H=2608:00 +CPU= 11.530
  18:00:28 STEP 2609 H=2609:00 +CPU= 12.659
  18:00:49 STEP 2610 H=2610:00 +CPU= 19.356
  18:01:02 STEP 2611 H=2611:00 +CPU= 12.496
  18:01:17 STEP 2612 H=2612:00 +CPU= 13.289
  18:01:35 STEP 2613 H=2613:00 +CPU= 17.525
  18:01:47 STEP 2614 H=2614:00 +CPU= 11.579
  18:02:00 STEP 2615 H=2615:00 +CPU= 12.031
  18:02:22 STEP 2616 H=2616:00 +CPU= 20.231
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:02:32 STEP 2617 H=2617:00 +CPU= 10.472
  18:02:44 STEP 2618 H=2618:00 +CPU= 10.683
  18:03:01 STEP 2619 H=2619:00 +CPU= 16.908
  18:03:12 STEP 2620 H=2620:00 +CPU= 10.826
  18:03:23 STEP 2621 H=2621:00 +CPU= 10.686
  18:03:41 STEP 2622 H=2622:00 +CPU= 17.069
  18:03:52 STEP 2623 H=2623:00 +CPU= 10.483
  18:04:03 STEP 2624 H=2624:00 +CPU= 10.476
  18:04:19 STEP 2625 H=2625:00 +CPU= 16.257
  18:04:30 STEP 2626 H=2626:00 +CPU= 10.555
  18:04:41 STEP 2627 H=2627:00 +CPU= 10.743
  18:05:01 STEP 2628 H=2628:00 +CPU= 18.711
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002628
  18:05:11 STEP 2629 H=2629:00 +CPU= 10.268
  18:05:22 STEP 2630 H=2630:00 +CPU= 10.444
  18:05:39 STEP 2631 H=2631:00 +CPU= 16.451
  18:05:50 STEP 2632 H=2632:00 +CPU= 10.587
  18:06:01 STEP 2633 H=2633:00 +CPU= 10.377
  18:06:17 STEP 2634 H=2634:00 +CPU= 16.504
  18:06:28 STEP 2635 H=2635:00 +CPU= 10.288
  18:06:39 STEP 2636 H=2636:00 +CPU= 10.705
  18:06:56 STEP 2637 H=2637:00 +CPU= 16.237
  18:07:07 STEP 2638 H=2638:00 +CPU= 10.561
  18:07:17 STEP 2639 H=2639:00 +CPU= 10.541
  18:07:38 STEP 2640 H=2640:00 +CPU= 19.368
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:07:48 STEP 2641 H=2641:00 +CPU= 10.185
  18:07:59 STEP 2642 H=2642:00 +CPU= 10.515
  18:08:16 STEP 2643 H=2643:00 +CPU= 16.328
  18:08:27 STEP 2644 H=2644:00 +CPU= 10.530
  18:08:37 STEP 2645 H=2645:00 +CPU= 10.336
  18:08:54 STEP 2646 H=2646:00 +CPU= 16.451
  18:09:05 STEP 2647 H=2647:00 +CPU= 10.190
  18:09:15 STEP 2648 H=2648:00 +CPU= 10.573
  18:09:32 STEP 2649 H=2649:00 +CPU= 16.173
  18:09:43 STEP 2650 H=2650:00 +CPU= 10.431
  18:09:53 STEP 2651 H=2651:00 +CPU= 10.196
  18:10:12 STEP 2652 H=2652:00 +CPU= 17.886
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002652
  18:10:22 STEP 2653 H=2653:00 +CPU= 10.199
  18:10:33 STEP 2654 H=2654:00 +CPU= 10.417
  18:10:49 STEP 2655 H=2655:00 +CPU= 16.093
  18:11:00 STEP 2656 H=2656:00 +CPU= 10.341
  18:11:11 STEP 2657 H=2657:00 +CPU= 10.284
  18:11:27 STEP 2658 H=2658:00 +CPU= 16.499
  18:11:38 STEP 2659 H=2659:00 +CPU= 10.210
  18:11:49 STEP 2660 H=2660:00 +CPU= 10.530
  18:12:05 STEP 2661 H=2661:00 +CPU= 16.275
  18:12:16 STEP 2662 H=2662:00 +CPU= 10.327
  18:12:27 STEP 2663 H=2663:00 +CPU= 10.379
  18:12:47 STEP 2664 H=2664:00 +CPU= 19.355
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:12:57 STEP 2665 H=2665:00 +CPU= 10.199
  18:13:08 STEP 2666 H=2666:00 +CPU= 10.466
  18:13:25 STEP 2667 H=2667:00 +CPU= 16.147
  18:13:35 STEP 2668 H=2668:00 +CPU= 10.461
  18:13:46 STEP 2669 H=2669:00 +CPU= 10.186
  18:14:03 STEP 2670 H=2670:00 +CPU= 16.983
  18:14:14 STEP 2671 H=2671:00 +CPU= 10.681
  18:14:26 STEP 2672 H=2672:00 +CPU= 11.055
  18:14:43 STEP 2673 H=2673:00 +CPU= 16.954
  18:14:55 STEP 2674 H=2674:00 +CPU= 11.019
  18:15:06 STEP 2675 H=2675:00 +CPU= 10.837
  18:15:25 STEP 2676 H=2676:00 +CPU= 18.584
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002676
  18:15:36 STEP 2677 H=2677:00 +CPU= 10.706
  18:15:47 STEP 2678 H=2678:00 +CPU= 11.141
  18:16:05 STEP 2679 H=2679:00 +CPU= 16.886
  18:16:16 STEP 2680 H=2680:00 +CPU= 10.748
  18:16:27 STEP 2681 H=2681:00 +CPU= 10.858
  18:16:45 STEP 2682 H=2682:00 +CPU= 17.294
  18:16:56 STEP 2683 H=2683:00 +CPU= 10.664
  18:17:07 STEP 2684 H=2684:00 +CPU= 11.079
  18:17:25 STEP 2685 H=2685:00 +CPU= 16.977
  18:17:36 STEP 2686 H=2686:00 +CPU= 10.815
  18:17:47 STEP 2687 H=2687:00 +CPU= 11.154
  18:18:08 STEP 2688 H=2688:00 +CPU= 20.137
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:18:19 STEP 2689 H=2689:00 +CPU= 10.748
  18:18:31 STEP 2690 H=2690:00 +CPU= 11.002
  18:18:48 STEP 2691 H=2691:00 +CPU= 17.108
  18:19:00 STEP 2692 H=2692:00 +CPU= 10.935
  18:19:11 STEP 2693 H=2693:00 +CPU= 10.926
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.693] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2550MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        WVCOUPLE 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         WAVEMDL 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          WAMODEL 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           >OMP-WAMODEL 2            (1431) 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            IMPLSCH 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181929:1672161569:27248.699] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             SNONLIN 
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181930:1672161570:27249.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:Lynx.local:1:1:2545:2545] [20221227:181930:1672161570:27249.699] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001A67062  snonlin_                  201  snonlin.F
oifs_43r3_model.e  0000000001A31273  implsch_                  285  implsch.F
oifs_43r3_model.e  000000000168CBD7  wamodel_                 1008  wamodel.F
oifs_43r3_model.e  0000000000872295  wavemdl_                  584  wavemdl.F
oifs_43r3_model.e  00000000007E0165  wvcouple_                 260  wvcouple.F90
oifs_43r3_model.e  000000000055E4AD  cnt4_                    1283  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0152
(argv4) batchid: 964
(argv5) wuid: 12180796
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/4
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_50f696a424059a7440d0062d7c0aa043 to: /var/lib/boinc/slots/4/oifs_43r3_ps_0152_1995050100_123_964_12180796.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/4/oifs_43r3_ps_0152_1995050100_123_964_12180796.zip
ic_ancil_file: ic_ancil_12180796
ifsdata_file: ifsdata_12180796
climate_data_file: clim_data_12180796
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cd6523865c1d1fbe43f8e5320b50eec3 to: /var/lib/boinc/slots/4/ic_ancil_12180796.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/4/ic_ancil_12180796.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c7ab967bdd94aa3f3293e5c896eeaf05 to: /var/lib/boinc/slots/4/ifsdata/ifsdata_12180796.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/4/ifsdata/ifsdata_12180796.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/4/159l_2/clim_data_12180796.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/4/159l_2/clim_data_12180796.zip
Checking for progress XML file: /var/lib/boinc/slots/4/progress_file_12180796.xml
Opened progress file ok : /var/lib/boinc/slots/4/progress_file_12180796.xml
-- Model is restarting --
Adjusting last_iter, 2694, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/4/progress_file_12180796.xml
last_cpu_time: 39329
upload_file_number: 112
last_iter: 2687
last_upload: 9676800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548
The child process has been launched with process id: 3183
Executing the command: /var/lib/boinc/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lynx.local:1:1:3183:3183] [20221227:195526:1672167326:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  19:55:49 STEP 2688 H=2688:00 +CPU= 18.867
  19:55:59 STEP 2689 H=2689:00 +CPU=  9.994
  19:56:10 STEP 2690 H=2690:00 +CPU= 10.146
  19:56:25 STEP 2691 H=2691:00 +CPU= 15.269
  19:56:35 STEP 2692 H=2692:00 +CPU=  9.987
  19:56:45 STEP 2693 H=2693:00 +CPU=  9.850
  19:57:01 STEP 2694 H=2694:00 +CPU= 16.354
  19:57:12 STEP 2695 H=2695:00 +CPU= 10.035
  19:57:22 STEP 2696 H=2696:00 +CPU= 10.547
  19:57:39 STEP 2697 H=2697:00 +CPU= 16.093
  19:57:50 STEP 2698 H=2698:00 +CPU= 10.641
  19:58:00 STEP 2699 H=2699:00 +CPU= 10.128
  19:58:18 STEP 2700 H=2700:00 +CPU= 17.796
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002700
  19:58:28 STEP 2701 H=2701:00 +CPU= 10.107
  19:58:42 STEP 2702 H=2702:00 +CPU= 12.901
  19:59:01 STEP 2703 H=2703:00 +CPU= 18.019
  19:59:12 STEP 2704 H=2704:00 +CPU= 11.022
  19:59:23 STEP 2705 H=2705:00 +CPU= 10.508
  19:59:40 STEP 2706 H=2706:00 +CPU= 16.585
  19:59:51 STEP 2707 H=2707:00 +CPU= 10.498
  20:00:02 STEP 2708 H=2708:00 +CPU= 10.899
  20:00:18 STEP 2709 H=2709:00 +CPU= 16.236
  20:00:29 STEP 2710 H=2710:00 +CPU= 10.582
  20:00:40 STEP 2711 H=2711:00 +CPU= 10.780
  20:01:01 STEP 2712 H=2712:00 +CPU= 19.574
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_112.zip
Uploading the intermediate file: upload_file_112.zip
  20:01:11 STEP 2713 H=2713:00 +CPU= 10.473
  20:01:22 STEP 2714 H=2714:00 +CPU= 10.772
  20:01:39 STEP 2715 H=2715:00 +CPU= 16.441
  20:01:50 STEP 2716 H=2716:00 +CPU= 10.681
  20:02:01 STEP 2717 H=2717:00 +CPU= 10.501
  20:02:18 STEP 2718 H=2718:00 +CPU= 16.800
  20:02:29 STEP 2719 H=2719:00 +CPU= 10.491
  20:02:40 STEP 2720 H=2720:00 +CPU= 10.761
  20:02:57 STEP 2721 H=2721:00 +CPU= 16.466
  20:03:08 STEP 2722 H=2722:00 +CPU= 10.678
  20:03:19 STEP 2723 H=2723:00 +CPU= 10.470
  20:03:37 STEP 2724 H=2724:00 +CPU= 18.356
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002724
  20:03:48 STEP 2725 H=2725:00 +CPU= 10.584
  20:03:59 STEP 2726 H=2726:00 +CPU= 10.844
  20:04:16 STEP 2727 H=2727:00 +CPU= 16.218
  20:04:27 STEP 2728 H=2728:00 +CPU= 10.805
  20:04:38 STEP 2729 H=2729:00 +CPU= 10.520
  20:04:55 STEP 2730 H=2730:00 +CPU= 16.520
  20:05:05 STEP 2731 H=2731:00 +CPU= 10.455
  20:05:16 STEP 2732 H=2732:00 +CPU= 10.738
  20:05:33 STEP 2733 H=2733:00 +CPU= 16.228
  20:05:44 STEP 2734 H=2734:00 +CPU= 10.811
  20:05:55 STEP 2735 H=2735:00 +CPU= 10.848
  20:06:16 STEP 2736 H=2736:00 +CPU= 19.782
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_113.zip
Uploading the intermediate file: upload_file_113.zip
  20:06:27 STEP 2737 H=2737:00 +CPU= 10.613
  20:06:38 STEP 2738 H=2738:00 +CPU= 10.751
  20:06:54 STEP 2739 H=2739:00 +CPU= 16.292
  20:07:05 STEP 2740 H=2740:00 +CPU= 10.708
  20:07:16 STEP 2741 H=2741:00 +CPU= 10.432
  20:07:33 STEP 2742 H=2742:00 +CPU= 16.717
  20:07:44 STEP 2743 H=2743:00 +CPU= 10.542
  20:07:55 STEP 2744 H=2744:00 +CPU= 10.811
  20:08:12 STEP 2745 H=2745:00 +CPU= 16.255
  20:08:23 STEP 2746 H=2746:00 +CPU= 10.818
  20:08:33 STEP 2747 H=2747:00 +CPU= 10.469
  20:08:52 STEP 2748 H=2748:00 +CPU= 18.184
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002748
  20:09:03 STEP 2749 H=2749:00 +CPU= 10.518
  20:09:14 STEP 2750 H=2750:00 +CPU= 10.812
  20:09:31 STEP 2751 H=2751:00 +CPU= 16.352
  20:09:42 STEP 2752 H=2752:00 +CPU= 10.880
  20:09:53 STEP 2753 H=2753:00 +CPU= 10.521
  20:10:10 STEP 2754 H=2754:00 +CPU= 16.575
  20:10:20 STEP 2755 H=2755:00 +CPU= 10.376
  20:10:31 STEP 2756 H=2756:00 +CPU= 10.830
  20:10:48 STEP 2757 H=2757:00 +CPU= 16.616
  20:10:59 STEP 2758 H=2758:00 +CPU= 10.751
  20:11:11 STEP 2759 H=2759:00 +CPU= 10.797
  20:11:31 STEP 2760 H=2760:00 +CPU= 19.709
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_114.zip
Uploading the intermediate file: upload_file_114.zip
  20:11:42 STEP 2761 H=2761:00 +CPU= 10.602
  20:11:53 STEP 2762 H=2762:00 +CPU= 10.844
  20:12:10 STEP 2763 H=2763:00 +CPU= 16.386
  20:12:21 STEP 2764 H=2764:00 +CPU= 10.717
  20:12:32 STEP 2765 H=2765:00 +CPU= 10.499
  20:12:49 STEP 2766 H=2766:00 +CPU= 16.898
  20:13:00 STEP 2767 H=2767:00 +CPU= 10.636
  20:13:11 STEP 2768 H=2768:00 +CPU= 10.908
  20:13:28 STEP 2769 H=2769:00 +CPU= 16.432
  20:13:39 STEP 2770 H=2770:00 +CPU= 10.830
  20:13:50 STEP 2771 H=2771:00 +CPU= 10.752
  20:14:09 STEP 2772 H=2772:00 +CPU= 18.349
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002772
  20:14:20 STEP 2773 H=2773:00 +CPU= 10.582
  20:14:31 STEP 2774 H=2774:00 +CPU= 10.849
  20:14:48 STEP 2775 H=2775:00 +CPU= 16.520
  20:14:59 STEP 2776 H=2776:00 +CPU= 10.736
  20:15:09 STEP 2777 H=2777:00 +CPU= 10.424
  20:15:26 STEP 2778 H=2778:00 +CPU= 16.749
  20:15:37 STEP 2779 H=2779:00 +CPU= 10.590
  20:15:48 STEP 2780 H=2780:00 +CPU= 10.844
  20:16:05 STEP 2781 H=2781:00 +CPU= 16.340
  20:16:16 STEP 2782 H=2782:00 +CPU= 10.778
  20:16:27 STEP 2783 H=2783:00 +CPU= 10.764
  20:16:48 STEP 2784 H=2784:00 +CPU= 20.004
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_115.zip
Uploading the intermediate file: upload_file_115.zip
  20:16:59 STEP 2785 H=2785:00 +CPU= 10.540
  20:17:10 STEP 2786 H=2786:00 +CPU= 10.887
  20:17:27 STEP 2787 H=2787:00 +CPU= 16.546
  20:17:38 STEP 2788 H=2788:00 +CPU= 10.980
  20:17:49 STEP 2789 H=2789:00 +CPU= 10.535
  20:18:06 STEP 2790 H=2790:00 +CPU= 16.799
  20:18:17 STEP 2791 H=2791:00 +CPU= 10.560
  20:18:28 STEP 2792 H=2792:00 +CPU= 10.769
  20:18:45 STEP 2793 H=2793:00 +CPU= 16.489
  20:18:56 STEP 2794 H=2794:00 +CPU= 10.917
  20:19:07 STEP 2795 H=2795:00 +CPU= 10.484
  20:19:26 STEP 2796 H=2796:00 +CPU= 18.476
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002796
  20:19:37 STEP 2797 H=2797:00 +CPU= 10.638
  20:19:48 STEP 2798 H=2798:00 +CPU= 10.789
  20:20:05 STEP 2799 H=2799:00 +CPU= 16.498
  20:20:16 STEP 2800 H=2800:00 +CPU= 10.718
  20:20:27 STEP 2801 H=2801:00 +CPU= 10.649
  20:20:44 STEP 2802 H=2802:00 +CPU= 16.849
  20:20:55 STEP 2803 H=2803:00 +CPU= 10.518
  20:21:06 STEP 2804 H=2804:00 +CPU= 10.784
  20:21:23 STEP 2805 H=2805:00 +CPU= 16.584
  20:21:34 STEP 2806 H=2806:00 +CPU= 10.680
  20:21:45 STEP 2807 H=2807:00 +CPU= 10.843
  20:22:06 STEP 2808 H=2808:00 +CPU= 19.984
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_116.zip
Uploading the intermediate file: upload_file_116.zip
  20:22:17 STEP 2809 H=2809:00 +CPU= 10.696
  20:22:28 STEP 2810 H=2810:00 +CPU= 11.015
  20:22:45 STEP 2811 H=2811:00 +CPU= 16.549
  20:22:56 STEP 2812 H=2812:00 +CPU= 10.780
  20:23:07 STEP 2813 H=2813:00 +CPU= 10.629
  20:23:25 STEP 2814 H=2814:00 +CPU= 16.879
  20:23:35 STEP 2815 H=2815:00 +CPU= 10.533
  20:23:46 STEP 2816 H=2816:00 +CPU= 10.828
  20:24:03 STEP 2817 H=2817:00 +CPU= 16.624
  20:24:15 STEP 2818 H=2818:00 +CPU= 10.736
  20:24:25 STEP 2819 H=2819:00 +CPU= 10.540
  20:24:44 STEP 2820 H=2820:00 +CPU= 18.336
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002820
  20:24:55 STEP 2821 H=2821:00 +CPU= 10.583
  20:25:06 STEP 2822 H=2822:00 +CPU= 10.722
  20:25:23 STEP 2823 H=2823:00 +CPU= 16.590
  20:25:34 STEP 2824 H=2824:00 +CPU= 10.835
  20:25:45 STEP 2825 H=2825:00 +CPU= 10.656
  20:26:02 STEP 2826 H=2826:00 +CPU= 17.001
  20:26:13 STEP 2827 H=2827:00 +CPU= 10.527
  20:26:24 STEP 2828 H=2828:00 +CPU= 10.854
  20:26:41 STEP 2829 H=2829:00 +CPU= 16.585
  20:26:53 STEP 2830 H=2830:00 +CPU= 10.930
  20:27:04 STEP 2831 H=2831:00 +CPU= 10.991
  20:27:25 STEP 2832 H=2832:00 +CPU= 20.245
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_117.zip
Uploading the intermediate file: upload_file_117.zip
  20:27:36 STEP 2833 H=2833:00 +CPU= 10.577
  20:27:47 STEP 2834 H=2834:00 +CPU= 10.789
  20:28:04 STEP 2835 H=2835:00 +CPU= 16.641
  20:28:15 STEP 2836 H=2836:00 +CPU= 10.929
  20:28:26 STEP 2837 H=2837:00 +CPU= 10.563
  20:28:43 STEP 2838 H=2838:00 +CPU= 16.909
  20:28:54 STEP 2839 H=2839:00 +CPU= 10.648
  20:29:05 STEP 2840 H=2840:00 +CPU= 10.899
  20:29:22 STEP 2841 H=2841:00 +CPU= 16.446
  20:29:33 STEP 2842 H=2842:00 +CPU= 10.823
  20:29:44 STEP 2843 H=2843:00 +CPU= 10.541
  20:30:03 STEP 2844 H=2844:00 +CPU= 18.266
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002844
  20:30:14 STEP 2845 H=2845:00 +CPU= 10.569
  20:30:25 STEP 2846 H=2846:00 +CPU= 10.757
  20:30:42 STEP 2847 H=2847:00 +CPU= 16.562
  20:30:53 STEP 2848 H=2848:00 +CPU= 10.919
  20:31:04 STEP 2849 H=2849:00 +CPU= 10.576
  20:31:21 STEP 2850 H=2850:00 +CPU= 17.053
  20:31:32 STEP 2851 H=2851:00 +CPU= 10.631
  20:31:44 STEP 2852 H=2852:00 +CPU= 10.827
  20:32:01 STEP 2853 H=2853:00 +CPU= 16.972
  20:32:12 STEP 2854 H=2854:00 +CPU= 10.959
  20:32:24 STEP 2855 H=2855:00 +CPU= 11.021
  20:32:45 STEP 2856 H=2856:00 +CPU= 20.285
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_118.zip
Uploading the intermediate file: upload_file_118.zip
  20:32:56 STEP 2857 H=2857:00 +CPU= 10.849
  20:33:08 STEP 2858 H=2858:00 +CPU= 11.308
  20:33:25 STEP 2859 H=2859:00 +CPU= 17.046
  20:33:37 STEP 2860 H=2860:00 +CPU= 11.227
  20:33:48 STEP 2861 H=2861:00 +CPU= 10.954
  20:34:06 STEP 2862 H=2862:00 +CPU= 17.357
  20:34:17 STEP 2863 H=2863:00 +CPU= 10.960
  20:34:29 STEP 2864 H=2864:00 +CPU= 11.174
  20:34:46 STEP 2865 H=2865:00 +CPU= 17.015
  20:34:58 STEP 2866 H=2866:00 +CPU= 11.145
  20:35:09 STEP 2867 H=2867:00 +CPU= 10.939
  20:35:29 STEP 2868 H=2868:00 +CPU= 19.026
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002868
  20:35:40 STEP 2869 H=2869:00 +CPU= 11.018
  20:35:52 STEP 2870 H=2870:00 +CPU= 11.019
  20:36:09 STEP 2871 H=2871:00 +CPU= 17.112
  20:36:21 STEP 2872 H=2872:00 +CPU= 11.109
  20:36:32 STEP 2873 H=2873:00 +CPU= 10.724
  20:36:49 STEP 2874 H=2874:00 +CPU= 17.120
  20:37:00 STEP 2875 H=2875:00 +CPU= 10.610
  20:37:12 STEP 2876 H=2876:00 +CPU= 10.920
  20:37:29 STEP 2877 H=2877:00 +CPU= 16.835
  20:37:40 STEP 2878 H=2878:00 +CPU= 10.891
  20:37:51 STEP 2879 H=2879:00 +CPU= 10.832
  20:38:12 STEP 2880 H=2880:00 +CPU= 20.389
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_119.zip
Uploading the intermediate file: upload_file_119.zip
  20:38:24 STEP 2881 H=2881:00 +CPU= 11.264
  20:38:36 STEP 2882 H=2882:00 +CPU= 11.434
  20:38:53 STEP 2883 H=2883:00 +CPU= 16.813
  20:39:05 STEP 2884 H=2884:00 +CPU= 11.429
  20:39:17 STEP 2885 H=2885:00 +CPU= 11.244
  20:39:35 STEP 2886 H=2886:00 +CPU= 17.316
  20:39:46 STEP 2887 H=2887:00 +CPU= 10.976
  20:39:58 STEP 2888 H=2888:00 +CPU= 11.073
  20:40:15 STEP 2889 H=2889:00 +CPU= 17.225
  20:40:28 STEP 2890 H=2890:00 +CPU= 11.821
  20:40:40 STEP 2891 H=2891:00 +CPU= 11.582
  20:41:00 STEP 2892 H=2892:00 +CPU= 19.196
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002892
  20:41:11 STEP 2893 H=2893:00 +CPU= 10.962
  20:41:23 STEP 2894 H=2894:00 +CPU= 11.303
  20:41:41 STEP 2895 H=2895:00 +CPU= 17.370
  20:41:52 STEP 2896 H=2896:00 +CPU= 11.262
  20:42:04 STEP 2897 H=2897:00 +CPU= 10.919
  20:42:22 STEP 2898 H=2898:00 +CPU= 17.466
  20:42:33 STEP 2899 H=2899:00 +CPU= 11.158
  20:42:45 STEP 2900 H=2900:00 +CPU= 11.446
  20:43:03 STEP 2901 H=2901:00 +CPU= 17.520
  20:43:15 STEP 2902 H=2902:00 +CPU= 11.679
  20:43:28 STEP 2903 H=2903:00 +CPU= 12.039
  20:43:50 STEP 2904 H=2904:00 +CPU= 21.190
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:44:02 STEP 2905 H=2905:00 +CPU= 11.297
  20:44:14 STEP 2906 H=2906:00 +CPU= 11.551
  20:44:32 STEP 2907 H=2907:00 +CPU= 17.699
  20:44:44 STEP 2908 H=2908:00 +CPU= 11.792
  20:44:56 STEP 2909 H=2909:00 +CPU= 11.415
  20:45:15 STEP 2910 H=2910:00 +CPU= 18.445
  20:45:27 STEP 2911 H=2911:00 +CPU= 11.325
  20:45:40 STEP 2912 H=2912:00 +CPU= 11.927
  20:45:58 STEP 2913 H=2913:00 +CPU= 17.924
  20:46:10 STEP 2914 H=2914:00 +CPU= 11.265
  20:46:22 STEP 2915 H=2915:00 +CPU= 11.373
  20:46:41 STEP 2916 H=2916:00 +CPU= 19.079
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002916
  20:46:53 STEP 2917 H=2917:00 +CPU= 11.186
  20:47:05 STEP 2918 H=2918:00 +CPU= 11.453
  20:47:23 STEP 2919 H=2919:00 +CPU= 17.504
  20:47:35 STEP 2920 H=2920:00 +CPU= 11.235
  20:47:46 STEP 2921 H=2921:00 +CPU= 11.344
  20:48:04 STEP 2922 H=2922:00 +CPU= 17.443
  20:48:16 STEP 2923 H=2923:00 +CPU= 10.952
  20:48:27 STEP 2924 H=2924:00 +CPU= 11.095
  20:48:45 STEP 2925 H=2925:00 +CPU= 17.012
  20:48:56 STEP 2926 H=2926:00 +CPU= 11.379
  20:49:08 STEP 2927 H=2927:00 +CPU= 11.177
  20:49:29 STEP 2928 H=2928:00 +CPU= 20.325
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:49:41 STEP 2929 H=2929:00 +CPU= 11.182
  20:49:53 STEP 2930 H=2930:00 +CPU= 11.383
Uploading trickle at timestep: 10540800
  20:50:11 STEP 2931 H=2931:00 +CPU= 17.407
  20:50:24 STEP 2932 H=2932:00 +CPU= 12.222
  20:50:36 STEP 2933 H=2933:00 +CPU= 11.935
  20:50:55 STEP 2934 H=2934:00 +CPU= 17.705
  20:51:06 STEP 2935 H=2935:00 +CPU= 11.091
  20:51:18 STEP 2936 H=2936:00 +CPU= 11.571
  20:51:36 STEP 2937 H=2937:00 +CPU= 17.579
  20:51:48 STEP 2938 H=2938:00 +CPU= 11.773
  20:52:01 STEP 2939 H=2939:00 +CPU= 11.775
  20:52:21 STEP 2940 H=2940:00 +CPU= 19.226
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002940
  20:52:32 STEP 2941 H=2941:00 +CPU= 11.211
  20:52:44 STEP 2942 H=2942:00 +CPU= 11.522
  20:53:02 STEP 2943 H=2943:00 +CPU= 16.914
  20:53:13 STEP 2944 H=2944:00 +CPU= 11.089
  20:53:24 STEP 2945 H=2945:00 +CPU= 10.904
  20:53:42 STEP 2946 H=2946:00 +CPU= 17.158
  20:53:53 STEP 2947 H=2947:00 +CPU= 10.851
  20:54:04 STEP 2948 H=2948:00 +CPU= 11.136
  20:54:22 STEP 2949 H=2949:00 +CPU= 16.907
  20:54:33 STEP 2950 H=2950:00 +CPU= 11.122
  20:54:45 STEP 2951 H=2951:00 +CPU= 11.316
  20:55:06 STEP 2952 H=2952:00 +CPU= 20.272
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12180796/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0152_1995050100_123_964_12180796_1_r1375452548_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:58:28 (3093): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:59:10 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 10,623,600 42,805 0.0040
09 May 2023 15:59:10 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 10,540,800 42,483 0.0040
09 May 2023 15:58:57 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 9,158,400 37,398 0.0041
09 May 2023 15:58:53 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 8,294,400 34,061 0.0041
09 May 2023 15:58:48 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 7,430,400 30,513 0.0041
09 May 2023 15:58:44 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 6,566,400 27,205 0.0041
09 May 2023 15:58:44 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 5,702,400 23,917 0.0042
09 May 2023 15:58:41 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 4,838,400 20,487 0.0042
09 May 2023 15:58:37 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 3,974,400 16,858 0.0042
09 May 2023 15:58:37 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 3,974,400 16,858 0.0042
09 May 2023 15:58:29 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 3,110,400 13,154 0.0042
09 May 2023 15:56:54 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 2,246,400 9,470 0.0042
09 May 2023 15:56:49 1529705 22293492 oifs_43r3_ps_0152_1995050100_123_964_12180796_1 1,382,400 5,838 0.0042


©2024 climateprediction.net