climateprediction.net home page
Task 22290206

Task 22290206

Name oifs_43r3_ps_0092_2018050100_123_987_12203736_0
Workunit 12203736
Created 24 Dec 2022, 19:44:27 UTC
Sent 24 Dec 2022, 19:49:31 UTC
Report deadline 23 Jan 2023, 19:49:31 UTC
Received 4 Jan 2023, 15:28:38 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1531398
Run time 12 hours 53 min 46 sec
CPU time 12 hours 42 min 16 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.99 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,806.02 MB
Peak swap size 4,978.11 MB
Peak disk usage 5,125.04 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
H=2398:00 +CPU= 12.749
  10:16:21 STEP 2399 H=2399:00 +CPU= 12.726
  10:16:45 STEP 2400 H=2400:00 +CPU= 23.323
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:16:57 STEP 2401 H=2401:00 +CPU= 12.267
  10:17:10 STEP 2402 H=2402:00 +CPU= 12.748
  10:17:30 STEP 2403 H=2403:00 +CPU= 19.643
  10:17:42 STEP 2404 H=2404:00 +CPU= 12.794
  10:17:55 STEP 2405 H=2405:00 +CPU= 12.310
  10:18:15 STEP 2406 H=2406:00 +CPU= 20.158
  10:18:27 STEP 2407 H=2407:00 +CPU= 12.349
  10:18:40 STEP 2408 H=2408:00 +CPU= 12.748
  10:19:00 STEP 2409 H=2409:00 +CPU= 19.714
  10:19:13 STEP 2410 H=2410:00 +CPU= 12.759
  10:19:25 STEP 2411 H=2411:00 +CPU= 12.358
  10:19:47 STEP 2412 H=2412:00 +CPU= 22.095
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002412
  10:20:00 STEP 2413 H=2413:00 +CPU= 12.355
  10:20:12 STEP 2414 H=2414:00 +CPU= 12.771
  10:20:32 STEP 2415 H=2415:00 +CPU= 19.700
  10:20:45 STEP 2416 H=2416:00 +CPU= 12.737
  10:20:57 STEP 2417 H=2417:00 +CPU= 12.299
  10:21:17 STEP 2418 H=2418:00 +CPU= 20.188
  10:21:30 STEP 2419 H=2419:00 +CPU= 12.301
  10:21:43 STEP 2420 H=2420:00 +CPU= 12.707
  10:22:02 STEP 2421 H=2421:00 +CPU= 19.650
  10:22:15 STEP 2422 H=2422:00 +CPU= 12.723
  10:22:28 STEP 2423 H=2423:00 +CPU= 12.673
  10:22:51 STEP 2424 H=2424:00 +CPU= 23.140
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:23:03 STEP 2425 H=2425:00 +CPU= 12.391
  10:23:16 STEP 2426 H=2426:00 +CPU= 12.888
  10:23:36 STEP 2427 H=2427:00 +CPU= 19.868
  10:23:49 STEP 2428 H=2428:00 +CPU= 12.910
  10:24:01 STEP 2429 H=2429:00 +CPU= 12.405
  10:24:22 STEP 2430 H=2430:00 +CPU= 20.414
  10:24:34 STEP 2431 H=2431:00 +CPU= 12.460
  10:24:47 STEP 2432 H=2432:00 +CPU= 12.810
  10:25:07 STEP 2433 H=2433:00 +CPU= 19.648
  10:25:20 STEP 2434 H=2434:00 +CPU= 12.765
  10:25:32 STEP 2435 H=2435:00 +CPU= 12.305
  10:25:54 STEP 2436 H=2436:00 +CPU= 22.077
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002436
  10:26:06 STEP 2437 H=2437:00 +CPU= 12.366
  10:26:19 STEP 2438 H=2438:00 +CPU= 12.762
  10:26:39 STEP 2439 H=2439:00 +CPU= 19.676
  10:26:52 STEP 2440 H=2440:00 +CPU= 12.752
  10:27:04 STEP 2441 H=2441:00 +CPU= 12.298
  10:27:24 STEP 2442 H=2442:00 +CPU= 20.155
  10:27:36 STEP 2443 H=2443:00 +CPU= 12.277
  10:27:49 STEP 2444 H=2444:00 +CPU= 12.678
  10:28:09 STEP 2445 H=2445:00 +CPU= 19.659
  10:28:22 STEP 2446 H=2446:00 +CPU= 12.704
  10:28:34 STEP 2447 H=2447:00 +CPU= 12.626
  10:28:57 STEP 2448 H=2448:00 +CPU= 23.288
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_101.zip
Uploading the intermediate file: upload_file_101.zip
  10:29:10 STEP 2449 H=2449:00 +CPU= 12.005
  10:29:22 STEP 2450 H=2450:00 +CPU= 12.560
  10:29:42 STEP 2451 H=2451:00 +CPU= 19.608
  10:29:54 STEP 2452 H=2452:00 +CPU= 12.699
  10:30:07 STEP 2453 H=2453:00 +CPU= 12.306
  10:30:27 STEP 2454 H=2454:00 +CPU= 20.171
  10:30:39 STEP 2455 H=2455:00 +CPU= 12.294
  10:30:52 STEP 2456 H=2456:00 +CPU= 12.777
  10:31:12 STEP 2457 H=2457:00 +CPU= 19.632
  10:31:25 STEP 2458 H=2458:00 +CPU= 12.777
  10:31:37 STEP 2459 H=2459:00 +CPU= 12.321
  10:31:59 STEP 2460 H=2460:00 +CPU= 22.080
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002460
  10:32:11 STEP 2461 H=2461:00 +CPU= 12.323
  10:32:24 STEP 2462 H=2462:00 +CPU= 12.766
  10:32:44 STEP 2463 H=2463:00 +CPU= 19.641
  10:32:57 STEP 2464 H=2464:00 +CPU= 12.733
  10:33:09 STEP 2465 H=2465:00 +CPU= 12.325
  10:33:29 STEP 2466 H=2466:00 +CPU= 20.122
  10:33:41 STEP 2467 H=2467:00 +CPU= 12.257
  10:33:54 STEP 2468 H=2468:00 +CPU= 12.716
  10:34:14 STEP 2469 H=2469:00 +CPU= 19.618
  10:34:27 STEP 2470 H=2470:00 +CPU= 12.751
  10:34:39 STEP 2471 H=2471:00 +CPU= 12.675
  10:35:03 STEP 2472 H=2472:00 +CPU= 23.269
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_102.zip
Uploading the intermediate file: upload_file_102.zip
  10:35:15 STEP 2473 H=2473:00 +CPU= 12.249
Uploading trickle at timestep: 8899200
  10:35:28 STEP 2474 H=2474:00 +CPU= 12.852
  10:35:48 STEP 2475 H=2475:00 +CPU= 19.860
  10:36:01 STEP 2476 H=2476:00 +CPU= 12.835
  10:36:13 STEP 2477 H=2477:00 +CPU= 12.441
  10:36:33 STEP 2478 H=2478:00 +CPU= 20.341
  10:36:46 STEP 2479 H=2479:00 +CPU= 12.453
  10:36:59 STEP 2480 H=2480:00 +CPU= 12.850
  10:37:19 STEP 2481 H=2481:00 +CPU= 19.822
  10:37:31 STEP 2482 H=2482:00 +CPU= 12.830
  10:37:44 STEP 2483 H=2483:00 +CPU= 12.354
  10:38:06 STEP 2484 H=2484:00 +CPU= 22.036
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002484
  10:38:18 STEP 2485 H=2485:00 +CPU= 12.382
  10:38:31 STEP 2486 H=2486:00 +CPU= 12.778
  10:38:51 STEP 2487 H=2487:00 +CPU= 19.652
  10:39:04 STEP 2488 H=2488:00 +CPU= 12.761
  10:39:16 STEP 2489 H=2489:00 +CPU= 12.324
  10:39:36 STEP 2490 H=2490:00 +CPU= 20.154
  10:39:48 STEP 2491 H=2491:00 +CPU= 12.305
  10:40:01 STEP 2492 H=2492:00 +CPU= 12.765
  10:40:21 STEP 2493 H=2493:00 +CPU= 19.679
  10:40:34 STEP 2494 H=2494:00 +CPU= 12.763
  10:40:47 STEP 2495 H=2495:00 +CPU= 12.732
  10:41:10 STEP 2496 H=2496:00 +CPU= 23.312
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_103.zip
Uploading the intermediate file: upload_file_103.zip
  10:41:22 STEP 2497 H=2497:00 +CPU= 12.308
  10:41:35 STEP 2498 H=2498:00 +CPU= 12.786
  10:41:55 STEP 2499 H=2499:00 +CPU= 19.661
  10:42:08 STEP 2500 H=2500:00 +CPU= 12.715
  10:42:20 STEP 2501 H=2501:00 +CPU= 12.340
  10:42:40 STEP 2502 H=2502:00 +CPU= 20.254
  10:42:53 STEP 2503 H=2503:00 +CPU= 12.293
  10:43:05 STEP 2504 H=2504:00 +CPU= 12.721
  10:43:25 STEP 2505 H=2505:00 +CPU= 19.679
  10:43:38 STEP 2506 H=2506:00 +CPU= 12.790
  10:43:50 STEP 2507 H=2507:00 +CPU= 12.418
  10:44:13 STEP 2508 H=2508:00 +CPU= 22.279
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002508
  10:44:25 STEP 2509 H=2509:00 +CPU= 12.446
  10:44:38 STEP 2510 H=2510:00 +CPU= 12.879
  10:44:58 STEP 2511 H=2511:00 +CPU= 19.905
  10:45:11 STEP 2512 H=2512:00 +CPU= 12.870
  10:45:23 STEP 2513 H=2513:00 +CPU= 12.461
  10:45:44 STEP 2514 H=2514:00 +CPU= 20.378
  10:45:56 STEP 2515 H=2515:00 +CPU= 12.315
  10:46:09 STEP 2516 H=2516:00 +CPU= 12.736
  10:46:28 STEP 2517 H=2517:00 +CPU= 19.641
  10:46:41 STEP 2518 H=2518:00 +CPU= 12.753
  10:46:54 STEP 2519 H=2519:00 +CPU= 12.748
  10:47:17 STEP 2520 H=2520:00 +CPU= 23.011
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_104.zip
Uploading the intermediate file: upload_file_104.zip
  10:47:29 STEP 2521 H=2521:00 +CPU= 12.364
  10:47:42 STEP 2522 H=2522:00 +CPU= 12.729
  10:48:02 STEP 2523 H=2523:00 +CPU= 19.725
  10:48:15 STEP 2524 H=2524:00 +CPU= 12.774
  10:48:27 STEP 2525 H=2525:00 +CPU= 12.315
  10:48:48 STEP 2526 H=2526:00 +CPU= 20.250
  10:49:00 STEP 2527 H=2527:00 +CPU= 12.298
  10:49:13 STEP 2528 H=2528:00 +CPU= 12.775
  10:49:32 STEP 2529 H=2529:00 +CPU= 19.670
  10:49:45 STEP 2530 H=2530:00 +CPU= 12.763
  10:49:58 STEP 2531 H=2531:00 +CPU= 12.367
  10:50:20 STEP 2532 H=2532:00 +CPU= 22.094
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002532
  10:50:32 STEP 2533 H=2533:00 +CPU= 12.351
  10:50:45 STEP 2534 H=2534:00 +CPU= 12.776
  10:51:05 STEP 2535 H=2535:00 +CPU= 19.689
  10:51:18 STEP 2536 H=2536:00 +CPU= 12.777
  10:51:30 STEP 2537 H=2537:00 +CPU= 12.341
  10:51:50 STEP 2538 H=2538:00 +CPU= 20.205
  10:52:02 STEP 2539 H=2539:00 +CPU= 12.339
  10:52:15 STEP 2540 H=2540:00 +CPU= 12.790
  10:52:35 STEP 2541 H=2541:00 +CPU= 19.728
  10:52:48 STEP 2542 H=2542:00 +CPU= 12.743
  10:53:01 STEP 2543 H=2543:00 +CPU= 12.664
  10:53:24 STEP 2544 H=2544:00 +CPU= 23.359
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_105.zip
Uploading the intermediate file: upload_file_105.zip
  10:53:36 STEP 2545 H=2545:00 +CPU= 12.280
  10:53:49 STEP 2546 H=2546:00 +CPU= 12.702
  10:54:09 STEP 2547 H=2547:00 +CPU= 19.609
  10:54:21 STEP 2548 H=2548:00 +CPU= 12.763
  10:54:34 STEP 2549 H=2549:00 +CPU= 12.348
  10:54:54 STEP 2550 H=2550:00 +CPU= 20.157
  10:55:06 STEP 2551 H=2551:00 +CPU= 12.318
  10:55:19 STEP 2552 H=2552:00 +CPU= 12.723
  10:55:39 STEP 2553 H=2553:00 +CPU= 19.651
  10:55:52 STEP 2554 H=2554:00 +CPU= 12.735
  10:56:04 STEP 2555 H=2555:00 +CPU= 12.336
  10:56:26 STEP 2556 H=2556:00 +CPU= 22.064
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002556
  10:56:38 STEP 2557 H=2557:00 +CPU= 12.254
  10:56:51 STEP 2558 H=2558:00 +CPU= 12.769
  10:57:11 STEP 2559 H=2559:00 +CPU= 19.628
  10:57:24 STEP 2560 H=2560:00 +CPU= 12.788
  10:57:36 STEP 2561 H=2561:00 +CPU= 12.363
  10:57:56 STEP 2562 H=2562:00 +CPU= 20.137
  10:58:08 STEP 2563 H=2563:00 +CPU= 12.297
  10:58:21 STEP 2564 H=2564:00 +CPU= 12.764
  10:58:41 STEP 2565 H=2565:00 +CPU= 19.653
  10:58:54 STEP 2566 H=2566:00 +CPU= 12.774
  10:59:07 STEP 2567 H=2567:00 +CPU= 12.729
  10:59:30 STEP 2568 H=2568:00 +CPU= 23.263
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_106.zip
Uploading the intermediate file: upload_file_106.zip
  10:59:42 STEP 2569 H=2569:00 +CPU= 12.355
  10:59:55 STEP 2570 H=2570:00 +CPU= 12.720
  11:00:15 STEP 2571 H=2571:00 +CPU= 19.681
  11:00:28 STEP 2572 H=2572:00 +CPU= 12.784
  11:00:40 STEP 2573 H=2573:00 +CPU= 12.323
  11:01:00 STEP 2574 H=2574:00 +CPU= 20.151
  11:01:12 STEP 2575 H=2575:00 +CPU= 12.322
  11:01:25 STEP 2576 H=2576:00 +CPU= 12.760
  11:01:45 STEP 2577 H=2577:00 +CPU= 19.639
  11:01:58 STEP 2578 H=2578:00 +CPU= 12.790
  11:02:10 STEP 2579 H=2579:00 +CPU= 12.330
  11:02:32 STEP 2580 H=2580:00 +CPU= 22.075
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002580
  11:02:45 STEP 2581 H=2581:00 +CPU= 12.324
  11:02:57 STEP 2582 H=2582:00 +CPU= 12.765
  11:03:17 STEP 2583 H=2583:00 +CPU= 19.614
  11:03:30 STEP 2584 H=2584:00 +CPU= 12.781
  11:03:42 STEP 2585 H=2585:00 +CPU= 12.334
  11:04:02 STEP 2586 H=2586:00 +CPU= 20.162
  11:04:15 STEP 2587 H=2587:00 +CPU= 12.290
  11:04:28 STEP 2588 H=2588:00 +CPU= 12.731
  11:04:47 STEP 2589 H=2589:00 +CPU= 19.585
  11:05:00 STEP 2590 H=2590:00 +CPU= 12.703
  11:05:13 STEP 2591 H=2591:00 +CPU= 12.673
  11:05:36 STEP 2592 H=2592:00 +CPU= 23.229
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:05:48 STEP 2593 H=2593:00 +CPU= 12.384
  11:06:01 STEP 2594 H=2594:00 +CPU= 12.810
  11:06:21 STEP 2595 H=2595:00 +CPU= 19.753
  11:06:34 STEP 2596 H=2596:00 +CPU= 12.827
  11:06:46 STEP 2597 H=2597:00 +CPU= 12.234
  11:07:06 STEP 2598 H=2598:00 +CPU= 20.363
  11:07:19 STEP 2599 H=2599:00 +CPU= 12.550
  11:07:32 STEP 2600 H=2600:00 +CPU= 12.874
  11:07:52 STEP 2601 H=2601:00 +CPU= 19.887
  11:08:05 STEP 2602 H=2602:00 +CPU= 12.965
  11:08:17 STEP 2603 H=2603:00 +CPU= 12.510
  11:08:40 STEP 2604 H=2604:00 +CPU= 22.346
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002604
  11:08:52 STEP 2605 H=2605:00 +CPU= 12.540
  11:09:05 STEP 2606 H=2606:00 +CPU= 12.942
  11:09:25 STEP 2607 H=2607:00 +CPU= 19.666
  11:09:38 STEP 2608 H=2608:00 +CPU= 12.746
  11:09:50 STEP 2609 H=2609:00 +CPU= 12.267
  11:10:10 STEP 2610 H=2610:00 +CPU= 20.113
  11:10:22 STEP 2611 H=2611:00 +CPU= 12.270
  11:10:35 STEP 2612 H=2612:00 +CPU= 12.718
  11:10:55 STEP 2613 H=2613:00 +CPU= 19.574
  11:11:08 STEP 2614 H=2614:00 +CPU= 12.689
  11:11:20 STEP 2615 H=2615:00 +CPU= 12.715
  11:11:44 STEP 2616 H=2616:00 +CPU= 23.247
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:11:56 STEP 2617 H=2617:00 +CPU= 12.227
  11:12:09 STEP 2618 H=2618:00 +CPU= 12.656
  11:12:28 STEP 2619 H=2619:00 +CPU= 19.536
  11:12:41 STEP 2620 H=2620:00 +CPU= 12.711
  11:12:53 STEP 2621 H=2621:00 +CPU= 12.277
  11:13:13 STEP 2622 H=2622:00 +CPU= 20.134
  11:13:26 STEP 2623 H=2623:00 +CPU= 12.235
  11:13:38 STEP 2624 H=2624:00 +CPU= 12.738
  11:13:58 STEP 2625 H=2625:00 +CPU= 19.595
  11:14:11 STEP 2626 H=2626:00 +CPU= 12.737
  11:14:23 STEP 2627 H=2627:00 +CPU= 12.329
  11:14:45 STEP 2628 H=2628:00 +CPU= 22.097
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002628
  11:14:58 STEP 2629 H=2629:00 +CPU= 12.274
  11:15:10 STEP 2630 H=2630:00 +CPU= 12.776
  11:15:30 STEP 2631 H=2631:00 +CPU= 19.672
  11:15:43 STEP 2632 H=2632:00 +CPU= 12.759
  11:15:55 STEP 2633 H=2633:00 +CPU= 12.326
  11:16:15 STEP 2634 H=2634:00 +CPU= 20.148
  11:16:28 STEP 2635 H=2635:00 +CPU= 12.319
  11:16:41 STEP 2636 H=2636:00 +CPU= 12.752
  11:17:00 STEP 2637 H=2637:00 +CPU= 19.657
  11:17:13 STEP 2638 H=2638:00 +CPU= 12.772
  11:17:26 STEP 2639 H=2639:00 +CPU= 12.664
  11:17:49 STEP 2640 H=2640:00 +CPU= 23.295
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_109.zip
Uploading the intermediate file: upload_file_109.zip
  11:18:01 STEP 2641 H=2641:00 +CPU= 12.248
  11:18:14 STEP 2642 H=2642:00 +CPU= 12.729
  11:18:34 STEP 2643 H=2643:00 +CPU= 19.819
  11:18:47 STEP 2644 H=2644:00 +CPU= 12.819
  11:18:59 STEP 2645 H=2645:00 +CPU= 12.357
  11:19:20 STEP 2646 H=2646:00 +CPU= 20.271
  11:19:32 STEP 2647 H=2647:00 +CPU= 12.335
  11:19:45 STEP 2648 H=2648:00 +CPU= 12.984
  11:20:05 STEP 2649 H=2649:00 +CPU= 19.864
  11:20:18 STEP 2650 H=2650:00 +CPU= 12.771
  11:20:30 STEP 2651 H=2651:00 +CPU= 12.330
  11:20:52 STEP 2652 H=2652:00 +CPU= 22.129
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002652
  11:21:05 STEP 2653 H=2653:00 +CPU= 12.368
  11:21:17 STEP 2654 H=2654:00 +CPU= 12.818
  11:21:37 STEP 2655 H=2655:00 +CPU= 19.761
  11:21:50 STEP 2656 H=2656:00 +CPU= 12.744
  11:22:02 STEP 2657 H=2657:00 +CPU= 12.348
  11:22:22 STEP 2658 H=2658:00 +CPU= 20.158
  11:22:35 STEP 2659 H=2659:00 +CPU= 12.279
  11:22:48 STEP 2660 H=2660:00 +CPU= 12.776
  11:23:07 STEP 2661 H=2661:00 +CPU= 19.629
  11:23:20 STEP 2662 H=2662:00 +CPU= 12.762
  11:23:33 STEP 2663 H=2663:00 +CPU= 12.724
  11:23:56 STEP 2664 H=2664:00 +CPU= 23.362
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_110.zip
Uploading the intermediate file: upload_file_110.zip
  11:24:09 STEP 2665 H=2665:00 +CPU= 12.320
  11:24:21 STEP 2666 H=2666:00 +CPU= 12.761
  11:24:41 STEP 2667 H=2667:00 +CPU= 19.668
  11:24:54 STEP 2668 H=2668:00 +CPU= 12.755
  11:25:06 STEP 2669 H=2669:00 +CPU= 12.279
  11:25:27 STEP 2670 H=2670:00 +CPU= 20.406
  11:25:39 STEP 2671 H=2671:00 +CPU= 12.424
  11:25:54 STEP 2672 H=2672:00 +CPU= 13.168
  11:26:17 STEP 2673 H=2673:00 +CPU= 20.554
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2018050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0092
(argv4) batchid: 987
(argv5) wuid: 12203736
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/4
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56630aea53a4df36df176922f8f3c42b to: /var/lib/boinc/slots/4/oifs_43r3_ps_0092_2018050100_123_987_12203736.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/4/oifs_43r3_ps_0092_2018050100_123_987_12203736.zip
ic_ancil_file: ic_ancil_12203736
ifsdata_file: ifsdata_12203736
climate_data_file: clim_data_12203736
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_8ead1d3ea42fb9993f857c72ad5b7eac to: /var/lib/boinc/slots/4/ic_ancil_12203736.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/4/ic_ancil_12203736.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_08c200b013193a324aa30bca3a6fc26c to: /var/lib/boinc/slots/4/ifsdata/ifsdata_12203736.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/4/ifsdata/ifsdata_12203736.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/4/159l_2/clim_data_12203736.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/4/159l_2/clim_data_12203736.zip
Checking for progress XML file: /var/lib/boinc/slots/4/progress_file_12203736.xml
Opened progress file ok : /var/lib/boinc/slots/4/progress_file_12203736.xml
-- Model is restarting --
Adjusting last_iter, 2673, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/4/progress_file_12203736.xml
last_cpu_time: 41192
upload_file_number: 111
last_iter: 2663
last_upload: 9590400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315
The child process has been launched with process id: 14206
Executing the command: /var/lib/boinc/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:14206:14206] [20221225:125833:1671973113:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:58:59 STEP 2664 H=2664:00 +CPU= 22.838
  12:59:12 STEP 2665 H=2665:00 +CPU= 12.861
  12:59:27 STEP 2666 H=2666:00 +CPU= 13.501
  12:59:53 STEP 2667 H=2667:00 +CPU= 22.034
  13:00:09 STEP 2668 H=2668:00 +CPU= 14.234
  13:00:25 STEP 2669 H=2669:00 +CPU= 14.009
  13:00:51 STEP 2670 H=2670:00 +CPU= 22.499
  13:01:08 STEP 2671 H=2671:00 +CPU= 14.036
  13:01:25 STEP 2672 H=2672:00 +CPU= 14.475
  13:01:50 STEP 2673 H=2673:00 +CPU= 22.050
  13:02:04 STEP 2674 H=2674:00 +CPU= 13.389
  13:02:18 STEP 2675 H=2675:00 +CPU= 12.894
  13:02:41 STEP 2676 H=2676:00 +CPU= 22.918
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002676
  13:02:55 STEP 2677 H=2677:00 +CPU= 12.763
  13:03:08 STEP 2678 H=2678:00 +CPU= 13.202
  13:03:29 STEP 2679 H=2679:00 +CPU= 20.415
  13:03:42 STEP 2680 H=2680:00 +CPU= 13.201
  13:03:56 STEP 2681 H=2681:00 +CPU= 12.756
  13:04:17 STEP 2682 H=2682:00 +CPU= 20.824
  13:04:30 STEP 2683 H=2683:00 +CPU= 12.784
  13:04:44 STEP 2684 H=2684:00 +CPU= 13.269
  13:05:05 STEP 2685 H=2685:00 +CPU= 20.466
  13:05:18 STEP 2686 H=2686:00 +CPU= 13.184
  13:05:32 STEP 2687 H=2687:00 +CPU= 13.003
  13:05:56 STEP 2688 H=2688:00 +CPU= 23.960
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_111.zip
Uploading the intermediate file: upload_file_111.zip
  13:06:09 STEP 2689 H=2689:00 +CPU= 12.727
  13:06:23 STEP 2690 H=2690:00 +CPU= 13.287
  13:06:44 STEP 2691 H=2691:00 +CPU= 20.202
  13:06:57 STEP 2692 H=2692:00 +CPU= 13.296
  13:07:11 STEP 2693 H=2693:00 +CPU= 12.738
  13:07:32 STEP 2694 H=2694:00 +CPU= 20.827
  13:07:45 STEP 2695 H=2695:00 +CPU= 12.801
  13:07:59 STEP 2696 H=2696:00 +CPU= 13.266
  13:08:20 STEP 2697 H=2697:00 +CPU= 20.211
  13:08:33 STEP 2698 H=2698:00 +CPU= 13.215
  13:08:46 STEP 2699 H=2699:00 +CPU= 12.854
  13:09:10 STEP 2700 H=2700:00 +CPU= 22.803
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002700
  13:09:23 STEP 2701 H=2701:00 +CPU= 12.628
  13:09:36 STEP 2702 H=2702:00 +CPU= 13.211
  13:09:57 STEP 2703 H=2703:00 +CPU= 20.412
  13:10:10 STEP 2704 H=2704:00 +CPU= 13.131
  13:10:23 STEP 2705 H=2705:00 +CPU= 12.741
  13:10:45 STEP 2706 H=2706:00 +CPU= 20.786
  13:10:58 STEP 2707 H=2707:00 +CPU= 12.606
  13:11:11 STEP 2708 H=2708:00 +CPU= 13.141
  13:11:32 STEP 2709 H=2709:00 +CPU= 20.455
  13:11:45 STEP 2710 H=2710:00 +CPU= 13.152
  13:11:59 STEP 2711 H=2711:00 +CPU= 13.008
  13:12:23 STEP 2712 H=2712:00 +CPU= 24.044
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_112.zip
Uploading the intermediate file: upload_file_112.zip
  13:12:37 STEP 2713 H=2713:00 +CPU= 12.770
  13:12:50 STEP 2714 H=2714:00 +CPU= 13.237
  13:13:11 STEP 2715 H=2715:00 +CPU= 20.337
  13:13:24 STEP 2716 H=2716:00 +CPU= 13.166
  13:13:37 STEP 2717 H=2717:00 +CPU= 12.786
  13:13:59 STEP 2718 H=2718:00 +CPU= 20.978
  13:14:12 STEP 2719 H=2719:00 +CPU= 12.711
  13:14:25 STEP 2720 H=2720:00 +CPU= 13.287
  13:14:46 STEP 2721 H=2721:00 +CPU= 20.354
  13:15:00 STEP 2722 H=2722:00 +CPU= 13.198
  13:15:13 STEP 2723 H=2723:00 +CPU= 12.598
  13:15:36 STEP 2724 H=2724:00 +CPU= 22.818
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002724
  13:15:49 STEP 2725 H=2725:00 +CPU= 12.686
  13:16:03 STEP 2726 H=2726:00 +CPU= 13.367
  13:16:24 STEP 2727 H=2727:00 +CPU= 20.294
  13:16:37 STEP 2728 H=2728:00 +CPU= 13.196
  13:16:51 STEP 2729 H=2729:00 +CPU= 12.842
  13:17:12 STEP 2730 H=2730:00 +CPU= 20.733
  13:17:25 STEP 2731 H=2731:00 +CPU= 12.715
  13:17:38 STEP 2732 H=2732:00 +CPU= 13.123
  13:17:59 STEP 2733 H=2733:00 +CPU= 20.428
  13:18:12 STEP 2734 H=2734:00 +CPU= 13.145
  13:18:26 STEP 2735 H=2735:00 +CPU= 13.105
  13:18:51 STEP 2736 H=2736:00 +CPU= 24.164
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_113.zip
Uploading the intermediate file: upload_file_113.zip
  13:19:04 STEP 2737 H=2737:00 +CPU= 12.647
  13:19:17 STEP 2738 H=2738:00 +CPU= 13.240
  13:19:38 STEP 2739 H=2739:00 +CPU= 20.258
  13:19:51 STEP 2740 H=2740:00 +CPU= 13.234
  13:20:04 STEP 2741 H=2741:00 +CPU= 12.754
  13:20:25 STEP 2742 H=2742:00 +CPU= 20.703
  13:20:39 STEP 2743 H=2743:00 +CPU= 12.758
  13:20:52 STEP 2744 H=2744:00 +CPU= 13.371
  13:21:13 STEP 2745 H=2745:00 +CPU= 20.342
  13:21:26 STEP 2746 H=2746:00 +CPU= 13.163
  13:21:40 STEP 2747 H=2747:00 +CPU= 12.784
  13:22:03 STEP 2748 H=2748:00 +CPU= 22.811
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002748
  13:22:16 STEP 2749 H=2749:00 +CPU= 12.755
  13:22:30 STEP 2750 H=2750:00 +CPU= 13.276
  13:22:50 STEP 2751 H=2751:00 +CPU= 20.209
  13:23:04 STEP 2752 H=2752:00 +CPU= 13.242
  13:23:17 STEP 2753 H=2753:00 +CPU= 12.781
  13:23:38 STEP 2754 H=2754:00 +CPU= 20.867
  13:23:51 STEP 2755 H=2755:00 +CPU= 12.587
  13:24:04 STEP 2756 H=2756:00 +CPU= 13.106
  13:24:25 STEP 2757 H=2757:00 +CPU= 20.206
  13:24:39 STEP 2758 H=2758:00 +CPU= 13.266
  13:24:52 STEP 2759 H=2759:00 +CPU= 13.151
  13:25:17 STEP 2760 H=2760:00 +CPU= 24.077
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:25:30 STEP 2761 H=2761:00 +CPU= 12.669
  13:25:43 STEP 2762 H=2762:00 +CPU= 13.140
  13:26:04 STEP 2763 H=2763:00 +CPU= 20.224
  13:26:17 STEP 2764 H=2764:00 +CPU= 13.212
  13:26:31 STEP 2765 H=2765:00 +CPU= 12.664
  13:26:52 STEP 2766 H=2766:00 +CPU= 20.717
  13:27:05 STEP 2767 H=2767:00 +CPU= 12.837
  13:27:19 STEP 2768 H=2768:00 +CPU= 13.155
  13:27:39 STEP 2769 H=2769:00 +CPU= 20.206
  13:27:53 STEP 2770 H=2770:00 +CPU= 13.264
  13:28:06 STEP 2771 H=2771:00 +CPU= 12.737
  13:28:30 STEP 2772 H=2772:00 +CPU= 22.799
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002772
  13:28:43 STEP 2773 H=2773:00 +CPU= 12.755
  13:28:56 STEP 2774 H=2774:00 +CPU= 13.137
  13:29:17 STEP 2775 H=2775:00 +CPU= 20.302
  13:29:30 STEP 2776 H=2776:00 +CPU= 13.173
  13:29:43 STEP 2777 H=2777:00 +CPU= 12.649
  13:30:04 STEP 2778 H=2778:00 +CPU= 20.638
  13:30:17 STEP 2779 H=2779:00 +CPU= 12.718
  13:30:31 STEP 2780 H=2780:00 +CPU= 13.121
  13:30:52 STEP 2781 H=2781:00 +CPU= 20.333
  13:31:05 STEP 2782 H=2782:00 +CPU= 13.066
  13:31:19 STEP 2783 H=2783:00 +CPU= 13.089
  13:31:43 STEP 2784 H=2784:00 +CPU= 23.963
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:31:56 STEP 2785 H=2785:00 +CPU= 12.618
  13:32:10 STEP 2786 H=2786:00 +CPU= 13.185
  13:32:30 STEP 2787 H=2787:00 +CPU= 20.188
  13:32:44 STEP 2788 H=2788:00 +CPU= 13.053
  13:32:57 STEP 2789 H=2789:00 +CPU= 12.762
  13:33:18 STEP 2790 H=2790:00 +CPU= 20.709
  13:33:31 STEP 2791 H=2791:00 +CPU= 12.607
  13:33:44 STEP 2792 H=2792:00 +CPU= 13.108
  13:34:05 STEP 2793 H=2793:00 +CPU= 20.255
  13:34:19 STEP 2794 H=2794:00 +CPU= 13.131
  13:34:32 STEP 2795 H=2795:00 +CPU= 12.737
  13:34:55 STEP 2796 H=2796:00 +CPU= 22.654
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002796
  13:35:08 STEP 2797 H=2797:00 +CPU= 12.652
  13:35:21 STEP 2798 H=2798:00 +CPU= 13.127
  13:35:42 STEP 2799 H=2799:00 +CPU= 20.209
  13:35:55 STEP 2800 H=2800:00 +CPU= 13.126
  13:36:08 STEP 2801 H=2801:00 +CPU= 12.679
  13:36:29 STEP 2802 H=2802:00 +CPU= 20.666
  13:36:42 STEP 2803 H=2803:00 +CPU= 12.606
  13:36:56 STEP 2804 H=2804:00 +CPU= 13.086
  13:37:16 STEP 2805 H=2805:00 +CPU= 20.236
  13:37:30 STEP 2806 H=2806:00 +CPU= 13.126
  13:37:43 STEP 2807 H=2807:00 +CPU= 12.979
  13:38:08 STEP 2808 H=2808:00 +CPU= 24.019
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:38:20 STEP 2809 H=2809:00 +CPU= 12.638
  13:38:34 STEP 2810 H=2810:00 +CPU= 12.915
  13:38:54 STEP 2811 H=2811:00 +CPU= 20.223
  13:39:08 STEP 2812 H=2812:00 +CPU= 13.024
  13:39:21 STEP 2813 H=2813:00 +CPU= 12.603
  13:39:42 STEP 2814 H=2814:00 +CPU= 20.760
  13:39:55 STEP 2815 H=2815:00 +CPU= 12.657
  13:40:08 STEP 2816 H=2816:00 +CPU= 12.897
  13:40:28 STEP 2817 H=2817:00 +CPU= 20.254
  13:40:42 STEP 2818 H=2818:00 +CPU= 13.082
  13:40:55 STEP 2819 H=2819:00 +CPU= 12.685
  13:41:18 STEP 2820 H=2820:00 +CPU= 22.726
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002820
  13:41:31 STEP 2821 H=2821:00 +CPU= 12.573
  13:41:44 STEP 2822 H=2822:00 +CPU= 13.133
  13:42:05 STEP 2823 H=2823:00 +CPU= 20.137
  13:42:18 STEP 2824 H=2824:00 +CPU= 13.097
  13:42:31 STEP 2825 H=2825:00 +CPU= 12.675
  13:42:53 STEP 2826 H=2826:00 +CPU= 20.783
  13:43:05 STEP 2827 H=2827:00 +CPU= 12.667
  13:43:19 STEP 2828 H=2828:00 +CPU= 13.024
  13:43:40 STEP 2829 H=2829:00 +CPU= 20.228
  13:43:53 STEP 2830 H=2830:00 +CPU= 13.026
  13:44:06 STEP 2831 H=2831:00 +CPU= 13.032
  13:44:31 STEP 2832 H=2832:00 +CPU= 23.840
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:44:44 STEP 2833 H=2833:00 +CPU= 12.587
  13:44:57 STEP 2834 H=2834:00 +CPU= 13.172
  13:45:18 STEP 2835 H=2835:00 +CPU= 20.068
  13:45:31 STEP 2836 H=2836:00 +CPU= 13.030
  13:45:44 STEP 2837 H=2837:00 +CPU= 12.573
  13:46:05 STEP 2838 H=2838:00 +CPU= 20.684
  13:46:18 STEP 2839 H=2839:00 +CPU= 12.640
  13:46:32 STEP 2840 H=2840:00 +CPU= 13.142
  13:46:53 STEP 2841 H=2841:00 +CPU= 20.171
  13:47:06 STEP 2842 H=2842:00 +CPU= 13.099
  13:47:19 STEP 2843 H=2843:00 +CPU= 12.611
  13:47:42 STEP 2844 H=2844:00 +CPU= 22.708
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002844
  13:47:55 STEP 2845 H=2845:00 +CPU= 12.687
  13:48:09 STEP 2846 H=2846:00 +CPU= 13.182
  13:48:29 STEP 2847 H=2847:00 +CPU= 20.155
  13:48:42 STEP 2848 H=2848:00 +CPU= 13.046
  13:48:55 STEP 2849 H=2849:00 +CPU= 12.670
  13:49:17 STEP 2850 H=2850:00 +CPU= 20.659
  13:49:29 STEP 2851 H=2851:00 +CPU= 12.572
  13:49:43 STEP 2852 H=2852:00 +CPU= 13.066
  13:50:03 STEP 2853 H=2853:00 +CPU= 20.273
  13:50:17 STEP 2854 H=2854:00 +CPU= 13.135
  13:50:30 STEP 2855 H=2855:00 +CPU= 13.009
  13:50:55 STEP 2856 H=2856:00 +CPU= 23.925
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:51:08 STEP 2857 H=2857:00 +CPU= 12.583
  13:51:21 STEP 2858 H=2858:00 +CPU= 13.194
  13:51:42 STEP 2859 H=2859:00 +CPU= 20.179
  13:51:55 STEP 2860 H=2860:00 +CPU= 13.005
  13:52:08 STEP 2861 H=2861:00 +CPU= 12.635
  13:52:29 STEP 2862 H=2862:00 +CPU= 20.726
  13:52:42 STEP 2863 H=2863:00 +CPU= 12.648
  13:52:56 STEP 2864 H=2864:00 +CPU= 13.180
  13:53:17 STEP 2865 H=2865:00 +CPU= 20.120
  13:53:30 STEP 2866 H=2866:00 +CPU= 13.085
  13:53:43 STEP 2867 H=2867:00 +CPU= 12.684
  13:54:06 STEP 2868 H=2868:00 +CPU= 22.638
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002868
  13:54:19 STEP 2869 H=2869:00 +CPU= 12.574
  13:54:33 STEP 2870 H=2870:00 +CPU= 13.086
  13:54:53 STEP 2871 H=2871:00 +CPU= 20.135
  13:55:07 STEP 2872 H=2872:00 +CPU= 13.087
  13:55:19 STEP 2873 H=2873:00 +CPU= 12.573
  13:55:40 STEP 2874 H=2874:00 +CPU= 20.641
  13:55:53 STEP 2875 H=2875:00 +CPU= 12.594
  13:56:07 STEP 2876 H=2876:00 +CPU= 13.053
  13:56:27 STEP 2877 H=2877:00 +CPU= 20.124
  13:56:41 STEP 2878 H=2878:00 +CPU= 13.044
  13:56:54 STEP 2879 H=2879:00 +CPU= 12.936
  13:57:19 STEP 2880 H=2880:00 +CPU= 23.869
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:57:32 STEP 2881 H=2881:00 +CPU= 12.547
  13:57:45 STEP 2882 H=2882:00 +CPU= 13.190
  13:58:06 STEP 2883 H=2883:00 +CPU= 20.132
  13:58:19 STEP 2884 H=2884:00 +CPU= 13.066
  13:58:32 STEP 2885 H=2885:00 +CPU= 12.784
  13:58:53 STEP 2886 H=2886:00 +CPU= 20.625
  13:59:06 STEP 2887 H=2887:00 +CPU= 12.581
  13:59:20 STEP 2888 H=2888:00 +CPU= 13.171
  13:59:40 STEP 2889 H=2889:00 +CPU= 20.192
  13:59:54 STEP 2890 H=2890:00 +CPU= 13.086
  14:00:07 STEP 2891 H=2891:00 +CPU= 12.675
  14:00:30 STEP 2892 H=2892:00 +CPU= 22.706
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002892
  14:00:43 STEP 2893 H=2893:00 +CPU= 12.704
  14:00:56 STEP 2894 H=2894:00 +CPU= 13.112
  14:01:17 STEP 2895 H=2895:00 +CPU= 20.122
  14:01:31 STEP 2896 H=2896:00 +CPU= 13.180
  14:01:44 STEP 2897 H=2897:00 +CPU= 12.610
  14:02:05 STEP 2898 H=2898:00 +CPU= 20.592
  14:02:18 STEP 2899 H=2899:00 +CPU= 12.692
  14:02:31 STEP 2900 H=2900:00 +CPU= 13.021
  14:02:52 STEP 2901 H=2901:00 +CPU= 20.015
  14:03:05 STEP 2902 H=2902:00 +CPU= 13.083
  14:03:18 STEP 2903 H=2903:00 +CPU= 13.110
  14:03:43 STEP 2904 H=2904:00 +CPU= 23.770
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_120.zip
Uploading the intermediate file: upload_file_120.zip
  14:03:55 STEP 2905 H=2905:00 +CPU= 12.589
Uploading trickle at timestep: 10454400
  14:04:09 STEP 2906 H=2906:00 +CPU= 13.071
  14:04:30 STEP 2907 H=2907:00 +CPU= 20.222
  14:04:43 STEP 2908 H=2908:00 +CPU= 13.085
  14:04:56 STEP 2909 H=2909:00 +CPU= 12.655
  14:05:17 STEP 2910 H=2910:00 +CPU= 20.614
  14:05:30 STEP 2911 H=2911:00 +CPU= 12.651
  14:05:43 STEP 2912 H=2912:00 +CPU= 13.011
  14:06:04 STEP 2913 H=2913:00 +CPU= 20.168
  14:06:18 STEP 2914 H=2914:00 +CPU= 13.097
  14:06:31 STEP 2915 H=2915:00 +CPU= 12.564
  14:06:54 STEP 2916 H=2916:00 +CPU= 22.685
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002916
  14:07:07 STEP 2917 H=2917:00 +CPU= 12.643
  14:07:20 STEP 2918 H=2918:00 +CPU= 13.085
  14:07:41 STEP 2919 H=2919:00 +CPU= 20.130
  14:07:54 STEP 2920 H=2920:00 +CPU= 13.050
  14:08:07 STEP 2921 H=2921:00 +CPU= 12.691
  14:08:28 STEP 2922 H=2922:00 +CPU= 20.518
  14:08:41 STEP 2923 H=2923:00 +CPU= 12.653
  14:08:55 STEP 2924 H=2924:00 +CPU= 13.015
  14:09:15 STEP 2925 H=2925:00 +CPU= 20.119
  14:09:28 STEP 2926 H=2926:00 +CPU= 13.047
  14:09:41 STEP 2927 H=2927:00 +CPU= 12.999
  14:10:06 STEP 2928 H=2928:00 +CPU= 23.957
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_121.zip
Uploading the intermediate file: upload_file_121.zip
  14:10:19 STEP 2929 H=2929:00 +CPU= 12.528
  14:10:32 STEP 2930 H=2930:00 +CPU= 13.037
  14:10:53 STEP 2931 H=2931:00 +CPU= 20.035
  14:11:06 STEP 2932 H=2932:00 +CPU= 13.107
  14:11:19 STEP 2933 H=2933:00 +CPU= 12.557
  14:11:40 STEP 2934 H=2934:00 +CPU= 20.635
  14:11:53 STEP 2935 H=2935:00 +CPU= 12.761
  14:12:06 STEP 2936 H=2936:00 +CPU= 13.026
  14:12:27 STEP 2937 H=2937:00 +CPU= 20.147
  14:12:40 STEP 2938 H=2938:00 +CPU= 13.171
  14:12:53 STEP 2939 H=2939:00 +CPU= 12.663
  14:13:16 STEP 2940 H=2940:00 +CPU= 22.359
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002940
  14:13:29 STEP 2941 H=2941:00 +CPU= 12.654
  14:13:43 STEP 2942 H=2942:00 +CPU= 13.108
  14:14:03 STEP 2943 H=2943:00 +CPU= 20.229
  14:14:17 STEP 2944 H=2944:00 +CPU= 13.062
  14:14:30 STEP 2945 H=2945:00 +CPU= 12.629
  14:14:51 STEP 2946 H=2946:00 +CPU= 20.757
  14:15:04 STEP 2947 H=2947:00 +CPU= 12.600
  14:15:17 STEP 2948 H=2948:00 +CPU= 13.081
  14:15:38 STEP 2949 H=2949:00 +CPU= 20.038
  14:15:51 STEP 2950 H=2950:00 +CPU= 13.014
  14:16:05 STEP 2951 H=2951:00 +CPU= 13.031
  14:16:28 STEP 2952 H=2952:00 +CPU= 23.275
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203736/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0092_2018050100_123_987_12203736_0_r809225315_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:19:51 (14075): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:55:08 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 10,623,600 45,736 0.0043
09 May 2023 15:55:02 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 10,454,400 44,989 0.0043
09 May 2023 15:54:41 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 8,899,200 38,133 0.0043
09 May 2023 15:54:34 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 8,035,200 34,478 0.0043
09 May 2023 15:54:28 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 7,171,200 30,803 0.0043
09 May 2023 15:54:23 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 6,307,200 27,138 0.0043
09 May 2023 15:54:16 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 5,443,200 23,504 0.0043
09 May 2023 15:54:10 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 4,579,200 19,830 0.0043
09 May 2023 15:54:04 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 3,715,200 16,165 0.0044
09 May 2023 15:53:26 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 2,592,000 11,106 0.0043
09 May 2023 15:53:19 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 1,728,000 7,420 0.0043
09 May 2023 15:53:12 1531398 22290206 oifs_43r3_ps_0092_2018050100_123_987_12203736_0 864,000 3,724 0.0043


©2024 climateprediction.net