climateprediction.net home page
Task 22282623

Task 22282623

Name oifs_43r3_ps_0990_2010050100_123_979_12196634_0
Workunit 12196634
Created 24 Dec 2022, 1:10:35 UTC
Sent 5 Jan 2023, 18:32:59 UTC
Report deadline 4 Feb 2023, 18:32:59 UTC
Received 11 Jan 2023, 15:00:27 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1534496
Run time 16 hours 56 min 51 sec
CPU time 16 hours 41 min 33 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,403.71 MB
Peak swap size 4,978.06 MB
Peak disk usage 3,742.63 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
2 STEP 2423 H=2423:00 +CPU= 18.315
  08:23:56 STEP 2424 H=2424:00 +CPU= 34.006
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_100.zip
Uploading the intermediate file: upload_file_100.zip
  08:24:14 STEP 2425 H=2425:00 +CPU= 17.563
  08:24:33 STEP 2426 H=2426:00 +CPU= 18.713
  08:25:01 STEP 2427 H=2427:00 +CPU= 28.276
  08:25:20 STEP 2428 H=2428:00 +CPU= 18.924
  08:25:38 STEP 2429 H=2429:00 +CPU= 17.466
  08:26:08 STEP 2430 H=2430:00 +CPU= 29.938
  08:26:27 STEP 2431 H=2431:00 +CPU= 18.420
  08:26:45 STEP 2432 H=2432:00 +CPU= 18.490
  08:27:14 STEP 2433 H=2433:00 +CPU= 28.617
  08:27:32 STEP 2434 H=2434:00 +CPU= 18.278
  08:27:52 STEP 2435 H=2435:00 +CPU= 19.125
  08:28:25 STEP 2436 H=2436:00 +CPU= 33.020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002436
  08:28:43 STEP 2437 H=2437:00 +CPU= 18.028
  08:29:02 STEP 2438 H=2438:00 +CPU= 18.533
  08:29:31 STEP 2439 H=2439:00 +CPU= 29.449
  08:29:49 STEP 2440 H=2440:00 +CPU= 18.131
  08:30:08 STEP 2441 H=2441:00 +CPU= 18.390
  08:30:37 STEP 2442 H=2442:00 +CPU= 28.659
  08:30:54 STEP 2443 H=2443:00 +CPU= 17.370
  08:31:12 STEP 2444 H=2444:00 +CPU= 17.923
  08:31:42 STEP 2445 H=2445:00 +CPU= 29.286
  08:31:59 STEP 2446 H=2446:00 +CPU= 17.423
  08:32:18 STEP 2447 H=2447:00 +CPU= 18.358
  08:32:53 STEP 2448 H=2448:00 +CPU= 34.400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:33:10 STEP 2449 H=2449:00 +CPU= 17.531
  08:33:29 STEP 2450 H=2450:00 +CPU= 18.884
  08:33:58 STEP 2451 H=2451:00 +CPU= 28.489
  08:34:17 STEP 2452 H=2452:00 +CPU= 18.324
  08:34:34 STEP 2453 H=2453:00 +CPU= 17.737
  08:35:05 STEP 2454 H=2454:00 +CPU= 30.539
  08:35:23 STEP 2455 H=2455:00 +CPU= 17.792
  08:35:43 STEP 2456 H=2456:00 +CPU= 19.016
  08:36:12 STEP 2457 H=2457:00 +CPU= 28.755
  08:36:30 STEP 2458 H=2458:00 +CPU= 18.515
  08:36:49 STEP 2459 H=2459:00 +CPU= 17.928
  08:37:21 STEP 2460 H=2460:00 +CPU= 32.036
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002460
  08:37:41 STEP 2461 H=2461:00 +CPU= 19.389
  08:38:01 STEP 2462 H=2462:00 +CPU= 19.911
  08:38:28 STEP 2463 H=2463:00 +CPU= 27.467
  08:38:46 STEP 2464 H=2464:00 +CPU= 17.590
  08:39:03 STEP 2465 H=2465:00 +CPU= 17.392
  08:39:32 STEP 2466 H=2466:00 +CPU= 29.010
  08:39:51 STEP 2467 H=2467:00 +CPU= 18.621
  08:40:09 STEP 2468 H=2468:00 +CPU= 18.326
  08:40:37 STEP 2469 H=2469:00 +CPU= 27.628
  08:40:56 STEP 2470 H=2470:00 +CPU= 18.987
  08:41:12 STEP 2471 H=2471:00 +CPU= 15.788
  08:41:43 STEP 2472 H=2472:00 +CPU= 30.647
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_102.zip
Uploading the intermediate file: upload_file_102.zip
  08:41:59 STEP 2473 H=2473:00 +CPU= 16.064
  08:42:17 STEP 2474 H=2474:00 +CPU= 16.941
  08:42:43 STEP 2475 H=2475:00 +CPU= 25.913
  08:43:00 STEP 2476 H=2476:00 +CPU= 16.817
  08:43:17 STEP 2477 H=2477:00 +CPU= 16.540
  08:43:44 STEP 2478 H=2478:00 +CPU= 27.014
  08:44:01 STEP 2479 H=2479:00 +CPU= 17.510
  08:44:19 STEP 2480 H=2480:00 +CPU= 17.667
  08:44:46 STEP 2481 H=2481:00 +CPU= 26.710
  08:45:04 STEP 2482 H=2482:00 +CPU= 17.534
  08:45:21 STEP 2483 H=2483:00 +CPU= 16.673
  08:45:52 STEP 2484 H=2484:00 +CPU= 30.744
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002484
  08:46:08 STEP 2485 H=2485:00 +CPU= 16.443
  08:46:26 STEP 2486 H=2486:00 +CPU= 17.911
  08:46:55 STEP 2487 H=2487:00 +CPU= 28.406
  08:47:12 STEP 2488 H=2488:00 +CPU= 17.228
  08:47:30 STEP 2489 H=2489:00 +CPU= 17.874
  08:47:58 STEP 2490 H=2490:00 +CPU= 28.124
  08:48:16 STEP 2491 H=2491:00 +CPU= 17.477
  08:48:34 STEP 2492 H=2492:00 +CPU= 17.975
  08:49:02 STEP 2493 H=2493:00 +CPU= 27.894
  08:49:20 STEP 2494 H=2494:00 +CPU= 18.283
  08:49:38 STEP 2495 H=2495:00 +CPU= 17.640
  08:50:12 STEP 2496 H=2496:00 +CPU= 33.070
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_103.zip
Uploading the intermediate file: upload_file_103.zip
  08:50:29 STEP 2497 H=2497:00 +CPU= 16.978
  08:50:47 STEP 2498 H=2498:00 +CPU= 18.001
  08:51:13 STEP 2499 H=2499:00 +CPU= 26.221
  08:51:32 STEP 2500 H=2500:00 +CPU= 17.943
  08:51:50 STEP 2501 H=2501:00 +CPU= 18.047
  08:52:18 STEP 2502 H=2502:00 +CPU= 27.646
  08:52:34 STEP 2503 H=2503:00 +CPU= 16.181
  08:52:52 STEP 2504 H=2504:00 +CPU= 17.675
  08:53:19 STEP 2505 H=2505:00 +CPU= 26.973
  08:53:38 STEP 2506 H=2506:00 +CPU= 18.887
  08:53:55 STEP 2507 H=2507:00 +CPU= 16.602
  08:54:25 STEP 2508 H=2508:00 +CPU= 29.907
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002508
  08:54:43 STEP 2509 H=2509:00 +CPU= 17.506
  08:55:00 STEP 2510 H=2510:00 +CPU= 17.578
  08:55:27 STEP 2511 H=2511:00 +CPU= 26.718
  08:55:44 STEP 2512 H=2512:00 +CPU= 16.583
  08:56:02 STEP 2513 H=2513:00 +CPU= 17.592
  08:56:28 STEP 2514 H=2514:00 +CPU= 26.366
  08:56:45 STEP 2515 H=2515:00 +CPU= 16.917
  08:57:03 STEP 2516 H=2516:00 +CPU= 17.886
  08:57:30 STEP 2517 H=2517:00 +CPU= 26.841
  08:57:48 STEP 2518 H=2518:00 +CPU= 17.371
  08:58:06 STEP 2519 H=2519:00 +CPU= 17.902
  08:58:39 STEP 2520 H=2520:00 +CPU= 32.702
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_104.zip
Uploading the intermediate file: upload_file_104.zip
  08:58:56 STEP 2521 H=2521:00 +CPU= 16.858
  08:59:13 STEP 2522 H=2522:00 +CPU= 17.354
  08:59:41 STEP 2523 H=2523:00 +CPU= 26.965
  08:59:59 STEP 2524 H=2524:00 +CPU= 17.955
  09:00:17 STEP 2525 H=2525:00 +CPU= 17.552
  09:00:45 STEP 2526 H=2526:00 +CPU= 28.305
  09:01:02 STEP 2527 H=2527:00 +CPU= 17.072
  09:01:20 STEP 2528 H=2528:00 +CPU= 17.507
  09:01:46 STEP 2529 H=2529:00 +CPU= 25.797
  09:02:03 STEP 2530 H=2530:00 +CPU= 16.725
  09:02:19 STEP 2531 H=2531:00 +CPU= 15.976
  09:02:49 STEP 2532 H=2532:00 +CPU= 29.816
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532
  09:03:06 STEP 2533 H=2533:00 +CPU= 17.297
  09:03:24 STEP 2534 H=2534:00 +CPU= 17.653
  09:03:51 STEP 2535 H=2535:00 +CPU= 26.373
  09:04:07 STEP 2536 H=2536:00 +CPU= 16.627
  09:04:24 STEP 2537 H=2537:00 +CPU= 16.351
  09:04:50 STEP 2538 H=2538:00 +CPU= 25.868
  09:05:06 STEP 2539 H=2539:00 +CPU= 16.126
  09:05:22 STEP 2540 H=2540:00 +CPU= 16.321
  09:05:49 STEP 2541 H=2541:00 +CPU= 26.760
  09:06:07 STEP 2542 H=2542:00 +CPU= 17.546
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:37:49 STEP 2543 H=2543:00 +CPU= 18.138
  09:38:22 STEP 2544 H=2544:00 +CPU= 32.739
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_105.zip
Uploading the intermediate file: upload_file_105.zip
  09:38:39 STEP 2545 H=2545:00 +CPU= 17.410
  09:38:58 STEP 2546 H=2546:00 +CPU= 18.601
  09:39:27 STEP 2547 H=2547:00 +CPU= 28.327
  09:39:45 STEP 2548 H=2548:00 +CPU= 18.000
  09:40:02 STEP 2549 H=2549:00 +CPU= 17.265
  09:40:31 STEP 2550 H=2550:00 +CPU= 28.209
  09:40:48 STEP 2551 H=2551:00 +CPU= 17.610
  09:41:06 STEP 2552 H=2552:00 +CPU= 17.752
  09:41:34 STEP 2553 H=2553:00 +CPU= 27.225
  09:41:52 STEP 2554 H=2554:00 +CPU= 18.107
  09:42:10 STEP 2555 H=2555:00 +CPU= 17.986
  09:42:39 STEP 2556 H=2556:00 +CPU= 28.595
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556
  09:42:56 STEP 2557 H=2557:00 +CPU= 17.093
  09:43:14 STEP 2558 H=2558:00 +CPU= 17.567
  09:43:41 STEP 2559 H=2559:00 +CPU= 27.184
  09:43:58 STEP 2560 H=2560:00 +CPU= 16.729
  09:44:15 STEP 2561 H=2561:00 +CPU= 17.306
  09:44:42 STEP 2562 H=2562:00 +CPU= 26.867
  09:44:59 STEP 2563 H=2563:00 +CPU= 16.867
  09:45:17 STEP 2564 H=2564:00 +CPU= 17.809
  09:45:45 STEP 2565 H=2565:00 +CPU= 27.577
  09:46:03 STEP 2566 H=2566:00 +CPU= 17.729
  09:46:21 STEP 2567 H=2567:00 +CPU= 18.299
  09:46:55 STEP 2568 H=2568:00 +CPU= 33.350
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_106.zip
Uploading the intermediate file: upload_file_106.zip
  09:47:13 STEP 2569 H=2569:00 +CPU= 17.780
  09:47:31 STEP 2570 H=2570:00 +CPU= 17.839
  09:47:59 STEP 2571 H=2571:00 +CPU= 27.808
  09:48:18 STEP 2572 H=2572:00 +CPU= 18.198
  09:48:35 STEP 2573 H=2573:00 +CPU= 16.715
  09:49:03 STEP 2574 H=2574:00 +CPU= 27.774
  09:49:21 STEP 2575 H=2575:00 +CPU= 18.270
  09:49:39 STEP 2576 H=2576:00 +CPU= 17.608
  09:50:06 STEP 2577 H=2577:00 +CPU= 27.318
  09:50:25 STEP 2578 H=2578:00 +CPU= 18.529
  09:50:42 STEP 2579 H=2579:00 +CPU= 16.804
  09:51:12 STEP 2580 H=2580:00 +CPU= 29.316
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580
  09:51:28 STEP 2581 H=2581:00 +CPU= 15.859
  09:51:45 STEP 2582 H=2582:00 +CPU= 16.526
  09:52:11 STEP 2583 H=2583:00 +CPU= 26.528
  09:52:30 STEP 2584 H=2584:00 +CPU= 18.363
  09:52:48 STEP 2585 H=2585:00 +CPU= 17.788
  09:53:16 STEP 2586 H=2586:00 +CPU= 27.907
  09:53:34 STEP 2587 H=2587:00 +CPU= 17.579
  09:53:52 STEP 2588 H=2588:00 +CPU= 17.731
  09:54:19 STEP 2589 H=2589:00 +CPU= 27.161
  09:54:36 STEP 2590 H=2590:00 +CPU= 17.085
  09:54:55 STEP 2591 H=2591:00 +CPU= 18.372
  09:55:27 STEP 2592 H=2592:00 +CPU= 31.617
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_107.zip
Uploading the intermediate file: upload_file_107.zip
  09:55:44 STEP 2593 H=2593:00 +CPU= 16.489
  09:56:01 STEP 2594 H=2594:00 +CPU= 17.546
  09:56:30 STEP 2595 H=2595:00 +CPU= 28.018
  09:56:48 STEP 2596 H=2596:00 +CPU= 17.923
  09:57:06 STEP 2597 H=2597:00 +CPU= 17.739
  09:57:35 STEP 2598 H=2598:00 +CPU= 28.847
  09:57:53 STEP 2599 H=2599:00 +CPU= 17.816
  09:58:11 STEP 2600 H=2600:00 +CPU= 17.828
  09:58:39 STEP 2601 H=2601:00 +CPU= 27.404
  09:58:57 STEP 2602 H=2602:00 +CPU= 17.610
  09:59:15 STEP 2603 H=2603:00 +CPU= 17.965
  09:59:46 STEP 2604 H=2604:00 +CPU= 30.766
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604
  10:00:04 STEP 2605 H=2605:00 +CPU= 17.590
  10:00:21 STEP 2606 H=2606:00 +CPU= 17.425
  10:00:48 STEP 2607 H=2607:00 +CPU= 26.387
  10:01:07 STEP 2608 H=2608:00 +CPU= 18.743
  10:01:26 STEP 2609 H=2609:00 +CPU= 18.463
  10:01:54 STEP 2610 H=2610:00 +CPU= 27.749
  10:02:10 STEP 2611 H=2611:00 +CPU= 15.921
  10:02:29 STEP 2612 H=2612:00 +CPU= 19.345
  10:02:57 STEP 2613 H=2613:00 +CPU= 28.372
  10:03:17 STEP 2614 H=2614:00 +CPU= 19.006
  10:03:35 STEP 2615 H=2615:00 +CPU= 18.509
  10:04:07 STEP 2616 H=2616:00 +CPU= 31.087
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_108.zip
Uploading the intermediate file: upload_file_108.zip
  10:04:25 STEP 2617 H=2617:00 +CPU= 18.212
  10:04:44 STEP 2618 H=2618:00 +CPU= 18.657
  10:05:11 STEP 2619 H=2619:00 +CPU= 26.955
  10:05:29 STEP 2620 H=2620:00 +CPU= 17.747
  10:05:47 STEP 2621 H=2621:00 +CPU= 17.991
  10:06:15 STEP 2622 H=2622:00 +CPU= 27.442
  10:06:32 STEP 2623 H=2623:00 +CPU= 17.487
  10:06:49 STEP 2624 H=2624:00 +CPU= 17.137
  10:07:17 STEP 2625 H=2625:00 +CPU= 26.925
  10:07:36 STEP 2626 H=2626:00 +CPU= 18.475
  10:07:52 STEP 2627 H=2627:00 +CPU= 16.352
  10:08:22 STEP 2628 H=2628:00 +CPU= 29.923
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628
  10:08:39 STEP 2629 H=2629:00 +CPU= 16.626
  10:08:56 STEP 2630 H=2630:00 +CPU= 16.916
  10:09:24 STEP 2631 H=2631:00 +CPU= 27.286
  10:09:41 STEP 2632 H=2632:00 +CPU= 16.869
  10:09:57 STEP 2633 H=2633:00 +CPU= 16.292
  10:10:25 STEP 2634 H=2634:00 +CPU= 28.371
  10:10:44 STEP 2635 H=2635:00 +CPU= 18.860
  10:11:03 STEP 2636 H=2636:00 +CPU= 18.413
  10:11:30 STEP 2637 H=2637:00 +CPU= 27.445
  10:11:48 STEP 2638 H=2638:00 +CPU= 17.810
  10:12:06 STEP 2639 H=2639:00 +CPU= 17.686
  10:12:39 STEP 2640 H=2640:00 +CPU= 31.463
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_109.zip
Uploading the intermediate file: upload_file_109.zip
  10:12:57 STEP 2641 H=2641:00 +CPU= 18.182
Uploading trickle at timestep: 9504000
  10:13:14 STEP 2642 H=2642:00 +CPU= 17.351
  10:13:41 STEP 2643 H=2643:00 +CPU= 26.311
  10:14:00 STEP 2644 H=2644:00 +CPU= 18.461
  10:14:18 STEP 2645 H=2645:00 +CPU= 17.341
  10:14:46 STEP 2646 H=2646:00 +CPU= 27.537
  10:15:03 STEP 2647 H=2647:00 +CPU= 17.391
  10:15:21 STEP 2648 H=2648:00 +CPU= 17.274
  10:15:48 STEP 2649 H=2649:00 +CPU= 26.963
  10:16:06 STEP 2650 H=2650:00 +CPU= 17.380
  10:16:24 STEP 2651 H=2651:00 +CPU= 17.764
  10:16:53 STEP 2652 H=2652:00 +CPU= 29.458
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652
  10:17:11 STEP 2653 H=2653:00 +CPU= 16.974
  10:17:28 STEP 2654 H=2654:00 +CPU= 17.002
  10:17:54 STEP 2655 H=2655:00 +CPU= 25.869
  10:18:12 STEP 2656 H=2656:00 +CPU= 17.838
  10:18:29 STEP 2657 H=2657:00 +CPU= 17.096
  10:18:57 STEP 2658 H=2658:00 +CPU= 27.951
  10:19:15 STEP 2659 H=2659:00 +CPU= 17.860
  10:19:34 STEP 2660 H=2660:00 +CPU= 18.479
  10:19:59 STEP 2661 H=2661:00 +CPU= 25.482
  10:20:18 STEP 2662 H=2662:00 +CPU= 18.623
  10:20:35 STEP 2663 H=2663:00 +CPU= 17.148
  10:21:09 STEP 2664 H=2664:00 +CPU= 33.297
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_110.zip
Uploading the intermediate file: upload_file_110.zip
  10:21:26 STEP 2665 H=2665:00 +CPU= 17.152
  10:21:43 STEP 2666 H=2666:00 +CPU= 16.913
  10:22:11 STEP 2667 H=2667:00 +CPU= 27.175
  10:22:28 STEP 2668 H=2668:00 +CPU= 17.064
  10:22:45 STEP 2669 H=2669:00 +CPU= 16.721
  10:23:15 STEP 2670 H=2670:00 +CPU= 30.108
  10:23:34 STEP 2671 H=2671:00 +CPU= 18.480
  10:23:52 STEP 2672 H=2672:00 +CPU= 18.005
  10:24:20 STEP 2673 H=2673:00 +CPU= 27.889
  10:24:38 STEP 2674 H=2674:00 +CPU= 17.671
  10:24:55 STEP 2675 H=2675:00 +CPU= 16.810
  10:25:25 STEP 2676 H=2676:00 +CPU= 30.134
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676
  10:25:42 STEP 2677 H=2677:00 +CPU= 16.512
  10:26:00 STEP 2678 H=2678:00 +CPU= 17.631
  10:26:26 STEP 2679 H=2679:00 +CPU= 25.950
  10:26:43 STEP 2680 H=2680:00 +CPU= 17.501
  10:27:01 STEP 2681 H=2681:00 +CPU= 18.108
  10:27:30 STEP 2682 H=2682:00 +CPU= 29.022
  10:27:48 STEP 2683 H=2683:00 +CPU= 17.318
  10:28:05 STEP 2684 H=2684:00 +CPU= 16.670
  10:28:30 STEP 2685 H=2685:00 +CPU= 25.405
  10:28:48 STEP 2686 H=2686:00 +CPU= 17.805
  10:29:06 STEP 2687 H=2687:00 +CPU= 17.484
  10:29:36 STEP 2688 H=2688:00 +CPU= 29.986
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_111.zip
Uploading the intermediate file: upload_file_111.zip
  10:29:54 STEP 2689 H=2689:00 +CPU= 17.572
  10:30:12 STEP 2690 H=2690:00 +CPU= 17.775
  10:30:38 STEP 2691 H=2691:00 +CPU= 26.379
  10:30:56 STEP 2692 H=2692:00 +CPU= 17.742
  10:31:13 STEP 2693 H=2693:00 +CPU= 16.980
  10:31:40 STEP 2694 H=2694:00 +CPU= 26.941
  10:31:58 STEP 2695 H=2695:00 +CPU= 17.903
  10:32:16 STEP 2696 H=2696:00 +CPU= 17.780
  10:32:44 STEP 2697 H=2697:00 +CPU= 27.281
  10:33:03 STEP 2698 H=2698:00 +CPU= 18.891
  10:33:20 STEP 2699 H=2699:00 +CPU= 17.391
  10:33:50 STEP 2700 H=2700:00 +CPU= 30.000
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002700
  10:34:08 STEP 2701 H=2701:00 +CPU= 17.634
  10:34:26 STEP 2702 H=2702:00 +CPU= 17.572
  10:34:53 STEP 2703 H=2703:00 +CPU= 27.129
  10:35:10 STEP 2704 H=2704:00 +CPU= 16.977
  10:35:28 STEP 2705 H=2705:00 +CPU= 17.727
  10:35:56 STEP 2706 H=2706:00 +CPU= 27.641
  10:36:13 STEP 2707 H=2707:00 +CPU= 16.567
  10:36:31 STEP 2708 H=2708:00 +CPU= 17.780
  10:36:58 STEP 2709 H=2709:00 +CPU= 27.395
  10:37:15 STEP 2710 H=2710:00 +CPU= 17.291
  10:37:33 STEP 2711 H=2711:00 +CPU= 17.575
  10:38:05 STEP 2712 H=2712:00 +CPU= 31.355
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_112.zip
Uploading the intermediate file: upload_file_112.zip
  10:38:22 STEP 2713 H=2713:00 +CPU= 16.984
  10:38:40 STEP 2714 H=2714:00 +CPU= 17.891
  10:39:07 STEP 2715 H=2715:00 +CPU= 26.807
  10:39:23 STEP 2716 H=2716:00 +CPU= 16.034
  10:39:39 STEP 2717 H=2717:00 +CPU= 15.991
  10:40:06 STEP 2718 H=2718:00 +CPU= 26.018
  10:40:23 STEP 2719 H=2719:00 +CPU= 17.201
  10:40:41 STEP 2720 H=2720:00 +CPU= 17.737
  10:41:09 STEP 2721 H=2721:00 +CPU= 27.719
  10:41:28 STEP 2722 H=2722:00 +CPU= 18.498
  10:41:46 STEP 2723 H=2723:00 +CPU= 17.236
  10:42:14 STEP 2724 H=2724:00 +CPU= 28.478
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002724
  10:42:31 STEP 2725 H=2725:00 +CPU= 16.627
  10:42:48 STEP 2726 H=2726:00 +CPU= 16.775
  10:43:13 STEP 2727 H=2727:00 +CPU= 25.560
  10:43:31 STEP 2728 H=2728:00 +CPU= 17.139
  10:43:47 STEP 2729 H=2729:00 +CPU= 16.051
  10:44:11 STEP 2730 H=2730:00 +CPU= 24.571
  10:44:26 STEP 2731 H=2731:00 +CPU= 14.796
  10:44:42 STEP 2732 H=2732:00 +CPU= 16.221
  10:45:09 STEP 2733 H=2733:00 +CPU= 25.971
  10:45:25 STEP 2734 H=2734:00 +CPU= 16.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:51:20 STEP 2735 H=2735:00 +CPU= 17.111
  12:51:52 STEP 2736 H=2736:00 +CPU= 31.627
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:52:07 STEP 2737 H=2737:00 +CPU= 15.336
  12:52:23 STEP 2738 H=2738:00 +CPU= 16.406
  12:52:49 STEP 2739 H=2739:00 +CPU= 24.752
  12:53:06 STEP 2740 H=2740:00 +CPU= 16.693
  12:53:22 STEP 2741 H=2741:00 +CPU= 15.774
  12:53:48 STEP 2742 H=2742:00 +CPU= 25.584
  12:54:05 STEP 2743 H=2743:00 +CPU= 17.118
  12:54:22 STEP 2744 H=2744:00 +CPU= 17.462
  12:54:47 STEP 2745 H=2745:00 +CPU= 24.746
  12:55:03 STEP 2746 H=2746:00 +CPU= 15.747
  12:55:19 STEP 2747 H=2747:00 +CPU= 16.014
  12:55:48 STEP 2748 H=2748:00 +CPU= 28.071
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
  12:56:05 STEP 2749 H=2749:00 +CPU= 17.007
  12:56:23 STEP 2750 H=2750:00 +CPU= 17.723
  12:56:48 STEP 2751 H=2751:00 +CPU= 25.794
  12:57:05 STEP 2752 H=2752:00 +CPU= 16.504
  12:57:22 STEP 2753 H=2753:00 +CPU= 16.966
  12:57:47 STEP 2754 H=2754:00 +CPU= 25.240
  12:58:03 STEP 2755 H=2755:00 +CPU= 15.346
  12:58:20 STEP 2756 H=2756:00 +CPU= 17.179
  12:58:47 STEP 2757 H=2757:00 +CPU= 26.151
  12:59:03 STEP 2758 H=2758:00 +CPU= 16.432
  12:59:20 STEP 2759 H=2759:00 +CPU= 16.617
  12:59:51 STEP 2760 H=2760:00 +CPU= 30.333
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:00:07 STEP 2761 H=2761:00 +CPU= 15.396
  13:00:24 STEP 2762 H=2762:00 +CPU= 17.283
  13:00:52 STEP 2763 H=2763:00 +CPU= 27.690
  13:01:09 STEP 2764 H=2764:00 +CPU= 16.650
  13:01:25 STEP 2765 H=2765:00 +CPU= 16.444
  13:01:52 STEP 2766 H=2766:00 +CPU= 26.689
  13:02:09 STEP 2767 H=2767:00 +CPU= 16.546
  13:02:27 STEP 2768 H=2768:00 +CPU= 18.085
  13:02:54 STEP 2769 H=2769:00 +CPU= 26.446
  13:03:12 STEP 2770 H=2770:00 +CPU= 17.314
  13:03:29 STEP 2771 H=2771:00 +CPU= 16.813
  13:03:58 STEP 2772 H=2772:00 +CPU= 28.931
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002772
  13:04:14 STEP 2773 H=2773:00 +CPU= 16.285
  13:04:33 STEP 2774 H=2774:00 +CPU= 18.218
  13:04:59 STEP 2775 H=2775:00 +CPU= 26.408
  13:05:16 STEP 2776 H=2776:00 +CPU= 16.701
  13:05:33 STEP 2777 H=2777:00 +CPU= 17.097
  13:06:00 STEP 2778 H=2778:00 +CPU= 26.816
  13:06:16 STEP 2779 H=2779:00 +CPU= 15.706
  13:06:34 STEP 2780 H=2780:00 +CPU= 17.372
  13:07:01 STEP 2781 H=2781:00 +CPU= 25.639
  13:07:17 STEP 2782 H=2782:00 +CPU= 16.470
  13:07:34 STEP 2783 H=2783:00 +CPU= 16.428
  13:08:05 STEP 2784 H=2784:00 +CPU= 30.451
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:08:21 STEP 2785 H=2785:00 +CPU= 16.011
  13:08:38 STEP 2786 H=2786:00 +CPU= 16.707
  13:09:04 STEP 2787 H=2787:00 +CPU= 26.232
  13:09:21 STEP 2788 H=2788:00 +CPU= 16.807
  13:09:37 STEP 2789 H=2789:00 +CPU= 15.904
  13:10:04 STEP 2790 H=2790:00 +CPU= 26.789
  13:10:21 STEP 2791 H=2791:00 +CPU= 16.368
  13:10:38 STEP 2792 H=2792:00 +CPU= 17.222
  13:11:04 STEP 2793 H=2793:00 +CPU= 25.911
  13:11:22 STEP 2794 H=2794:00 +CPU= 17.204
  13:11:38 STEP 2795 H=2795:00 +CPU= 16.457
  13:12:09 STEP 2796 H=2796:00 +CPU= 30.819
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002796
  13:12:26 STEP 2797 H=2797:00 +CPU= 16.160
  13:12:43 STEP 2798 H=2798:00 +CPU= 17.413
  13:13:08 STEP 2799 H=2799:00 +CPU= 25.182
  13:13:25 STEP 2800 H=2800:00 +CPU= 16.014
  13:13:43 STEP 2801 H=2801:00 +CPU= 18.081
  13:14:10 STEP 2802 H=2802:00 +CPU= 26.663
  13:14:27 STEP 2803 H=2803:00 +CPU= 17.092
  13:14:43 STEP 2804 H=2804:00 +CPU= 15.870
  13:15:08 STEP 2805 H=2805:00 +CPU= 24.744
  13:15:24 STEP 2806 H=2806:00 +CPU= 16.059
  13:15:40 STEP 2807 H=2807:00 +CPU= 15.916
  13:16:10 STEP 2808 H=2808:00 +CPU= 29.959
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:16:27 STEP 2809 H=2809:00 +CPU= 16.189
  13:16:43 STEP 2810 H=2810:00 +CPU= 15.989
  13:17:07 STEP 2811 H=2811:00 +CPU= 24.705
  13:17:24 STEP 2812 H=2812:00 +CPU= 17.034
  13:17:41 STEP 2813 H=2813:00 +CPU= 16.736
  13:18:07 STEP 2814 H=2814:00 +CPU= 25.764
  13:18:23 STEP 2815 H=2815:00 +CPU= 15.889
  13:18:41 STEP 2816 H=2816:00 +CPU= 17.166
  13:19:07 STEP 2817 H=2817:00 +CPU= 26.379
  13:19:24 STEP 2818 H=2818:00 +CPU= 16.998
  13:19:41 STEP 2819 H=2819:00 +CPU= 16.330
  13:20:08 STEP 2820 H=2820:00 +CPU= 26.865
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002820
  13:20:24 STEP 2821 H=2821:00 +CPU= 15.837
  13:20:41 STEP 2822 H=2822:00 +CPU= 17.174
  13:21:06 STEP 2823 H=2823:00 +CPU= 25.065
  13:21:23 STEP 2824 H=2824:00 +CPU= 16.350
  13:21:38 STEP 2825 H=2825:00 +CPU= 15.152
  13:22:04 STEP 2826 H=2826:00 +CPU= 26.016
  13:22:21 STEP 2827 H=2827:00 +CPU= 16.279
  13:22:38 STEP 2828 H=2828:00 +CPU= 16.798
  13:23:04 STEP 2829 H=2829:00 +CPU= 26.242
  13:23:22 STEP 2830 H=2830:00 +CPU= 17.573
  13:23:39 STEP 2831 H=2831:00 +CPU= 17.576
  13:24:10 STEP 2832 H=2832:00 +CPU= 30.681
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:24:27 STEP 2833 H=2833:00 +CPU= 16.403
  13:24:44 STEP 2834 H=2834:00 +CPU= 17.093
  13:25:10 STEP 2835 H=2835:00 +CPU= 25.428
  13:25:27 STEP 2836 H=2836:00 +CPU= 17.025
  13:25:43 STEP 2837 H=2837:00 +CPU= 15.994
  13:26:09 STEP 2838 H=2838:00 +CPU= 26.177
  13:26:25 STEP 2839 H=2839:00 +CPU= 15.798
  13:26:42 STEP 2840 H=2840:00 +CPU= 16.613
  13:27:09 STEP 2841 H=2841:00 +CPU= 26.645
  13:27:26 STEP 2842 H=2842:00 +CPU= 17.136
  13:27:43 STEP 2843 H=2843:00 +CPU= 16.361
  13:28:11 STEP 2844 H=2844:00 +CPU= 28.397
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002844
  13:28:28 STEP 2845 H=2845:00 +CPU= 16.063
  13:28:45 STEP 2846 H=2846:00 +CPU= 16.610
  13:29:10 STEP 2847 H=2847:00 +CPU= 25.100
  13:29:26 STEP 2848 H=2848:00 +CPU= 16.159
  13:29:43 STEP 2849 H=2849:00 +CPU= 16.402
  13:30:09 STEP 2850 H=2850:00 +CPU= 26.005
  13:30:26 STEP 2851 H=2851:00 +CPU= 17.153
  13:30:43 STEP 2852 H=2852:00 +CPU= 16.788
  13:31:08 STEP 2853 H=2853:00 +CPU= 24.746
  13:31:24 STEP 2854 H=2854:00 +CPU= 16.271
  13:31:42 STEP 2855 H=2855:00 +CPU= 17.375
  13:32:12 STEP 2856 H=2856:00 +CPU= 29.435
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:32:29 STEP 2857 H=2857:00 +CPU= 16.984
  13:32:46 STEP 2858 H=2858:00 +CPU= 16.902
  13:33:13 STEP 2859 H=2859:00 +CPU= 26.460
  13:33:30 STEP 2860 H=2860:00 +CPU= 17.380
  13:33:47 STEP 2861 H=2861:00 +CPU= 16.565
  13:34:13 STEP 2862 H=2862:00 +CPU= 26.311
  13:34:28 STEP 2863 H=2863:00 +CPU= 15.090
  13:34:46 STEP 2864 H=2864:00 +CPU= 17.166
  13:35:12 STEP 2865 H=2865:00 +CPU= 26.430
  13:35:29 STEP 2866 H=2866:00 +CPU= 16.616
  13:35:46 STEP 2867 H=2867:00 +CPU= 16.785
  13:36:16 STEP 2868 H=2868:00 +CPU= 28.729
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:38:44 STEP 2869 H=2869:00 +CPU= 16.112
  13:39:02 STEP 2870 H=2870:00 +CPU= 17.477
  13:39:28 STEP 2871 H=2871:00 +CPU= 26.071
  13:39:46 STEP 2872 H=2872:00 +CPU= 18.006
  13:40:03 STEP 2873 H=2873:00 +CPU= 17.070
  13:40:31 STEP 2874 H=2874:00 +CPU= 27.687
  13:40:49 STEP 2875 H=2875:00 +CPU= 17.918
  13:41:06 STEP 2876 H=2876:00 +CPU= 16.264
  13:41:32 STEP 2877 H=2877:00 +CPU= 26.605
  13:41:50 STEP 2878 H=2878:00 +CPU= 17.930
  13:42:09 STEP 2879 H=2879:00 +CPU= 18.381
  13:42:41 STEP 2880 H=2880:00 +CPU= 32.367
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:43:00 STEP 2881 H=2881:00 +CPU= 18.640
Uploading trickle at timestep: 10368000
  13:43:18 STEP 2882 H=2882:00 +CPU= 17.213
  13:43:45 STEP 2883 H=2883:00 +CPU= 27.446
  13:44:03 STEP 2884 H=2884:00 +CPU= 17.558
  13:44:20 STEP 2885 H=2885:00 +CPU= 17.348
  13:44:50 STEP 2886 H=2886:00 +CPU= 29.267
  13:45:10 STEP 2887 H=2887:00 +CPU= 18.913
  13:45:29 STEP 2888 H=2888:00 +CPU= 19.334
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2010050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0990
(argv4) batchid: 979
(argv5) wuid: 12196634
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_2afc937c4b4cac2346f1d7aa62ad3361 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0990_2010050100_123_979_12196634.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0990_2010050100_123_979_12196634.zip
ic_ancil_file: ic_ancil_12196634
ifsdata_file: ifsdata_12196634
climate_data_file: clim_data_12196634
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_1ec658b420363a26f75fb37b9b0fde35 to: /var/lib/boinc-client/slots/0/ic_ancil_12196634.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12196634.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cddda90848e257bb40dd005b878b6d6c to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12196634.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12196634.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12196634.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12196634.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12196634.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12196634.xml
-- Model is restarting --
Adjusting last_iter, 2889, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12196634.xml
last_cpu_time: 58609
upload_file_number: 120
last_iter: 2879
last_upload: 10368000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886
The child process has been launched with process id: 3456
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Mint18:1:1:3456:3456] [20230106:150213:1673042533:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:02:48 STEP 2880 H=2880:00 +CPU= 31.112
  15:03:06 STEP 2881 H=2881:00 +CPU= 17.897
  15:03:25 STEP 2882 H=2882:00 +CPU= 18.944
  15:03:48 STEP 2883 H=2883:00 +CPU= 22.153
  15:04:02 STEP 2884 H=2884:00 +CPU= 13.822
  15:04:15 STEP 2885 H=2885:00 +CPU= 13.576
  15:04:40 STEP 2886 H=2886:00 +CPU= 23.381
  15:04:55 STEP 2887 H=2887:00 +CPU= 15.324
  15:05:11 STEP 2888 H=2888:00 +CPU= 15.279
  15:05:35 STEP 2889 H=2889:00 +CPU= 23.654
  15:05:53 STEP 2890 H=2890:00 +CPU= 16.585
  15:06:09 STEP 2891 H=2891:00 +CPU= 16.175
  15:06:39 STEP 2892 H=2892:00 +CPU= 28.823
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  15:06:56 STEP 2893 H=2893:00 +CPU= 15.844
  15:07:12 STEP 2894 H=2894:00 +CPU= 15.221
  15:07:41 STEP 2895 H=2895:00 +CPU= 28.566
  15:07:58 STEP 2896 H=2896:00 +CPU= 16.821
  15:08:16 STEP 2897 H=2897:00 +CPU= 17.238
  15:08:39 STEP 2898 H=2898:00 +CPU= 22.486
  15:08:53 STEP 2899 H=2899:00 +CPU= 13.588
  15:09:07 STEP 2900 H=2900:00 +CPU= 13.869
  15:09:32 STEP 2901 H=2901:00 +CPU= 23.815
  15:09:49 STEP 2902 H=2902:00 +CPU= 16.535
  15:10:06 STEP 2903 H=2903:00 +CPU= 16.769
  15:10:37 STEP 2904 H=2904:00 +CPU= 29.685
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_120.zip
Uploading the intermediate file: upload_file_120.zip
  15:10:54 STEP 2905 H=2905:00 +CPU= 16.524
  15:11:14 STEP 2906 H=2906:00 +CPU= 19.456
  15:11:44 STEP 2907 H=2907:00 +CPU= 28.887
  15:12:04 STEP 2908 H=2908:00 +CPU= 19.076
  15:12:21 STEP 2909 H=2909:00 +CPU= 17.241
  15:12:45 STEP 2910 H=2910:00 +CPU= 23.631
  15:12:59 STEP 2911 H=2911:00 +CPU= 13.437
  15:13:14 STEP 2912 H=2912:00 +CPU= 14.950
  15:13:42 STEP 2913 H=2913:00 +CPU= 26.886
  15:13:58 STEP 2914 H=2914:00 +CPU= 16.276
  15:14:15 STEP 2915 H=2915:00 +CPU= 16.129
  15:14:50 STEP 2916 H=2916:00 +CPU= 34.017
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
  15:15:13 STEP 2917 H=2917:00 +CPU= 20.841
  15:15:30 STEP 2918 H=2918:00 +CPU= 16.969
  15:15:56 STEP 2919 H=2919:00 +CPU= 24.619
  15:16:11 STEP 2920 H=2920:00 +CPU= 14.049
  15:16:25 STEP 2921 H=2921:00 +CPU= 14.017
  15:16:53 STEP 2922 H=2922:00 +CPU= 25.134
  15:17:15 STEP 2923 H=2923:00 +CPU= 19.643
  15:17:35 STEP 2924 H=2924:00 +CPU= 18.876
  15:17:58 STEP 2925 H=2925:00 +CPU= 22.562
  15:18:13 STEP 2926 H=2926:00 +CPU= 14.877
  15:18:33 STEP 2927 H=2927:00 +CPU= 18.886
  15:19:08 STEP 2928 H=2928:00 +CPU= 33.488
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_121.zip
Uploading the intermediate file: upload_file_121.zip
  15:19:29 STEP 2929 H=2929:00 +CPU= 19.927
  15:19:48 STEP 2930 H=2930:00 +CPU= 17.703
  15:20:10 STEP 2931 H=2931:00 +CPU= 21.539
  15:20:23 STEP 2932 H=2932:00 +CPU= 12.832
  15:20:42 STEP 2933 H=2933:00 +CPU= 17.902
  15:21:10 STEP 2934 H=2934:00 +CPU= 27.473
  15:21:25 STEP 2935 H=2935:00 +CPU= 14.535
  15:21:42 STEP 2936 H=2936:00 +CPU= 15.859
  15:22:09 STEP 2937 H=2937:00 +CPU= 26.732
  15:22:28 STEP 2938 H=2938:00 +CPU= 17.632
  15:22:46 STEP 2939 H=2939:00 +CPU= 17.477
  15:23:16 STEP 2940 H=2940:00 +CPU= 28.622
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002940
  15:23:35 STEP 2941 H=2941:00 +CPU= 18.258
  15:23:54 STEP 2942 H=2942:00 +CPU= 18.818
  15:24:26 STEP 2943 H=2943:00 +CPU= 29.903
  15:24:45 STEP 2944 H=2944:00 +CPU= 18.470
  15:25:06 STEP 2945 H=2945:00 +CPU= 19.471
  15:25:34 STEP 2946 H=2946:00 +CPU= 25.805
  15:25:52 STEP 2947 H=2947:00 +CPU= 17.067
  15:26:10 STEP 2948 H=2948:00 +CPU= 17.171
  15:26:40 STEP 2949 H=2949:00 +CPU= 28.223
  15:26:59 STEP 2950 H=2950:00 +CPU= 17.967
  15:27:21 STEP 2951 H=2951:00 +CPU= 20.234
  15:27:58 STEP 2952 H=2952:00 +CPU= 34.818
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196634/ICMSHhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0990_2010050100_123_979_12196634_0_r801474886_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
15:31:22 (3434): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:11:00 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 10,623,600 60,093 0.0057
09 May 2023 16:10:57 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 10,368,000 58,438 0.0056
09 May 2023 16:10:43 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 9,504,000 53,549 0.0056
09 May 2023 16:10:37 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 8,640,000 48,427 0.0056
09 May 2023 16:10:25 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 7,776,000 43,231 0.0056
09 May 2023 16:10:19 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 6,912,000 38,484 0.0056
09 May 2023 16:10:15 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 6,048,000 33,856 0.0056
09 May 2023 16:10:09 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 5,184,000 28,699 0.0055
09 May 2023 16:09:54 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 4,320,000 23,874 0.0055
09 May 2023 16:09:49 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 3,456,000 19,094 0.0055
09 May 2023 16:09:44 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 2,592,000 14,255 0.0055
09 May 2023 16:09:32 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 1,728,000 9,534 0.0055
09 May 2023 16:09:28 1534496 22282623 oifs_43r3_ps_0990_2010050100_123_979_12196634_0 864,000 4,766 0.0055


©2024 climateprediction.net