climateprediction.net home page
Task 22298298

Task 22298298

Name oifs_43r3_ps_0440_1982050100_123_951_12168084_1
Workunit 12168084
Created 15 Jan 2023, 20:39:14 UTC
Sent 15 Jan 2023, 21:10:24 UTC
Report deadline 14 Feb 2023, 21:10:24 UTC
Received 16 Jan 2023, 17:43:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532237
Run time 18 hours 49 min 10 sec
CPU time 16 hours 57 min 53 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,401.63 MB
Peak swap size 4,978.08 MB
Peak disk usage 6,075.16 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
8084_1_r695931999_100.zip
Uploading the intermediate file: upload_file_100.zip
  07:03:32 STEP 2425 H=2425:00 +CPU= 16.413
Uploading trickle at timestep: 8726400
  07:03:50 STEP 2426 H=2426:00 +CPU= 16.684
  07:04:18 STEP 2427 H=2427:00 +CPU= 25.769
  07:04:37 STEP 2428 H=2428:00 +CPU= 17.188
  07:04:55 STEP 2429 H=2429:00 +CPU= 16.076
  07:05:22 STEP 2430 H=2430:00 +CPU= 25.257
  07:05:40 STEP 2431 H=2431:00 +CPU= 16.540
  07:05:58 STEP 2432 H=2432:00 +CPU= 16.933
  07:06:25 STEP 2433 H=2433:00 +CPU= 25.003
  07:06:44 STEP 2434 H=2434:00 +CPU= 17.079
  07:07:01 STEP 2435 H=2435:00 +CPU= 16.461
  07:07:31 STEP 2436 H=2436:00 +CPU= 27.233
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002436
  07:07:49 STEP 2437 H=2437:00 +CPU= 16.610
  07:08:07 STEP 2438 H=2438:00 +CPU= 16.648
  07:08:34 STEP 2439 H=2439:00 +CPU= 24.997
  07:08:52 STEP 2440 H=2440:00 +CPU= 16.762
  07:09:09 STEP 2441 H=2441:00 +CPU= 15.883
  07:09:36 STEP 2442 H=2442:00 +CPU= 25.549
  07:09:54 STEP 2443 H=2443:00 +CPU= 16.584
  07:10:12 STEP 2444 H=2444:00 +CPU= 16.719
  07:10:39 STEP 2445 H=2445:00 +CPU= 24.579
  07:10:57 STEP 2446 H=2446:00 +CPU= 16.931
  07:11:15 STEP 2447 H=2447:00 +CPU= 16.778
  07:11:47 STEP 2448 H=2448:00 +CPU= 29.073
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_101.zip
Uploading the intermediate file: upload_file_101.zip
  07:12:04 STEP 2449 H=2449:00 +CPU= 16.128
  07:12:22 STEP 2450 H=2450:00 +CPU= 16.220
  07:12:48 STEP 2451 H=2451:00 +CPU= 24.600
  07:13:06 STEP 2452 H=2452:00 +CPU= 16.686
  07:13:23 STEP 2453 H=2453:00 +CPU= 15.928
  07:13:50 STEP 2454 H=2454:00 +CPU= 25.399
  07:14:08 STEP 2455 H=2455:00 +CPU= 16.566
  07:14:26 STEP 2456 H=2456:00 +CPU= 16.498
  07:14:53 STEP 2457 H=2457:00 +CPU= 24.540
  07:15:10 STEP 2458 H=2458:00 +CPU= 16.472
  07:15:28 STEP 2459 H=2459:00 +CPU= 16.410
  07:15:58 STEP 2460 H=2460:00 +CPU= 27.391
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002460
  07:16:16 STEP 2461 H=2461:00 +CPU= 16.782
  07:16:34 STEP 2462 H=2462:00 +CPU= 16.774
  07:17:00 STEP 2463 H=2463:00 +CPU= 24.744
  07:17:19 STEP 2464 H=2464:00 +CPU= 16.831
  07:17:36 STEP 2465 H=2465:00 +CPU= 16.579
  07:18:04 STEP 2466 H=2466:00 +CPU= 25.348
  07:18:22 STEP 2467 H=2467:00 +CPU= 16.633
  07:18:39 STEP 2468 H=2468:00 +CPU= 16.346
  07:19:06 STEP 2469 H=2469:00 +CPU= 24.806
  07:19:24 STEP 2470 H=2470:00 +CPU= 16.788
  07:19:43 STEP 2471 H=2471:00 +CPU= 17.157
  07:20:14 STEP 2472 H=2472:00 +CPU= 29.046
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_102.zip
Uploading the intermediate file: upload_file_102.zip
  07:20:32 STEP 2473 H=2473:00 +CPU= 16.401
  07:20:50 STEP 2474 H=2474:00 +CPU= 16.387
  07:21:17 STEP 2475 H=2475:00 +CPU= 24.871
  07:21:34 STEP 2476 H=2476:00 +CPU= 16.533
  07:21:52 STEP 2477 H=2477:00 +CPU= 16.060
  07:22:19 STEP 2478 H=2478:00 +CPU= 25.251
  07:22:37 STEP 2479 H=2479:00 +CPU= 16.558
  07:22:55 STEP 2480 H=2480:00 +CPU= 16.694
  07:23:21 STEP 2481 H=2481:00 +CPU= 24.934
  07:23:40 STEP 2482 H=2482:00 +CPU= 17.378
  07:23:58 STEP 2483 H=2483:00 +CPU= 16.581
  07:24:28 STEP 2484 H=2484:00 +CPU= 27.896
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002484
  07:24:47 STEP 2485 H=2485:00 +CPU= 16.962
  07:25:04 STEP 2486 H=2486:00 +CPU= 16.300
  07:25:30 STEP 2487 H=2487:00 +CPU= 23.975
  07:25:47 STEP 2488 H=2488:00 +CPU= 16.385
  07:26:05 STEP 2489 H=2489:00 +CPU= 16.266
  07:26:33 STEP 2490 H=2490:00 +CPU= 26.004
  07:26:51 STEP 2491 H=2491:00 +CPU= 16.003
  07:27:08 STEP 2492 H=2492:00 +CPU= 16.498
  07:27:35 STEP 2493 H=2493:00 +CPU= 24.458
  07:27:53 STEP 2494 H=2494:00 +CPU= 17.096
  07:28:11 STEP 2495 H=2495:00 +CPU= 16.933
  07:28:43 STEP 2496 H=2496:00 +CPU= 29.224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_103.zip
Uploading the intermediate file: upload_file_103.zip
  07:29:01 STEP 2497 H=2497:00 +CPU= 16.493
  07:29:19 STEP 2498 H=2498:00 +CPU= 16.406
  07:29:45 STEP 2499 H=2499:00 +CPU= 24.625
  07:30:03 STEP 2500 H=2500:00 +CPU= 16.697
  07:30:20 STEP 2501 H=2501:00 +CPU= 15.862
  07:30:47 STEP 2502 H=2502:00 +CPU= 25.108
  07:31:04 STEP 2503 H=2503:00 +CPU= 16.234
  07:31:23 STEP 2504 H=2504:00 +CPU= 16.788
  07:31:49 STEP 2505 H=2505:00 +CPU= 24.588
  07:32:07 STEP 2506 H=2506:00 +CPU= 16.643
  07:32:25 STEP 2507 H=2507:00 +CPU= 16.347
  07:32:55 STEP 2508 H=2508:00 +CPU= 27.614
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002508
  07:33:12 STEP 2509 H=2509:00 +CPU= 16.232
  07:33:30 STEP 2510 H=2510:00 +CPU= 17.060
  07:33:57 STEP 2511 H=2511:00 +CPU= 24.955
  07:34:15 STEP 2512 H=2512:00 +CPU= 16.658
  07:34:33 STEP 2513 H=2513:00 +CPU= 16.330
  07:35:00 STEP 2514 H=2514:00 +CPU= 25.088
  07:35:17 STEP 2515 H=2515:00 +CPU= 16.562
  07:35:35 STEP 2516 H=2516:00 +CPU= 16.695
  07:36:02 STEP 2517 H=2517:00 +CPU= 24.735
  07:36:20 STEP 2518 H=2518:00 +CPU= 16.648
  07:36:38 STEP 2519 H=2519:00 +CPU= 16.883
  07:37:09 STEP 2520 H=2520:00 +CPU= 28.912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_104.zip
Uploading the intermediate file: upload_file_104.zip
  07:37:27 STEP 2521 H=2521:00 +CPU= 16.236
  07:37:45 STEP 2522 H=2522:00 +CPU= 16.625
  07:38:11 STEP 2523 H=2523:00 +CPU= 24.893
  07:38:30 STEP 2524 H=2524:00 +CPU= 16.779
  07:38:47 STEP 2525 H=2525:00 +CPU= 16.153
  07:39:14 STEP 2526 H=2526:00 +CPU= 25.312
  07:39:32 STEP 2527 H=2527:00 +CPU= 16.287
  07:39:49 STEP 2528 H=2528:00 +CPU= 16.642
  07:40:18 STEP 2529 H=2529:00 +CPU= 25.237
  07:40:36 STEP 2530 H=2530:00 +CPU= 17.013
  07:40:54 STEP 2531 H=2531:00 +CPU= 16.367
  07:41:24 STEP 2532 H=2532:00 +CPU= 27.768
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532
  07:41:41 STEP 2533 H=2533:00 +CPU= 16.623
  07:42:00 STEP 2534 H=2534:00 +CPU= 17.078
  07:42:27 STEP 2535 H=2535:00 +CPU= 25.030
  07:42:45 STEP 2536 H=2536:00 +CPU= 16.930
  07:43:03 STEP 2537 H=2537:00 +CPU= 16.310
  07:43:31 STEP 2538 H=2538:00 +CPU= 25.694
  07:43:49 STEP 2539 H=2539:00 +CPU= 16.684
  07:44:07 STEP 2540 H=2540:00 +CPU= 17.145
  07:44:34 STEP 2541 H=2541:00 +CPU= 24.654
  07:44:52 STEP 2542 H=2542:00 +CPU= 16.970
  07:45:10 STEP 2543 H=2543:00 +CPU= 16.924
  07:45:42 STEP 2544 H=2544:00 +CPU= 28.893
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_105.zip
Uploading the intermediate file: upload_file_105.zip
  07:46:00 STEP 2545 H=2545:00 +CPU= 16.586
  07:46:16 STEP 2546 H=2546:00 +CPU= 15.727
  07:46:42 STEP 2547 H=2547:00 +CPU= 23.680
  07:47:01 STEP 2548 H=2548:00 +CPU= 17.327
  07:47:19 STEP 2549 H=2549:00 +CPU= 16.435
  07:47:46 STEP 2550 H=2550:00 +CPU= 25.158
  07:48:03 STEP 2551 H=2551:00 +CPU= 16.242
  07:48:22 STEP 2552 H=2552:00 +CPU= 16.985
  07:48:49 STEP 2553 H=2553:00 +CPU= 25.260
  07:49:07 STEP 2554 H=2554:00 +CPU= 16.445
  07:49:24 STEP 2555 H=2555:00 +CPU= 16.041
  07:49:54 STEP 2556 H=2556:00 +CPU= 27.800
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556
  07:50:12 STEP 2557 H=2557:00 +CPU= 16.701
  07:50:31 STEP 2558 H=2558:00 +CPU= 16.981
  07:50:57 STEP 2559 H=2559:00 +CPU= 24.870
  07:51:15 STEP 2560 H=2560:00 +CPU= 16.856
  07:51:33 STEP 2561 H=2561:00 +CPU= 16.514
  07:52:01 STEP 2562 H=2562:00 +CPU= 25.447
  07:52:19 STEP 2563 H=2563:00 +CPU= 16.707
  07:52:37 STEP 2564 H=2564:00 +CPU= 16.558
  07:53:03 STEP 2565 H=2565:00 +CPU= 24.592
  07:53:21 STEP 2566 H=2566:00 +CPU= 16.828
  07:53:40 STEP 2567 H=2567:00 +CPU= 17.181
  07:54:11 STEP 2568 H=2568:00 +CPU= 28.681
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_106.zip
Uploading the intermediate file: upload_file_106.zip
  07:54:28 STEP 2569 H=2569:00 +CPU= 16.106
  07:54:46 STEP 2570 H=2570:00 +CPU= 16.329
  07:55:12 STEP 2571 H=2571:00 +CPU= 24.515
  07:55:30 STEP 2572 H=2572:00 +CPU= 16.997
  07:55:48 STEP 2573 H=2573:00 +CPU= 16.021
  07:56:15 STEP 2574 H=2574:00 +CPU= 25.094
  07:56:33 STEP 2575 H=2575:00 +CPU= 16.582
  07:56:51 STEP 2576 H=2576:00 +CPU= 16.430
  07:57:18 STEP 2577 H=2577:00 +CPU= 24.898
  07:57:35 STEP 2578 H=2578:00 +CPU= 16.064
  07:57:53 STEP 2579 H=2579:00 +CPU= 16.924
  07:58:22 STEP 2580 H=2580:00 +CPU= 27.356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580
  07:58:40 STEP 2581 H=2581:00 +CPU= 16.637
  07:58:59 STEP 2582 H=2582:00 +CPU= 16.851
  07:59:25 STEP 2583 H=2583:00 +CPU= 24.779
  07:59:43 STEP 2584 H=2584:00 +CPU= 16.367
  08:00:01 STEP 2585 H=2585:00 +CPU= 16.367
  08:00:28 STEP 2586 H=2586:00 +CPU= 25.477
  08:00:45 STEP 2587 H=2587:00 +CPU= 16.224
  08:01:03 STEP 2588 H=2588:00 +CPU= 16.371
  08:01:30 STEP 2589 H=2589:00 +CPU= 24.900
  08:01:48 STEP 2590 H=2590:00 +CPU= 16.682
  08:02:06 STEP 2591 H=2591:00 +CPU= 16.905
  08:02:38 STEP 2592 H=2592:00 +CPU= 29.091
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_107.zip
Uploading the intermediate file: upload_file_107.zip
  08:02:56 STEP 2593 H=2593:00 +CPU= 16.523
  08:03:13 STEP 2594 H=2594:00 +CPU= 16.383
  08:03:40 STEP 2595 H=2595:00 +CPU= 25.157
  08:03:59 STEP 2596 H=2596:00 +CPU= 17.153
  08:04:17 STEP 2597 H=2597:00 +CPU= 16.331
  08:04:44 STEP 2598 H=2598:00 +CPU= 25.319
  08:05:01 STEP 2599 H=2599:00 +CPU= 16.162
  08:05:19 STEP 2600 H=2600:00 +CPU= 16.743
  08:05:46 STEP 2601 H=2601:00 +CPU= 24.820
  08:06:04 STEP 2602 H=2602:00 +CPU= 16.271
  08:06:22 STEP 2603 H=2603:00 +CPU= 16.660
  08:06:52 STEP 2604 H=2604:00 +CPU= 27.944
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604
  08:07:10 STEP 2605 H=2605:00 +CPU= 16.446
  08:07:28 STEP 2606 H=2606:00 +CPU= 16.789
  08:07:55 STEP 2607 H=2607:00 +CPU= 25.184
  08:08:13 STEP 2608 H=2608:00 +CPU= 16.618
  08:08:31 STEP 2609 H=2609:00 +CPU= 16.852
  08:08:58 STEP 2610 H=2610:00 +CPU= 25.276
  08:09:15 STEP 2611 H=2611:00 +CPU= 15.801
  08:09:33 STEP 2612 H=2612:00 +CPU= 16.453
  08:10:00 STEP 2613 H=2613:00 +CPU= 25.157
  08:10:18 STEP 2614 H=2614:00 +CPU= 16.988
  08:10:37 STEP 2615 H=2615:00 +CPU= 17.236
  08:11:09 STEP 2616 H=2616:00 +CPU= 29.093
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_108.zip
Uploading the intermediate file: upload_file_108.zip
  08:11:26 STEP 2617 H=2617:00 +CPU= 16.410
  08:11:44 STEP 2618 H=2618:00 +CPU= 16.508
  08:12:10 STEP 2619 H=2619:00 +CPU= 24.477
  08:12:29 STEP 2620 H=2620:00 +CPU= 16.847
  08:12:46 STEP 2621 H=2621:00 +CPU= 16.228
  08:13:13 STEP 2622 H=2622:00 +CPU= 25.374
  08:13:31 STEP 2623 H=2623:00 +CPU= 16.446
  08:13:49 STEP 2624 H=2624:00 +CPU= 16.587
  08:14:16 STEP 2625 H=2625:00 +CPU= 25.182
  08:14:35 STEP 2626 H=2626:00 +CPU= 17.184
  08:14:53 STEP 2627 H=2627:00 +CPU= 16.844
  08:15:23 STEP 2628 H=2628:00 +CPU= 28.011
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628
  08:15:40 STEP 2629 H=2629:00 +CPU= 15.798
  08:15:57 STEP 2630 H=2630:00 +CPU= 16.018
  08:16:24 STEP 2631 H=2631:00 +CPU= 24.698
  08:16:42 STEP 2632 H=2632:00 +CPU= 17.188
  08:17:00 STEP 2633 H=2633:00 +CPU= 16.263
  08:17:27 STEP 2634 H=2634:00 +CPU= 25.471
  08:17:46 STEP 2635 H=2635:00 +CPU= 17.024
  08:18:04 STEP 2636 H=2636:00 +CPU= 16.779
  08:18:31 STEP 2637 H=2637:00 +CPU= 25.035
  08:18:49 STEP 2638 H=2638:00 +CPU= 16.854
  08:19:07 STEP 2639 H=2639:00 +CPU= 17.034
  08:19:40 STEP 2640 H=2640:00 +CPU= 29.688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_109.zip
Uploading the intermediate file: upload_file_109.zip
  08:19:59 STEP 2641 H=2641:00 +CPU= 17.168
  08:20:16 STEP 2642 H=2642:00 +CPU= 16.220
  08:20:42 STEP 2643 H=2643:00 +CPU= 24.633
  08:21:00 STEP 2644 H=2644:00 +CPU= 16.779
  08:21:18 STEP 2645 H=2645:00 +CPU= 15.872
  08:21:45 STEP 2646 H=2646:00 +CPU= 25.334
  08:22:02 STEP 2647 H=2647:00 +CPU= 15.972
  08:22:20 STEP 2648 H=2648:00 +CPU= 16.909
  08:22:48 STEP 2649 H=2649:00 +CPU= 25.221
  08:23:06 STEP 2650 H=2650:00 +CPU= 16.764
  08:23:24 STEP 2651 H=2651:00 +CPU= 16.550
  08:23:53 STEP 2652 H=2652:00 +CPU= 27.522
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652
  08:24:11 STEP 2653 H=2653:00 +CPU= 16.610
  08:24:29 STEP 2654 H=2654:00 +CPU= 16.728
  08:24:57 STEP 2655 H=2655:00 +CPU= 25.213
  08:25:15 STEP 2656 H=2656:00 +CPU= 16.608
  08:25:33 STEP 2657 H=2657:00 +CPU= 16.537
  08:26:00 STEP 2658 H=2658:00 +CPU= 25.407
  08:26:18 STEP 2659 H=2659:00 +CPU= 16.250
  08:26:36 STEP 2660 H=2660:00 +CPU= 16.754
  08:27:03 STEP 2661 H=2661:00 +CPU= 24.695
  08:27:21 STEP 2662 H=2662:00 +CPU= 16.615
  08:27:39 STEP 2663 H=2663:00 +CPU= 17.348
  08:28:11 STEP 2664 H=2664:00 +CPU= 29.158
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_110.zip
Uploading the intermediate file: upload_file_110.zip
  08:28:28 STEP 2665 H=2665:00 +CPU= 16.016
Uploading trickle at timestep: 9590400
  08:28:46 STEP 2666 H=2666:00 +CPU= 16.795
  08:29:13 STEP 2667 H=2667:00 +CPU= 24.929
  08:29:32 STEP 2668 H=2668:00 +CPU= 17.219
  08:29:48 STEP 2669 H=2669:00 +CPU= 15.503
  08:30:16 STEP 2670 H=2670:00 +CPU= 25.453
  08:30:35 STEP 2671 H=2671:00 +CPU= 17.078
  08:30:53 STEP 2672 H=2672:00 +CPU= 16.801
  08:31:20 STEP 2673 H=2673:00 +CPU= 24.964
  08:31:39 STEP 2674 H=2674:00 +CPU= 17.016
  08:31:56 STEP 2675 H=2675:00 +CPU= 16.610
  08:32:26 STEP 2676 H=2676:00 +CPU= 27.328
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676
  08:32:44 STEP 2677 H=2677:00 +CPU= 16.455
  08:33:01 STEP 2678 H=2678:00 +CPU= 16.406
  08:33:28 STEP 2679 H=2679:00 +CPU= 24.781
  08:33:46 STEP 2680 H=2680:00 +CPU= 16.727
  08:34:03 STEP 2681 H=2681:00 +CPU= 16.099
  08:34:30 STEP 2682 H=2682:00 +CPU= 25.340
  08:34:49 STEP 2683 H=2683:00 +CPU= 16.764
  08:35:07 STEP 2684 H=2684:00 +CPU= 16.780
  08:35:34 STEP 2685 H=2685:00 +CPU= 25.274
  08:35:52 STEP 2686 H=2686:00 +CPU= 17.007
  08:36:10 STEP 2687 H=2687:00 +CPU= 16.838
  08:36:43 STEP 2688 H=2688:00 +CPU= 29.212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_111.zip
Uploading the intermediate file: upload_file_111.zip
  08:37:01 STEP 2689 H=2689:00 +CPU= 16.600
  08:37:18 STEP 2690 H=2690:00 +CPU= 16.177
  08:37:44 STEP 2691 H=2691:00 +CPU= 24.005
  08:38:02 STEP 2692 H=2692:00 +CPU= 16.770
  08:38:19 STEP 2693 H=2693:00 +CPU= 16.134
  08:38:47 STEP 2694 H=2694:00 +CPU= 25.660
  08:39:05 STEP 2695 H=2695:00 +CPU= 16.939
  08:39:23 STEP 2696 H=2696:00 +CPU= 16.590
  08:39:51 STEP 2697 H=2697:00 +CPU= 25.301
  08:40:10 STEP 2698 H=2698:00 +CPU= 17.029
  08:40:27 STEP 2699 H=2699:00 +CPU= 16.509
  08:40:56 STEP 2700 H=2700:00 +CPU= 26.704
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002700
  08:41:14 STEP 2701 H=2701:00 +CPU= 16.558
  08:41:31 STEP 2702 H=2702:00 +CPU= 16.582
  08:41:58 STEP 2703 H=2703:00 +CPU= 24.658
  08:42:16 STEP 2704 H=2704:00 +CPU= 17.061
  08:42:33 STEP 2705 H=2705:00 +CPU= 15.696
  08:43:02 STEP 2706 H=2706:00 +CPU= 26.172
  08:43:20 STEP 2707 H=2707:00 +CPU= 16.432
  08:43:38 STEP 2708 H=2708:00 +CPU= 17.023
  08:44:04 STEP 2709 H=2709:00 +CPU= 24.225
  08:44:22 STEP 2710 H=2710:00 +CPU= 16.964
  08:44:41 STEP 2711 H=2711:00 +CPU= 17.169
  08:45:13 STEP 2712 H=2712:00 +CPU= 29.102
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_112.zip
Uploading the intermediate file: upload_file_112.zip
  08:45:30 STEP 2713 H=2713:00 +CPU= 16.065
  08:45:48 STEP 2714 H=2714:00 +CPU= 16.679
  08:46:15 STEP 2715 H=2715:00 +CPU= 24.916
  08:46:34 STEP 2716 H=2716:00 +CPU= 16.954
  08:46:51 STEP 2717 H=2717:00 +CPU= 16.583
  08:47:19 STEP 2718 H=2718:00 +CPU= 25.324
  08:47:37 STEP 2719 H=2719:00 +CPU= 16.790
  08:47:55 STEP 2720 H=2720:00 +CPU= 16.874
  08:48:22 STEP 2721 H=2721:00 +CPU= 25.128
  08:48:40 STEP 2722 H=2722:00 +CPU= 16.578
  08:48:58 STEP 2723 H=2723:00 +CPU= 16.814
  08:49:28 STEP 2724 H=2724:00 +CPU= 27.687
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002724
  08:49:46 STEP 2725 H=2725:00 +CPU= 16.687
  08:50:04 STEP 2726 H=2726:00 +CPU= 16.873
  08:50:30 STEP 2727 H=2727:00 +CPU= 24.544
  08:50:48 STEP 2728 H=2728:00 +CPU= 16.576
  08:51:06 STEP 2729 H=2729:00 +CPU= 16.348
  08:51:34 STEP 2730 H=2730:00 +CPU= 25.608
  08:51:51 STEP 2731 H=2731:00 +CPU= 16.410
  08:52:09 STEP 2732 H=2732:00 +CPU= 16.397
  08:52:37 STEP 2733 H=2733:00 +CPU= 25.364
  08:52:55 STEP 2734 H=2734:00 +CPU= 17.031
  08:53:13 STEP 2735 H=2735:00 +CPU= 16.792
  08:53:44 STEP 2736 H=2736:00 +CPU= 28.688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_113.zip
Uploading the intermediate file: upload_file_113.zip
  08:54:02 STEP 2737 H=2737:00 +CPU= 16.071
  08:54:19 STEP 2738 H=2738:00 +CPU= 16.124
  08:54:45 STEP 2739 H=2739:00 +CPU= 24.226
  08:55:03 STEP 2740 H=2740:00 +CPU= 16.746
  08:55:20 STEP 2741 H=2741:00 +CPU= 16.143
  08:55:48 STEP 2742 H=2742:00 +CPU= 25.607
  08:56:06 STEP 2743 H=2743:00 +CPU= 16.714
  08:56:25 STEP 2744 H=2744:00 +CPU= 17.018
  08:56:51 STEP 2745 H=2745:00 +CPU= 24.724
  08:57:09 STEP 2746 H=2746:00 +CPU= 16.737
  08:57:27 STEP 2747 H=2747:00 +CPU= 16.630
  08:57:57 STEP 2748 H=2748:00 +CPU= 27.560
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
  08:58:15 STEP 2749 H=2749:00 +CPU= 16.308
  08:58:32 STEP 2750 H=2750:00 +CPU= 16.559
  08:59:00 STEP 2751 H=2751:00 +CPU= 25.511
  08:59:20 STEP 2752 H=2752:00 +CPU= 17.426
  08:59:38 STEP 2753 H=2753:00 +CPU= 16.940
  09:00:05 STEP 2754 H=2754:00 +CPU= 25.190
  09:00:23 STEP 2755 H=2755:00 +CPU= 16.540
  09:00:41 STEP 2756 H=2756:00 +CPU= 16.785
  09:01:08 STEP 2757 H=2757:00 +CPU= 25.119
  09:01:27 STEP 2758 H=2758:00 +CPU= 16.954
  09:01:45 STEP 2759 H=2759:00 +CPU= 16.892
  09:02:17 STEP 2760 H=2760:00 +CPU= 29.403
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_114.zip
Uploading the intermediate file: upload_file_114.zip
  09:02:35 STEP 2761 H=2761:00 +CPU= 16.396
  09:02:52 STEP 2762 H=2762:00 +CPU= 16.537
  09:03:18 STEP 2763 H=2763:00 +CPU= 24.370
  09:03:37 STEP 2764 H=2764:00 +CPU= 17.205
  09:03:54 STEP 2765 H=2765:00 +CPU= 15.785
  09:04:21 STEP 2766 H=2766:00 +CPU= 25.096
  09:04:39 STEP 2767 H=2767:00 +CPU= 16.772
  09:04:57 STEP 2768 H=2768:00 +CPU= 16.276
  09:05:25 STEP 2769 H=2769:00 +CPU= 25.259
  09:05:43 STEP 2770 H=2770:00 +CPU= 16.936
  09:06:01 STEP 2771 H=2771:00 +CPU= 16.565
  09:06:30 STEP 2772 H=2772:00 +CPU= 27.222
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002772
  09:06:48 STEP 2773 H=2773:00 +CPU= 16.742
  09:07:06 STEP 2774 H=2774:00 +CPU= 17.094
  09:07:33 STEP 2775 H=2775:00 +CPU= 24.812
  09:07:51 STEP 2776 H=2776:00 +CPU= 16.505
  09:08:09 STEP 2777 H=2777:00 +CPU= 16.262
  09:08:38 STEP 2778 H=2778:00 +CPU= 26.118
  09:08:56 STEP 2779 H=2779:00 +CPU= 16.417
  09:09:13 STEP 2780 H=2780:00 +CPU= 16.509
  09:09:40 STEP 2781 H=2781:00 +CPU= 24.897
  09:09:59 STEP 2782 H=2782:00 +CPU= 17.224
  09:10:17 STEP 2783 H=2783:00 +CPU= 17.058
  09:10:49 STEP 2784 H=2784:00 +CPU= 29.518
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_115.zip
Uploading the intermediate file: upload_file_115.zip
  09:11:07 STEP 2785 H=2785:00 +CPU= 16.597
  09:11:24 STEP 2786 H=2786:00 +CPU= 16.078
  09:11:51 STEP 2787 H=2787:00 +CPU= 24.440
  09:12:09 STEP 2788 H=2788:00 +CPU= 16.767
  09:12:26 STEP 2789 H=2789:00 +CPU= 16.328
  09:12:54 STEP 2790 H=2790:00 +CPU= 25.805
  09:13:12 STEP 2791 H=2791:00 +CPU= 16.486
  09:13:31 STEP 2792 H=2792:00 +CPU= 16.850
  09:13:58 STEP 2793 H=2793:00 +CPU= 25.525
  09:14:18 STEP 2794 H=2794:00 +CPU= 17.224
  09:14:35 STEP 2795 H=2795:00 +CPU= 15.684
  09:15:03 STEP 2796 H=2796:00 +CPU= 26.222
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002796
  09:15:19 STEP 2797 H=2797:00 +CPU= 15.479
  09:15:37 STEP 2798 H=2798:00 +CPU= 15.825
  09:16:02 STEP 2799 H=2799:00 +CPU= 23.629
  09:16:19 STEP 2800 H=2800:00 +CPU= 15.816
  09:16:35 STEP 2801 H=2801:00 +CPU= 15.101
  09:17:02 STEP 2802 H=2802:00 +CPU= 24.060
  09:17:17 STEP 2803 H=2803:00 +CPU= 14.896
  09:17:33 STEP 2804 H=2804:00 +CPU= 14.750
  09:17:57 STEP 2805 H=2805:00 +CPU= 22.145
  09:18:12 STEP 2806 H=2806:00 +CPU= 14.691
  09:18:28 STEP 2807 H=2807:00 +CPU= 14.891
  09:18:57 STEP 2808 H=2808:00 +CPU= 26.660
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_116.zip
Uploading the intermediate file: upload_file_116.zip
  09:19:12 STEP 2809 H=2809:00 +CPU= 14.141
  09:19:27 STEP 2810 H=2810:00 +CPU= 14.431
  09:19:51 STEP 2811 H=2811:00 +CPU= 21.845
  09:20:07 STEP 2812 H=2812:00 +CPU= 14.906
  09:20:22 STEP 2813 H=2813:00 +CPU= 14.283
  09:20:47 STEP 2814 H=2814:00 +CPU= 22.776
  09:21:03 STEP 2815 H=2815:00 +CPU= 14.407
  09:21:19 STEP 2816 H=2816:00 +CPU= 14.711
  09:21:43 STEP 2817 H=2817:00 +CPU= 22.245
  09:21:58 STEP 2818 H=2818:00 +CPU= 14.661
  09:22:13 STEP 2819 H=2819:00 +CPU= 14.268
  09:22:40 STEP 2820 H=2820:00 +CPU= 24.746
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002820
  09:22:55 STEP 2821 H=2821:00 +CPU= 14.380
  09:23:11 STEP 2822 H=2822:00 +CPU= 14.809
  09:23:35 STEP 2823 H=2823:00 +CPU= 22.003
  09:23:50 STEP 2824 H=2824:00 +CPU= 14.705
  09:24:06 STEP 2825 H=2825:00 +CPU= 14.533
  09:24:30 STEP 2826 H=2826:00 +CPU= 22.788
  09:24:46 STEP 2827 H=2827:00 +CPU= 14.426
  09:25:01 STEP 2828 H=2828:00 +CPU= 14.788
  09:25:25 STEP 2829 H=2829:00 +CPU= 22.317
  09:25:41 STEP 2830 H=2830:00 +CPU= 14.848
  09:25:57 STEP 2831 H=2831:00 +CPU= 14.789
  09:26:26 STEP 2832 H=2832:00 +CPU= 26.347
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_117.zip
Uploading the intermediate file: upload_file_117.zip
  09:26:42 STEP 2833 H=2833:00 +CPU= 14.535
  09:26:58 STEP 2834 H=2834:00 +CPU= 14.570
  09:27:21 STEP 2835 H=2835:00 +CPU= 21.941
  09:27:37 STEP 2836 H=2836:00 +CPU= 14.722
  09:27:51 STEP 2837 H=2837:00 +CPU= 13.861
  09:28:15 STEP 2838 H=2838:00 +CPU= 22.102
  09:28:30 STEP 2839 H=2839:00 +CPU= 14.392
  09:28:46 STEP 2840 H=2840:00 +CPU= 14.730
  09:29:11 STEP 2841 H=2841:00 +CPU= 22.458
  09:29:27 STEP 2842 H=2842:00 +CPU= 15.003
  09:29:43 STEP 2843 H=2843:00 +CPU= 14.570
  09:30:10 STEP 2844 H=2844:00 +CPU= 24.877
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002844
  09:30:26 STEP 2845 H=2845:00 +CPU= 14.856
  09:30:41 STEP 2846 H=2846:00 +CPU= 14.788
  09:31:05 STEP 2847 H=2847:00 +CPU= 22.172
  09:31:21 STEP 2848 H=2848:00 +CPU= 14.873
  09:31:36 STEP 2849 H=2849:00 +CPU= 14.223
  09:32:00 STEP 2850 H=2850:00 +CPU= 22.567
  09:32:15 STEP 2851 H=2851:00 +CPU= 14.011
  09:32:31 STEP 2852 H=2852:00 +CPU= 14.657
  09:32:55 STEP 2853 H=2853:00 +CPU= 22.456
  09:33:11 STEP 2854 H=2854:00 +CPU= 15.081
  09:33:27 STEP 2855 H=2855:00 +CPU= 14.829
  09:33:55 STEP 2856 H=2856:00 +CPU= 25.890
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_118.zip
Uploading the intermediate file: upload_file_118.zip
  09:34:10 STEP 2857 H=2857:00 +CPU= 14.342
  09:34:25 STEP 2858 H=2858:00 +CPU= 14.514
  09:34:49 STEP 2859 H=2859:00 +CPU= 22.175
  09:35:06 STEP 2860 H=2860:00 +CPU= 15.147
  09:35:22 STEP 2861 H=2861:00 +CPU= 14.566
  09:35:46 STEP 2862 H=2862:00 +CPU= 22.476
  09:36:01 STEP 2863 H=2863:00 +CPU= 14.480
  09:36:18 STEP 2864 H=2864:00 +CPU= 14.879
  09:36:41 STEP 2865 H=2865:00 +CPU= 21.883
  09:36:56 STEP 2866 H=2866:00 +CPU= 13.926
  09:37:10 STEP 2867 H=2867:00 +CPU= 13.627
  09:37:35 STEP 2868 H=2868:00 +CPU= 23.737
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002868
  09:37:50 STEP 2869 H=2869:00 +CPU= 14.004
  09:38:05 STEP 2870 H=2870:00 +CPU= 13.643
  09:38:28 STEP 2871 H=2871:00 +CPU= 21.309
  09:38:43 STEP 2872 H=2872:00 +CPU= 14.016
  09:38:58 STEP 2873 H=2873:00 +CPU= 13.779
  09:39:21 STEP 2874 H=2874:00 +CPU= 22.158
  09:39:36 STEP 2875 H=2875:00 +CPU= 13.514
  09:39:50 STEP 2876 H=2876:00 +CPU= 14.007
  09:40:13 STEP 2877 H=2877:00 +CPU= 21.592
  09:40:28 STEP 2878 H=2878:00 +CPU= 13.879
  09:40:43 STEP 2879 H=2879:00 +CPU= 14.157
  09:41:11 STEP 2880 H=2880:00 +CPU= 25.211
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_119.zip
Uploading the intermediate file: upload_file_119.zip
  09:41:26 STEP 2881 H=2881:00 +CPU= 13.565
  09:41:40 STEP 2882 H=2882:00 +CPU= 13.899
  09:42:03 STEP 2883 H=2883:00 +CPU= 21.181
  09:42:18 STEP 2884 H=2884:00 +CPU= 13.976
  09:42:32 STEP 2885 H=2885:00 +CPU= 13.549
  09:42:55 STEP 2886 H=2886:00 +CPU= 21.799
  09:43:10 STEP 2887 H=2887:00 +CPU= 13.716
  09:43:25 STEP 2888 H=2888:00 +CPU= 14.328
  09:43:49 STEP 2889 H=2889:00 +CPU= 22.079
  09:44:05 STEP 2890 H=2890:00 +CPU= 14.823
  09:44:21 STEP 2891 H=2891:00 +CPU= 14.890
  09:44:49 STEP 2892 H=2892:00 +CPU= 25.860
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  09:45:07 STEP 2893 H=2893:00 +CPU= 16.576
  09:45:26 STEP 2894 H=2894:00 +CPU= 17.971
  09:45:55 STEP 2895 H=2895:00 +CPU= 26.765
  09:46:17 STEP 2896 H=2896:00 +CPU= 20.013
  09:46:36 STEP 2897 H=2897:00 +CPU= 17.962
  09:47:07 STEP 2898 H=2898:00 +CPU= 27.646
  09:47:26 STEP 2899 H=2899:00 +CPU= 17.762
  09:47:47 STEP 2900 H=2900:00 +CPU= 19.168
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0440
(argv4) batchid: 951
(argv5) wuid: 12168084
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_22d6a680fdda7c2e81d8549c29938992 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0440_1982050100_123_951_12168084.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0440_1982050100_123_951_12168084.zip
ic_ancil_file: ic_ancil_12168084
ifsdata_file: ifsdata_12168084
climate_data_file: clim_data_12168084
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_a9c6bf42a8a6f068c8941bd7baf9ab76 to: /var/lib/boinc-client/slots/0/ic_ancil_12168084.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12168084.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_01071c23723d6ac11812701960d4142a to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12168084.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12168084.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12168084.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12168084.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12168084.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12168084.xml
-- Model is restarting --
Adjusting last_iter, 2901, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12168084.xml
last_cpu_time: 59471
upload_file_number: 120
last_iter: 2879
last_upload: 10368000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999
The child process has been launched with process id: 2212136
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:2212136:2212136] [20230116:094901:1673887741:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  09:49:37 STEP 2880 H=2880:00 +CPU= 30.957
  09:49:57 STEP 2881 H=2881:00 +CPU= 17.773
  09:50:16 STEP 2882 H=2882:00 +CPU= 17.731
  09:50:46 STEP 2883 H=2883:00 +CPU= 27.636
  09:51:06 STEP 2884 H=2884:00 +CPU= 18.213
  09:51:25 STEP 2885 H=2885:00 +CPU= 17.504
  09:51:56 STEP 2886 H=2886:00 +CPU= 28.985
  09:52:15 STEP 2887 H=2887:00 +CPU= 17.684
  09:52:34 STEP 2888 H=2888:00 +CPU= 17.474
  09:53:05 STEP 2889 H=2889:00 +CPU= 27.892
  09:53:26 STEP 2890 H=2890:00 +CPU= 18.335
  09:53:45 STEP 2891 H=2891:00 +CPU= 17.632
  09:54:18 STEP 2892 H=2892:00 +CPU= 30.511
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  09:54:38 STEP 2893 H=2893:00 +CPU= 17.712
  09:54:57 STEP 2894 H=2894:00 +CPU= 18.137
  09:55:27 STEP 2895 H=2895:00 +CPU= 27.402
  09:55:48 STEP 2896 H=2896:00 +CPU= 18.954
  09:56:07 STEP 2897 H=2897:00 +CPU= 17.258
  09:56:38 STEP 2898 H=2898:00 +CPU= 27.801
  09:56:58 STEP 2899 H=2899:00 +CPU= 17.952
  09:57:18 STEP 2900 H=2900:00 +CPU= 18.445
  09:57:47 STEP 2901 H=2901:00 +CPU= 27.223
  09:58:06 STEP 2902 H=2902:00 +CPU= 17.866
  09:58:26 STEP 2903 H=2903:00 +CPU= 17.873
  09:59:00 STEP 2904 H=2904:00 +CPU= 30.284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_120.zip
Uploading the intermediate file: upload_file_120.zip
  09:59:19 STEP 2905 H=2905:00 +CPU= 17.488
  09:59:42 STEP 2906 H=2906:00 +CPU= 20.150
  10:00:11 STEP 2907 H=2907:00 +CPU= 27.016
  10:00:31 STEP 2908 H=2908:00 +CPU= 18.213
  10:00:50 STEP 2909 H=2909:00 +CPU= 17.627
  10:01:22 STEP 2910 H=2910:00 +CPU= 29.097
  10:01:42 STEP 2911 H=2911:00 +CPU= 18.062
  10:02:01 STEP 2912 H=2912:00 +CPU= 17.851
  10:02:32 STEP 2913 H=2913:00 +CPU= 28.021
  10:02:52 STEP 2914 H=2914:00 +CPU= 18.064
  10:03:10 STEP 2915 H=2915:00 +CPU= 16.512
  10:03:43 STEP 2916 H=2916:00 +CPU= 30.205
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
  10:04:04 STEP 2917 H=2917:00 +CPU= 18.656
  10:04:24 STEP 2918 H=2918:00 +CPU= 18.216
  10:04:53 STEP 2919 H=2919:00 +CPU= 26.729
  10:05:14 STEP 2920 H=2920:00 +CPU= 18.748
  10:05:32 STEP 2921 H=2921:00 +CPU= 17.345
  10:06:01 STEP 2922 H=2922:00 +CPU= 26.758
  10:06:21 STEP 2923 H=2923:00 +CPU= 18.076
  10:06:42 STEP 2924 H=2924:00 +CPU= 19.082
  10:07:14 STEP 2925 H=2925:00 +CPU= 29.216
  10:07:33 STEP 2926 H=2926:00 +CPU= 17.697
  10:07:51 STEP 2927 H=2927:00 +CPU= 16.822
  10:08:29 STEP 2928 H=2928:00 +CPU= 34.519
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_121.zip
Uploading the intermediate file: upload_file_121.zip
  10:08:50 STEP 2929 H=2929:00 +CPU= 18.923
  10:09:09 STEP 2930 H=2930:00 +CPU= 17.947
  10:09:40 STEP 2931 H=2931:00 +CPU= 28.052
  10:10:01 STEP 2932 H=2932:00 +CPU= 19.073
  10:10:21 STEP 2933 H=2933:00 +CPU= 17.933
  10:10:51 STEP 2934 H=2934:00 +CPU= 27.283
  10:11:12 STEP 2935 H=2935:00 +CPU= 19.530
  10:11:32 STEP 2936 H=2936:00 +CPU= 18.207
  10:12:03 STEP 2937 H=2937:00 +CPU= 28.490
  10:12:24 STEP 2938 H=2938:00 +CPU= 18.891
  10:12:44 STEP 2939 H=2939:00 +CPU= 18.740
  10:13:20 STEP 2940 H=2940:00 +CPU= 31.625
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002940
  10:13:40 STEP 2941 H=2941:00 +CPU= 18.876
  10:14:00 STEP 2942 H=2942:00 +CPU= 18.031
  10:14:30 STEP 2943 H=2943:00 +CPU= 27.957
  10:14:52 STEP 2944 H=2944:00 +CPU= 20.162
  10:15:13 STEP 2945 H=2945:00 +CPU= 18.613
  10:15:44 STEP 2946 H=2946:00 +CPU= 28.994
  10:16:05 STEP 2947 H=2947:00 +CPU= 18.904
  10:16:28 STEP 2948 H=2948:00 +CPU= 20.412
  10:16:58 STEP 2949 H=2949:00 +CPU= 27.996
  10:17:18 STEP 2950 H=2950:00 +CPU= 18.109
  10:17:37 STEP 2951 H=2951:00 +CPU= 17.763
  10:18:15 STEP 2952 H=2952:00 +CPU= 34.040
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168084/ICMGGhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0440_1982050100_123_951_12168084_1_r695931999_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:21:38 (2201074): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:22:42 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 10,623,600 61,073 0.0057
09 May 2023 16:22:33 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 9,590,400 55,042 0.0057
09 May 2023 16:22:29 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 8,726,400 50,312 0.0058
09 May 2023 16:22:21 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 7,862,400 45,593 0.0058
09 May 2023 16:22:17 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 6,998,400 40,854 0.0058
09 May 2023 16:22:13 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 6,134,400 36,121 0.0059
09 May 2023 16:22:05 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 5,270,400 31,379 0.0060
09 May 2023 16:22:01 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 4,406,400 26,636 0.0060
09 May 2023 16:21:53 1532237 22298298 oifs_43r3_ps_0440_1982050100_123_951_12168084_1 3,542,400 21,883 0.0062


©2024 cpdn.org