climateprediction.net home page
Task 22276369

Task 22276369

Name oifs_43r3_ps_0075_2005050100_123_974_12190719_0
Workunit 12190719
Created 23 Dec 2022, 9:37:21 UTC
Sent 20 Jan 2023, 11:36:42 UTC
Report deadline 21 Mar 2023, 11:36:42 UTC
Received 21 Jan 2023, 11:23:08 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532237
Run time 17 hours 38 min 36 sec
CPU time 15 hours 40 min 10 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,413.18 MB
Peak swap size 4,978.07 MB
Peak disk usage 4,465.22 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
02424
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_100.zip
Uploading the intermediate file: upload_file_100.zip
  00:55:04 STEP 2425 H=2425:00 +CPU= 14.627
  00:55:19 STEP 2426 H=2426:00 +CPU= 15.083
  00:55:41 STEP 2427 H=2427:00 +CPU= 21.958
  00:55:56 STEP 2428 H=2428:00 +CPU= 14.866
  00:56:11 STEP 2429 H=2429:00 +CPU= 14.332
  00:56:33 STEP 2430 H=2430:00 +CPU= 22.493
  00:56:48 STEP 2431 H=2431:00 +CPU= 14.801
  00:57:03 STEP 2432 H=2432:00 +CPU= 14.853
  00:57:26 STEP 2433 H=2433:00 +CPU= 22.765
  00:57:41 STEP 2434 H=2434:00 +CPU= 14.341
  00:57:55 STEP 2435 H=2435:00 +CPU= 14.577
  00:58:20 STEP 2436 H=2436:00 +CPU= 24.890
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002436
  00:58:35 STEP 2437 H=2437:00 +CPU= 14.961
  00:58:51 STEP 2438 H=2438:00 +CPU= 15.256
  00:59:13 STEP 2439 H=2439:00 +CPU= 22.570
  00:59:28 STEP 2440 H=2440:00 +CPU= 14.959
  00:59:43 STEP 2441 H=2441:00 +CPU= 14.966
  01:00:06 STEP 2442 H=2442:00 +CPU= 22.262
  01:00:21 STEP 2443 H=2443:00 +CPU= 14.916
  01:00:36 STEP 2444 H=2444:00 +CPU= 15.273
  01:00:59 STEP 2445 H=2445:00 +CPU= 22.429
  01:01:13 STEP 2446 H=2446:00 +CPU= 14.315
  01:01:29 STEP 2447 H=2447:00 +CPU= 15.661
  01:01:56 STEP 2448 H=2448:00 +CPU= 26.843
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_101.zip
Uploading the intermediate file: upload_file_101.zip
  01:02:11 STEP 2449 H=2449:00 +CPU= 14.897
  01:02:26 STEP 2450 H=2450:00 +CPU= 14.837
  01:02:48 STEP 2451 H=2451:00 +CPU= 22.357
  01:03:03 STEP 2452 H=2452:00 +CPU= 15.075
  01:03:18 STEP 2453 H=2453:00 +CPU= 15.000
  01:03:41 STEP 2454 H=2454:00 +CPU= 22.516
  01:03:56 STEP 2455 H=2455:00 +CPU= 15.082
  01:04:11 STEP 2456 H=2456:00 +CPU= 15.021
  01:04:34 STEP 2457 H=2457:00 +CPU= 22.359
  01:04:49 STEP 2458 H=2458:00 +CPU= 15.167
  01:05:04 STEP 2459 H=2459:00 +CPU= 15.384
  01:05:29 STEP 2460 H=2460:00 +CPU= 24.379
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002460
  01:05:44 STEP 2461 H=2461:00 +CPU= 15.023
  01:05:59 STEP 2462 H=2462:00 +CPU= 14.817
  01:06:21 STEP 2463 H=2463:00 +CPU= 22.125
  01:06:37 STEP 2464 H=2464:00 +CPU= 15.177
  01:06:51 STEP 2465 H=2465:00 +CPU= 14.837
  01:07:14 STEP 2466 H=2466:00 +CPU= 21.935
  01:07:29 STEP 2467 H=2467:00 +CPU= 14.982
  01:07:44 STEP 2468 H=2468:00 +CPU= 15.294
  01:08:07 STEP 2469 H=2469:00 +CPU= 22.339
  01:08:21 STEP 2470 H=2470:00 +CPU= 14.747
  01:08:37 STEP 2471 H=2471:00 +CPU= 15.878
  01:09:03 STEP 2472 H=2472:00 +CPU= 25.881
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_102.zip
Uploading the intermediate file: upload_file_102.zip
  01:09:18 STEP 2473 H=2473:00 +CPU= 14.733
  01:09:33 STEP 2474 H=2474:00 +CPU= 14.800
  01:09:55 STEP 2475 H=2475:00 +CPU= 21.850
  01:10:10 STEP 2476 H=2476:00 +CPU= 15.068
  01:10:25 STEP 2477 H=2477:00 +CPU= 14.937
  01:10:48 STEP 2478 H=2478:00 +CPU= 22.835
  01:11:03 STEP 2479 H=2479:00 +CPU= 15.052
  01:11:18 STEP 2480 H=2480:00 +CPU= 14.496
  01:11:40 STEP 2481 H=2481:00 +CPU= 22.239
  01:11:55 STEP 2482 H=2482:00 +CPU= 14.451
  01:12:09 STEP 2483 H=2483:00 +CPU= 14.354
  01:12:34 STEP 2484 H=2484:00 +CPU= 25.173
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002484
  01:12:50 STEP 2485 H=2485:00 +CPU= 15.342
  01:13:05 STEP 2486 H=2486:00 +CPU= 15.092
  01:13:28 STEP 2487 H=2487:00 +CPU= 22.654
  01:13:43 STEP 2488 H=2488:00 +CPU= 15.406
  01:13:58 STEP 2489 H=2489:00 +CPU= 15.000
  01:14:21 STEP 2490 H=2490:00 +CPU= 22.504
  01:14:36 STEP 2491 H=2491:00 +CPU= 14.705
  01:14:51 STEP 2492 H=2492:00 +CPU= 14.896
  01:15:13 STEP 2493 H=2493:00 +CPU= 22.267
  01:15:28 STEP 2494 H=2494:00 +CPU= 15.023
  01:15:44 STEP 2495 H=2495:00 +CPU= 15.775
  01:16:11 STEP 2496 H=2496:00 +CPU= 26.657
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_103.zip
Uploading the intermediate file: upload_file_103.zip
  01:16:26 STEP 2497 H=2497:00 +CPU= 14.572
  01:16:41 STEP 2498 H=2498:00 +CPU= 15.093
  01:17:03 STEP 2499 H=2499:00 +CPU= 22.141
  01:17:19 STEP 2500 H=2500:00 +CPU= 15.367
  01:17:33 STEP 2501 H=2501:00 +CPU= 14.634
  01:17:56 STEP 2502 H=2502:00 +CPU= 22.353
  01:18:11 STEP 2503 H=2503:00 +CPU= 15.282
  01:18:26 STEP 2504 H=2504:00 +CPU= 15.051
  01:18:49 STEP 2505 H=2505:00 +CPU= 22.412
  01:19:04 STEP 2506 H=2506:00 +CPU= 14.853
  01:19:19 STEP 2507 H=2507:00 +CPU= 14.876
  01:19:43 STEP 2508 H=2508:00 +CPU= 24.492
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002508
  01:19:58 STEP 2509 H=2509:00 +CPU= 14.917
  01:20:14 STEP 2510 H=2510:00 +CPU= 15.424
  01:20:37 STEP 2511 H=2511:00 +CPU= 22.724
  01:20:52 STEP 2512 H=2512:00 +CPU= 14.950
  01:21:07 STEP 2513 H=2513:00 +CPU= 15.425
  01:21:30 STEP 2514 H=2514:00 +CPU= 22.437
  01:21:45 STEP 2515 H=2515:00 +CPU= 15.273
  01:22:01 STEP 2516 H=2516:00 +CPU= 15.190
  01:22:23 STEP 2517 H=2517:00 +CPU= 22.013
  01:22:37 STEP 2518 H=2518:00 +CPU= 14.618
  01:22:53 STEP 2519 H=2519:00 +CPU= 15.433
  01:23:19 STEP 2520 H=2520:00 +CPU= 25.512
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:23:33 STEP 2521 H=2521:00 +CPU= 14.573
  01:23:48 STEP 2522 H=2522:00 +CPU= 14.561
  01:24:10 STEP 2523 H=2523:00 +CPU= 22.263
  01:24:26 STEP 2524 H=2524:00 +CPU= 15.449
  01:24:41 STEP 2525 H=2525:00 +CPU= 14.939
  01:25:04 STEP 2526 H=2526:00 +CPU= 22.600
  01:25:19 STEP 2527 H=2527:00 +CPU= 15.133
  01:25:34 STEP 2528 H=2528:00 +CPU= 15.229
  01:25:57 STEP 2529 H=2529:00 +CPU= 22.705
  01:26:13 STEP 2530 H=2530:00 +CPU= 15.531
  01:26:28 STEP 2531 H=2531:00 +CPU= 15.435
  01:26:53 STEP 2532 H=2532:00 +CPU= 24.340
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002532
  01:27:07 STEP 2533 H=2533:00 +CPU= 14.554
  01:27:22 STEP 2534 H=2534:00 +CPU= 14.741
  01:27:44 STEP 2535 H=2535:00 +CPU= 22.110
  01:28:00 STEP 2536 H=2536:00 +CPU= 15.130
  01:28:15 STEP 2537 H=2537:00 +CPU= 15.071
  01:28:37 STEP 2538 H=2538:00 +CPU= 22.278
  01:28:52 STEP 2539 H=2539:00 +CPU= 14.693
  01:29:07 STEP 2540 H=2540:00 +CPU= 14.695
  01:29:29 STEP 2541 H=2541:00 +CPU= 22.040
  01:29:44 STEP 2542 H=2542:00 +CPU= 14.605
  01:29:59 STEP 2543 H=2543:00 +CPU= 15.272
  01:30:26 STEP 2544 H=2544:00 +CPU= 27.079
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_105.zip
Uploading the intermediate file: upload_file_105.zip
  01:30:41 STEP 2545 H=2545:00 +CPU= 14.630
  01:30:56 STEP 2546 H=2546:00 +CPU= 14.829
  01:31:18 STEP 2547 H=2547:00 +CPU= 22.075
  01:31:33 STEP 2548 H=2548:00 +CPU= 15.015
  01:31:48 STEP 2549 H=2549:00 +CPU= 14.691
  01:32:11 STEP 2550 H=2550:00 +CPU= 22.522
  01:32:25 STEP 2551 H=2551:00 +CPU= 14.301
  01:32:40 STEP 2552 H=2552:00 +CPU= 14.781
  01:33:02 STEP 2553 H=2553:00 +CPU= 22.102
  01:33:17 STEP 2554 H=2554:00 +CPU= 14.593
  01:33:32 STEP 2555 H=2555:00 +CPU= 15.400
  01:33:57 STEP 2556 H=2556:00 +CPU= 24.872
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002556
  01:34:12 STEP 2557 H=2557:00 +CPU= 14.652
  01:34:28 STEP 2558 H=2558:00 +CPU= 15.351
  01:34:50 STEP 2559 H=2559:00 +CPU= 22.007
  01:35:06 STEP 2560 H=2560:00 +CPU= 15.703
  01:35:20 STEP 2561 H=2561:00 +CPU= 14.421
  01:35:43 STEP 2562 H=2562:00 +CPU= 22.383
  01:35:57 STEP 2563 H=2563:00 +CPU= 14.533
  01:36:12 STEP 2564 H=2564:00 +CPU= 14.794
  01:36:35 STEP 2565 H=2565:00 +CPU= 22.471
  01:36:50 STEP 2566 H=2566:00 +CPU= 15.052
  01:37:05 STEP 2567 H=2567:00 +CPU= 15.171
  01:37:31 STEP 2568 H=2568:00 +CPU= 26.225
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_106.zip
Uploading the intermediate file: upload_file_106.zip
  01:37:46 STEP 2569 H=2569:00 +CPU= 14.281
  01:38:01 STEP 2570 H=2570:00 +CPU= 15.151
  01:38:23 STEP 2571 H=2571:00 +CPU= 21.855
  01:38:38 STEP 2572 H=2572:00 +CPU= 15.372
  01:38:53 STEP 2573 H=2573:00 +CPU= 14.703
  01:39:16 STEP 2574 H=2574:00 +CPU= 22.312
  01:39:31 STEP 2575 H=2575:00 +CPU= 14.723
  01:39:45 STEP 2576 H=2576:00 +CPU= 14.805
  01:40:07 STEP 2577 H=2577:00 +CPU= 21.902
  01:40:22 STEP 2578 H=2578:00 +CPU= 14.752
  01:40:37 STEP 2579 H=2579:00 +CPU= 14.800
  01:41:02 STEP 2580 H=2580:00 +CPU= 25.095
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002580
  01:41:17 STEP 2581 H=2581:00 +CPU= 14.746
  01:41:33 STEP 2582 H=2582:00 +CPU= 15.475
  01:41:55 STEP 2583 H=2583:00 +CPU= 22.217
  01:42:11 STEP 2584 H=2584:00 +CPU= 15.271
  01:42:25 STEP 2585 H=2585:00 +CPU= 14.613
  01:42:48 STEP 2586 H=2586:00 +CPU= 22.508
  01:43:03 STEP 2587 H=2587:00 +CPU= 14.847
  01:43:18 STEP 2588 H=2588:00 +CPU= 15.543
  01:43:41 STEP 2589 H=2589:00 +CPU= 22.142
  01:43:56 STEP 2590 H=2590:00 +CPU= 15.004
  01:44:11 STEP 2591 H=2591:00 +CPU= 15.301
  01:44:38 STEP 2592 H=2592:00 +CPU= 26.454
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:44:52 STEP 2593 H=2593:00 +CPU= 14.302
  01:45:07 STEP 2594 H=2594:00 +CPU= 15.094
Uploading trickle at timestep: 9331200
  01:45:29 STEP 2595 H=2595:00 +CPU= 21.820
  01:45:45 STEP 2596 H=2596:00 +CPU= 15.520
  01:46:00 STEP 2597 H=2597:00 +CPU= 14.930
  01:46:23 STEP 2598 H=2598:00 +CPU= 22.802
  01:46:38 STEP 2599 H=2599:00 +CPU= 14.712
  01:46:53 STEP 2600 H=2600:00 +CPU= 15.299
  01:47:16 STEP 2601 H=2601:00 +CPU= 22.269
  01:47:31 STEP 2602 H=2602:00 +CPU= 15.005
  01:47:45 STEP 2603 H=2603:00 +CPU= 14.877
  01:48:10 STEP 2604 H=2604:00 +CPU= 24.297
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002604
  01:48:25 STEP 2605 H=2605:00 +CPU= 14.712
  01:48:40 STEP 2606 H=2606:00 +CPU= 15.135
  01:49:02 STEP 2607 H=2607:00 +CPU= 22.284
  01:49:18 STEP 2608 H=2608:00 +CPU= 15.213
  01:49:33 STEP 2609 H=2609:00 +CPU= 14.807
  01:49:56 STEP 2610 H=2610:00 +CPU= 22.896
  01:50:10 STEP 2611 H=2611:00 +CPU= 14.717
  01:50:26 STEP 2612 H=2612:00 +CPU= 15.289
  01:50:48 STEP 2613 H=2613:00 +CPU= 22.154
  01:51:03 STEP 2614 H=2614:00 +CPU= 14.768
  01:51:18 STEP 2615 H=2615:00 +CPU= 15.017
  01:51:44 STEP 2616 H=2616:00 +CPU= 25.772
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:51:59 STEP 2617 H=2617:00 +CPU= 14.319
  01:52:14 STEP 2618 H=2618:00 +CPU= 14.807
  01:52:36 STEP 2619 H=2619:00 +CPU= 22.638
  01:52:52 STEP 2620 H=2620:00 +CPU= 15.283
  01:53:07 STEP 2621 H=2621:00 +CPU= 14.955
  01:53:30 STEP 2622 H=2622:00 +CPU= 22.797
  01:53:44 STEP 2623 H=2623:00 +CPU= 14.718
  01:53:59 STEP 2624 H=2624:00 +CPU= 15.001
  01:54:22 STEP 2625 H=2625:00 +CPU= 22.588
  01:54:37 STEP 2626 H=2626:00 +CPU= 15.139
  01:54:52 STEP 2627 H=2627:00 +CPU= 15.029
  01:55:17 STEP 2628 H=2628:00 +CPU= 24.343
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002628
  01:55:32 STEP 2629 H=2629:00 +CPU= 15.102
  01:55:48 STEP 2630 H=2630:00 +CPU= 15.248
  01:56:10 STEP 2631 H=2631:00 +CPU= 21.963
  01:56:25 STEP 2632 H=2632:00 +CPU= 15.254
  01:56:40 STEP 2633 H=2633:00 +CPU= 14.769
  01:57:03 STEP 2634 H=2634:00 +CPU= 22.777
  01:57:18 STEP 2635 H=2635:00 +CPU= 14.939
  01:57:33 STEP 2636 H=2636:00 +CPU= 14.840
  01:57:55 STEP 2637 H=2637:00 +CPU= 22.122
  01:58:10 STEP 2638 H=2638:00 +CPU= 14.751
  01:58:26 STEP 2639 H=2639:00 +CPU= 15.678
  01:58:52 STEP 2640 H=2640:00 +CPU= 26.034
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:59:07 STEP 2641 H=2641:00 +CPU= 14.731
  01:59:21 STEP 2642 H=2642:00 +CPU= 14.671
  01:59:44 STEP 2643 H=2643:00 +CPU= 22.096
  01:59:59 STEP 2644 H=2644:00 +CPU= 15.090
  02:00:14 STEP 2645 H=2645:00 +CPU= 15.545
  02:00:37 STEP 2646 H=2646:00 +CPU= 22.412
  02:00:52 STEP 2647 H=2647:00 +CPU= 14.782
  02:01:07 STEP 2648 H=2648:00 +CPU= 15.007
  02:01:29 STEP 2649 H=2649:00 +CPU= 22.274
  02:01:44 STEP 2650 H=2650:00 +CPU= 14.676
  02:01:59 STEP 2651 H=2651:00 +CPU= 14.618
  02:02:25 STEP 2652 H=2652:00 +CPU= 25.689
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002652
  02:02:39 STEP 2653 H=2653:00 +CPU= 14.668
  02:02:55 STEP 2654 H=2654:00 +CPU= 15.246
  02:03:17 STEP 2655 H=2655:00 +CPU= 22.544
  02:03:33 STEP 2656 H=2656:00 +CPU= 15.170
  02:03:48 STEP 2657 H=2657:00 +CPU= 15.481
  02:04:11 STEP 2658 H=2658:00 +CPU= 22.498
  02:04:26 STEP 2659 H=2659:00 +CPU= 14.981
  02:04:41 STEP 2660 H=2660:00 +CPU= 15.118
  02:05:04 STEP 2661 H=2661:00 +CPU= 22.289
  02:05:19 STEP 2662 H=2662:00 +CPU= 14.845
  02:05:34 STEP 2663 H=2663:00 +CPU= 15.305
  02:06:00 STEP 2664 H=2664:00 +CPU= 25.867
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_110.zip
Uploading the intermediate file: upload_file_110.zip
  02:06:15 STEP 2665 H=2665:00 +CPU= 14.628
  02:06:30 STEP 2666 H=2666:00 +CPU= 14.732
  02:06:52 STEP 2667 H=2667:00 +CPU= 21.997
  02:07:07 STEP 2668 H=2668:00 +CPU= 15.162
  02:07:22 STEP 2669 H=2669:00 +CPU= 14.597
  02:07:44 STEP 2670 H=2670:00 +CPU= 22.552
  02:08:00 STEP 2671 H=2671:00 +CPU= 15.194
  02:08:15 STEP 2672 H=2672:00 +CPU= 15.344
  02:08:37 STEP 2673 H=2673:00 +CPU= 22.127
  02:08:52 STEP 2674 H=2674:00 +CPU= 14.806
  02:09:07 STEP 2675 H=2675:00 +CPU= 14.752
  02:09:32 STEP 2676 H=2676:00 +CPU= 24.715
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002676
  02:09:47 STEP 2677 H=2677:00 +CPU= 15.315
  02:10:03 STEP 2678 H=2678:00 +CPU= 15.238
  02:10:25 STEP 2679 H=2679:00 +CPU= 22.070
  02:10:40 STEP 2680 H=2680:00 +CPU= 15.127
  02:10:55 STEP 2681 H=2681:00 +CPU= 14.718
  02:11:17 STEP 2682 H=2682:00 +CPU= 22.374
  02:11:32 STEP 2683 H=2683:00 +CPU= 14.890
  02:11:47 STEP 2684 H=2684:00 +CPU= 14.865
  02:12:09 STEP 2685 H=2685:00 +CPU= 21.898
  02:12:24 STEP 2686 H=2686:00 +CPU= 14.496
  02:12:40 STEP 2687 H=2687:00 +CPU= 15.948
  02:13:07 STEP 2688 H=2688:00 +CPU= 26.824
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_111.zip
Uploading the intermediate file: upload_file_111.zip
  02:13:22 STEP 2689 H=2689:00 +CPU= 14.563
  02:13:36 STEP 2690 H=2690:00 +CPU= 14.739
  02:13:58 STEP 2691 H=2691:00 +CPU= 22.012
  02:14:13 STEP 2692 H=2692:00 +CPU= 14.928
  02:14:28 STEP 2693 H=2693:00 +CPU= 14.894
  02:14:51 STEP 2694 H=2694:00 +CPU= 22.437
  02:15:06 STEP 2695 H=2695:00 +CPU= 14.981
  02:15:21 STEP 2696 H=2696:00 +CPU= 15.395
  02:15:44 STEP 2697 H=2697:00 +CPU= 22.557
  02:16:00 STEP 2698 H=2698:00 +CPU= 15.225
  02:16:15 STEP 2699 H=2699:00 +CPU= 14.983
  02:16:39 STEP 2700 H=2700:00 +CPU= 24.575
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002700
  02:16:54 STEP 2701 H=2701:00 +CPU= 14.504
  02:17:10 STEP 2702 H=2702:00 +CPU= 15.684
  02:17:32 STEP 2703 H=2703:00 +CPU= 21.906
  02:17:47 STEP 2704 H=2704:00 +CPU= 15.493
  02:18:02 STEP 2705 H=2705:00 +CPU= 15.039
  02:18:25 STEP 2706 H=2706:00 +CPU= 22.562
  02:18:40 STEP 2707 H=2707:00 +CPU= 14.514
  02:18:55 STEP 2708 H=2708:00 +CPU= 15.095
  02:19:17 STEP 2709 H=2709:00 +CPU= 22.155
  02:19:32 STEP 2710 H=2710:00 +CPU= 14.945
  02:19:48 STEP 2711 H=2711:00 +CPU= 15.187
  02:20:14 STEP 2712 H=2712:00 +CPU= 26.225
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:20:29 STEP 2713 H=2713:00 +CPU= 14.362
  02:20:44 STEP 2714 H=2714:00 +CPU= 15.337
  02:21:06 STEP 2715 H=2715:00 +CPU= 21.944
  02:21:21 STEP 2716 H=2716:00 +CPU= 15.465
  02:21:36 STEP 2717 H=2717:00 +CPU= 14.713
  02:21:59 STEP 2718 H=2718:00 +CPU= 22.687
  02:22:14 STEP 2719 H=2719:00 +CPU= 15.213
  02:22:30 STEP 2720 H=2720:00 +CPU= 15.534
  02:22:53 STEP 2721 H=2721:00 +CPU= 22.438
  02:23:08 STEP 2722 H=2722:00 +CPU= 15.251
  02:23:23 STEP 2723 H=2723:00 +CPU= 15.052
  02:23:47 STEP 2724 H=2724:00 +CPU= 24.096
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002724
  02:24:02 STEP 2725 H=2725:00 +CPU= 14.685
  02:24:18 STEP 2726 H=2726:00 +CPU= 15.550
  02:24:40 STEP 2727 H=2727:00 +CPU= 21.733
  02:24:55 STEP 2728 H=2728:00 +CPU= 14.992
  02:25:09 STEP 2729 H=2729:00 +CPU= 14.079
  02:25:32 STEP 2730 H=2730:00 +CPU= 22.538
  02:25:46 STEP 2731 H=2731:00 +CPU= 14.521
  02:26:02 STEP 2732 H=2732:00 +CPU= 15.343
  02:26:24 STEP 2733 H=2733:00 +CPU= 21.952
  02:26:39 STEP 2734 H=2734:00 +CPU= 15.252
  02:26:55 STEP 2735 H=2735:00 +CPU= 15.371
  02:27:21 STEP 2736 H=2736:00 +CPU= 26.177
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:27:35 STEP 2737 H=2737:00 +CPU= 14.272
  02:27:50 STEP 2738 H=2738:00 +CPU= 15.099
  02:28:12 STEP 2739 H=2739:00 +CPU= 21.751
  02:28:27 STEP 2740 H=2740:00 +CPU= 15.007
  02:28:42 STEP 2741 H=2741:00 +CPU= 14.845
  02:29:05 STEP 2742 H=2742:00 +CPU= 22.630
  02:29:20 STEP 2743 H=2743:00 +CPU= 14.628
  02:29:36 STEP 2744 H=2744:00 +CPU= 15.736
  02:29:58 STEP 2745 H=2745:00 +CPU= 22.129
  02:30:13 STEP 2746 H=2746:00 +CPU= 15.293
  02:30:28 STEP 2747 H=2747:00 +CPU= 14.975
  02:30:53 STEP 2748 H=2748:00 +CPU= 24.378
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002748
  02:31:08 STEP 2749 H=2749:00 +CPU= 14.714
  02:31:23 STEP 2750 H=2750:00 +CPU= 14.992
  02:31:45 STEP 2751 H=2751:00 +CPU= 22.027
  02:32:00 STEP 2752 H=2752:00 +CPU= 15.256
  02:32:15 STEP 2753 H=2753:00 +CPU= 14.462
  02:32:37 STEP 2754 H=2754:00 +CPU= 22.297
  02:32:52 STEP 2755 H=2755:00 +CPU= 14.377
  02:33:07 STEP 2756 H=2756:00 +CPU= 15.040
  02:33:29 STEP 2757 H=2757:00 +CPU= 22.142
  02:33:44 STEP 2758 H=2758:00 +CPU= 14.871
  02:33:59 STEP 2759 H=2759:00 +CPU= 15.391
  02:34:25 STEP 2760 H=2760:00 +CPU= 25.735
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:34:40 STEP 2761 H=2761:00 +CPU= 14.241
  02:34:55 STEP 2762 H=2762:00 +CPU= 15.025
  02:35:18 STEP 2763 H=2763:00 +CPU= 22.747
  02:35:33 STEP 2764 H=2764:00 +CPU= 15.186
  02:35:48 STEP 2765 H=2765:00 +CPU= 14.773
  02:36:10 STEP 2766 H=2766:00 +CPU= 22.315
  02:36:25 STEP 2767 H=2767:00 +CPU= 14.901
  02:36:40 STEP 2768 H=2768:00 +CPU= 15.137
  02:37:03 STEP 2769 H=2769:00 +CPU= 22.028
  02:37:17 STEP 2770 H=2770:00 +CPU= 14.833
  02:37:32 STEP 2771 H=2771:00 +CPU= 14.723
  02:37:57 STEP 2772 H=2772:00 +CPU= 24.472
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002772
  02:38:12 STEP 2773 H=2773:00 +CPU= 14.549
  02:38:27 STEP 2774 H=2774:00 +CPU= 15.447
  02:38:50 STEP 2775 H=2775:00 +CPU= 22.617
  02:39:04 STEP 2776 H=2776:00 +CPU= 14.062
  02:39:18 STEP 2777 H=2777:00 +CPU= 13.919
  02:39:39 STEP 2778 H=2778:00 +CPU= 21.309
  02:39:53 STEP 2779 H=2779:00 +CPU= 13.468
  02:40:07 STEP 2780 H=2780:00 +CPU= 14.159
  02:40:28 STEP 2781 H=2781:00 +CPU= 20.932
  02:40:42 STEP 2782 H=2782:00 +CPU= 13.906
  02:40:56 STEP 2783 H=2783:00 +CPU= 14.028
  02:41:21 STEP 2784 H=2784:00 +CPU= 24.843
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:41:35 STEP 2785 H=2785:00 +CPU= 13.257
  02:41:49 STEP 2786 H=2786:00 +CPU= 13.982
  02:42:09 STEP 2787 H=2787:00 +CPU= 20.481
  02:42:23 STEP 2788 H=2788:00 +CPU= 13.853
  02:42:37 STEP 2789 H=2789:00 +CPU= 13.450
  02:42:58 STEP 2790 H=2790:00 +CPU= 21.019
  02:43:12 STEP 2791 H=2791:00 +CPU= 13.731
  02:43:25 STEP 2792 H=2792:00 +CPU= 13.780
  02:43:46 STEP 2793 H=2793:00 +CPU= 20.839
  02:44:00 STEP 2794 H=2794:00 +CPU= 13.431
  02:44:14 STEP 2795 H=2795:00 +CPU= 13.696
  02:44:37 STEP 2796 H=2796:00 +CPU= 23.304
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002796
  02:44:51 STEP 2797 H=2797:00 +CPU= 13.468
  02:45:05 STEP 2798 H=2798:00 +CPU= 13.942
  02:45:26 STEP 2799 H=2799:00 +CPU= 21.525
  02:45:40 STEP 2800 H=2800:00 +CPU= 14.072
  02:45:54 STEP 2801 H=2801:00 +CPU= 13.810
  02:46:16 STEP 2802 H=2802:00 +CPU= 21.127
  02:46:29 STEP 2803 H=2803:00 +CPU= 13.648
  02:46:43 STEP 2804 H=2804:00 +CPU= 13.604
  02:47:04 STEP 2805 H=2805:00 +CPU= 20.934
  02:47:18 STEP 2806 H=2806:00 +CPU= 13.468
  02:47:31 STEP 2807 H=2807:00 +CPU= 13.675
  02:47:56 STEP 2808 H=2808:00 +CPU= 24.392
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:48:10 STEP 2809 H=2809:00 +CPU= 13.488
  02:48:24 STEP 2810 H=2810:00 +CPU= 13.934
  02:48:44 STEP 2811 H=2811:00 +CPU= 20.679
  02:48:58 STEP 2812 H=2812:00 +CPU= 13.690
  02:49:11 STEP 2813 H=2813:00 +CPU= 13.271
  02:49:32 STEP 2814 H=2814:00 +CPU= 20.771
  02:49:46 STEP 2815 H=2815:00 +CPU= 13.360
  02:50:00 STEP 2816 H=2816:00 +CPU= 13.892
  02:50:20 STEP 2817 H=2817:00 +CPU= 20.604
  02:50:34 STEP 2818 H=2818:00 +CPU= 13.828
  02:50:48 STEP 2819 H=2819:00 +CPU= 13.817
  02:51:12 STEP 2820 H=2820:00 +CPU= 23.302
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002820
  02:51:25 STEP 2821 H=2821:00 +CPU= 13.286
  02:51:39 STEP 2822 H=2822:00 +CPU= 14.063
  02:52:00 STEP 2823 H=2823:00 +CPU= 21.099
  02:52:14 STEP 2824 H=2824:00 +CPU= 13.503
  02:52:27 STEP 2825 H=2825:00 +CPU= 13.697
  02:52:48 STEP 2826 H=2826:00 +CPU= 20.911
  02:53:02 STEP 2827 H=2827:00 +CPU= 13.538
  02:53:16 STEP 2828 H=2828:00 +CPU= 13.751
  02:53:37 STEP 2829 H=2829:00 +CPU= 20.899
  02:53:50 STEP 2830 H=2830:00 +CPU= 13.306
  02:54:04 STEP 2831 H=2831:00 +CPU= 13.873
  02:54:29 STEP 2832 H=2832:00 +CPU= 25.176
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:54:43 STEP 2833 H=2833:00 +CPU= 13.780
Uploading trickle at timestep: 10195200
  02:54:58 STEP 2834 H=2834:00 +CPU= 14.033
  02:55:19 STEP 2835 H=2835:00 +CPU= 21.327
  02:55:33 STEP 2836 H=2836:00 +CPU= 13.930
  02:55:46 STEP 2837 H=2837:00 +CPU= 13.573
  02:56:08 STEP 2838 H=2838:00 +CPU= 21.056
  02:56:21 STEP 2839 H=2839:00 +CPU= 13.413
  02:56:35 STEP 2840 H=2840:00 +CPU= 13.760
  02:56:56 STEP 2841 H=2841:00 +CPU= 20.652
  02:57:10 STEP 2842 H=2842:00 +CPU= 13.882
  02:57:24 STEP 2843 H=2843:00 +CPU= 13.780
  02:57:47 STEP 2844 H=2844:00 +CPU= 23.461
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002844
  02:58:01 STEP 2845 H=2845:00 +CPU= 13.805
  02:58:15 STEP 2846 H=2846:00 +CPU= 14.352
  02:58:36 STEP 2847 H=2847:00 +CPU= 20.971
  02:58:51 STEP 2848 H=2848:00 +CPU= 14.172
  02:59:04 STEP 2849 H=2849:00 +CPU= 13.422
  02:59:25 STEP 2850 H=2850:00 +CPU= 20.987
  02:59:38 STEP 2851 H=2851:00 +CPU= 12.640
  02:59:51 STEP 2852 H=2852:00 +CPU= 12.639
  03:00:11 STEP 2853 H=2853:00 +CPU= 19.673
  03:00:23 STEP 2854 H=2854:00 +CPU= 12.609
  03:00:36 STEP 2855 H=2855:00 +CPU= 12.953
  03:00:59 STEP 2856 H=2856:00 +CPU= 22.910
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:01:12 STEP 2857 H=2857:00 +CPU= 12.632
  03:01:25 STEP 2858 H=2858:00 +CPU= 13.026
  03:01:45 STEP 2859 H=2859:00 +CPU= 19.483
  03:01:57 STEP 2860 H=2860:00 +CPU= 12.811
  03:02:10 STEP 2861 H=2861:00 +CPU= 12.738
  03:02:31 STEP 2862 H=2862:00 +CPU= 20.387
  03:02:43 STEP 2863 H=2863:00 +CPU= 12.522
  03:02:56 STEP 2864 H=2864:00 +CPU= 13.046
  03:03:16 STEP 2865 H=2865:00 +CPU= 19.408
  03:03:29 STEP 2866 H=2866:00 +CPU= 13.013
  03:03:42 STEP 2867 H=2867:00 +CPU= 12.734
  03:04:03 STEP 2868 H=2868:00 +CPU= 21.335
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002868
  03:04:16 STEP 2869 H=2869:00 +CPU= 12.415
  03:04:28 STEP 2870 H=2870:00 +CPU= 12.602
  03:04:48 STEP 2871 H=2871:00 +CPU= 19.426
  03:05:01 STEP 2872 H=2872:00 +CPU= 12.729
  03:05:13 STEP 2873 H=2873:00 +CPU= 12.530
  03:05:33 STEP 2874 H=2874:00 +CPU= 19.740
  03:05:46 STEP 2875 H=2875:00 +CPU= 12.651
  03:05:58 STEP 2876 H=2876:00 +CPU= 12.726
  03:06:18 STEP 2877 H=2877:00 +CPU= 19.470
  03:06:31 STEP 2878 H=2878:00 +CPU= 12.950
  03:06:44 STEP 2879 H=2879:00 +CPU= 12.940
  03:07:07 STEP 2880 H=2880:00 +CPU= 22.992
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:07:20 STEP 2881 H=2881:00 +CPU= 12.146
  03:07:32 STEP 2882 H=2882:00 +CPU= 12.581
  03:07:51 STEP 2883 H=2883:00 +CPU= 19.143
  03:08:04 STEP 2884 H=2884:00 +CPU= 13.084
  03:08:17 STEP 2885 H=2885:00 +CPU= 12.264
  03:08:37 STEP 2886 H=2886:00 +CPU= 19.714
  03:08:49 STEP 2887 H=2887:00 +CPU= 12.111
  03:09:01 STEP 2888 H=2888:00 +CPU= 12.698
  03:09:21 STEP 2889 H=2889:00 +CPU= 19.664
  03:09:34 STEP 2890 H=2890:00 +CPU= 12.866
  03:09:47 STEP 2891 H=2891:00 +CPU= 13.077
  03:10:09 STEP 2892 H=2892:00 +CPU= 21.285
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002892
  03:10:21 STEP 2893 H=2893:00 +CPU= 12.280
  03:10:34 STEP 2894 H=2894:00 +CPU= 12.971
  03:10:54 STEP 2895 H=2895:00 +CPU= 19.439
  03:11:07 STEP 2896 H=2896:00 +CPU= 12.830
  03:11:19 STEP 2897 H=2897:00 +CPU= 12.371
  03:11:39 STEP 2898 H=2898:00 +CPU= 19.804
  03:11:51 STEP 2899 H=2899:00 +CPU= 12.184
  03:12:04 STEP 2900 H=2900:00 +CPU= 12.743
  03:12:24 STEP 2901 H=2901:00 +CPU= 19.654
  03:12:36 STEP 2902 H=2902:00 +CPU= 12.408
  03:12:49 STEP 2903 H=2903:00 +CPU= 12.913
  03:13:12 STEP 2904 H=2904:00 +CPU= 23.176
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:13:25 STEP 2905 H=2905:00 +CPU= 13.008
  03:13:38 STEP 2906 H=2906:00 +CPU= 12.726
  03:13:58 STEP 2907 H=2907:00 +CPU= 19.322
  03:14:10 STEP 2908 H=2908:00 +CPU= 12.642
  03:14:23 STEP 2909 H=2909:00 +CPU= 12.435
  03:14:43 STEP 2910 H=2910:00 +CPU= 20.179
  03:14:56 STEP 2911 H=2911:00 +CPU= 12.681
  03:15:09 STEP 2912 H=2912:00 +CPU= 13.286
  03:15:29 STEP 2913 H=2913:00 +CPU= 20.109
  03:15:43 STEP 2914 H=2914:00 +CPU= 13.104
  03:15:56 STEP 2915 H=2915:00 +CPU= 13.152
  03:16:17 STEP 2916 H=2916:00 +CPU= 21.548
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002916
  03:16:30 STEP 2917 H=2917:00 +CPU= 12.558
  03:16:43 STEP 2918 H=2918:00 +CPU= 12.546
  03:17:02 STEP 2919 H=2919:00 +CPU= 19.458
  03:17:15 STEP 2920 H=2920:00 +CPU= 12.737
  03:17:27 STEP 2921 H=2921:00 +CPU= 12.374
  03:17:47 STEP 2922 H=2922:00 +CPU= 20.108
  03:18:00 STEP 2923 H=2923:00 +CPU= 12.219
  03:18:13 STEP 2924 H=2924:00 +CPU= 12.862
  03:18:32 STEP 2925 H=2925:00 +CPU= 19.403
  03:18:45 STEP 2926 H=2926:00 +CPU= 12.697
  03:18:58 STEP 2927 H=2927:00 +CPU= 12.740
  03:19:21 STEP 2928 H=2928:00 +CPU= 23.407
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:19:34 STEP 2929 H=2929:00 +CPU= 12.341
  03:19:47 STEP 2930 H=2930:00 +CPU= 12.829
  03:20:06 STEP 2931 H=2931:00 +CPU= 19.329
  03:20:19 STEP 2932 H=2932:00 +CPU= 12.644
  03:20:31 STEP 2933 H=2933:00 +CPU= 12.491
  03:20:51 STEP 2934 H=2934:00 +CPU= 19.796
  03:21:04 STEP 2935 H=2935:00 +CPU= 12.911
  03:21:17 STEP 2936 H=2936:00 +CPU= 12.799
  03:21:36 STEP 2937 H=2937:00 +CPU= 19.265
  03:21:49 STEP 2938 H=2938:00 +CPU= 13.041
  03:22:02 STEP 2939 H=2939:00 +CPU= 12.464
  03:22:24 STEP 2940 H=2940:00 +CPU= 21.854
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002940
  03:22:36 STEP 2941 H=2941:00 +CPU= 12.297
  03:22:50 STEP 2942 H=2942:00 +CPU= 13.307
  03:23:14 STEP 2943 H=2943:00 +CPU= 23.867
  03:23:34 STEP 2944 H=2944:00 +CPU= 19.814
  03:23:53 STEP 2945 H=2945:00 +CPU= 18.518
  03:24:20 STEP 2946 H=2946:00 +CPU= 27.160
  03:24:35 STEP 2947 H=2947:00 +CPU= 15.198
  03:24:53 STEP 2948 H=2948:00 +CPU= 17.508
  03:25:19 STEP 2949 H=2949:00 +CPU= 26.250
  03:25:36 STEP 2950 H=2950:00 +CPU= 16.842
  03:25:53 STEP 2951 H=2951:00 +CPU= 16.436
  03:26:22 STEP 2952 H=2952:00 +CPU= 28.753
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719/ICMGGhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2005050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0075
(argv4) batchid: 974
(argv5) wuid: 12190719
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190719
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ed1df54201edf9af11311162e2ec908b to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0075_2005050100_123_974_12190719.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0075_2005050100_123_974_12190719.zip
ic_ancil_file: ic_ancil_12190719
ifsdata_file: ifsdata_12190719
climate_data_file: clim_data_12190719
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_dc7c290ef7dbf9fee68d2148e277ba30 to: /var/lib/boinc-client/slots/16/ic_ancil_12190719.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12190719.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_89f058f3556fdb863820c56220c8c0c8 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12190719.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12190719.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12190719.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12190719.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12190719.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12190719.xml
-- Model is restarting --
Adjusting last_iter, 2952, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12190719.xml
last_cpu_time: 56379
upload_file_number: 122
last_iter: 2951
last_upload: 10540800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576
The child process has been launched with process id: 916748
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:916748:916748] [20230121:032802:1674296882:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  03:28:34 STEP 2952 H=2952:00 +CPU= 29.006
The child process terminated with status: 0
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0075_2005050100_123_974_12190719_0_r1096930576_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:31:57 (916745): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:33:04 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 10,623,600 56,410 0.0053
09 May 2023 16:33:04 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 10,623,600 56,385 0.0053
09 May 2023 16:32:58 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 10,195,200 54,483 0.0053
09 May 2023 16:32:53 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 9,331,200 50,323 0.0054
09 May 2023 16:32:46 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 8,467,200 46,074 0.0054
09 May 2023 16:32:40 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 7,603,200 41,846 0.0055
09 May 2023 16:32:29 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 6,739,200 37,597 0.0056
09 May 2023 16:32:23 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 5,875,200 33,358 0.0057
09 May 2023 16:32:17 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 5,011,200 29,110 0.0058
09 May 2023 16:32:12 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 4,147,200 24,871 0.0060
09 May 2023 16:32:05 1532237 22276369 oifs_43r3_ps_0075_2005050100_123_974_12190719_0 3,283,200 20,653 0.0063


©2024 cpdn.org