climateprediction.net home page
Task 22272909

Task 22272909

Name oifs_43r3_ps_0837_2001050100_123_970_12187481_0
Workunit 12187481
Created 23 Dec 2022, 1:09:12 UTC
Sent 6 Jan 2023, 13:39:25 UTC
Report deadline 5 Feb 2023, 13:39:25 UTC
Received 11 Jan 2023, 19:51:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1531770
Run time 1 days 0 hours 22 min 49 sec
CPU time 22 hours 12 min 38 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.11 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,393.79 MB
Peak swap size 4,978.14 MB
Peak disk usage 3,752.95 MB
Stderr 
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
nc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:41:42 STEP 2401 H=2401:00 +CPU= 22.935
Uploading trickle at timestep: 8640000
  10:42:06 STEP 2402 H=2402:00 +CPU= 23.492
  10:42:44 STEP 2403 H=2403:00 +CPU= 37.375
  10:43:08 STEP 2404 H=2404:00 +CPU= 23.593
  10:43:31 STEP 2405 H=2405:00 +CPU= 22.886
  10:44:09 STEP 2406 H=2406:00 +CPU= 38.067
  10:44:32 STEP 2407 H=2407:00 +CPU= 22.942
  10:44:56 STEP 2408 H=2408:00 +CPU= 23.547
  10:45:34 STEP 2409 H=2409:00 +CPU= 37.350
  10:45:57 STEP 2410 H=2410:00 +CPU= 23.547
  10:46:20 STEP 2411 H=2411:00 +CPU= 22.875
  10:47:02 STEP 2412 H=2412:00 +CPU= 41.047
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002412
  10:47:25 STEP 2413 H=2413:00 +CPU= 22.988
  10:47:48 STEP 2414 H=2414:00 +CPU= 23.565
  10:48:26 STEP 2415 H=2415:00 +CPU= 37.182
  10:48:49 STEP 2416 H=2416:00 +CPU= 23.559
  10:49:12 STEP 2417 H=2417:00 +CPU= 22.915
  10:49:51 STEP 2418 H=2418:00 +CPU= 38.092
  10:50:14 STEP 2419 H=2419:00 +CPU= 22.774
  10:50:37 STEP 2420 H=2420:00 +CPU= 23.633
  10:51:15 STEP 2421 H=2421:00 +CPU= 37.360
  10:51:41 STEP 2422 H=2422:00 +CPU= 23.845
  10:52:04 STEP 2423 H=2423:00 +CPU= 23.462
  10:52:51 STEP 2424 H=2424:00 +CPU= 43.813
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:53:14 STEP 2425 H=2425:00 +CPU= 23.061
  10:53:38 STEP 2426 H=2426:00 +CPU= 23.588
  10:54:15 STEP 2427 H=2427:00 +CPU= 37.306
  10:54:40 STEP 2428 H=2428:00 +CPU= 23.436
  10:55:03 STEP 2429 H=2429:00 +CPU= 22.907
  10:55:42 STEP 2430 H=2430:00 +CPU= 38.236
  10:56:05 STEP 2431 H=2431:00 +CPU= 22.950
  10:56:28 STEP 2432 H=2432:00 +CPU= 23.584
  10:57:06 STEP 2433 H=2433:00 +CPU= 37.333
  10:57:30 STEP 2434 H=2434:00 +CPU= 23.570
  10:57:53 STEP 2435 H=2435:00 +CPU= 23.000
  10:58:34 STEP 2436 H=2436:00 +CPU= 41.082
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002436
  10:58:57 STEP 2437 H=2437:00 +CPU= 22.927
  10:59:21 STEP 2438 H=2438:00 +CPU= 23.513
  10:59:58 STEP 2439 H=2439:00 +CPU= 37.115
  11:00:22 STEP 2440 H=2440:00 +CPU= 23.775
  11:00:45 STEP 2441 H=2441:00 +CPU= 23.500
  11:01:24 STEP 2442 H=2442:00 +CPU= 38.860
  11:01:48 STEP 2443 H=2443:00 +CPU= 22.974
  11:02:11 STEP 2444 H=2444:00 +CPU= 23.505
  11:02:49 STEP 2445 H=2445:00 +CPU= 37.355
  11:03:12 STEP 2446 H=2446:00 +CPU= 23.566
  11:03:36 STEP 2447 H=2447:00 +CPU= 23.640
  11:04:20 STEP 2448 H=2448:00 +CPU= 43.604
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_101.zip
Uploading the intermediate file: upload_file_101.zip
  11:04:43 STEP 2449 H=2449:00 +CPU= 22.876
  11:05:07 STEP 2450 H=2450:00 +CPU= 23.371
  11:05:45 STEP 2451 H=2451:00 +CPU= 37.947
  11:06:08 STEP 2452 H=2452:00 +CPU= 23.337
  11:06:31 STEP 2453 H=2453:00 +CPU= 22.887
  11:07:10 STEP 2454 H=2454:00 +CPU= 38.139
  11:07:33 STEP 2455 H=2455:00 +CPU= 22.730
  11:07:56 STEP 2456 H=2456:00 +CPU= 23.475
  11:08:34 STEP 2457 H=2457:00 +CPU= 37.083
  11:08:57 STEP 2458 H=2458:00 +CPU= 23.452
  11:09:20 STEP 2459 H=2459:00 +CPU= 22.808
  11:10:01 STEP 2460 H=2460:00 +CPU= 40.981
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002460
  11:10:24 STEP 2461 H=2461:00 +CPU= 22.903
  11:10:48 STEP 2462 H=2462:00 +CPU= 23.592
  11:11:25 STEP 2463 H=2463:00 +CPU= 36.995
  11:11:49 STEP 2464 H=2464:00 +CPU= 23.405
  11:12:12 STEP 2465 H=2465:00 +CPU= 22.806
  11:12:50 STEP 2466 H=2466:00 +CPU= 37.834
  11:13:12 STEP 2467 H=2467:00 +CPU= 22.693
  11:13:36 STEP 2468 H=2468:00 +CPU= 23.379
  11:14:13 STEP 2469 H=2469:00 +CPU= 37.107
  11:14:39 STEP 2470 H=2470:00 +CPU= 23.411
  11:15:02 STEP 2471 H=2471:00 +CPU= 23.545
  11:15:50 STEP 2472 H=2472:00 +CPU= 43.977
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_102.zip
Uploading the intermediate file: upload_file_102.zip
  11:16:13 STEP 2473 H=2473:00 +CPU= 23.295
  11:16:37 STEP 2474 H=2474:00 +CPU= 23.765
  11:17:21 STEP 2475 H=2475:00 +CPU= 38.483
  11:17:45 STEP 2476 H=2476:00 +CPU= 23.849
  11:18:09 STEP 2477 H=2477:00 +CPU= 23.020
  11:18:48 STEP 2478 H=2478:00 +CPU= 38.740
  11:19:12 STEP 2479 H=2479:00 +CPU= 23.281
  11:19:36 STEP 2480 H=2480:00 +CPU= 24.013
  11:20:14 STEP 2481 H=2481:00 +CPU= 37.925
  11:20:38 STEP 2482 H=2482:00 +CPU= 23.881
  11:21:02 STEP 2483 H=2483:00 +CPU= 23.382
  11:21:44 STEP 2484 H=2484:00 +CPU= 41.750
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002484
  11:22:07 STEP 2485 H=2485:00 +CPU= 23.339
  11:22:32 STEP 2486 H=2486:00 +CPU= 24.034
  11:23:10 STEP 2487 H=2487:00 +CPU= 38.043
  11:23:34 STEP 2488 H=2488:00 +CPU= 24.053
  11:23:58 STEP 2489 H=2489:00 +CPU= 23.231
  11:24:37 STEP 2490 H=2490:00 +CPU= 38.489
  11:25:00 STEP 2491 H=2491:00 +CPU= 23.180
  11:25:24 STEP 2492 H=2492:00 +CPU= 23.838
  11:26:02 STEP 2493 H=2493:00 +CPU= 37.749
  11:26:26 STEP 2494 H=2494:00 +CPU= 23.804
  11:26:50 STEP 2495 H=2495:00 +CPU= 24.038
  11:27:41 STEP 2496 H=2496:00 +CPU= 44.234
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_103.zip
Uploading the intermediate file: upload_file_103.zip
  11:28:05 STEP 2497 H=2497:00 +CPU= 23.338
  11:28:29 STEP 2498 H=2498:00 +CPU= 23.840
  11:29:08 STEP 2499 H=2499:00 +CPU= 37.728
  11:29:32 STEP 2500 H=2500:00 +CPU= 23.902
  11:29:55 STEP 2501 H=2501:00 +CPU= 23.225
  11:30:34 STEP 2502 H=2502:00 +CPU= 38.661
  11:30:58 STEP 2503 H=2503:00 +CPU= 23.135
  11:31:22 STEP 2504 H=2504:00 +CPU= 23.902
  11:32:00 STEP 2505 H=2505:00 +CPU= 37.795
  11:32:24 STEP 2506 H=2506:00 +CPU= 23.911
  11:32:47 STEP 2507 H=2507:00 +CPU= 23.255
  11:33:29 STEP 2508 H=2508:00 +CPU= 41.570
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002508
  11:33:53 STEP 2509 H=2509:00 +CPU= 23.285
  11:34:17 STEP 2510 H=2510:00 +CPU= 23.892
  11:34:55 STEP 2511 H=2511:00 +CPU= 37.795
  11:35:19 STEP 2512 H=2512:00 +CPU= 23.782
  11:35:42 STEP 2513 H=2513:00 +CPU= 23.116
  11:36:21 STEP 2514 H=2514:00 +CPU= 38.425
  11:36:44 STEP 2515 H=2515:00 +CPU= 23.143
  11:37:08 STEP 2516 H=2516:00 +CPU= 23.831
  11:37:46 STEP 2517 H=2517:00 +CPU= 37.595
  11:38:10 STEP 2518 H=2518:00 +CPU= 23.999
  11:38:34 STEP 2519 H=2519:00 +CPU= 24.006
  11:39:22 STEP 2520 H=2520:00 +CPU= 44.303
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:39:46 STEP 2521 H=2521:00 +CPU= 23.119
  11:40:10 STEP 2522 H=2522:00 +CPU= 23.932
  11:40:48 STEP 2523 H=2523:00 +CPU= 37.710
  11:41:15 STEP 2524 H=2524:00 +CPU= 24.166
  11:41:39 STEP 2525 H=2525:00 +CPU= 23.229
  11:42:18 STEP 2526 H=2526:00 +CPU= 38.511
  11:42:41 STEP 2527 H=2527:00 +CPU= 23.332
  11:43:05 STEP 2528 H=2528:00 +CPU= 23.986
  11:43:43 STEP 2529 H=2529:00 +CPU= 37.709
  11:44:08 STEP 2530 H=2530:00 +CPU= 23.995
  11:44:31 STEP 2531 H=2531:00 +CPU= 23.293
  11:45:13 STEP 2532 H=2532:00 +CPU= 41.693
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002532
  11:45:36 STEP 2533 H=2533:00 +CPU= 23.251
  11:46:01 STEP 2534 H=2534:00 +CPU= 23.874
  11:46:39 STEP 2535 H=2535:00 +CPU= 37.796
  11:47:03 STEP 2536 H=2536:00 +CPU= 23.694
  11:47:26 STEP 2537 H=2537:00 +CPU= 22.844
  11:48:04 STEP 2538 H=2538:00 +CPU= 37.741
  11:48:27 STEP 2539 H=2539:00 +CPU= 22.928
  11:48:50 STEP 2540 H=2540:00 +CPU= 23.550
  11:49:28 STEP 2541 H=2541:00 +CPU= 37.404
  11:49:52 STEP 2542 H=2542:00 +CPU= 23.612
  11:50:16 STEP 2543 H=2543:00 +CPU= 23.695
  11:51:02 STEP 2544 H=2544:00 +CPU= 43.023
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:51:25 STEP 2545 H=2545:00 +CPU= 22.693
  11:51:49 STEP 2546 H=2546:00 +CPU= 23.459
  11:52:26 STEP 2547 H=2547:00 +CPU= 37.124
  11:52:50 STEP 2548 H=2548:00 +CPU= 23.898
  11:53:13 STEP 2549 H=2549:00 +CPU= 22.886
  11:53:52 STEP 2550 H=2550:00 +CPU= 38.050
  11:54:15 STEP 2551 H=2551:00 +CPU= 23.017
  11:54:39 STEP 2552 H=2552:00 +CPU= 23.665
  11:55:16 STEP 2553 H=2553:00 +CPU= 37.245
  11:55:40 STEP 2554 H=2554:00 +CPU= 23.630
  11:56:03 STEP 2555 H=2555:00 +CPU= 22.936
  11:56:44 STEP 2556 H=2556:00 +CPU= 40.914
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002556
  11:57:07 STEP 2557 H=2557:00 +CPU= 23.072
  11:57:31 STEP 2558 H=2558:00 +CPU= 23.537
  11:58:08 STEP 2559 H=2559:00 +CPU= 37.171
  11:58:32 STEP 2560 H=2560:00 +CPU= 23.701
  11:58:55 STEP 2561 H=2561:00 +CPU= 22.895
  11:59:34 STEP 2562 H=2562:00 +CPU= 38.033
  11:59:57 STEP 2563 H=2563:00 +CPU= 23.129
  12:00:21 STEP 2564 H=2564:00 +CPU= 23.722
  12:00:59 STEP 2565 H=2565:00 +CPU= 37.675
  12:01:23 STEP 2566 H=2566:00 +CPU= 23.657
  12:01:46 STEP 2567 H=2567:00 +CPU= 23.656
  12:02:32 STEP 2568 H=2568:00 +CPU= 43.345
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_106.zip
Uploading the intermediate file: upload_file_106.zip
  12:02:56 STEP 2569 H=2569:00 +CPU= 22.973
  12:03:19 STEP 2570 H=2570:00 +CPU= 23.582
  12:03:57 STEP 2571 H=2571:00 +CPU= 37.094
  12:04:21 STEP 2572 H=2572:00 +CPU= 24.068
  12:04:44 STEP 2573 H=2573:00 +CPU= 23.007
  12:05:22 STEP 2574 H=2574:00 +CPU= 37.898
  12:05:46 STEP 2575 H=2575:00 +CPU= 23.176
  12:06:09 STEP 2576 H=2576:00 +CPU= 23.599
  12:06:46 STEP 2577 H=2577:00 +CPU= 37.105
  12:07:10 STEP 2578 H=2578:00 +CPU= 23.640
  12:07:33 STEP 2579 H=2579:00 +CPU= 22.962
  12:08:15 STEP 2580 H=2580:00 +CPU= 40.852
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002580
  12:08:38 STEP 2581 H=2581:00 +CPU= 23.014
  12:09:02 STEP 2582 H=2582:00 +CPU= 23.700
  12:09:39 STEP 2583 H=2583:00 +CPU= 37.223
  12:10:03 STEP 2584 H=2584:00 +CPU= 23.596
  12:10:26 STEP 2585 H=2585:00 +CPU= 22.937
  12:11:04 STEP 2586 H=2586:00 +CPU= 38.153
  12:11:27 STEP 2587 H=2587:00 +CPU= 22.896
  12:11:51 STEP 2588 H=2588:00 +CPU= 23.607
  12:12:28 STEP 2589 H=2589:00 +CPU= 37.113
  12:12:52 STEP 2590 H=2590:00 +CPU= 23.792
  12:13:16 STEP 2591 H=2591:00 +CPU= 23.762
  12:14:03 STEP 2592 H=2592:00 +CPU= 43.699
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_107.zip
Uploading the intermediate file: upload_file_107.zip
  12:14:26 STEP 2593 H=2593:00 +CPU= 23.004
  12:14:50 STEP 2594 H=2594:00 +CPU= 23.729
  12:15:28 STEP 2595 H=2595:00 +CPU= 37.185
  12:15:52 STEP 2596 H=2596:00 +CPU= 23.937
  12:16:15 STEP 2597 H=2597:00 +CPU= 23.040
  12:16:54 STEP 2598 H=2598:00 +CPU= 37.912
  12:17:17 STEP 2599 H=2599:00 +CPU= 23.033
  12:17:40 STEP 2600 H=2600:00 +CPU= 23.509
  12:18:18 STEP 2601 H=2601:00 +CPU= 37.270
  12:18:42 STEP 2602 H=2602:00 +CPU= 23.631
  12:19:05 STEP 2603 H=2603:00 +CPU= 22.909
  12:19:46 STEP 2604 H=2604:00 +CPU= 40.768
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002604
  12:20:09 STEP 2605 H=2605:00 +CPU= 23.020
  12:20:32 STEP 2606 H=2606:00 +CPU= 23.604
  12:21:10 STEP 2607 H=2607:00 +CPU= 37.713
  12:21:34 STEP 2608 H=2608:00 +CPU= 23.897
  12:21:58 STEP 2609 H=2609:00 +CPU= 23.113
  12:22:36 STEP 2610 H=2610:00 +CPU= 38.342
  12:23:00 STEP 2611 H=2611:00 +CPU= 23.220
  12:23:24 STEP 2612 H=2612:00 +CPU= 23.644
  12:24:02 STEP 2613 H=2613:00 +CPU= 37.832
  12:24:27 STEP 2614 H=2614:00 +CPU= 24.626
  12:24:51 STEP 2615 H=2615:00 +CPU= 24.108
  12:25:43 STEP 2616 H=2616:00 +CPU= 43.796
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:26:07 STEP 2617 H=2617:00 +CPU= 23.242
  12:26:31 STEP 2618 H=2618:00 +CPU= 23.714
  12:27:08 STEP 2619 H=2619:00 +CPU= 37.436
  12:27:33 STEP 2620 H=2620:00 +CPU= 24.147
  12:27:56 STEP 2621 H=2621:00 +CPU= 23.252
  12:28:35 STEP 2622 H=2622:00 +CPU= 38.308
  12:28:58 STEP 2623 H=2623:00 +CPU= 23.209
  12:29:22 STEP 2624 H=2624:00 +CPU= 23.753
  12:29:59 STEP 2625 H=2625:00 +CPU= 37.228
  12:30:23 STEP 2626 H=2626:00 +CPU= 23.785
  12:30:46 STEP 2627 H=2627:00 +CPU= 22.838
  12:31:27 STEP 2628 H=2628:00 +CPU= 40.994
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002628
  12:31:51 STEP 2629 H=2629:00 +CPU= 23.008
  12:32:14 STEP 2630 H=2630:00 +CPU= 23.664
  12:32:52 STEP 2631 H=2631:00 +CPU= 37.174
  12:33:15 STEP 2632 H=2632:00 +CPU= 23.564
  12:33:38 STEP 2633 H=2633:00 +CPU= 22.723
  12:34:16 STEP 2634 H=2634:00 +CPU= 37.797
  12:34:39 STEP 2635 H=2635:00 +CPU= 22.964
  12:35:03 STEP 2636 H=2636:00 +CPU= 23.550
  12:35:40 STEP 2637 H=2637:00 +CPU= 37.133
  12:36:04 STEP 2638 H=2638:00 +CPU= 23.698
  12:36:28 STEP 2639 H=2639:00 +CPU= 23.455
  12:37:15 STEP 2640 H=2640:00 +CPU= 43.722
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:37:38 STEP 2641 H=2641:00 +CPU= 22.945
Uploading trickle at timestep: 9504000
  12:38:02 STEP 2642 H=2642:00 +CPU= 23.497
  12:38:40 STEP 2643 H=2643:00 +CPU= 37.202
  12:39:05 STEP 2644 H=2644:00 +CPU= 23.862
  12:39:28 STEP 2645 H=2645:00 +CPU= 22.770
  12:40:07 STEP 2646 H=2646:00 +CPU= 37.982
  12:40:30 STEP 2647 H=2647:00 +CPU= 23.110
  12:40:54 STEP 2648 H=2648:00 +CPU= 23.573
  12:41:31 STEP 2649 H=2649:00 +CPU= 37.202
  12:41:55 STEP 2650 H=2650:00 +CPU= 23.570
  12:42:17 STEP 2651 H=2651:00 +CPU= 22.741
  12:42:59 STEP 2652 H=2652:00 +CPU= 41.541
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002652
  12:43:22 STEP 2653 H=2653:00 +CPU= 23.014
  12:43:46 STEP 2654 H=2654:00 +CPU= 23.648
  12:44:24 STEP 2655 H=2655:00 +CPU= 37.165
  12:44:47 STEP 2656 H=2656:00 +CPU= 23.693
  12:45:10 STEP 2657 H=2657:00 +CPU= 22.804
  12:45:48 STEP 2658 H=2658:00 +CPU= 37.738
  12:46:11 STEP 2659 H=2659:00 +CPU= 22.999
  12:46:35 STEP 2660 H=2660:00 +CPU= 23.599
  12:47:12 STEP 2661 H=2661:00 +CPU= 37.084
  12:47:36 STEP 2662 H=2662:00 +CPU= 23.599
  12:47:59 STEP 2663 H=2663:00 +CPU= 23.489
  12:48:43 STEP 2664 H=2664:00 +CPU= 43.675
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:49:07 STEP 2665 H=2665:00 +CPU= 23.036
  12:49:30 STEP 2666 H=2666:00 +CPU= 23.431
  12:50:07 STEP 2667 H=2667:00 +CPU= 36.920
  12:50:31 STEP 2668 H=2668:00 +CPU= 23.691
  12:50:54 STEP 2669 H=2669:00 +CPU= 22.948
  12:51:33 STEP 2670 H=2670:00 +CPU= 37.928
  12:51:56 STEP 2671 H=2671:00 +CPU= 22.917
  12:52:20 STEP 2672 H=2672:00 +CPU= 23.714
  12:52:57 STEP 2673 H=2673:00 +CPU= 37.037
  12:53:21 STEP 2674 H=2674:00 +CPU= 23.673
  12:53:44 STEP 2675 H=2675:00 +CPU= 23.014
  12:54:25 STEP 2676 H=2676:00 +CPU= 40.705
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002676
  12:54:48 STEP 2677 H=2677:00 +CPU= 23.034
  12:55:12 STEP 2678 H=2678:00 +CPU= 23.555
  12:55:49 STEP 2679 H=2679:00 +CPU= 37.108
  12:56:13 STEP 2680 H=2680:00 +CPU= 23.746
  12:56:36 STEP 2681 H=2681:00 +CPU= 22.927
  12:57:14 STEP 2682 H=2682:00 +CPU= 37.915
  12:57:37 STEP 2683 H=2683:00 +CPU= 22.941
  12:58:01 STEP 2684 H=2684:00 +CPU= 23.562
  12:58:38 STEP 2685 H=2685:00 +CPU= 37.049
  12:59:02 STEP 2686 H=2686:00 +CPU= 23.571
  12:59:26 STEP 2687 H=2687:00 +CPU= 23.614
  13:00:11 STEP 2688 H=2688:00 +CPU= 43.979
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_111.zip
Uploading the intermediate file: upload_file_111.zip
  13:00:34 STEP 2689 H=2689:00 +CPU= 22.840
  13:00:59 STEP 2690 H=2690:00 +CPU= 23.698
  13:01:36 STEP 2691 H=2691:00 +CPU= 37.108
  13:02:00 STEP 2692 H=2692:00 +CPU= 23.531
  13:02:25 STEP 2693 H=2693:00 +CPU= 23.165
  13:03:03 STEP 2694 H=2694:00 +CPU= 37.839
  13:03:26 STEP 2695 H=2695:00 +CPU= 23.023
  13:03:50 STEP 2696 H=2696:00 +CPU= 23.681
  13:04:28 STEP 2697 H=2697:00 +CPU= 37.222
  13:04:52 STEP 2698 H=2698:00 +CPU= 24.035
  13:05:15 STEP 2699 H=2699:00 +CPU= 23.096
  13:05:57 STEP 2700 H=2700:00 +CPU= 40.805
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002700
  13:06:20 STEP 2701 H=2701:00 +CPU= 22.934
  13:06:43 STEP 2702 H=2702:00 +CPU= 23.579
  13:07:21 STEP 2703 H=2703:00 +CPU= 37.020
  13:07:44 STEP 2704 H=2704:00 +CPU= 23.473
  13:08:07 STEP 2705 H=2705:00 +CPU= 22.874
  13:08:45 STEP 2706 H=2706:00 +CPU= 38.064
  13:09:08 STEP 2707 H=2707:00 +CPU= 22.972
  13:09:32 STEP 2708 H=2708:00 +CPU= 23.689
  13:10:10 STEP 2709 H=2709:00 +CPU= 37.148
  13:10:33 STEP 2710 H=2710:00 +CPU= 23.601
  13:10:57 STEP 2711 H=2711:00 +CPU= 23.613
  13:11:44 STEP 2712 H=2712:00 +CPU= 43.777
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_112.zip
Uploading the intermediate file: upload_file_112.zip
  13:12:07 STEP 2713 H=2713:00 +CPU= 22.862
  13:12:31 STEP 2714 H=2714:00 +CPU= 23.576
  13:13:08 STEP 2715 H=2715:00 +CPU= 37.089
  13:13:32 STEP 2716 H=2716:00 +CPU= 23.546
  13:14:03 STEP 2717 H=2717:00 +CPU= 23.089
  13:14:41 STEP 2718 H=2718:00 +CPU= 37.920
  13:15:04 STEP 2719 H=2719:00 +CPU= 23.147
  13:15:28 STEP 2720 H=2720:00 +CPU= 23.895
  13:16:06 STEP 2721 H=2721:00 +CPU= 37.142
  13:16:30 STEP 2722 H=2722:00 +CPU= 23.792
  13:16:53 STEP 2723 H=2723:00 +CPU= 23.105
  13:17:34 STEP 2724 H=2724:00 +CPU= 40.965
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002724
  13:17:57 STEP 2725 H=2725:00 +CPU= 23.022
  13:18:21 STEP 2726 H=2726:00 +CPU= 23.681
  13:18:58 STEP 2727 H=2727:00 +CPU= 37.021
  13:19:22 STEP 2728 H=2728:00 +CPU= 23.577
  13:19:45 STEP 2729 H=2729:00 +CPU= 23.140
  13:20:23 STEP 2730 H=2730:00 +CPU= 37.940
  13:20:47 STEP 2731 H=2731:00 +CPU= 23.071
  13:21:11 STEP 2732 H=2732:00 +CPU= 23.810
  13:21:48 STEP 2733 H=2733:00 +CPU= 37.140
  13:22:12 STEP 2734 H=2734:00 +CPU= 23.768
  13:22:36 STEP 2735 H=2735:00 +CPU= 23.636
  13:23:25 STEP 2736 H=2736:00 +CPU= 43.556
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_113.zip
Uploading the intermediate file: upload_file_113.zip
  13:23:48 STEP 2737 H=2737:00 +CPU= 23.021
  13:24:12 STEP 2738 H=2738:00 +CPU= 23.631
  13:24:49 STEP 2739 H=2739:00 +CPU= 37.265
  13:25:13 STEP 2740 H=2740:00 +CPU= 23.563
  13:25:39 STEP 2741 H=2741:00 +CPU= 23.470
  13:26:17 STEP 2742 H=2742:00 +CPU= 38.367
  13:26:41 STEP 2743 H=2743:00 +CPU= 22.977
  13:27:04 STEP 2744 H=2744:00 +CPU= 23.760
  13:27:42 STEP 2745 H=2745:00 +CPU= 37.132
  13:28:06 STEP 2746 H=2746:00 +CPU= 23.831
  13:28:29 STEP 2747 H=2747:00 +CPU= 23.132
  13:29:10 STEP 2748 H=2748:00 +CPU= 40.856
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002748
  13:29:33 STEP 2749 H=2749:00 +CPU= 23.100
  13:29:57 STEP 2750 H=2750:00 +CPU= 23.649
  13:30:34 STEP 2751 H=2751:00 +CPU= 37.036
  13:30:58 STEP 2752 H=2752:00 +CPU= 23.648
  13:31:21 STEP 2753 H=2753:00 +CPU= 22.881
  13:31:59 STEP 2754 H=2754:00 +CPU= 37.954
  13:32:22 STEP 2755 H=2755:00 +CPU= 22.984
  13:32:46 STEP 2756 H=2756:00 +CPU= 23.716
  13:33:23 STEP 2757 H=2757:00 +CPU= 37.015
  13:33:47 STEP 2758 H=2758:00 +CPU= 23.589
  13:34:11 STEP 2759 H=2759:00 +CPU= 23.572
  13:34:56 STEP 2760 H=2760:00 +CPU= 43.669
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:35:19 STEP 2761 H=2761:00 +CPU= 22.965
  13:35:44 STEP 2762 H=2762:00 +CPU= 23.784
  13:36:21 STEP 2763 H=2763:00 +CPU= 37.321
  13:36:45 STEP 2764 H=2764:00 +CPU= 23.660
  13:37:10 STEP 2765 H=2765:00 +CPU= 23.359
  13:37:49 STEP 2766 H=2766:00 +CPU= 38.003
  13:38:12 STEP 2767 H=2767:00 +CPU= 22.938
  13:38:36 STEP 2768 H=2768:00 +CPU= 23.734
  13:39:13 STEP 2769 H=2769:00 +CPU= 37.382
  13:39:37 STEP 2770 H=2770:00 +CPU= 23.652
  13:40:00 STEP 2771 H=2771:00 +CPU= 23.041
  13:40:42 STEP 2772 H=2772:00 +CPU= 40.873
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002772
  13:41:05 STEP 2773 H=2773:00 +CPU= 22.957
  13:41:29 STEP 2774 H=2774:00 +CPU= 23.831
  13:42:06 STEP 2775 H=2775:00 +CPU= 37.279
  13:42:30 STEP 2776 H=2776:00 +CPU= 23.614
  13:42:53 STEP 2777 H=2777:00 +CPU= 22.993
  13:43:31 STEP 2778 H=2778:00 +CPU= 37.888
  13:43:54 STEP 2779 H=2779:00 +CPU= 22.748
  13:44:17 STEP 2780 H=2780:00 +CPU= 23.587
  13:44:55 STEP 2781 H=2781:00 +CPU= 37.003
  13:45:18 STEP 2782 H=2782:00 +CPU= 23.555
  13:45:42 STEP 2783 H=2783:00 +CPU= 23.656
  13:46:28 STEP 2784 H=2784:00 +CPU= 43.601
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:46:51 STEP 2785 H=2785:00 +CPU= 22.898
  13:47:17 STEP 2786 H=2786:00 +CPU= 23.650
  13:47:54 STEP 2787 H=2787:00 +CPU= 36.999
  13:48:18 STEP 2788 H=2788:00 +CPU= 23.639
  13:48:41 STEP 2789 H=2789:00 +CPU= 22.869
  13:49:20 STEP 2790 H=2790:00 +CPU= 38.512
  13:49:43 STEP 2791 H=2791:00 +CPU= 22.870
  13:50:07 STEP 2792 H=2792:00 +CPU= 23.734
  13:50:44 STEP 2793 H=2793:00 +CPU= 37.229
  13:51:12 STEP 2794 H=2794:00 +CPU= 23.612
  13:51:36 STEP 2795 H=2795:00 +CPU= 21.730
  13:52:15 STEP 2796 H=2796:00 +CPU= 38.101
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002796
  13:52:36 STEP 2797 H=2797:00 +CPU= 20.962
  13:52:58 STEP 2798 H=2798:00 +CPU= 21.603
  13:53:33 STEP 2799 H=2799:00 +CPU= 33.672
  13:53:55 STEP 2800 H=2800:00 +CPU= 21.531
  13:54:16 STEP 2801 H=2801:00 +CPU= 21.019
  13:54:51 STEP 2802 H=2802:00 +CPU= 34.314
  13:55:12 STEP 2803 H=2803:00 +CPU= 20.967
  13:55:34 STEP 2804 H=2804:00 +CPU= 21.556
  13:56:08 STEP 2805 H=2805:00 +CPU= 33.685
  13:56:31 STEP 2806 H=2806:00 +CPU= 21.751
  13:56:53 STEP 2807 H=2807:00 +CPU= 21.598
  13:57:35 STEP 2808 H=2808:00 +CPU= 40.182
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:57:57 STEP 2809 H=2809:00 +CPU= 21.095
  13:58:19 STEP 2810 H=2810:00 +CPU= 21.583
  13:58:54 STEP 2811 H=2811:00 +CPU= 33.649
  13:59:16 STEP 2812 H=2812:00 +CPU= 21.636
  13:59:37 STEP 2813 H=2813:00 +CPU= 20.893
  14:00:12 STEP 2814 H=2814:00 +CPU= 34.562
  14:00:34 STEP 2815 H=2815:00 +CPU= 21.083
  14:00:57 STEP 2816 H=2816:00 +CPU= 21.591
  14:01:31 STEP 2817 H=2817:00 +CPU= 33.748
  14:01:53 STEP 2818 H=2818:00 +CPU= 21.674
  14:02:14 STEP 2819 H=2819:00 +CPU= 21.032
  14:02:52 STEP 2820 H=2820:00 +CPU= 37.343
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002820
  14:03:14 STEP 2821 H=2821:00 +CPU= 21.109
  14:03:36 STEP 2822 H=2822:00 +CPU= 21.566
  14:04:11 STEP 2823 H=2823:00 +CPU= 33.848
  14:04:33 STEP 2824 H=2824:00 +CPU= 21.668
  14:04:55 STEP 2825 H=2825:00 +CPU= 21.008
  14:05:30 STEP 2826 H=2826:00 +CPU= 34.462
  14:05:51 STEP 2827 H=2827:00 +CPU= 21.005
  14:06:13 STEP 2828 H=2828:00 +CPU= 21.606
  14:06:47 STEP 2829 H=2829:00 +CPU= 33.773
  14:07:09 STEP 2830 H=2830:00 +CPU= 21.604
  14:07:31 STEP 2831 H=2831:00 +CPU= 21.765
  14:08:15 STEP 2832 H=2832:00 +CPU= 40.480
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_117.zip
Uploading the intermediate file: upload_file_117.zip
  14:08:37 STEP 2833 H=2833:00 +CPU= 20.984
  14:08:59 STEP 2834 H=2834:00 +CPU= 21.717
  14:09:34 STEP 2835 H=2835:00 +CPU= 34.008
  14:09:56 STEP 2836 H=2836:00 +CPU= 21.644
  14:10:18 STEP 2837 H=2837:00 +CPU= 21.075
  14:10:53 STEP 2838 H=2838:00 +CPU= 34.465
  14:11:14 STEP 2839 H=2839:00 +CPU= 21.105
  14:11:37 STEP 2840 H=2840:00 +CPU= 22.019
  14:12:12 STEP 2841 H=2841:00 +CPU= 33.853
  14:12:34 STEP 2842 H=2842:00 +CPU= 21.690
  14:12:56 STEP 2843 H=2843:00 +CPU= 21.141
  14:13:34 STEP 2844 H=2844:00 +CPU= 37.368
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002844
  14:13:55 STEP 2845 H=2845:00 +CPU= 21.067
  14:14:17 STEP 2846 H=2846:00 +CPU= 21.617
  14:14:52 STEP 2847 H=2847:00 +CPU= 33.839
  14:15:14 STEP 2848 H=2848:00 +CPU= 21.646
  14:15:35 STEP 2849 H=2849:00 +CPU= 21.142
  14:16:11 STEP 2850 H=2850:00 +CPU= 34.546
  14:16:32 STEP 2851 H=2851:00 +CPU= 21.022
  14:16:54 STEP 2852 H=2852:00 +CPU= 21.607
  14:17:28 STEP 2853 H=2853:00 +CPU= 33.826
  14:17:50 STEP 2854 H=2854:00 +CPU= 21.610
  14:18:13 STEP 2855 H=2855:00 +CPU= 21.628
  14:18:54 STEP 2856 H=2856:00 +CPU= 39.862
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_118.zip
Uploading the intermediate file: upload_file_118.zip
  14:19:15 STEP 2857 H=2857:00 +CPU= 21.017
  14:19:38 STEP 2858 H=2858:00 +CPU= 21.696
  14:20:14 STEP 2859 H=2859:00 +CPU= 34.495
  14:20:36 STEP 2860 H=2860:00 +CPU= 21.759
  14:20:57 STEP 2861 H=2861:00 +CPU= 21.120
  14:21:34 STEP 2862 H=2862:00 +CPU= 34.679
  14:21:56 STEP 2863 H=2863:00 +CPU= 21.184
  14:22:18 STEP 2864 H=2864:00 +CPU= 21.768
  14:22:52 STEP 2865 H=2865:00 +CPU= 34.295
  14:23:15 STEP 2866 H=2866:00 +CPU= 21.885
  14:23:37 STEP 2867 H=2867:00 +CPU= 21.274
  14:24:15 STEP 2868 H=2868:00 +CPU= 37.750
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002868
  14:24:37 STEP 2869 H=2869:00 +CPU= 21.245
  14:24:59 STEP 2870 H=2870:00 +CPU= 21.789
  14:25:34 STEP 2871 H=2871:00 +CPU= 33.948
  14:25:56 STEP 2872 H=2872:00 +CPU= 21.856
  14:26:18 STEP 2873 H=2873:00 +CPU= 21.182
  14:26:53 STEP 2874 H=2874:00 +CPU= 34.971
  14:27:15 STEP 2875 H=2875:00 +CPU= 21.205
  14:27:37 STEP 2876 H=2876:00 +CPU= 21.869
  14:28:12 STEP 2877 H=2877:00 +CPU= 34.110
  14:28:35 STEP 2878 H=2878:00 +CPU= 21.829
  14:28:57 STEP 2879 H=2879:00 +CPU= 21.857
  14:29:40 STEP 2880 H=2880:00 +CPU= 40.152
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_119.zip
Uploading the intermediate file: upload_file_119.zip
  14:30:02 STEP 2881 H=2881:00 +CPU= 21.134
Uploading trickle at timestep: 10368000
  14:30:24 STEP 2882 H=2882:00 +CPU= 21.789
  14:30:59 STEP 2883 H=2883:00 +CPU= 34.008
  14:31:21 STEP 2884 H=2884:00 +CPU= 21.843
  14:31:43 STEP 2885 H=2885:00 +CPU= 21.453
  14:32:20 STEP 2886 H=2886:00 +CPU= 34.809
  14:32:41 STEP 2887 H=2887:00 +CPU= 21.183
  14:33:04 STEP 2888 H=2888:00 +CPU= 21.954
  14:33:39 STEP 2889 H=2889:00 +CPU= 34.206
  14:34:01 STEP 2890 H=2890:00 +CPU= 21.823
  14:34:25 STEP 2891 H=2891:00 +CPU= 21.604
  14:35:04 STEP 2892 H=2892:00 +CPU= 37.845
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002892
  14:35:26 STEP 2893 H=2893:00 +CPU= 21.128
  14:35:48 STEP 2894 H=2894:00 +CPU= 21.865
  14:36:23 STEP 2895 H=2895:00 +CPU= 33.927
  14:36:45 STEP 2896 H=2896:00 +CPU= 21.841
  14:37:06 STEP 2897 H=2897:00 +CPU= 21.208
  14:37:42 STEP 2898 H=2898:00 +CPU= 34.622
  14:38:03 STEP 2899 H=2899:00 +CPU= 21.302
  14:38:25 STEP 2900 H=2900:00 +CPU= 21.694
  14:39:00 STEP 2901 H=2901:00 +CPU= 34.063
  14:39:23 STEP 2902 H=2902:00 +CPU= 21.800
  14:39:45 STEP 2903 H=2903:00 +CPU= 21.879
  14:40:27 STEP 2904 H=2904:00 +CPU= 40.260
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_120.zip
Uploading the intermediate file: upload_file_120.zip
  14:40:49 STEP 2905 H=2905:00 +CPU= 21.183
  14:41:11 STEP 2906 H=2906:00 +CPU= 21.718
  14:41:46 STEP 2907 H=2907:00 +CPU= 34.139
  14:42:09 STEP 2908 H=2908:00 +CPU= 21.779
  14:42:30 STEP 2909 H=2909:00 +CPU= 21.132
  14:43:06 STEP 2910 H=2910:00 +CPU= 34.951
  14:43:28 STEP 2911 H=2911:00 +CPU= 21.201
  14:43:50 STEP 2912 H=2912:00 +CPU= 21.965
  14:44:25 STEP 2913 H=2913:00 +CPU= 33.908
  14:44:48 STEP 2914 H=2914:00 +CPU= 21.978
  14:45:09 STEP 2915 H=2915:00 +CPU= 21.125
  14:45:48 STEP 2916 H=2916:00 +CPU= 37.630
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002916
  14:46:10 STEP 2917 H=2917:00 +CPU= 21.102
  14:46:32 STEP 2918 H=2918:00 +CPU= 21.629
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2001050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0837
(argv4) batchid: 970
(argv5) wuid: 12187481
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_dbc36754dce6c47dbeb44535c00ea1a4 to: /var/lib/boinc/slots/1/oifs_43r3_ps_0837_2001050100_123_970_12187481.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_ps_0837_2001050100_123_970_12187481.zip
ic_ancil_file: ic_ancil_12187481
ifsdata_file: ifsdata_12187481
climate_data_file: clim_data_12187481
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_0dcd2e96029f7c4aa8213e19dd8619d4 to: /var/lib/boinc/slots/1/ic_ancil_12187481.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12187481.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_408b78754bf0e9dcc2802db33ac3ba48 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12187481.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12187481.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12187481.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12187481.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12187481.xml
Opened progress file ok : /var/lib/boinc/slots/1/progress_file_12187481.xml
-- Model is restarting --
Adjusting last_iter, 2919, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/1/progress_file_12187481.xml
last_cpu_time: 78639
upload_file_number: 121
last_iter: 2903
last_upload: 10454400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700
The child process has been launched with process id: 14846
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc:1:1:14846:14846] [20230109:135238:1673272358:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:53:23 STEP 2904 H=2904:00 +CPU= 39.498
  13:53:45 STEP 2905 H=2905:00 +CPU= 21.492
  13:54:07 STEP 2906 H=2906:00 +CPU= 22.102
  13:54:47 STEP 2907 H=2907:00 +CPU= 36.118
  13:55:11 STEP 2908 H=2908:00 +CPU= 23.323
  13:55:37 STEP 2909 H=2909:00 +CPU= 22.011
  13:56:13 STEP 2910 H=2910:00 +CPU= 35.050
  13:56:34 STEP 2911 H=2911:00 +CPU= 20.976
  13:56:56 STEP 2912 H=2912:00 +CPU= 22.068
  13:57:31 STEP 2913 H=2913:00 +CPU= 34.050
  13:57:52 STEP 2914 H=2914:00 +CPU= 21.651
  13:58:14 STEP 2915 H=2915:00 +CPU= 21.234
  13:58:52 STEP 2916 H=2916:00 +CPU= 37.324
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002916
  13:59:13 STEP 2917 H=2917:00 +CPU= 21.213
  13:59:36 STEP 2918 H=2918:00 +CPU= 22.344
  14:00:10 STEP 2919 H=2919:00 +CPU= 33.854
  14:00:33 STEP 2920 H=2920:00 +CPU= 21.943
  14:00:55 STEP 2921 H=2921:00 +CPU= 21.660
  14:01:31 STEP 2922 H=2922:00 +CPU= 35.644
  14:01:53 STEP 2923 H=2923:00 +CPU= 21.482
  14:02:15 STEP 2924 H=2924:00 +CPU= 21.505
  14:02:50 STEP 2925 H=2925:00 +CPU= 34.565
  14:03:15 STEP 2926 H=2926:00 +CPU= 22.143
  14:03:42 STEP 2927 H=2927:00 +CPU= 22.658
  14:04:34 STEP 2928 H=2928:00 +CPU= 40.855
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_121.zip
Uploading the intermediate file: upload_file_121.zip
  14:05:00 STEP 2929 H=2929:00 +CPU= 21.484
  14:05:26 STEP 2930 H=2930:00 +CPU= 22.075
  14:06:09 STEP 2931 H=2931:00 +CPU= 34.688
  14:06:35 STEP 2932 H=2932:00 +CPU= 22.104
  14:07:01 STEP 2933 H=2933:00 +CPU= 21.600
  14:07:44 STEP 2934 H=2934:00 +CPU= 35.446
  14:08:10 STEP 2935 H=2935:00 +CPU= 21.597
  14:08:38 STEP 2936 H=2936:00 +CPU= 22.355
  14:09:22 STEP 2937 H=2937:00 +CPU= 34.563
  14:09:52 STEP 2938 H=2938:00 +CPU= 22.267
  14:10:20 STEP 2939 H=2939:00 +CPU= 21.348
  14:11:09 STEP 2940 H=2940:00 +CPU= 38.075
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002940
  14:11:32 STEP 2941 H=2941:00 +CPU= 21.976
  14:11:55 STEP 2942 H=2942:00 +CPU= 22.239
  14:12:30 STEP 2943 H=2943:00 +CPU= 35.252
  14:12:52 STEP 2944 H=2944:00 +CPU= 22.217
  14:13:14 STEP 2945 H=2945:00 +CPU= 21.493
  14:13:51 STEP 2946 H=2946:00 +CPU= 35.899
  14:14:13 STEP 2947 H=2947:00 +CPU= 21.625
  14:14:35 STEP 2948 H=2948:00 +CPU= 22.275
  14:15:10 STEP 2949 H=2949:00 +CPU= 34.560
  14:15:32 STEP 2950 H=2950:00 +CPU= 22.042
  14:15:54 STEP 2951 H=2951:00 +CPU= 22.292
  14:16:35 STEP 2952 H=2952:00 +CPU= 39.184
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187481/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0837_2001050100_123_970_12187481_0_r227328700_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:19:59 (14843): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:13:47 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 10,623,600 79,958 0.0075
09 May 2023 16:11:47 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 10,368,000 77,630 0.0075
09 May 2023 16:11:47 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 10,368,000 77,630 0.0075
09 May 2023 16:11:41 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 9,504,000 71,010 0.0075
09 May 2023 16:11:38 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 8,640,000 64,146 0.0074
09 May 2023 16:11:33 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 7,776,000 57,341 0.0074
09 May 2023 16:11:27 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 6,912,000 50,769 0.0073
09 May 2023 16:11:20 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 6,048,000 44,520 0.0074
09 May 2023 16:11:14 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 5,184,000 38,148 0.0074
09 May 2023 16:11:11 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 4,320,000 31,729 0.0073
09 May 2023 16:11:00 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 3,456,000 25,032 0.0072
09 May 2023 16:10:53 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 2,592,000 18,297 0.0071
09 May 2023 16:10:47 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 1,728,000 12,083 0.0070
09 May 2023 16:10:40 1531770 22272909 oifs_43r3_ps_0837_2001050100_123_970_12187481_0 864,000 6,087 0.0070


©2024 climateprediction.net