climateprediction.net home page
Task 22294490

Task 22294490

Name oifs_43r3_ps_0699_2001050100_123_970_12187343_2
Workunit 12187343
Created 30 Dec 2022, 7:13:40 UTC
Sent 3 Jan 2023, 21:35:03 UTC
Report deadline 2 Feb 2023, 21:35:03 UTC
Received 5 Jan 2023, 7:57:53 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1531398
Run time 23 hours 43 min 30 sec
CPU time 23 hours 27 min 25 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.92 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,804.00 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,291.81 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
:18:24 STEP 2396 H=2396:00 +CPU= 17.113
  20:18:49 STEP 2397 H=2397:00 +CPU= 24.180
  20:19:05 STEP 2398 H=2398:00 +CPU= 16.869
  20:19:22 STEP 2399 H=2399:00 +CPU= 16.592
  20:19:51 STEP 2400 H=2400:00 +CPU= 28.866
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_99.zip
Uploading the intermediate file: upload_file_99.zip
  20:20:09 STEP 2401 H=2401:00 +CPU= 17.653
  20:20:27 STEP 2402 H=2402:00 +CPU= 18.026
  20:20:54 STEP 2403 H=2403:00 +CPU= 27.248
  20:21:14 STEP 2404 H=2404:00 +CPU= 20.310
  20:21:33 STEP 2405 H=2405:00 +CPU= 18.377
  20:22:02 STEP 2406 H=2406:00 +CPU= 29.368
  20:22:20 STEP 2407 H=2407:00 +CPU= 17.695
  20:22:39 STEP 2408 H=2408:00 +CPU= 19.321
  20:23:09 STEP 2409 H=2409:00 +CPU= 29.726
  20:23:29 STEP 2410 H=2410:00 +CPU= 20.026
  20:23:49 STEP 2411 H=2411:00 +CPU= 19.176
  20:24:20 STEP 2412 H=2412:00 +CPU= 31.508
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002412
  20:24:38 STEP 2413 H=2413:00 +CPU= 17.924
  20:24:57 STEP 2414 H=2414:00 +CPU= 18.168
  20:25:26 STEP 2415 H=2415:00 +CPU= 29.195
  20:25:46 STEP 2416 H=2416:00 +CPU= 20.380
  20:26:06 STEP 2417 H=2417:00 +CPU= 19.660
  20:26:36 STEP 2418 H=2418:00 +CPU= 29.851
  20:26:55 STEP 2419 H=2419:00 +CPU= 19.493
  20:27:15 STEP 2420 H=2420:00 +CPU= 19.835
  20:27:45 STEP 2421 H=2421:00 +CPU= 29.538
  20:28:05 STEP 2422 H=2422:00 +CPU= 20.514
  20:28:25 STEP 2423 H=2423:00 +CPU= 19.962
  20:29:00 STEP 2424 H=2424:00 +CPU= 34.538
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_100.zip
Uploading the intermediate file: upload_file_100.zip
  20:29:19 STEP 2425 H=2425:00 +CPU= 18.468
  20:29:39 STEP 2426 H=2426:00 +CPU= 20.030
  20:30:08 STEP 2427 H=2427:00 +CPU= 29.485
  20:30:28 STEP 2428 H=2428:00 +CPU= 19.933
  20:30:48 STEP 2429 H=2429:00 +CPU= 19.372
  20:31:17 STEP 2430 H=2430:00 +CPU= 29.592
  20:31:35 STEP 2431 H=2431:00 +CPU= 17.886
  20:31:54 STEP 2432 H=2432:00 +CPU= 18.642
  20:32:22 STEP 2433 H=2433:00 +CPU= 28.025
  20:32:40 STEP 2434 H=2434:00 +CPU= 18.011
  20:32:58 STEP 2435 H=2435:00 +CPU= 17.560
  20:33:28 STEP 2436 H=2436:00 +CPU= 30.090
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002436
  20:33:46 STEP 2437 H=2437:00 +CPU= 17.508
  20:34:03 STEP 2438 H=2438:00 +CPU= 17.542
  20:34:30 STEP 2439 H=2439:00 +CPU= 26.850
  20:34:48 STEP 2440 H=2440:00 +CPU= 17.740
  20:35:06 STEP 2441 H=2441:00 +CPU= 17.774
  20:35:33 STEP 2442 H=2442:00 +CPU= 27.007
  20:35:51 STEP 2443 H=2443:00 +CPU= 18.618
  20:36:11 STEP 2444 H=2444:00 +CPU= 19.302
  20:36:39 STEP 2445 H=2445:00 +CPU= 28.114
  20:36:58 STEP 2446 H=2446:00 +CPU= 18.859
  20:37:17 STEP 2447 H=2447:00 +CPU= 18.767
  20:37:48 STEP 2448 H=2448:00 +CPU= 31.019
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_101.zip
Uploading the intermediate file: upload_file_101.zip
  20:38:05 STEP 2449 H=2449:00 +CPU= 16.752
Uploading trickle at timestep: 8812800
  20:38:23 STEP 2450 H=2450:00 +CPU= 18.618
  20:38:51 STEP 2451 H=2451:00 +CPU= 28.112
  20:39:10 STEP 2452 H=2452:00 +CPU= 18.848
  20:39:27 STEP 2453 H=2453:00 +CPU= 16.831
  20:39:54 STEP 2454 H=2454:00 +CPU= 26.748
  20:40:11 STEP 2455 H=2455:00 +CPU= 16.703
  20:40:29 STEP 2456 H=2456:00 +CPU= 18.632
  20:40:58 STEP 2457 H=2457:00 +CPU= 28.230
  20:41:17 STEP 2458 H=2458:00 +CPU= 18.916
  20:41:35 STEP 2459 H=2459:00 +CPU= 18.405
  20:42:04 STEP 2460 H=2460:00 +CPU= 29.253
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002460
  20:42:22 STEP 2461 H=2461:00 +CPU= 17.140
  20:42:39 STEP 2462 H=2462:00 +CPU= 17.404
  20:43:05 STEP 2463 H=2463:00 +CPU= 25.938
  20:43:23 STEP 2464 H=2464:00 +CPU= 17.698
  20:43:41 STEP 2465 H=2465:00 +CPU= 18.239
  20:44:10 STEP 2466 H=2466:00 +CPU= 28.736
  20:44:28 STEP 2467 H=2467:00 +CPU= 18.182
  20:44:47 STEP 2468 H=2468:00 +CPU= 18.860
  20:45:13 STEP 2469 H=2469:00 +CPU= 25.687
  20:45:30 STEP 2470 H=2470:00 +CPU= 16.957
  20:45:48 STEP 2471 H=2471:00 +CPU= 17.414
  20:46:18 STEP 2472 H=2472:00 +CPU= 30.090
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_102.zip
Uploading the intermediate file: upload_file_102.zip
  20:46:35 STEP 2473 H=2473:00 +CPU= 17.361
  20:46:54 STEP 2474 H=2474:00 +CPU= 18.721
  20:47:22 STEP 2475 H=2475:00 +CPU= 28.099
  20:47:41 STEP 2476 H=2476:00 +CPU= 18.632
  20:47:59 STEP 2477 H=2477:00 +CPU= 17.766
  20:48:26 STEP 2478 H=2478:00 +CPU= 27.679
  20:48:44 STEP 2479 H=2479:00 +CPU= 17.049
  20:49:01 STEP 2480 H=2480:00 +CPU= 17.540
  20:49:29 STEP 2481 H=2481:00 +CPU= 27.749
  20:49:46 STEP 2482 H=2482:00 +CPU= 17.443
  20:50:03 STEP 2483 H=2483:00 +CPU= 17.004
  20:50:32 STEP 2484 H=2484:00 +CPU= 28.457
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002484
  20:50:50 STEP 2485 H=2485:00 +CPU= 17.675
  20:51:08 STEP 2486 H=2486:00 +CPU= 18.503
  20:51:35 STEP 2487 H=2487:00 +CPU= 26.561
  20:51:54 STEP 2488 H=2488:00 +CPU= 19.112
  20:52:12 STEP 2489 H=2489:00 +CPU= 17.739
  20:52:41 STEP 2490 H=2490:00 +CPU= 28.452
  20:52:58 STEP 2491 H=2491:00 +CPU= 17.678
  20:53:17 STEP 2492 H=2492:00 +CPU= 18.562
  20:53:45 STEP 2493 H=2493:00 +CPU= 28.311
  20:54:05 STEP 2494 H=2494:00 +CPU= 18.973
  20:54:24 STEP 2495 H=2495:00 +CPU= 18.991
  20:54:54 STEP 2496 H=2496:00 +CPU= 30.842
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_103.zip
Uploading the intermediate file: upload_file_103.zip
  20:55:12 STEP 2497 H=2497:00 +CPU= 17.006
  20:55:31 STEP 2498 H=2498:00 +CPU= 19.352
  20:56:00 STEP 2499 H=2499:00 +CPU= 29.129
  20:56:19 STEP 2500 H=2500:00 +CPU= 19.057
  20:56:38 STEP 2501 H=2501:00 +CPU= 18.331
  20:57:06 STEP 2502 H=2502:00 +CPU= 28.420
  20:57:25 STEP 2503 H=2503:00 +CPU= 18.318
  20:57:43 STEP 2504 H=2504:00 +CPU= 18.078
  20:58:10 STEP 2505 H=2505:00 +CPU= 27.497
  20:58:30 STEP 2506 H=2506:00 +CPU= 19.914
  20:58:49 STEP 2507 H=2507:00 +CPU= 19.007
  20:59:22 STEP 2508 H=2508:00 +CPU= 32.257
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002508
  20:59:41 STEP 2509 H=2509:00 +CPU= 19.402
  21:00:01 STEP 2510 H=2510:00 +CPU= 19.943
  21:00:30 STEP 2511 H=2511:00 +CPU= 28.894
  21:00:48 STEP 2512 H=2512:00 +CPU= 18.022
  21:01:07 STEP 2513 H=2513:00 +CPU= 18.598
  21:01:37 STEP 2514 H=2514:00 +CPU= 27.730
  21:02:00 STEP 2515 H=2515:00 +CPU= 17.744
  21:02:20 STEP 2516 H=2516:00 +CPU= 18.388
  21:02:51 STEP 2517 H=2517:00 +CPU= 27.168
  21:03:12 STEP 2518 H=2518:00 +CPU= 18.686
  21:03:33 STEP 2519 H=2519:00 +CPU= 18.771
  21:04:09 STEP 2520 H=2520:00 +CPU= 33.302
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_104.zip
Uploading the intermediate file: upload_file_104.zip
  21:04:27 STEP 2521 H=2521:00 +CPU= 17.824
  21:04:47 STEP 2522 H=2522:00 +CPU= 18.657
  21:05:17 STEP 2523 H=2523:00 +CPU= 28.100
  21:05:36 STEP 2524 H=2524:00 +CPU= 18.455
  21:05:56 STEP 2525 H=2525:00 +CPU= 18.229
  21:06:27 STEP 2526 H=2526:00 +CPU= 28.808
  21:06:46 STEP 2527 H=2527:00 +CPU= 18.176
  21:07:07 STEP 2528 H=2528:00 +CPU= 19.072
  21:07:36 STEP 2529 H=2529:00 +CPU= 27.791
  21:07:56 STEP 2530 H=2530:00 +CPU= 18.502
  21:08:16 STEP 2531 H=2531:00 +CPU= 18.532
  21:08:50 STEP 2532 H=2532:00 +CPU= 31.191
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002532
  21:09:09 STEP 2533 H=2533:00 +CPU= 17.956
  21:09:29 STEP 2534 H=2534:00 +CPU= 18.987
  21:09:59 STEP 2535 H=2535:00 +CPU= 28.073
  21:10:19 STEP 2536 H=2536:00 +CPU= 18.285
  21:10:38 STEP 2537 H=2537:00 +CPU= 18.293
  21:11:08 STEP 2538 H=2538:00 +CPU= 28.371
  21:11:27 STEP 2539 H=2539:00 +CPU= 18.174
  21:11:47 STEP 2540 H=2540:00 +CPU= 19.119
  21:12:15 STEP 2541 H=2541:00 +CPU= 28.011
  21:12:34 STEP 2542 H=2542:00 +CPU= 18.545
  21:12:54 STEP 2543 H=2543:00 +CPU= 19.131
  21:13:28 STEP 2544 H=2544:00 +CPU= 32.870
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_105.zip
Uploading the intermediate file: upload_file_105.zip
  21:13:46 STEP 2545 H=2545:00 +CPU= 17.572
  21:14:07 STEP 2546 H=2546:00 +CPU= 19.222
  21:14:38 STEP 2547 H=2547:00 +CPU= 28.136
  21:14:58 STEP 2548 H=2548:00 +CPU= 18.486
  21:15:18 STEP 2549 H=2549:00 +CPU= 18.347
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2001050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0699
(argv4) batchid: 970
(argv5) wuid: 12187343
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/5
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_07e6b671760f5eae0e293d1b27ea3145 to: /var/lib/boinc/slots/5/oifs_43r3_ps_0699_2001050100_123_970_12187343.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/5/oifs_43r3_ps_0699_2001050100_123_970_12187343.zip
ic_ancil_file: ic_ancil_12187343
ifsdata_file: ifsdata_12187343
climate_data_file: clim_data_12187343
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_8f000115387a8899607ae492a939f32e to: /var/lib/boinc/slots/5/ic_ancil_12187343.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/5/ic_ancil_12187343.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b935b3ec8ea9c354ff15ac97c2af8850 to: /var/lib/boinc/slots/5/ifsdata/ifsdata_12187343.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/5/ifsdata/ifsdata_12187343.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/5/159l_2/clim_data_12187343.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/5/159l_2/clim_data_12187343.zip
Checking for progress XML file: /var/lib/boinc/slots/5/progress_file_12187343.xml
Opened progress file ok : /var/lib/boinc/slots/5/progress_file_12187343.xml
-- Model is restarting --
Adjusting last_iter, 2549, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/5/progress_file_12187343.xml
last_cpu_time: 76063
upload_file_number: 106
last_iter: 2543
last_upload: 9158400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868
The child process has been launched with process id: 12994
Executing the command: /var/lib/boinc/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:12994:12994] [20230104:232424:1672874664:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:24:59 STEP 2544 H=2544:00 +CPU= 31.860
  23:25:17 STEP 2545 H=2545:00 +CPU= 18.343
  23:25:36 STEP 2546 H=2546:00 +CPU= 18.499
  23:26:03 STEP 2547 H=2547:00 +CPU= 26.609
  23:26:22 STEP 2548 H=2548:00 +CPU= 19.315
  23:26:41 STEP 2549 H=2549:00 +CPU= 18.797
  23:27:11 STEP 2550 H=2550:00 +CPU= 28.732
  23:27:30 STEP 2551 H=2551:00 +CPU= 19.195
  23:27:51 STEP 2552 H=2552:00 +CPU= 19.749
  23:28:19 STEP 2553 H=2553:00 +CPU= 27.631
  23:28:39 STEP 2554 H=2554:00 +CPU= 18.935
  23:28:57 STEP 2555 H=2555:00 +CPU= 18.375
  23:29:29 STEP 2556 H=2556:00 +CPU= 31.126
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002556
  23:29:49 STEP 2557 H=2557:00 +CPU= 18.931
  23:30:08 STEP 2558 H=2558:00 +CPU= 18.862
  23:30:37 STEP 2559 H=2559:00 +CPU= 27.739
  23:30:55 STEP 2560 H=2560:00 +CPU= 17.865
  23:31:14 STEP 2561 H=2561:00 +CPU= 18.846
  23:31:44 STEP 2562 H=2562:00 +CPU= 28.930
  23:32:03 STEP 2563 H=2563:00 +CPU= 18.947
  23:32:23 STEP 2564 H=2564:00 +CPU= 18.754
  23:32:52 STEP 2565 H=2565:00 +CPU= 28.321
  23:33:12 STEP 2566 H=2566:00 +CPU= 19.147
  23:33:33 STEP 2567 H=2567:00 +CPU= 19.884
  23:34:05 STEP 2568 H=2568:00 +CPU= 32.190
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_106.zip
Uploading the intermediate file: upload_file_106.zip
  23:34:24 STEP 2569 H=2569:00 +CPU= 18.886
  23:34:43 STEP 2570 H=2570:00 +CPU= 18.648
  23:35:10 STEP 2571 H=2571:00 +CPU= 26.936
  23:35:28 STEP 2572 H=2572:00 +CPU= 18.197
  23:35:48 STEP 2573 H=2573:00 +CPU= 19.354
  23:36:17 STEP 2574 H=2574:00 +CPU= 29.261
  23:36:35 STEP 2575 H=2575:00 +CPU= 18.095
  23:36:54 STEP 2576 H=2576:00 +CPU= 19.075
  23:37:22 STEP 2577 H=2577:00 +CPU= 28.257
  23:37:42 STEP 2578 H=2578:00 +CPU= 19.331
  23:38:01 STEP 2579 H=2579:00 +CPU= 18.820
  23:38:32 STEP 2580 H=2580:00 +CPU= 31.825
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002580
  23:38:51 STEP 2581 H=2581:00 +CPU= 18.431
  23:39:10 STEP 2582 H=2582:00 +CPU= 19.360
  23:39:39 STEP 2583 H=2583:00 +CPU= 28.411
  23:39:58 STEP 2584 H=2584:00 +CPU= 19.371
  23:40:17 STEP 2585 H=2585:00 +CPU= 18.835
  23:40:45 STEP 2586 H=2586:00 +CPU= 28.117
  23:41:03 STEP 2587 H=2587:00 +CPU= 18.042
  23:41:22 STEP 2588 H=2588:00 +CPU= 18.641
  23:41:50 STEP 2589 H=2589:00 +CPU= 28.299
  23:42:10 STEP 2590 H=2590:00 +CPU= 19.334
  23:42:29 STEP 2591 H=2591:00 +CPU= 19.469
  23:43:01 STEP 2592 H=2592:00 +CPU= 32.024
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_107.zip
Uploading the intermediate file: upload_file_107.zip
  23:43:20 STEP 2593 H=2593:00 +CPU= 18.411
  23:43:38 STEP 2594 H=2594:00 +CPU= 17.804
  23:44:05 STEP 2595 H=2595:00 +CPU= 26.757
  23:44:22 STEP 2596 H=2596:00 +CPU= 17.936
  23:44:40 STEP 2597 H=2597:00 +CPU= 17.462
  23:45:07 STEP 2598 H=2598:00 +CPU= 27.345
  23:45:24 STEP 2599 H=2599:00 +CPU= 17.034
  23:45:42 STEP 2600 H=2600:00 +CPU= 17.669
  23:46:09 STEP 2601 H=2601:00 +CPU= 26.503
  23:46:27 STEP 2602 H=2602:00 +CPU= 18.094
  23:46:45 STEP 2603 H=2603:00 +CPU= 18.088
  23:47:16 STEP 2604 H=2604:00 +CPU= 31.390
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002604
  23:47:34 STEP 2605 H=2605:00 +CPU= 17.221
  23:47:51 STEP 2606 H=2606:00 +CPU= 17.515
  23:48:18 STEP 2607 H=2607:00 +CPU= 26.360
  23:48:35 STEP 2608 H=2608:00 +CPU= 17.656
  23:48:52 STEP 2609 H=2609:00 +CPU= 16.927
  23:49:20 STEP 2610 H=2610:00 +CPU= 27.184
  23:49:37 STEP 2611 H=2611:00 +CPU= 16.957
  23:49:54 STEP 2612 H=2612:00 +CPU= 17.411
  23:50:20 STEP 2613 H=2613:00 +CPU= 26.190
  23:50:38 STEP 2614 H=2614:00 +CPU= 17.553
  23:50:56 STEP 2615 H=2615:00 +CPU= 17.803
  23:51:28 STEP 2616 H=2616:00 +CPU= 31.469
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_108.zip
Uploading the intermediate file: upload_file_108.zip
  23:51:46 STEP 2617 H=2617:00 +CPU= 18.111
  23:52:04 STEP 2618 H=2618:00 +CPU= 18.450
  23:52:32 STEP 2619 H=2619:00 +CPU= 27.845
  23:52:51 STEP 2620 H=2620:00 +CPU= 19.033
  23:53:10 STEP 2621 H=2621:00 +CPU= 18.352
  23:53:38 STEP 2622 H=2622:00 +CPU= 28.339
  23:53:57 STEP 2623 H=2623:00 +CPU= 18.426
  23:54:15 STEP 2624 H=2624:00 +CPU= 18.817
  23:54:43 STEP 2625 H=2625:00 +CPU= 27.966
  23:55:03 STEP 2626 H=2626:00 +CPU= 19.114
  23:55:21 STEP 2627 H=2627:00 +CPU= 18.243
  23:55:52 STEP 2628 H=2628:00 +CPU= 30.913
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002628
  23:56:10 STEP 2629 H=2629:00 +CPU= 18.626
  23:56:29 STEP 2630 H=2630:00 +CPU= 18.875
  23:56:57 STEP 2631 H=2631:00 +CPU= 28.163
  23:57:16 STEP 2632 H=2632:00 +CPU= 18.952
  23:57:35 STEP 2633 H=2633:00 +CPU= 18.611
  23:58:04 STEP 2634 H=2634:00 +CPU= 28.882
  23:58:23 STEP 2635 H=2635:00 +CPU= 18.843
  23:58:42 STEP 2636 H=2636:00 +CPU= 19.341
  23:59:10 STEP 2637 H=2637:00 +CPU= 28.185
  23:59:30 STEP 2638 H=2638:00 +CPU= 19.342
  23:59:50 STEP 2639 H=2639:00 +CPU= 19.706
  00:00:22 STEP 2640 H=2640:00 +CPU= 32.622
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_109.zip
Uploading the intermediate file: upload_file_109.zip
  00:00:41 STEP 2641 H=2641:00 +CPU= 18.346
  00:01:00 STEP 2642 H=2642:00 +CPU= 19.370
  00:01:29 STEP 2643 H=2643:00 +CPU= 28.357
  00:01:48 STEP 2644 H=2644:00 +CPU= 19.115
  00:02:06 STEP 2645 H=2645:00 +CPU= 18.079
  00:02:35 STEP 2646 H=2646:00 +CPU= 29.534
  00:02:54 STEP 2647 H=2647:00 +CPU= 18.140
  00:03:12 STEP 2648 H=2648:00 +CPU= 18.582
  00:03:41 STEP 2649 H=2649:00 +CPU= 28.443
  00:03:59 STEP 2650 H=2650:00 +CPU= 18.039
  00:04:17 STEP 2651 H=2651:00 +CPU= 18.128
  00:04:48 STEP 2652 H=2652:00 +CPU= 30.687
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002652
  00:05:05 STEP 2653 H=2653:00 +CPU= 16.966
  00:05:22 STEP 2654 H=2654:00 +CPU= 17.607
  00:05:49 STEP 2655 H=2655:00 +CPU= 26.934
  00:06:07 STEP 2656 H=2656:00 +CPU= 17.319
  00:06:24 STEP 2657 H=2657:00 +CPU= 17.500
  00:06:53 STEP 2658 H=2658:00 +CPU= 28.469
  00:07:11 STEP 2659 H=2659:00 +CPU= 18.257
  00:07:30 STEP 2660 H=2660:00 +CPU= 18.689
  00:07:58 STEP 2661 H=2661:00 +CPU= 27.852
  00:08:16 STEP 2662 H=2662:00 +CPU= 18.923
  00:08:35 STEP 2663 H=2663:00 +CPU= 18.030
  00:09:05 STEP 2664 H=2664:00 +CPU= 30.539
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_110.zip
Uploading the intermediate file: upload_file_110.zip
  00:09:23 STEP 2665 H=2665:00 +CPU= 17.467
  00:09:40 STEP 2666 H=2666:00 +CPU= 17.475
  00:10:06 STEP 2667 H=2667:00 +CPU= 25.878
  00:10:25 STEP 2668 H=2668:00 +CPU= 18.484
  00:10:43 STEP 2669 H=2669:00 +CPU= 18.030
  00:11:12 STEP 2670 H=2670:00 +CPU= 28.717
  00:11:30 STEP 2671 H=2671:00 +CPU= 18.263
  00:11:49 STEP 2672 H=2672:00 +CPU= 18.806
  00:12:17 STEP 2673 H=2673:00 +CPU= 28.010
  00:12:36 STEP 2674 H=2674:00 +CPU= 18.938
  00:12:54 STEP 2675 H=2675:00 +CPU= 18.044
  00:13:25 STEP 2676 H=2676:00 +CPU= 31.135
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002676
  00:13:43 STEP 2677 H=2677:00 +CPU= 18.305
  00:14:02 STEP 2678 H=2678:00 +CPU= 18.652
  00:14:30 STEP 2679 H=2679:00 +CPU= 28.144
  00:14:49 STEP 2680 H=2680:00 +CPU= 18.726
  00:15:07 STEP 2681 H=2681:00 +CPU= 18.017
  00:15:36 STEP 2682 H=2682:00 +CPU= 28.529
  00:15:54 STEP 2683 H=2683:00 +CPU= 18.234
  00:16:12 STEP 2684 H=2684:00 +CPU= 18.519
  00:16:38 STEP 2685 H=2685:00 +CPU= 25.644
  00:16:53 STEP 2686 H=2686:00 +CPU= 15.370
  00:17:09 STEP 2687 H=2687:00 +CPU= 15.210
  00:17:36 STEP 2688 H=2688:00 +CPU= 26.964
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_111.zip
Uploading the intermediate file: upload_file_111.zip
  00:17:51 STEP 2689 H=2689:00 +CPU= 15.051
  00:18:06 STEP 2690 H=2690:00 +CPU= 14.728
  00:18:29 STEP 2691 H=2691:00 +CPU= 23.273
  00:18:44 STEP 2692 H=2692:00 +CPU= 15.217
  00:18:59 STEP 2693 H=2693:00 +CPU= 14.477
  00:19:22 STEP 2694 H=2694:00 +CPU= 23.546
  00:19:37 STEP 2695 H=2695:00 +CPU= 14.658
  00:19:51 STEP 2696 H=2696:00 +CPU= 14.533
  00:20:15 STEP 2697 H=2697:00 +CPU= 23.289
  00:20:31 STEP 2698 H=2698:00 +CPU= 15.973
  00:20:47 STEP 2699 H=2699:00 +CPU= 15.750
  00:21:14 STEP 2700 H=2700:00 +CPU= 27.300
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002700
  00:21:29 STEP 2701 H=2701:00 +CPU= 15.064
  00:21:44 STEP 2702 H=2702:00 +CPU= 14.999
  00:22:07 STEP 2703 H=2703:00 +CPU= 22.992
  00:22:23 STEP 2704 H=2704:00 +CPU= 15.719
  00:22:38 STEP 2705 H=2705:00 +CPU= 15.479
  00:23:03 STEP 2706 H=2706:00 +CPU= 24.898
  00:23:19 STEP 2707 H=2707:00 +CPU= 15.593
  00:23:34 STEP 2708 H=2708:00 +CPU= 15.340
  00:23:59 STEP 2709 H=2709:00 +CPU= 24.316
  00:24:15 STEP 2710 H=2710:00 +CPU= 16.266
  00:24:31 STEP 2711 H=2711:00 +CPU= 15.775
  00:24:59 STEP 2712 H=2712:00 +CPU= 28.533
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_112.zip
Uploading the intermediate file: upload_file_112.zip
  00:25:14 STEP 2713 H=2713:00 +CPU= 14.926
  00:25:30 STEP 2714 H=2714:00 +CPU= 15.081
  00:25:53 STEP 2715 H=2715:00 +CPU= 23.163
  00:26:08 STEP 2716 H=2716:00 +CPU= 14.999
  00:26:23 STEP 2717 H=2717:00 +CPU= 14.657
  00:26:48 STEP 2718 H=2718:00 +CPU= 25.042
  00:27:03 STEP 2719 H=2719:00 +CPU= 15.334
  00:27:19 STEP 2720 H=2720:00 +CPU= 15.791
  00:27:44 STEP 2721 H=2721:00 +CPU= 24.799
  00:28:00 STEP 2722 H=2722:00 +CPU= 15.938
  00:28:15 STEP 2723 H=2723:00 +CPU= 15.315
  00:28:42 STEP 2724 H=2724:00 +CPU= 26.968
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002724
  00:28:57 STEP 2725 H=2725:00 +CPU= 14.872
  00:29:12 STEP 2726 H=2726:00 +CPU= 15.037
  00:29:35 STEP 2727 H=2727:00 +CPU= 23.155
  00:29:50 STEP 2728 H=2728:00 +CPU= 15.180
  00:30:05 STEP 2729 H=2729:00 +CPU= 14.921
  00:30:29 STEP 2730 H=2730:00 +CPU= 23.353
  00:30:43 STEP 2731 H=2731:00 +CPU= 14.650
  00:30:59 STEP 2732 H=2732:00 +CPU= 15.371
  00:31:22 STEP 2733 H=2733:00 +CPU= 22.855
  00:31:37 STEP 2734 H=2734:00 +CPU= 15.333
  00:31:53 STEP 2735 H=2735:00 +CPU= 15.532
  00:32:20 STEP 2736 H=2736:00 +CPU= 27.057
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_113.zip
Uploading the intermediate file: upload_file_113.zip
  00:32:35 STEP 2737 H=2737:00 +CPU= 14.731
  00:32:50 STEP 2738 H=2738:00 +CPU= 15.140
  00:33:13 STEP 2739 H=2739:00 +CPU= 22.903
  00:33:29 STEP 2740 H=2740:00 +CPU= 15.857
  00:33:44 STEP 2741 H=2741:00 +CPU= 14.676
  00:34:07 STEP 2742 H=2742:00 +CPU= 23.378
  00:34:22 STEP 2743 H=2743:00 +CPU= 14.890
  00:34:37 STEP 2744 H=2744:00 +CPU= 15.396
  00:35:00 STEP 2745 H=2745:00 +CPU= 22.891
  00:35:15 STEP 2746 H=2746:00 +CPU= 15.170
  00:35:30 STEP 2747 H=2747:00 +CPU= 14.826
  00:35:56 STEP 2748 H=2748:00 +CPU= 25.363
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002748
  00:36:10 STEP 2749 H=2749:00 +CPU= 14.676
  00:36:26 STEP 2750 H=2750:00 +CPU= 15.286
  00:36:48 STEP 2751 H=2751:00 +CPU= 22.715
  00:37:04 STEP 2752 H=2752:00 +CPU= 15.196
  00:37:18 STEP 2753 H=2753:00 +CPU= 14.679
  00:37:42 STEP 2754 H=2754:00 +CPU= 23.624
  00:37:57 STEP 2755 H=2755:00 +CPU= 14.708
  00:38:12 STEP 2756 H=2756:00 +CPU= 15.064
  00:38:35 STEP 2757 H=2757:00 +CPU= 22.899
  00:38:50 STEP 2758 H=2758:00 +CPU= 15.130
  00:39:05 STEP 2759 H=2759:00 +CPU= 15.065
  00:39:32 STEP 2760 H=2760:00 +CPU= 27.118
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_114.zip
Uploading the intermediate file: upload_file_114.zip
  00:39:47 STEP 2761 H=2761:00 +CPU= 14.906
  00:40:02 STEP 2762 H=2762:00 +CPU= 15.279
  00:40:27 STEP 2763 H=2763:00 +CPU= 24.740
  00:40:43 STEP 2764 H=2764:00 +CPU= 16.268
  00:40:59 STEP 2765 H=2765:00 +CPU= 14.991
  00:41:23 STEP 2766 H=2766:00 +CPU= 24.236
  00:41:39 STEP 2767 H=2767:00 +CPU= 15.947
  00:41:56 STEP 2768 H=2768:00 +CPU= 17.052
  00:42:24 STEP 2769 H=2769:00 +CPU= 27.667
  00:42:42 STEP 2770 H=2770:00 +CPU= 18.206
  00:42:59 STEP 2771 H=2771:00 +CPU= 16.528
  00:43:29 STEP 2772 H=2772:00 +CPU= 30.290
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002772
  00:43:47 STEP 2773 H=2773:00 +CPU= 17.449
  00:44:05 STEP 2774 H=2774:00 +CPU= 17.994
  00:44:33 STEP 2775 H=2775:00 +CPU= 28.213
  00:44:51 STEP 2776 H=2776:00 +CPU= 17.897
  00:45:08 STEP 2777 H=2777:00 +CPU= 16.858
  00:45:37 STEP 2778 H=2778:00 +CPU= 28.614
  00:45:54 STEP 2779 H=2779:00 +CPU= 17.509
  00:46:12 STEP 2780 H=2780:00 +CPU= 18.302
  00:46:40 STEP 2781 H=2781:00 +CPU= 27.977
  00:46:59 STEP 2782 H=2782:00 +CPU= 18.087
  00:47:17 STEP 2783 H=2783:00 +CPU= 18.197
  00:47:48 STEP 2784 H=2784:00 +CPU= 30.554
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_115.zip
Uploading the intermediate file: upload_file_115.zip
  00:48:05 STEP 2785 H=2785:00 +CPU= 17.391
Uploading trickle at timestep: 10022400
  00:48:23 STEP 2786 H=2786:00 +CPU= 18.033
  00:48:51 STEP 2787 H=2787:00 +CPU= 27.655
  00:49:09 STEP 2788 H=2788:00 +CPU= 17.774
  00:49:26 STEP 2789 H=2789:00 +CPU= 16.788
  00:49:54 STEP 2790 H=2790:00 +CPU= 27.843
  00:50:10 STEP 2791 H=2791:00 +CPU= 16.532
  00:50:27 STEP 2792 H=2792:00 +CPU= 16.852
  00:50:54 STEP 2793 H=2793:00 +CPU= 26.785
  00:51:11 STEP 2794 H=2794:00 +CPU= 16.965
  00:51:27 STEP 2795 H=2795:00 +CPU= 16.277
  00:51:56 STEP 2796 H=2796:00 +CPU= 28.236
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002796
  00:52:12 STEP 2797 H=2797:00 +CPU= 16.718
  00:52:29 STEP 2798 H=2798:00 +CPU= 16.658
  00:52:55 STEP 2799 H=2799:00 +CPU= 25.423
  00:53:12 STEP 2800 H=2800:00 +CPU= 16.921
  00:53:28 STEP 2801 H=2801:00 +CPU= 16.245
  00:53:54 STEP 2802 H=2802:00 +CPU= 25.807
  00:54:10 STEP 2803 H=2803:00 +CPU= 16.542
  00:54:27 STEP 2804 H=2804:00 +CPU= 16.817
  00:54:52 STEP 2805 H=2805:00 +CPU= 25.347
  00:55:11 STEP 2806 H=2806:00 +CPU= 18.451
  00:55:29 STEP 2807 H=2807:00 +CPU= 18.420
  00:56:01 STEP 2808 H=2808:00 +CPU= 31.545
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_116.zip
Uploading the intermediate file: upload_file_116.zip
  00:56:19 STEP 2809 H=2809:00 +CPU= 17.410
  00:56:36 STEP 2810 H=2810:00 +CPU= 17.538
  00:57:03 STEP 2811 H=2811:00 +CPU= 27.260
  00:57:21 STEP 2812 H=2812:00 +CPU= 17.916
  00:57:39 STEP 2813 H=2813:00 +CPU= 17.667
  00:58:07 STEP 2814 H=2814:00 +CPU= 27.502
  00:58:24 STEP 2815 H=2815:00 +CPU= 16.985
  00:58:42 STEP 2816 H=2816:00 +CPU= 17.689
  00:59:09 STEP 2817 H=2817:00 +CPU= 26.985
  00:59:28 STEP 2818 H=2818:00 +CPU= 18.638
  00:59:45 STEP 2819 H=2819:00 +CPU= 17.595
  01:00:16 STEP 2820 H=2820:00 +CPU= 30.273
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002820
  01:00:34 STEP 2821 H=2821:00 +CPU= 18.076
  01:00:52 STEP 2822 H=2822:00 +CPU= 17.967
  01:01:19 STEP 2823 H=2823:00 +CPU= 27.507
  01:01:37 STEP 2824 H=2824:00 +CPU= 17.882
  01:01:55 STEP 2825 H=2825:00 +CPU= 17.183
  01:02:22 STEP 2826 H=2826:00 +CPU= 27.517
  01:02:40 STEP 2827 H=2827:00 +CPU= 17.745
  01:02:57 STEP 2828 H=2828:00 +CPU= 16.868
  01:03:23 STEP 2829 H=2829:00 +CPU= 26.072
  01:03:40 STEP 2830 H=2830:00 +CPU= 17.304
  01:03:57 STEP 2831 H=2831:00 +CPU= 17.006
  01:04:28 STEP 2832 H=2832:00 +CPU= 30.819
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_117.zip
Uploading the intermediate file: upload_file_117.zip
  01:04:45 STEP 2833 H=2833:00 +CPU= 17.178
  01:05:02 STEP 2834 H=2834:00 +CPU= 16.997
  01:05:29 STEP 2835 H=2835:00 +CPU= 26.386
  01:05:47 STEP 2836 H=2836:00 +CPU= 17.666
  01:06:05 STEP 2837 H=2837:00 +CPU= 17.821
  01:06:31 STEP 2838 H=2838:00 +CPU= 26.761
  01:06:49 STEP 2839 H=2839:00 +CPU= 17.243
  01:07:07 STEP 2840 H=2840:00 +CPU= 18.111
  01:07:34 STEP 2841 H=2841:00 +CPU= 27.060
  01:07:52 STEP 2842 H=2842:00 +CPU= 18.143
  01:08:10 STEP 2843 H=2843:00 +CPU= 17.726
  01:08:39 STEP 2844 H=2844:00 +CPU= 29.082
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002844
  01:08:57 STEP 2845 H=2845:00 +CPU= 17.995
  01:09:16 STEP 2846 H=2846:00 +CPU= 18.262
  01:09:42 STEP 2847 H=2847:00 +CPU= 26.786
  01:10:01 STEP 2848 H=2848:00 +CPU= 18.315
  01:10:18 STEP 2849 H=2849:00 +CPU= 17.699
  01:10:46 STEP 2850 H=2850:00 +CPU= 27.800
  01:11:04 STEP 2851 H=2851:00 +CPU= 17.697
  01:11:22 STEP 2852 H=2852:00 +CPU= 18.455
  01:11:49 STEP 2853 H=2853:00 +CPU= 25.998
  01:12:06 STEP 2854 H=2854:00 +CPU= 17.503
  01:12:24 STEP 2855 H=2855:00 +CPU= 17.533
  01:12:55 STEP 2856 H=2856:00 +CPU= 30.886
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_118.zip
Uploading the intermediate file: upload_file_118.zip
  01:13:12 STEP 2857 H=2857:00 +CPU= 17.103
  01:13:30 STEP 2858 H=2858:00 +CPU= 18.551
  01:13:57 STEP 2859 H=2859:00 +CPU= 26.725
  01:14:15 STEP 2860 H=2860:00 +CPU= 18.061
  01:14:34 STEP 2861 H=2861:00 +CPU= 18.044
  01:15:01 STEP 2862 H=2862:00 +CPU= 27.465
  01:15:19 STEP 2863 H=2863:00 +CPU= 17.842
  01:15:37 STEP 2864 H=2864:00 +CPU= 18.211
  01:16:05 STEP 2865 H=2865:00 +CPU= 27.230
  01:16:22 STEP 2866 H=2866:00 +CPU= 17.345
  01:16:39 STEP 2867 H=2867:00 +CPU= 16.937
  01:17:09 STEP 2868 H=2868:00 +CPU= 29.762
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002868
  01:17:27 STEP 2869 H=2869:00 +CPU= 17.977
  01:17:45 STEP 2870 H=2870:00 +CPU= 17.943
  01:18:13 STEP 2871 H=2871:00 +CPU= 27.660
  01:18:31 STEP 2872 H=2872:00 +CPU= 18.489
  01:18:48 STEP 2873 H=2873:00 +CPU= 17.193
  01:19:16 STEP 2874 H=2874:00 +CPU= 27.511
  01:19:34 STEP 2875 H=2875:00 +CPU= 18.041
  01:19:52 STEP 2876 H=2876:00 +CPU= 17.846
  01:20:18 STEP 2877 H=2877:00 +CPU= 26.392
  01:20:36 STEP 2878 H=2878:00 +CPU= 18.203
  01:20:55 STEP 2879 H=2879:00 +CPU= 18.635
  01:21:27 STEP 2880 H=2880:00 +CPU= 31.552
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_119.zip
Uploading the intermediate file: upload_file_119.zip
  01:21:44 STEP 2881 H=2881:00 +CPU= 17.521
  01:22:03 STEP 2882 H=2882:00 +CPU= 18.128
  01:22:30 STEP 2883 H=2883:00 +CPU= 27.216
  01:22:49 STEP 2884 H=2884:00 +CPU= 18.661
  01:23:05 STEP 2885 H=2885:00 +CPU= 16.519
  01:23:32 STEP 2886 H=2886:00 +CPU= 26.290
  01:23:48 STEP 2887 H=2887:00 +CPU= 16.416
  01:24:05 STEP 2888 H=2888:00 +CPU= 16.605
  01:24:29 STEP 2889 H=2889:00 +CPU= 24.367
  01:24:45 STEP 2890 H=2890:00 +CPU= 15.786
  01:25:00 STEP 2891 H=2891:00 +CPU= 15.193
  01:25:27 STEP 2892 H=2892:00 +CPU= 27.238
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002892
  01:25:43 STEP 2893 H=2893:00 +CPU= 15.848
  01:25:58 STEP 2894 H=2894:00 +CPU= 15.088
  01:26:23 STEP 2895 H=2895:00 +CPU= 24.998
  01:26:39 STEP 2896 H=2896:00 +CPU= 15.338
  01:26:54 STEP 2897 H=2897:00 +CPU= 15.368
  01:27:19 STEP 2898 H=2898:00 +CPU= 25.181
  01:27:36 STEP 2899 H=2899:00 +CPU= 16.236
  01:27:52 STEP 2900 H=2900:00 +CPU= 16.411
  01:28:18 STEP 2901 H=2901:00 +CPU= 25.621
  01:28:35 STEP 2902 H=2902:00 +CPU= 16.829
  01:28:51 STEP 2903 H=2903:00 +CPU= 16.512
  01:29:19 STEP 2904 H=2904:00 +CPU= 28.152
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_120.zip
Uploading the intermediate file: upload_file_120.zip
  01:29:35 STEP 2905 H=2905:00 +CPU= 15.403
  01:29:51 STEP 2906 H=2906:00 +CPU= 15.780
  01:30:15 STEP 2907 H=2907:00 +CPU= 23.889
  01:30:31 STEP 2908 H=2908:00 +CPU= 15.755
  01:30:46 STEP 2909 H=2909:00 +CPU= 15.415
  01:31:11 STEP 2910 H=2910:00 +CPU= 25.050
  01:31:28 STEP 2911 H=2911:00 +CPU= 16.406
  01:31:44 STEP 2912 H=2912:00 +CPU= 15.963
  01:32:07 STEP 2913 H=2913:00 +CPU= 23.705
  01:32:24 STEP 2914 H=2914:00 +CPU= 16.215
  01:32:40 STEP 2915 H=2915:00 +CPU= 15.738
  01:33:07 STEP 2916 H=2916:00 +CPU= 27.172
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002916
  01:33:23 STEP 2917 H=2917:00 +CPU= 16.142
  01:33:39 STEP 2918 H=2918:00 +CPU= 16.143
  01:34:03 STEP 2919 H=2919:00 +CPU= 23.736
  01:34:19 STEP 2920 H=2920:00 +CPU= 15.902
  01:34:35 STEP 2921 H=2921:00 +CPU= 15.636
  01:34:59 STEP 2922 H=2922:00 +CPU= 24.302
  01:35:15 STEP 2923 H=2923:00 +CPU= 15.806
  01:35:31 STEP 2924 H=2924:00 +CPU= 16.091
  01:35:55 STEP 2925 H=2925:00 +CPU= 23.916
  01:36:11 STEP 2926 H=2926:00 +CPU= 15.544
  01:36:27 STEP 2927 H=2927:00 +CPU= 16.126
  01:36:56 STEP 2928 H=2928:00 +CPU= 29.608
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_121.zip
Uploading the intermediate file: upload_file_121.zip
  01:37:13 STEP 2929 H=2929:00 +CPU= 16.627
  01:37:30 STEP 2930 H=2930:00 +CPU= 16.495
  01:37:54 STEP 2931 H=2931:00 +CPU= 23.854
  01:38:10 STEP 2932 H=2932:00 +CPU= 16.743
  01:38:26 STEP 2933 H=2933:00 +CPU= 15.980
  01:38:51 STEP 2934 H=2934:00 +CPU= 24.540
  01:39:07 STEP 2935 H=2935:00 +CPU= 15.993
  01:39:23 STEP 2936 H=2936:00 +CPU= 15.896
  01:39:47 STEP 2937 H=2937:00 +CPU= 23.629
  01:40:02 STEP 2938 H=2938:00 +CPU= 15.777
  01:40:18 STEP 2939 H=2939:00 +CPU= 15.497
  01:40:45 STEP 2940 H=2940:00 +CPU= 26.931
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002940
  01:41:00 STEP 2941 H=2941:00 +CPU= 15.362
  01:41:16 STEP 2942 H=2942:00 +CPU= 16.020
  01:41:40 STEP 2943 H=2943:00 +CPU= 23.871
  01:41:56 STEP 2944 H=2944:00 +CPU= 15.956
  01:42:12 STEP 2945 H=2945:00 +CPU= 15.850
  01:42:38 STEP 2946 H=2946:00 +CPU= 25.758
  01:42:55 STEP 2947 H=2947:00 +CPU= 16.508
  01:43:12 STEP 2948 H=2948:00 +CPU= 16.745
  01:43:37 STEP 2949 H=2949:00 +CPU= 25.594
  01:43:54 STEP 2950 H=2950:00 +CPU= 16.938
  01:44:11 STEP 2951 H=2951:00 +CPU= 16.875
  01:44:40 STEP 2952 H=2952:00 +CPU= 28.737
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12187343/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0699_2001050100_123_970_12187343_2_r1794729868_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
01:48:03 (12965): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:08:42 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 10,623,600 84,445 0.0079
09 May 2023 16:08:23 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 10,022,400 81,047 0.0081
09 May 2023 16:08:16 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 8,812,800 73,880 0.0084
09 May 2023 16:08:06 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 7,948,800 68,001 0.0086
09 May 2023 16:08:00 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 7,084,800 60,615 0.0086
09 May 2023 16:07:54 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 6,220,800 53,237 0.0086
09 May 2023 16:07:50 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 5,356,800 45,907 0.0086
09 May 2023 16:07:46 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 4,492,800 38,530 0.0086
09 May 2023 16:07:42 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 3,628,800 31,153 0.0086
09 May 2023 16:07:42 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 3,628,800 31,153 0.0086
09 May 2023 16:07:37 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 2,764,800 23,778 0.0086
09 May 2023 16:07:33 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 1,900,800 16,322 0.0086
09 May 2023 16:07:33 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 1,900,800 16,322 0.0086
09 May 2023 16:07:28 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 1,036,800 8,829 0.0085
09 May 2023 16:07:28 1531398 22294490 oifs_43r3_ps_0699_2001050100_123_970_12187343_2 1,036,800 8,829 0.0085


©2024 climateprediction.net