climateprediction.net home page
Task 22316990

Task 22316990

Name oifs_43r3_01a6_2019110100_123_993_12215100_1
Workunit 12215100
Created 25 Feb 2023, 4:49:36 UTC
Sent 25 Feb 2023, 4:49:41 UTC
Report deadline 26 Apr 2023, 4:49:41 UTC
Received 25 Feb 2023, 19:10:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536631
Run time 13 hours 57 min 29 sec
CPU time 13 hours 52 min 39 sec
Validate state Valid
Credit 14,515.20
Device peak FLOPS 7.25 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,415.98 MB
Peak swap size 4,974.30 MB
Peak disk usage 1,267.64 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
TEP 2372 H=2372:00 +CPU= 14.801
  10:54:18 STEP 2373 H=2373:00 +CPU= 22.973
  10:54:33 STEP 2374 H=2374:00 +CPU= 14.593
  10:54:48 STEP 2375 H=2375:00 +CPU= 14.507
  10:55:15 STEP 2376 H=2376:00 +CPU= 26.961
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:55:29 STEP 2377 H=2377:00 +CPU= 14.373
  10:55:44 STEP 2378 H=2378:00 +CPU= 14.946
  10:56:07 STEP 2379 H=2379:00 +CPU= 22.837
  10:56:22 STEP 2380 H=2380:00 +CPU= 14.762
  10:56:36 STEP 2381 H=2381:00 +CPU= 14.131
  10:56:59 STEP 2382 H=2382:00 +CPU= 23.531
  10:57:13 STEP 2383 H=2383:00 +CPU= 13.998
  10:57:28 STEP 2384 H=2384:00 +CPU= 15.014
  10:57:51 STEP 2385 H=2385:00 +CPU= 22.635
  10:58:06 STEP 2386 H=2386:00 +CPU= 14.493
  10:58:20 STEP 2387 H=2387:00 +CPU= 14.427
  10:58:45 STEP 2388 H=2388:00 +CPU= 25.104
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002388
  10:58:59 STEP 2389 H=2389:00 +CPU= 13.970
  10:59:13 STEP 2390 H=2390:00 +CPU= 14.185
  10:59:36 STEP 2391 H=2391:00 +CPU= 22.816
  10:59:51 STEP 2392 H=2392:00 +CPU= 14.602
  11:00:05 STEP 2393 H=2393:00 +CPU= 14.142
  11:00:29 STEP 2394 H=2394:00 +CPU= 23.512
  11:00:43 STEP 2395 H=2395:00 +CPU= 14.266
  11:00:57 STEP 2396 H=2396:00 +CPU= 14.517
  11:01:20 STEP 2397 H=2397:00 +CPU= 22.698
  11:01:35 STEP 2398 H=2398:00 +CPU= 14.839
  11:01:50 STEP 2399 H=2399:00 +CPU= 14.731
  11:02:17 STEP 2400 H=2400:00 +CPU= 26.804
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_99.zip
Uploading the intermediate file: upload_file_99.zip
  11:02:31 STEP 2401 H=2401:00 +CPU= 14.397
Uploading trickle at timestep: 8640000
  11:02:45 STEP 2402 H=2402:00 +CPU= 14.421
  11:03:08 STEP 2403 H=2403:00 +CPU= 22.846
  11:03:23 STEP 2404 H=2404:00 +CPU= 14.883
  11:03:38 STEP 2405 H=2405:00 +CPU= 14.261
  11:04:01 STEP 2406 H=2406:00 +CPU= 23.268
  11:04:15 STEP 2407 H=2407:00 +CPU= 14.341
  11:04:30 STEP 2408 H=2408:00 +CPU= 14.676
  11:04:53 STEP 2409 H=2409:00 +CPU= 22.827
  11:05:07 STEP 2410 H=2410:00 +CPU= 14.256
  11:05:21 STEP 2411 H=2411:00 +CPU= 13.607
  11:05:46 STEP 2412 H=2412:00 +CPU= 25.048
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002412
  11:06:00 STEP 2413 H=2413:00 +CPU= 14.179
  11:06:14 STEP 2414 H=2414:00 +CPU= 14.436
  11:06:38 STEP 2415 H=2415:00 +CPU= 23.037
  11:06:52 STEP 2416 H=2416:00 +CPU= 14.831
  11:07:07 STEP 2417 H=2417:00 +CPU= 14.328
  11:07:30 STEP 2418 H=2418:00 +CPU= 23.251
  11:07:44 STEP 2419 H=2419:00 +CPU= 14.181
  11:07:59 STEP 2420 H=2420:00 +CPU= 14.724
  11:08:22 STEP 2421 H=2421:00 +CPU= 22.720
  11:08:36 STEP 2422 H=2422:00 +CPU= 14.470
  11:08:51 STEP 2423 H=2423:00 +CPU= 14.594
  11:09:18 STEP 2424 H=2424:00 +CPU= 26.959
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_100.zip
Uploading the intermediate file: upload_file_100.zip
  11:09:32 STEP 2425 H=2425:00 +CPU= 14.150
  11:09:47 STEP 2426 H=2426:00 +CPU= 14.482
  11:10:09 STEP 2427 H=2427:00 +CPU= 22.744
  11:10:24 STEP 2428 H=2428:00 +CPU= 14.761
  11:10:38 STEP 2429 H=2429:00 +CPU= 14.332
  11:11:02 STEP 2430 H=2430:00 +CPU= 23.277
  11:11:16 STEP 2431 H=2431:00 +CPU= 13.691
  11:11:30 STEP 2432 H=2432:00 +CPU= 14.541
  11:11:53 STEP 2433 H=2433:00 +CPU= 22.852
  11:12:07 STEP 2434 H=2434:00 +CPU= 14.393
  11:12:22 STEP 2435 H=2435:00 +CPU= 14.514
  11:12:47 STEP 2436 H=2436:00 +CPU= 25.136
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002436
  11:13:01 STEP 2437 H=2437:00 +CPU= 14.015
  11:13:16 STEP 2438 H=2438:00 +CPU= 14.719
  11:13:39 STEP 2439 H=2439:00 +CPU= 22.838
  11:13:53 STEP 2440 H=2440:00 +CPU= 14.653
  11:14:08 STEP 2441 H=2441:00 +CPU= 14.152
  11:14:31 STEP 2442 H=2442:00 +CPU= 23.826
  11:14:46 STEP 2443 H=2443:00 +CPU= 14.295
  11:15:01 STEP 2444 H=2444:00 +CPU= 14.701
  11:15:23 STEP 2445 H=2445:00 +CPU= 22.657
  11:15:38 STEP 2446 H=2446:00 +CPU= 14.591
  11:15:52 STEP 2447 H=2447:00 +CPU= 14.263
  11:16:19 STEP 2448 H=2448:00 +CPU= 26.932
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_101.zip
Uploading the intermediate file: upload_file_101.zip
  11:16:33 STEP 2449 H=2449:00 +CPU= 14.165
  11:16:48 STEP 2450 H=2450:00 +CPU= 14.566
  11:17:11 STEP 2451 H=2451:00 +CPU= 23.235
  11:17:26 STEP 2452 H=2452:00 +CPU= 14.496
  11:17:40 STEP 2453 H=2453:00 +CPU= 13.877
  11:18:03 STEP 2454 H=2454:00 +CPU= 23.299
  11:18:18 STEP 2455 H=2455:00 +CPU= 14.527
  11:18:32 STEP 2456 H=2456:00 +CPU= 14.537
  11:18:55 STEP 2457 H=2457:00 +CPU= 22.863
  11:19:10 STEP 2458 H=2458:00 +CPU= 14.481
  11:19:24 STEP 2459 H=2459:00 +CPU= 14.557
  11:19:50 STEP 2460 H=2460:00 +CPU= 25.516
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002460
  11:20:04 STEP 2461 H=2461:00 +CPU= 13.967
  11:20:18 STEP 2462 H=2462:00 +CPU= 14.668
  11:20:41 STEP 2463 H=2463:00 +CPU= 22.691
  11:20:56 STEP 2464 H=2464:00 +CPU= 14.631
  11:21:10 STEP 2465 H=2465:00 +CPU= 14.178
  11:21:33 STEP 2466 H=2466:00 +CPU= 23.447
  11:21:48 STEP 2467 H=2467:00 +CPU= 14.240
  11:22:02 STEP 2468 H=2468:00 +CPU= 14.666
  11:22:25 STEP 2469 H=2469:00 +CPU= 22.985
  11:22:40 STEP 2470 H=2470:00 +CPU= 14.641
  11:22:55 STEP 2471 H=2471:00 +CPU= 14.460
  11:23:22 STEP 2472 H=2472:00 +CPU= 27.484
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_102.zip
Uploading the intermediate file: upload_file_102.zip
  11:23:36 STEP 2473 H=2473:00 +CPU= 13.964
  11:23:51 STEP 2474 H=2474:00 +CPU= 14.687
  11:24:14 STEP 2475 H=2475:00 +CPU= 23.040
  11:24:29 STEP 2476 H=2476:00 +CPU= 15.000
  11:24:43 STEP 2477 H=2477:00 +CPU= 13.990
  11:25:06 STEP 2478 H=2478:00 +CPU= 23.152
  11:25:20 STEP 2479 H=2479:00 +CPU= 14.254
  11:25:35 STEP 2480 H=2480:00 +CPU= 14.201
  11:25:58 STEP 2481 H=2481:00 +CPU= 22.927
  11:26:12 STEP 2482 H=2482:00 +CPU= 14.648
  11:26:27 STEP 2483 H=2483:00 +CPU= 14.238
  11:26:52 STEP 2484 H=2484:00 +CPU= 25.410
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002484
  11:27:06 STEP 2485 H=2485:00 +CPU= 13.793
  11:27:21 STEP 2486 H=2486:00 +CPU= 14.824
  11:27:44 STEP 2487 H=2487:00 +CPU= 23.028
  11:27:58 STEP 2488 H=2488:00 +CPU= 14.484
  11:28:12 STEP 2489 H=2489:00 +CPU= 13.903
  11:28:36 STEP 2490 H=2490:00 +CPU= 23.387
  11:28:50 STEP 2491 H=2491:00 +CPU= 14.179
  11:29:04 STEP 2492 H=2492:00 +CPU= 14.211
  11:29:27 STEP 2493 H=2493:00 +CPU= 22.655
  11:29:42 STEP 2494 H=2494:00 +CPU= 14.815
  11:29:56 STEP 2495 H=2495:00 +CPU= 14.456
  11:30:23 STEP 2496 H=2496:00 +CPU= 27.068
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_103.zip
Uploading the intermediate file: upload_file_103.zip
  11:30:38 STEP 2497 H=2497:00 +CPU= 14.337
  11:30:52 STEP 2498 H=2498:00 +CPU= 14.285
  11:31:15 STEP 2499 H=2499:00 +CPU= 23.262
  11:31:30 STEP 2500 H=2500:00 +CPU= 14.917
  11:31:44 STEP 2501 H=2501:00 +CPU= 13.587
  11:32:07 STEP 2502 H=2502:00 +CPU= 23.537
  11:32:22 STEP 2503 H=2503:00 +CPU= 14.431
  11:32:36 STEP 2504 H=2504:00 +CPU= 14.240
  11:32:59 STEP 2505 H=2505:00 +CPU= 22.963
  11:33:14 STEP 2506 H=2506:00 +CPU= 14.737
  11:33:28 STEP 2507 H=2507:00 +CPU= 14.454
  11:33:54 STEP 2508 H=2508:00 +CPU= 25.376
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002508
  11:34:08 STEP 2509 H=2509:00 +CPU= 14.136
  11:34:22 STEP 2510 H=2510:00 +CPU= 14.449
  11:34:45 STEP 2511 H=2511:00 +CPU= 22.779
  11:35:00 STEP 2512 H=2512:00 +CPU= 14.710
  11:35:14 STEP 2513 H=2513:00 +CPU= 13.838
  11:35:37 STEP 2514 H=2514:00 +CPU= 23.173
  11:35:51 STEP 2515 H=2515:00 +CPU= 13.686
  11:36:05 STEP 2516 H=2516:00 +CPU= 14.836
  11:36:28 STEP 2517 H=2517:00 +CPU= 22.632
  11:36:43 STEP 2518 H=2518:00 +CPU= 14.866
  11:36:58 STEP 2519 H=2519:00 +CPU= 14.623
  11:37:25 STEP 2520 H=2520:00 +CPU= 27.122
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:37:39 STEP 2521 H=2521:00 +CPU= 14.231
  11:37:54 STEP 2522 H=2522:00 +CPU= 14.946
  11:38:17 STEP 2523 H=2523:00 +CPU= 22.942
  11:38:32 STEP 2524 H=2524:00 +CPU= 14.427
  11:38:46 STEP 2525 H=2525:00 +CPU= 14.172
  11:39:09 STEP 2526 H=2526:00 +CPU= 23.262
  11:39:24 STEP 2527 H=2527:00 +CPU= 14.580
  11:39:38 STEP 2528 H=2528:00 +CPU= 14.617
  11:40:01 STEP 2529 H=2529:00 +CPU= 22.761
  11:40:16 STEP 2530 H=2530:00 +CPU= 14.870
  11:40:30 STEP 2531 H=2531:00 +CPU= 14.107
  11:40:55 STEP 2532 H=2532:00 +CPU= 25.002
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002532
  11:41:09 STEP 2533 H=2533:00 +CPU= 14.131
  11:41:24 STEP 2534 H=2534:00 +CPU= 14.598
  11:41:47 STEP 2535 H=2535:00 +CPU= 22.832
  11:42:01 STEP 2536 H=2536:00 +CPU= 14.522
  11:42:15 STEP 2537 H=2537:00 +CPU= 14.053
  11:42:39 STEP 2538 H=2538:00 +CPU= 23.419
  11:42:53 STEP 2539 H=2539:00 +CPU= 13.647
  11:43:07 STEP 2540 H=2540:00 +CPU= 14.573
  11:43:30 STEP 2541 H=2541:00 +CPU= 23.124
  11:43:45 STEP 2542 H=2542:00 +CPU= 14.720
  11:44:00 STEP 2543 H=2543:00 +CPU= 14.674
  11:44:26 STEP 2544 H=2544:00 +CPU= 26.441
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:44:41 STEP 2545 H=2545:00 +CPU= 14.265
  11:44:56 STEP 2546 H=2546:00 +CPU= 14.981
  11:45:19 STEP 2547 H=2547:00 +CPU= 22.966
  11:45:33 STEP 2548 H=2548:00 +CPU= 14.302
  11:45:47 STEP 2549 H=2549:00 +CPU= 14.415
  11:46:11 STEP 2550 H=2550:00 +CPU= 23.193
  11:46:24 STEP 2551 H=2551:00 +CPU= 13.801
  11:46:39 STEP 2552 H=2552:00 +CPU= 14.128
  11:47:01 STEP 2553 H=2553:00 +CPU= 22.807
  11:47:16 STEP 2554 H=2554:00 +CPU= 15.021
  11:47:30 STEP 2555 H=2555:00 +CPU= 13.919
  11:47:56 STEP 2556 H=2556:00 +CPU= 25.066
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002556
  11:48:10 STEP 2557 H=2557:00 +CPU= 14.334
  11:48:24 STEP 2558 H=2558:00 +CPU= 14.344
  11:48:47 STEP 2559 H=2559:00 +CPU= 22.711
  11:49:02 STEP 2560 H=2560:00 +CPU= 14.851
  11:49:16 STEP 2561 H=2561:00 +CPU= 14.289
  11:49:40 STEP 2562 H=2562:00 +CPU= 23.327
  11:49:54 STEP 2563 H=2563:00 +CPU= 13.944
  11:50:08 STEP 2564 H=2564:00 +CPU= 14.789
  11:50:32 STEP 2565 H=2565:00 +CPU= 23.189
  11:50:46 STEP 2566 H=2566:00 +CPU= 14.613
  11:51:01 STEP 2567 H=2567:00 +CPU= 14.795
  11:51:28 STEP 2568 H=2568:00 +CPU= 26.478
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:51:42 STEP 2569 H=2569:00 +CPU= 13.972
  11:51:56 STEP 2570 H=2570:00 +CPU= 14.353
  11:52:19 STEP 2571 H=2571:00 +CPU= 23.132
  11:52:34 STEP 2572 H=2572:00 +CPU= 14.639
  11:52:47 STEP 2573 H=2573:00 +CPU= 13.537
  11:53:11 STEP 2574 H=2574:00 +CPU= 23.558
  11:53:25 STEP 2575 H=2575:00 +CPU= 13.976
  11:53:40 STEP 2576 H=2576:00 +CPU= 14.715
  11:54:02 STEP 2577 H=2577:00 +CPU= 22.573
  11:54:17 STEP 2578 H=2578:00 +CPU= 14.644
  11:54:31 STEP 2579 H=2579:00 +CPU= 14.126
  11:54:56 STEP 2580 H=2580:00 +CPU= 25.047
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002580
  11:55:10 STEP 2581 H=2581:00 +CPU= 14.028
  11:55:25 STEP 2582 H=2582:00 +CPU= 14.968
  11:55:48 STEP 2583 H=2583:00 +CPU= 22.885
  11:56:03 STEP 2584 H=2584:00 +CPU= 14.899
  11:56:17 STEP 2585 H=2585:00 +CPU= 14.077
  11:56:41 STEP 2586 H=2586:00 +CPU= 23.378
  11:56:55 STEP 2587 H=2587:00 +CPU= 14.241
  11:57:10 STEP 2588 H=2588:00 +CPU= 14.737
  11:57:33 STEP 2589 H=2589:00 +CPU= 22.907
  11:57:47 STEP 2590 H=2590:00 +CPU= 14.333
  11:58:02 STEP 2591 H=2591:00 +CPU= 14.591
  11:58:29 STEP 2592 H=2592:00 +CPU= 26.955
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:58:43 STEP 2593 H=2593:00 +CPU= 14.061
  11:58:57 STEP 2594 H=2594:00 +CPU= 14.498
  11:59:20 STEP 2595 H=2595:00 +CPU= 22.605
  11:59:35 STEP 2596 H=2596:00 +CPU= 14.715
  11:59:48 STEP 2597 H=2597:00 +CPU= 13.797
  12:00:12 STEP 2598 H=2598:00 +CPU= 23.429
  12:00:26 STEP 2599 H=2599:00 +CPU= 13.942
  12:00:40 STEP 2600 H=2600:00 +CPU= 14.459
  12:01:03 STEP 2601 H=2601:00 +CPU= 22.878
  12:01:18 STEP 2602 H=2602:00 +CPU= 14.686
  12:01:32 STEP 2603 H=2603:00 +CPU= 14.485
  12:01:58 STEP 2604 H=2604:00 +CPU= 25.513
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002604
  12:02:12 STEP 2605 H=2605:00 +CPU= 13.949
  12:02:26 STEP 2606 H=2606:00 +CPU= 14.352
  12:02:49 STEP 2607 H=2607:00 +CPU= 23.067
  12:03:04 STEP 2608 H=2608:00 +CPU= 14.952
  12:03:19 STEP 2609 H=2609:00 +CPU= 14.301
  12:03:42 STEP 2610 H=2610:00 +CPU= 23.250
  12:03:56 STEP 2611 H=2611:00 +CPU= 14.320
  12:04:11 STEP 2612 H=2612:00 +CPU= 14.803
  12:04:34 STEP 2613 H=2613:00 +CPU= 22.923
  12:04:49 STEP 2614 H=2614:00 +CPU= 14.881
  12:05:04 STEP 2615 H=2615:00 +CPU= 14.842
  12:05:31 STEP 2616 H=2616:00 +CPU= 27.185
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:05:45 STEP 2617 H=2617:00 +CPU= 13.841
  12:06:00 STEP 2618 H=2618:00 +CPU= 14.577
  12:06:22 STEP 2619 H=2619:00 +CPU= 22.726
  12:06:37 STEP 2620 H=2620:00 +CPU= 14.620
  12:06:52 STEP 2621 H=2621:00 +CPU= 14.655
  12:07:15 STEP 2622 H=2622:00 +CPU= 23.688
  12:07:29 STEP 2623 H=2623:00 +CPU= 13.868
  12:07:44 STEP 2624 H=2624:00 +CPU= 14.431
  12:08:07 STEP 2625 H=2625:00 +CPU= 22.830
  12:08:21 STEP 2626 H=2626:00 +CPU= 14.157
  12:08:35 STEP 2627 H=2627:00 +CPU= 14.198
  12:09:00 STEP 2628 H=2628:00 +CPU= 25.027
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002628
  12:09:14 STEP 2629 H=2629:00 +CPU= 14.320
  12:09:29 STEP 2630 H=2630:00 +CPU= 14.769
  12:09:52 STEP 2631 H=2631:00 +CPU= 23.045
  12:10:07 STEP 2632 H=2632:00 +CPU= 14.764
  12:10:22 STEP 2633 H=2633:00 +CPU= 14.719
  12:10:45 STEP 2634 H=2634:00 +CPU= 23.304
  12:11:00 STEP 2635 H=2635:00 +CPU= 14.384
  12:11:14 STEP 2636 H=2636:00 +CPU= 14.350
  12:11:37 STEP 2637 H=2637:00 +CPU= 23.160
  12:11:52 STEP 2638 H=2638:00 +CPU= 14.477
  12:12:06 STEP 2639 H=2639:00 +CPU= 14.286
  12:12:33 STEP 2640 H=2640:00 +CPU= 27.241
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:12:48 STEP 2641 H=2641:00 +CPU= 14.278
Uploading trickle at timestep: 9504000
  12:13:03 STEP 2642 H=2642:00 +CPU= 14.967
  12:13:25 STEP 2643 H=2643:00 +CPU= 22.625
  12:13:40 STEP 2644 H=2644:00 +CPU= 14.925
  12:13:54 STEP 2645 H=2645:00 +CPU= 14.241
  12:14:18 STEP 2646 H=2646:00 +CPU= 23.466
  12:14:32 STEP 2647 H=2647:00 +CPU= 14.374
  12:14:47 STEP 2648 H=2648:00 +CPU= 14.498
  12:15:10 STEP 2649 H=2649:00 +CPU= 23.419
  12:15:25 STEP 2650 H=2650:00 +CPU= 14.470
  12:15:39 STEP 2651 H=2651:00 +CPU= 14.014
  12:16:04 STEP 2652 H=2652:00 +CPU= 25.161
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002652
  12:16:18 STEP 2653 H=2653:00 +CPU= 14.365
  12:16:33 STEP 2654 H=2654:00 +CPU= 14.924
  12:16:56 STEP 2655 H=2655:00 +CPU= 22.970
  12:17:11 STEP 2656 H=2656:00 +CPU= 14.552
  12:17:25 STEP 2657 H=2657:00 +CPU= 14.164
  12:17:49 STEP 2658 H=2658:00 +CPU= 23.473
  12:18:03 STEP 2659 H=2659:00 +CPU= 14.079
  12:18:17 STEP 2660 H=2660:00 +CPU= 14.328
  12:18:40 STEP 2661 H=2661:00 +CPU= 22.838
  12:18:55 STEP 2662 H=2662:00 +CPU= 14.672
  12:19:09 STEP 2663 H=2663:00 +CPU= 14.432
  12:19:36 STEP 2664 H=2664:00 +CPU= 27.286
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:19:51 STEP 2665 H=2665:00 +CPU= 14.253
  12:20:05 STEP 2666 H=2666:00 +CPU= 14.716
  12:20:28 STEP 2667 H=2667:00 +CPU= 22.759
  12:20:43 STEP 2668 H=2668:00 +CPU= 14.407
  12:20:57 STEP 2669 H=2669:00 +CPU= 14.384
  12:21:21 STEP 2670 H=2670:00 +CPU= 23.590
  12:21:35 STEP 2671 H=2671:00 +CPU= 14.357
  12:21:50 STEP 2672 H=2672:00 +CPU= 14.704
  12:22:13 STEP 2673 H=2673:00 +CPU= 22.909
  12:22:27 STEP 2674 H=2674:00 +CPU= 14.612
  12:22:42 STEP 2675 H=2675:00 +CPU= 14.145
  12:23:07 STEP 2676 H=2676:00 +CPU= 25.139
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002676
  12:23:20 STEP 2677 H=2677:00 +CPU= 13.773
  12:23:35 STEP 2678 H=2678:00 +CPU= 14.927
  12:23:58 STEP 2679 H=2679:00 +CPU= 22.756
  12:24:13 STEP 2680 H=2680:00 +CPU= 14.422
  12:24:27 STEP 2681 H=2681:00 +CPU= 14.050
  12:24:50 STEP 2682 H=2682:00 +CPU= 23.494
  12:25:04 STEP 2683 H=2683:00 +CPU= 13.931
  12:25:19 STEP 2684 H=2684:00 +CPU= 14.839
  12:25:42 STEP 2685 H=2685:00 +CPU= 23.114
  12:25:57 STEP 2686 H=2686:00 +CPU= 14.372
  12:26:11 STEP 2687 H=2687:00 +CPU= 14.676
  12:26:38 STEP 2688 H=2688:00 +CPU= 26.743
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:26:52 STEP 2689 H=2689:00 +CPU= 14.071
  12:27:07 STEP 2690 H=2690:00 +CPU= 14.739
  12:27:30 STEP 2691 H=2691:00 +CPU= 22.793
  12:27:45 STEP 2692 H=2692:00 +CPU= 14.910
  12:27:59 STEP 2693 H=2693:00 +CPU= 14.378
  12:28:23 STEP 2694 H=2694:00 +CPU= 23.500
  12:28:36 STEP 2695 H=2695:00 +CPU= 13.727
  12:28:51 STEP 2696 H=2696:00 +CPU= 14.767
  12:29:14 STEP 2697 H=2697:00 +CPU= 22.922
  12:29:29 STEP 2698 H=2698:00 +CPU= 14.921
  12:29:43 STEP 2699 H=2699:00 +CPU= 14.180
  12:30:09 STEP 2700 H=2700:00 +CPU= 25.182
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002700
  12:30:23 STEP 2701 H=2701:00 +CPU= 14.200
  12:30:38 STEP 2702 H=2702:00 +CPU= 14.856
  12:31:01 STEP 2703 H=2703:00 +CPU= 22.794
  12:31:15 STEP 2704 H=2704:00 +CPU= 14.610
  12:31:30 STEP 2705 H=2705:00 +CPU= 14.355
  12:31:53 STEP 2706 H=2706:00 +CPU= 23.511
  12:32:07 STEP 2707 H=2707:00 +CPU= 14.174
  12:32:22 STEP 2708 H=2708:00 +CPU= 14.514
  12:32:45 STEP 2709 H=2709:00 +CPU= 22.991
  12:33:00 STEP 2710 H=2710:00 +CPU= 14.778
  12:33:14 STEP 2711 H=2711:00 +CPU= 14.701
  12:33:41 STEP 2712 H=2712:00 +CPU= 26.842
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:33:55 STEP 2713 H=2713:00 +CPU= 13.906
  12:34:10 STEP 2714 H=2714:00 +CPU= 14.959
  12:34:33 STEP 2715 H=2715:00 +CPU= 22.755
  12:34:47 STEP 2716 H=2716:00 +CPU= 14.473
  12:35:02 STEP 2717 H=2717:00 +CPU= 14.053
  12:35:25 STEP 2718 H=2718:00 +CPU= 23.248
  12:35:39 STEP 2719 H=2719:00 +CPU= 14.173
  12:35:54 STEP 2720 H=2720:00 +CPU= 14.791
  12:36:17 STEP 2721 H=2721:00 +CPU= 23.105
  12:36:32 STEP 2722 H=2722:00 +CPU= 14.845
  12:36:46 STEP 2723 H=2723:00 +CPU= 13.899
  12:37:11 STEP 2724 H=2724:00 +CPU= 25.146
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002724
  12:37:25 STEP 2725 H=2725:00 +CPU= 14.415
  12:37:40 STEP 2726 H=2726:00 +CPU= 14.789
  12:38:03 STEP 2727 H=2727:00 +CPU= 22.559
  12:38:18 STEP 2728 H=2728:00 +CPU= 14.936
  12:38:32 STEP 2729 H=2729:00 +CPU= 14.129
  12:38:55 STEP 2730 H=2730:00 +CPU= 22.973
  12:39:09 STEP 2731 H=2731:00 +CPU= 14.416
  12:39:24 STEP 2732 H=2732:00 +CPU= 14.557
  12:39:47 STEP 2733 H=2733:00 +CPU= 23.003
  12:40:02 STEP 2734 H=2734:00 +CPU= 14.821
  12:40:17 STEP 2735 H=2735:00 +CPU= 14.799
  12:40:44 STEP 2736 H=2736:00 +CPU= 27.285
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:40:58 STEP 2737 H=2737:00 +CPU= 14.360
  12:41:13 STEP 2738 H=2738:00 +CPU= 14.743
  12:41:36 STEP 2739 H=2739:00 +CPU= 22.831
  12:41:50 STEP 2740 H=2740:00 +CPU= 14.355
  12:42:05 STEP 2741 H=2741:00 +CPU= 14.232
  12:42:28 STEP 2742 H=2742:00 +CPU= 23.089
  12:42:42 STEP 2743 H=2743:00 +CPU= 14.413
  12:42:57 STEP 2744 H=2744:00 +CPU= 14.797
  12:43:20 STEP 2745 H=2745:00 +CPU= 22.623
  12:43:35 STEP 2746 H=2746:00 +CPU= 15.089
  12:43:49 STEP 2747 H=2747:00 +CPU= 14.068
  12:44:14 STEP 2748 H=2748:00 +CPU= 25.243
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002748
  12:44:28 STEP 2749 H=2749:00 +CPU= 13.652
  12:44:43 STEP 2750 H=2750:00 +CPU= 14.858
  12:45:06 STEP 2751 H=2751:00 +CPU= 23.161
  12:45:20 STEP 2752 H=2752:00 +CPU= 14.520
  12:45:34 STEP 2753 H=2753:00 +CPU= 13.903
  12:45:57 STEP 2754 H=2754:00 +CPU= 22.776
  12:46:11 STEP 2755 H=2755:00 +CPU= 14.083
  12:46:25 STEP 2756 H=2756:00 +CPU= 14.179
  12:46:48 STEP 2757 H=2757:00 +CPU= 22.720
  12:47:03 STEP 2758 H=2758:00 +CPU= 14.718
  12:47:17 STEP 2759 H=2759:00 +CPU= 14.425
  12:47:44 STEP 2760 H=2760:00 +CPU= 26.980
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:47:58 STEP 2761 H=2761:00 +CPU= 13.742
  12:48:13 STEP 2762 H=2762:00 +CPU= 14.773
  12:48:36 STEP 2763 H=2763:00 +CPU= 22.584
  12:48:50 STEP 2764 H=2764:00 +CPU= 14.474
  12:49:05 STEP 2765 H=2765:00 +CPU= 14.530
  12:49:28 STEP 2766 H=2766:00 +CPU= 23.667
  12:49:43 STEP 2767 H=2767:00 +CPU= 14.340
  12:49:58 STEP 2768 H=2768:00 +CPU= 14.926
  12:50:21 STEP 2769 H=2769:00 +CPU= 22.751
  12:50:36 STEP 2770 H=2770:00 +CPU= 14.978
  12:50:49 STEP 2771 H=2771:00 +CPU= 13.926
  12:51:15 STEP 2772 H=2772:00 +CPU= 25.415
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002772
  12:51:29 STEP 2773 H=2773:00 +CPU= 14.480
  12:51:44 STEP 2774 H=2774:00 +CPU= 14.599
  12:52:07 STEP 2775 H=2775:00 +CPU= 22.902
  12:52:22 STEP 2776 H=2776:00 +CPU= 14.849
  12:52:36 STEP 2777 H=2777:00 +CPU= 13.930
  12:52:59 STEP 2778 H=2778:00 +CPU= 23.322
  12:53:14 STEP 2779 H=2779:00 +CPU= 14.454
  12:53:28 STEP 2780 H=2780:00 +CPU= 14.220
  12:53:51 STEP 2781 H=2781:00 +CPU= 22.904
  12:54:06 STEP 2782 H=2782:00 +CPU= 14.659
  12:54:20 STEP 2783 H=2783:00 +CPU= 14.490
  12:54:47 STEP 2784 H=2784:00 +CPU= 27.137
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_115.zip
Uploading the intermediate file: upload_file_115.zip
  12:55:01 STEP 2785 H=2785:00 +CPU= 14.217
  12:55:16 STEP 2786 H=2786:00 +CPU= 14.710
  12:55:39 STEP 2787 H=2787:00 +CPU= 22.930
  12:55:54 STEP 2788 H=2788:00 +CPU= 14.533
  12:56:08 STEP 2789 H=2789:00 +CPU= 14.193
  12:56:31 STEP 2790 H=2790:00 +CPU= 23.340
  12:56:46 STEP 2791 H=2791:00 +CPU= 14.298
  12:57:00 STEP 2792 H=2792:00 +CPU= 14.535
  12:57:23 STEP 2793 H=2793:00 +CPU= 22.997
  12:57:38 STEP 2794 H=2794:00 +CPU= 14.824
  12:57:52 STEP 2795 H=2795:00 +CPU= 14.400
  12:58:18 STEP 2796 H=2796:00 +CPU= 25.515
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002796
  12:58:32 STEP 2797 H=2797:00 +CPU= 14.447
  12:58:47 STEP 2798 H=2798:00 +CPU= 14.718
  12:59:10 STEP 2799 H=2799:00 +CPU= 22.858
  12:59:25 STEP 2800 H=2800:00 +CPU= 15.131
  12:59:40 STEP 2801 H=2801:00 +CPU= 14.385
  13:00:03 STEP 2802 H=2802:00 +CPU= 23.626
  13:00:17 STEP 2803 H=2803:00 +CPU= 13.917
  13:00:32 STEP 2804 H=2804:00 +CPU= 14.854
  13:00:55 STEP 2805 H=2805:00 +CPU= 22.469
  13:01:09 STEP 2806 H=2806:00 +CPU= 14.551
  13:01:24 STEP 2807 H=2807:00 +CPU= 14.742
  13:01:51 STEP 2808 H=2808:00 +CPU= 26.879
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:02:05 STEP 2809 H=2809:00 +CPU= 13.954
  13:02:20 STEP 2810 H=2810:00 +CPU= 15.012
  13:02:43 STEP 2811 H=2811:00 +CPU= 23.058
  13:02:58 STEP 2812 H=2812:00 +CPU= 14.867
  13:03:12 STEP 2813 H=2813:00 +CPU= 13.809
  13:03:35 STEP 2814 H=2814:00 +CPU= 23.133
  13:03:49 STEP 2815 H=2815:00 +CPU= 14.525
  13:04:04 STEP 2816 H=2816:00 +CPU= 14.573
  13:04:27 STEP 2817 H=2817:00 +CPU= 23.164
  13:04:42 STEP 2818 H=2818:00 +CPU= 14.697
  13:04:56 STEP 2819 H=2819:00 +CPU= 14.313
  13:05:22 STEP 2820 H=2820:00 +CPU= 25.479
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002820
  13:05:36 STEP 2821 H=2821:00 +CPU= 14.459
  13:05:51 STEP 2822 H=2822:00 +CPU= 14.695
  13:06:14 STEP 2823 H=2823:00 +CPU= 23.108
  13:06:29 STEP 2824 H=2824:00 +CPU= 14.817
  13:06:43 STEP 2825 H=2825:00 +CPU= 13.940
  13:07:07 STEP 2826 H=2826:00 +CPU= 23.824
  13:07:21 STEP 2827 H=2827:00 +CPU= 14.230
  13:07:36 STEP 2828 H=2828:00 +CPU= 14.568
  13:07:59 STEP 2829 H=2829:00 +CPU= 22.962
  13:08:13 STEP 2830 H=2830:00 +CPU= 14.285
  13:08:28 STEP 2831 H=2831:00 +CPU= 14.756
  13:08:55 STEP 2832 H=2832:00 +CPU= 26.919
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:09:09 STEP 2833 H=2833:00 +CPU= 14.555
  13:09:24 STEP 2834 H=2834:00 +CPU= 14.955
  13:09:47 STEP 2835 H=2835:00 +CPU= 23.007
  13:10:01 STEP 2836 H=2836:00 +CPU= 14.086
  13:10:15 STEP 2837 H=2837:00 +CPU= 13.712
  13:10:39 STEP 2838 H=2838:00 +CPU= 23.498
  13:10:53 STEP 2839 H=2839:00 +CPU= 14.092
  13:11:07 STEP 2840 H=2840:00 +CPU= 14.413
  13:11:30 STEP 2841 H=2841:00 +CPU= 22.863
  13:11:45 STEP 2842 H=2842:00 +CPU= 14.629
  13:11:59 STEP 2843 H=2843:00 +CPU= 14.028
  13:12:24 STEP 2844 H=2844:00 +CPU= 25.033
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002844
  13:12:38 STEP 2845 H=2845:00 +CPU= 14.206
  13:12:53 STEP 2846 H=2846:00 +CPU= 14.524
  13:13:16 STEP 2847 H=2847:00 +CPU= 22.921
  13:13:30 STEP 2848 H=2848:00 +CPU= 14.822
  13:13:45 STEP 2849 H=2849:00 +CPU= 14.165
  13:14:08 STEP 2850 H=2850:00 +CPU= 23.350
  13:14:22 STEP 2851 H=2851:00 +CPU= 14.162
  13:14:37 STEP 2852 H=2852:00 +CPU= 14.549
  13:14:59 STEP 2853 H=2853:00 +CPU= 22.677
  13:15:14 STEP 2854 H=2854:00 +CPU= 14.790
  13:15:29 STEP 2855 H=2855:00 +CPU= 14.611
  13:15:56 STEP 2856 H=2856:00 +CPU= 26.721
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:16:10 STEP 2857 H=2857:00 +CPU= 14.397
  13:16:25 STEP 2858 H=2858:00 +CPU= 14.795
  13:16:47 STEP 2859 H=2859:00 +CPU= 22.447
  13:17:02 STEP 2860 H=2860:00 +CPU= 14.291
  13:17:16 STEP 2861 H=2861:00 +CPU= 13.775
  13:17:39 STEP 2862 H=2862:00 +CPU= 23.733
  13:17:54 STEP 2863 H=2863:00 +CPU= 14.319
  13:18:08 STEP 2864 H=2864:00 +CPU= 14.445
  13:18:31 STEP 2865 H=2865:00 +CPU= 23.020
  13:18:46 STEP 2866 H=2866:00 +CPU= 14.911
  13:19:00 STEP 2867 H=2867:00 +CPU= 14.322
  13:19:26 STEP 2868 H=2868:00 +CPU= 25.253
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002868
  13:19:40 STEP 2869 H=2869:00 +CPU= 14.207
  13:19:54 STEP 2870 H=2870:00 +CPU= 14.255
  13:20:17 STEP 2871 H=2871:00 +CPU= 22.869
  13:20:32 STEP 2872 H=2872:00 +CPU= 14.701
  13:20:46 STEP 2873 H=2873:00 +CPU= 14.193
  13:21:10 STEP 2874 H=2874:00 +CPU= 23.523
  13:21:24 STEP 2875 H=2875:00 +CPU= 14.395
  13:21:38 STEP 2876 H=2876:00 +CPU= 14.035
  13:22:01 STEP 2877 H=2877:00 +CPU= 22.813
  13:22:16 STEP 2878 H=2878:00 +CPU= 14.672
  13:22:30 STEP 2879 H=2879:00 +CPU= 14.594
  13:22:58 STEP 2880 H=2880:00 +CPU= 27.148
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:23:12 STEP 2881 H=2881:00 +CPU= 14.290
Uploading trickle at timestep: 10368000
  13:23:27 STEP 2882 H=2882:00 +CPU= 15.082
  13:23:50 STEP 2883 H=2883:00 +CPU= 23.122
  13:24:05 STEP 2884 H=2884:00 +CPU= 14.553
  13:24:19 STEP 2885 H=2885:00 +CPU= 14.347
  13:24:42 STEP 2886 H=2886:00 +CPU= 23.343
  13:24:57 STEP 2887 H=2887:00 +CPU= 14.225
  13:25:12 STEP 2888 H=2888:00 +CPU= 14.858
  13:25:35 STEP 2889 H=2889:00 +CPU= 23.152
  13:25:50 STEP 2890 H=2890:00 +CPU= 14.837
  13:26:04 STEP 2891 H=2891:00 +CPU= 13.957
  13:26:29 STEP 2892 H=2892:00 +CPU= 25.617
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002892
  13:26:43 STEP 2893 H=2893:00 +CPU= 13.971
  13:26:58 STEP 2894 H=2894:00 +CPU= 14.472
  13:27:21 STEP 2895 H=2895:00 +CPU= 22.856
  13:27:36 STEP 2896 H=2896:00 +CPU= 14.977
  13:27:50 STEP 2897 H=2897:00 +CPU= 14.202
  13:28:13 STEP 2898 H=2898:00 +CPU= 23.551
  13:28:27 STEP 2899 H=2899:00 +CPU= 13.801
  13:28:42 STEP 2900 H=2900:00 +CPU= 14.986
  13:29:05 STEP 2901 H=2901:00 +CPU= 22.986
  13:29:20 STEP 2902 H=2902:00 +CPU= 14.695
  13:29:34 STEP 2903 H=2903:00 +CPU= 14.108
  13:30:01 STEP 2904 H=2904:00 +CPU= 26.783
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:30:15 STEP 2905 H=2905:00 +CPU= 14.154
  13:30:30 STEP 2906 H=2906:00 +CPU= 14.550
  13:30:53 STEP 2907 H=2907:00 +CPU= 23.111
  13:31:08 STEP 2908 H=2908:00 +CPU= 14.775
  13:31:22 STEP 2909 H=2909:00 +CPU= 14.296
  13:31:46 STEP 2910 H=2910:00 +CPU= 23.475
  13:32:00 STEP 2911 H=2911:00 +CPU= 14.493
  13:32:15 STEP 2912 H=2912:00 +CPU= 14.822
  13:32:38 STEP 2913 H=2913:00 +CPU= 23.467
  13:32:53 STEP 2914 H=2914:00 +CPU= 14.888
  13:33:08 STEP 2915 H=2915:00 +CPU= 14.436
  13:33:33 STEP 2916 H=2916:00 +CPU= 25.135
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002916
  13:33:47 STEP 2917 H=2917:00 +CPU= 14.426
  13:34:02 STEP 2918 H=2918:00 +CPU= 14.845
  13:34:25 STEP 2919 H=2919:00 +CPU= 22.939
  13:34:39 STEP 2920 H=2920:00 +CPU= 14.142
  13:34:53 STEP 2921 H=2921:00 +CPU= 13.892
  13:35:17 STEP 2922 H=2922:00 +CPU= 23.409
  13:35:31 STEP 2923 H=2923:00 +CPU= 14.009
  13:35:46 STEP 2924 H=2924:00 +CPU= 14.852
  13:36:09 STEP 2925 H=2925:00 +CPU= 22.763
  13:36:23 STEP 2926 H=2926:00 +CPU= 14.794
  13:36:38 STEP 2927 H=2927:00 +CPU= 14.702
  13:37:05 STEP 2928 H=2928:00 +CPU= 26.452
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_121.zip
Uploading the intermediate file: upload_file_121.zip
  13:37:19 STEP 2929 H=2929:00 +CPU= 14.179
  13:37:34 STEP 2930 H=2930:00 +CPU= 14.687
  13:37:56 STEP 2931 H=2931:00 +CPU= 22.597
  13:38:11 STEP 2932 H=2932:00 +CPU= 14.687
  13:38:25 STEP 2933 H=2933:00 +CPU= 14.331
  13:38:49 STEP 2934 H=2934:00 +CPU= 23.271
  13:39:03 STEP 2935 H=2935:00 +CPU= 14.356
  13:39:18 STEP 2936 H=2936:00 +CPU= 14.691
  13:39:41 STEP 2937 H=2937:00 +CPU= 23.064
  13:39:55 STEP 2938 H=2938:00 +CPU= 14.640
  13:40:10 STEP 2939 H=2939:00 +CPU= 14.321
  13:40:35 STEP 2940 H=2940:00 +CPU= 25.060
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002940
  13:40:49 STEP 2941 H=2941:00 +CPU= 13.959
  13:41:04 STEP 2942 H=2942:00 +CPU= 14.793
  13:41:26 STEP 2943 H=2943:00 +CPU= 22.645
  13:41:41 STEP 2944 H=2944:00 +CPU= 14.797
  13:41:55 STEP 2945 H=2945:00 +CPU= 14.038
  13:42:19 STEP 2946 H=2946:00 +CPU= 23.579
  13:42:33 STEP 2947 H=2947:00 +CPU= 14.410
  13:42:48 STEP 2948 H=2948:00 +CPU= 14.592
  13:43:11 STEP 2949 H=2949:00 +CPU= 22.787
  13:43:26 STEP 2950 H=2950:00 +CPU= 14.733
  13:43:40 STEP 2951 H=2951:00 +CPU= 14.337
  13:44:06 STEP 2952 H=2952:00 +CPU= 26.276
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.10671392617025     
  MAXGPFV : MAX. VALUE =   0.728493779854728     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    328784698 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0078( 3.8%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 13:44:06 STEP 2952 H=2952:00 +CPU= 26.276
 END CNT3
 NSTEP =  2952 CNT0   000000000  22.737  22.737  22.775   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   139.1     0.0   139.1     0.7   207.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1192.2    1192.2      7.62      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     173.9     173.9      1.03      0.00
  10 SCAN2M - PHYSICS                             2953    7517.1    7517.1     44.36      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     797.8     797.8      0.39      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      12.8      12.8      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    8304.5    8304.5     16.35      0.00
  14 SUINIF                                          1    1227.1    1227.1      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      30.8      30.8      0.02      0.00
  18 SUSPECG                                         1     226.5     226.5      0.00      0.00
  19 SUSPEC                                          1     230.9     230.9      0.00      0.00
  24 SUGRIDU                                         1     737.5     737.5      0.00      0.00
  25 SPECRT                                          1     137.9     137.9      0.00      0.00
  26 SUGRIDF                                         1     120.7     120.7      0.00      0.00
  27 RESTART FILES - WRITING                       123    1602.1    1602.1      0.39      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1513.3    1513.3      0.75      0.00
  31 POSDDH IN STEPO                                13       0.6       0.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2106.2    2106.2     12.43      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1910.9    1910.9     11.27      0.00
  39 SU0YOMB                                         1     199.3     199.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953       8.8       8.8      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      63.4      63.4      0.37      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      14.6      14.6      0.09      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      95.6      95.6      1.93      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      95.3      95.3      1.17      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      39.7      39.7      0.49      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      33.8      33.8      0.68      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      14.2      14.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      12.3      12.3      0.25      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      10.5      10.5      0.13      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      19.9      19.9      0.40      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      14.4      14.4      0.18      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    50041.6 CPU TIME   49959.2 VECTOR TIME    49959.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      212.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/28/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/28/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/28/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215100/ICMUAhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01a6_2019110100_123_993_12215100_1_r1799996251_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
13:47:29 (1351699): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:55 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 10,623,600 49,959 0.0047
09 May 2023 16:53:55 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 10,368,000 48,697 0.0047
09 May 2023 16:53:53 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 9,504,000 44,477 0.0047
09 May 2023 16:53:47 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 8,640,000 40,268 0.0047
09 May 2023 16:53:44 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 7,776,000 36,059 0.0046
09 May 2023 16:53:43 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 6,912,000 32,024 0.0046
09 May 2023 16:53:37 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 6,048,000 28,020 0.0046
09 May 2023 16:53:34 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 5,184,000 24,035 0.0046
09 May 2023 16:53:31 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 4,320,000 20,051 0.0046
09 May 2023 16:53:30 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 3,456,000 16,046 0.0046
09 May 2023 16:53:24 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 2,592,000 12,042 0.0046
09 May 2023 16:53:20 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 1,728,000 8,027 0.0046
09 May 2023 16:53:17 1536631 22316990 oifs_43r3_01a6_2019110100_123_993_12215100_1 864,000 4,022 0.0047


©2024 climateprediction.net