climateprediction.net home page
Task 22316637

Task 22316637

Name oifs_43r3_01dw_2019110100_123_993_12215234_0
Workunit 12215234
Created 24 Feb 2023, 17:51:34 UTC
Sent 24 Feb 2023, 17:58:19 UTC
Report deadline 25 Apr 2023, 17:58:19 UTC
Received 25 Feb 2023, 11:17:40 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537784
Run time 16 hours 58 min 36 sec
CPU time 16 hours 54 min 28 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.16 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,414.68 MB
Peak swap size 4,974.30 MB
Peak disk usage 1,459.82 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
8 STEP 2372 H=2372:00 +CPU= 16.266
  07:47:22 STEP 2373 H=2373:00 +CPU= 24.705
  07:47:39 STEP 2374 H=2374:00 +CPU= 16.301
  07:47:55 STEP 2375 H=2375:00 +CPU= 16.472
  07:48:24 STEP 2376 H=2376:00 +CPU= 28.922
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_98.zip
Uploading the intermediate file: upload_file_98.zip
  07:48:40 STEP 2377 H=2377:00 +CPU= 15.637
  07:48:56 STEP 2378 H=2378:00 +CPU= 16.115
  07:49:21 STEP 2379 H=2379:00 +CPU= 24.664
  07:49:37 STEP 2380 H=2380:00 +CPU= 16.223
  07:49:52 STEP 2381 H=2381:00 +CPU= 15.712
  07:50:18 STEP 2382 H=2382:00 +CPU= 25.303
  07:50:34 STEP 2383 H=2383:00 +CPU= 15.815
  07:50:50 STEP 2384 H=2384:00 +CPU= 16.238
  07:51:15 STEP 2385 H=2385:00 +CPU= 24.957
  07:51:31 STEP 2386 H=2386:00 +CPU= 16.249
  07:51:47 STEP 2387 H=2387:00 +CPU= 15.949
  07:52:14 STEP 2388 H=2388:00 +CPU= 27.256
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002388
  07:52:30 STEP 2389 H=2389:00 +CPU= 15.896
  07:52:46 STEP 2390 H=2390:00 +CPU= 16.093
  07:53:11 STEP 2391 H=2391:00 +CPU= 24.879
  07:53:27 STEP 2392 H=2392:00 +CPU= 16.235
  07:53:43 STEP 2393 H=2393:00 +CPU= 15.781
  07:54:09 STEP 2394 H=2394:00 +CPU= 25.466
  07:54:24 STEP 2395 H=2395:00 +CPU= 15.589
  07:54:41 STEP 2396 H=2396:00 +CPU= 16.383
  07:55:06 STEP 2397 H=2397:00 +CPU= 24.901
  07:55:22 STEP 2398 H=2398:00 +CPU= 16.136
  07:55:38 STEP 2399 H=2399:00 +CPU= 16.398
  07:56:08 STEP 2400 H=2400:00 +CPU= 29.592
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_99.zip
Uploading the intermediate file: upload_file_99.zip
  07:56:23 STEP 2401 H=2401:00 +CPU= 15.692
Uploading trickle at timestep: 8640000
  07:56:39 STEP 2402 H=2402:00 +CPU= 16.090
  07:57:04 STEP 2403 H=2403:00 +CPU= 24.841
  07:57:21 STEP 2404 H=2404:00 +CPU= 16.293
  07:57:36 STEP 2405 H=2405:00 +CPU= 15.732
  07:58:02 STEP 2406 H=2406:00 +CPU= 25.606
  07:58:18 STEP 2407 H=2407:00 +CPU= 15.750
  07:58:34 STEP 2408 H=2408:00 +CPU= 16.221
  07:58:59 STEP 2409 H=2409:00 +CPU= 24.794
  07:59:15 STEP 2410 H=2410:00 +CPU= 16.404
  07:59:31 STEP 2411 H=2411:00 +CPU= 15.705
  07:59:58 STEP 2412 H=2412:00 +CPU= 27.587
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002412
  08:00:14 STEP 2413 H=2413:00 +CPU= 15.789
  08:00:30 STEP 2414 H=2414:00 +CPU= 16.136
  08:00:55 STEP 2415 H=2415:00 +CPU= 24.920
  08:01:12 STEP 2416 H=2416:00 +CPU= 16.318
  08:01:27 STEP 2417 H=2417:00 +CPU= 15.879
  08:01:53 STEP 2418 H=2418:00 +CPU= 25.572
  08:02:09 STEP 2419 H=2419:00 +CPU= 15.718
  08:02:25 STEP 2420 H=2420:00 +CPU= 16.373
  08:02:50 STEP 2421 H=2421:00 +CPU= 25.046
  08:03:06 STEP 2422 H=2422:00 +CPU= 16.213
  08:03:23 STEP 2423 H=2423:00 +CPU= 16.318
  08:03:52 STEP 2424 H=2424:00 +CPU= 29.195
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_100.zip
Uploading the intermediate file: upload_file_100.zip
  08:04:08 STEP 2425 H=2425:00 +CPU= 15.562
  08:04:24 STEP 2426 H=2426:00 +CPU= 16.071
  08:04:48 STEP 2427 H=2427:00 +CPU= 24.809
  08:05:05 STEP 2428 H=2428:00 +CPU= 16.166
  08:05:20 STEP 2429 H=2429:00 +CPU= 15.645
  08:05:46 STEP 2430 H=2430:00 +CPU= 25.482
  08:06:02 STEP 2431 H=2431:00 +CPU= 15.847
  08:06:18 STEP 2432 H=2432:00 +CPU= 16.167
  08:06:43 STEP 2433 H=2433:00 +CPU= 25.044
  08:06:59 STEP 2434 H=2434:00 +CPU= 16.482
  08:07:15 STEP 2435 H=2435:00 +CPU= 16.005
  08:07:43 STEP 2436 H=2436:00 +CPU= 27.354
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002436
  08:07:58 STEP 2437 H=2437:00 +CPU= 15.692
  08:08:14 STEP 2438 H=2438:00 +CPU= 16.078
  08:08:39 STEP 2439 H=2439:00 +CPU= 25.054
  08:08:55 STEP 2440 H=2440:00 +CPU= 15.992
  08:09:11 STEP 2441 H=2441:00 +CPU= 15.786
  08:09:37 STEP 2442 H=2442:00 +CPU= 25.552
  08:09:53 STEP 2443 H=2443:00 +CPU= 15.797
  08:10:09 STEP 2444 H=2444:00 +CPU= 16.189
  08:10:34 STEP 2445 H=2445:00 +CPU= 24.933
  08:10:50 STEP 2446 H=2446:00 +CPU= 16.178
  08:11:06 STEP 2447 H=2447:00 +CPU= 16.439
  08:11:36 STEP 2448 H=2448:00 +CPU= 29.307
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:11:51 STEP 2449 H=2449:00 +CPU= 15.663
  08:12:07 STEP 2450 H=2450:00 +CPU= 16.071
  08:12:32 STEP 2451 H=2451:00 +CPU= 24.887
  08:12:48 STEP 2452 H=2452:00 +CPU= 16.147
  08:13:04 STEP 2453 H=2453:00 +CPU= 15.604
  08:13:29 STEP 2454 H=2454:00 +CPU= 25.379
  08:13:45 STEP 2455 H=2455:00 +CPU= 15.825
  08:14:02 STEP 2456 H=2456:00 +CPU= 16.223
  08:14:27 STEP 2457 H=2457:00 +CPU= 25.004
  08:14:43 STEP 2458 H=2458:00 +CPU= 16.625
  08:14:59 STEP 2459 H=2459:00 +CPU= 15.780
  08:15:26 STEP 2460 H=2460:00 +CPU= 27.376
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002460
  08:15:42 STEP 2461 H=2461:00 +CPU= 15.896
  08:15:58 STEP 2462 H=2462:00 +CPU= 16.169
  08:16:24 STEP 2463 H=2463:00 +CPU= 25.064
  08:16:40 STEP 2464 H=2464:00 +CPU= 16.367
  08:16:56 STEP 2465 H=2465:00 +CPU= 15.628
  08:17:21 STEP 2466 H=2466:00 +CPU= 25.364
  08:17:37 STEP 2467 H=2467:00 +CPU= 15.891
  08:17:53 STEP 2468 H=2468:00 +CPU= 16.438
  08:18:18 STEP 2469 H=2469:00 +CPU= 25.024
  08:18:35 STEP 2470 H=2470:00 +CPU= 16.366
  08:18:51 STEP 2471 H=2471:00 +CPU= 16.221
  08:19:20 STEP 2472 H=2472:00 +CPU= 29.317
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_102.zip
Uploading the intermediate file: upload_file_102.zip
  08:19:36 STEP 2473 H=2473:00 +CPU= 15.850
  08:19:52 STEP 2474 H=2474:00 +CPU= 15.995
  08:20:17 STEP 2475 H=2475:00 +CPU= 24.883
  08:20:33 STEP 2476 H=2476:00 +CPU= 16.319
  08:20:49 STEP 2477 H=2477:00 +CPU= 15.679
  08:21:14 STEP 2478 H=2478:00 +CPU= 25.561
  08:21:30 STEP 2479 H=2479:00 +CPU= 15.761
  08:21:47 STEP 2480 H=2480:00 +CPU= 16.387
  08:22:12 STEP 2481 H=2481:00 +CPU= 25.056
  08:22:28 STEP 2482 H=2482:00 +CPU= 16.406
  08:22:44 STEP 2483 H=2483:00 +CPU= 15.802
  08:23:11 STEP 2484 H=2484:00 +CPU= 27.416
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002484
  08:23:27 STEP 2485 H=2485:00 +CPU= 16.085
  08:23:44 STEP 2486 H=2486:00 +CPU= 16.126
  08:24:09 STEP 2487 H=2487:00 +CPU= 25.016
  08:24:25 STEP 2488 H=2488:00 +CPU= 16.319
  08:24:41 STEP 2489 H=2489:00 +CPU= 15.665
  08:25:06 STEP 2490 H=2490:00 +CPU= 25.455
  08:25:22 STEP 2491 H=2491:00 +CPU= 15.738
  08:25:38 STEP 2492 H=2492:00 +CPU= 16.207
  08:26:03 STEP 2493 H=2493:00 +CPU= 25.204
  08:26:19 STEP 2494 H=2494:00 +CPU= 16.337
  08:26:36 STEP 2495 H=2495:00 +CPU= 16.286
  08:27:05 STEP 2496 H=2496:00 +CPU= 29.409
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_103.zip
Uploading the intermediate file: upload_file_103.zip
  08:27:21 STEP 2497 H=2497:00 +CPU= 15.625
  08:27:37 STEP 2498 H=2498:00 +CPU= 16.075
  08:28:02 STEP 2499 H=2499:00 +CPU= 24.877
  08:28:18 STEP 2500 H=2500:00 +CPU= 16.128
  08:28:34 STEP 2501 H=2501:00 +CPU= 15.644
  08:28:59 STEP 2502 H=2502:00 +CPU= 25.406
  08:29:15 STEP 2503 H=2503:00 +CPU= 15.885
  08:29:31 STEP 2504 H=2504:00 +CPU= 16.126
  08:29:56 STEP 2505 H=2505:00 +CPU= 24.829
  08:30:12 STEP 2506 H=2506:00 +CPU= 16.346
  08:30:28 STEP 2507 H=2507:00 +CPU= 15.804
  08:30:55 STEP 2508 H=2508:00 +CPU= 27.304
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002508
  08:31:11 STEP 2509 H=2509:00 +CPU= 15.803
  08:31:27 STEP 2510 H=2510:00 +CPU= 15.998
  08:31:52 STEP 2511 H=2511:00 +CPU= 24.992
  08:32:09 STEP 2512 H=2512:00 +CPU= 16.384
  08:32:24 STEP 2513 H=2513:00 +CPU= 15.787
  08:32:50 STEP 2514 H=2514:00 +CPU= 25.549
  08:33:06 STEP 2515 H=2515:00 +CPU= 15.910
  08:33:22 STEP 2516 H=2516:00 +CPU= 16.395
  08:33:47 STEP 2517 H=2517:00 +CPU= 25.022
  08:34:04 STEP 2518 H=2518:00 +CPU= 16.412
  08:34:20 STEP 2519 H=2519:00 +CPU= 16.240
  08:34:49 STEP 2520 H=2520:00 +CPU= 29.236
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_104.zip
Uploading the intermediate file: upload_file_104.zip
  08:35:05 STEP 2521 H=2521:00 +CPU= 15.699
  08:35:21 STEP 2522 H=2522:00 +CPU= 15.897
  08:35:46 STEP 2523 H=2523:00 +CPU= 24.979
  08:36:02 STEP 2524 H=2524:00 +CPU= 16.220
  08:36:17 STEP 2525 H=2525:00 +CPU= 15.504
  08:36:43 STEP 2526 H=2526:00 +CPU= 25.698
  08:36:59 STEP 2527 H=2527:00 +CPU= 16.023
  08:37:15 STEP 2528 H=2528:00 +CPU= 15.958
  08:37:40 STEP 2529 H=2529:00 +CPU= 24.910
  08:37:56 STEP 2530 H=2530:00 +CPU= 16.132
  08:38:12 STEP 2531 H=2531:00 +CPU= 15.605
  08:38:39 STEP 2532 H=2532:00 +CPU= 27.441
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002532
  08:38:55 STEP 2533 H=2533:00 +CPU= 16.004
  08:39:11 STEP 2534 H=2534:00 +CPU= 16.101
  08:39:36 STEP 2535 H=2535:00 +CPU= 25.089
  08:39:53 STEP 2536 H=2536:00 +CPU= 16.318
  08:40:09 STEP 2537 H=2537:00 +CPU= 15.741
  08:40:34 STEP 2538 H=2538:00 +CPU= 25.530
  08:40:50 STEP 2539 H=2539:00 +CPU= 15.858
  08:41:06 STEP 2540 H=2540:00 +CPU= 16.274
  08:41:31 STEP 2541 H=2541:00 +CPU= 25.071
  08:41:48 STEP 2542 H=2542:00 +CPU= 16.512
  08:42:04 STEP 2543 H=2543:00 +CPU= 16.366
  08:42:33 STEP 2544 H=2544:00 +CPU= 29.269
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_105.zip
Uploading the intermediate file: upload_file_105.zip
  08:42:49 STEP 2545 H=2545:00 +CPU= 15.895
  08:43:05 STEP 2546 H=2546:00 +CPU= 16.033
  08:43:31 STEP 2547 H=2547:00 +CPU= 25.127
  08:43:47 STEP 2548 H=2548:00 +CPU= 16.376
  08:44:03 STEP 2549 H=2549:00 +CPU= 15.732
  08:44:28 STEP 2550 H=2550:00 +CPU= 25.471
  08:44:44 STEP 2551 H=2551:00 +CPU= 15.787
  08:45:00 STEP 2552 H=2552:00 +CPU= 16.373
  08:45:25 STEP 2553 H=2553:00 +CPU= 25.025
  08:45:42 STEP 2554 H=2554:00 +CPU= 16.491
  08:45:58 STEP 2555 H=2555:00 +CPU= 15.932
  08:46:25 STEP 2556 H=2556:00 +CPU= 27.227
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002556
  08:46:41 STEP 2557 H=2557:00 +CPU= 15.945
  08:46:57 STEP 2558 H=2558:00 +CPU= 16.080
  08:47:22 STEP 2559 H=2559:00 +CPU= 24.950
  08:47:38 STEP 2560 H=2560:00 +CPU= 16.256
  08:47:54 STEP 2561 H=2561:00 +CPU= 15.780
  08:48:19 STEP 2562 H=2562:00 +CPU= 25.375
  08:48:35 STEP 2563 H=2563:00 +CPU= 16.016
  08:48:52 STEP 2564 H=2564:00 +CPU= 16.251
  08:49:17 STEP 2565 H=2565:00 +CPU= 25.091
  08:49:33 STEP 2566 H=2566:00 +CPU= 16.525
  08:49:50 STEP 2567 H=2567:00 +CPU= 16.216
  08:50:19 STEP 2568 H=2568:00 +CPU= 29.097
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_106.zip
Uploading the intermediate file: upload_file_106.zip
  08:50:35 STEP 2569 H=2569:00 +CPU= 16.004
  08:50:51 STEP 2570 H=2570:00 +CPU= 15.989
  08:51:16 STEP 2571 H=2571:00 +CPU= 24.879
  08:51:32 STEP 2572 H=2572:00 +CPU= 16.219
  08:51:47 STEP 2573 H=2573:00 +CPU= 15.610
  08:52:13 STEP 2574 H=2574:00 +CPU= 25.444
  08:52:29 STEP 2575 H=2575:00 +CPU= 15.921
  08:52:45 STEP 2576 H=2576:00 +CPU= 16.287
  08:53:10 STEP 2577 H=2577:00 +CPU= 25.001
  08:53:27 STEP 2578 H=2578:00 +CPU= 16.525
  08:53:42 STEP 2579 H=2579:00 +CPU= 15.709
  08:54:10 STEP 2580 H=2580:00 +CPU= 27.260
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002580
  08:54:25 STEP 2581 H=2581:00 +CPU= 15.811
  08:54:41 STEP 2582 H=2582:00 +CPU= 15.903
  08:55:06 STEP 2583 H=2583:00 +CPU= 24.730
  08:55:22 STEP 2584 H=2584:00 +CPU= 16.287
  08:55:38 STEP 2585 H=2585:00 +CPU= 15.646
  08:56:03 STEP 2586 H=2586:00 +CPU= 25.506
  08:56:19 STEP 2587 H=2587:00 +CPU= 15.887
  08:56:36 STEP 2588 H=2588:00 +CPU= 16.309
  08:57:01 STEP 2589 H=2589:00 +CPU= 25.135
  08:57:17 STEP 2590 H=2590:00 +CPU= 16.522
  08:57:34 STEP 2591 H=2591:00 +CPU= 16.237
  08:58:03 STEP 2592 H=2592:00 +CPU= 29.333
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_107.zip
Uploading the intermediate file: upload_file_107.zip
  08:58:19 STEP 2593 H=2593:00 +CPU= 15.749
  08:58:35 STEP 2594 H=2594:00 +CPU= 15.906
  08:59:00 STEP 2595 H=2595:00 +CPU= 24.970
  08:59:16 STEP 2596 H=2596:00 +CPU= 16.275
  08:59:31 STEP 2597 H=2597:00 +CPU= 15.469
  08:59:57 STEP 2598 H=2598:00 +CPU= 25.397
  09:00:13 STEP 2599 H=2599:00 +CPU= 15.839
  09:00:29 STEP 2600 H=2600:00 +CPU= 16.124
  09:00:54 STEP 2601 H=2601:00 +CPU= 25.120
  09:01:10 STEP 2602 H=2602:00 +CPU= 16.528
  09:01:26 STEP 2603 H=2603:00 +CPU= 15.789
  09:01:53 STEP 2604 H=2604:00 +CPU= 27.187
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002604
  09:02:09 STEP 2605 H=2605:00 +CPU= 15.680
  09:02:25 STEP 2606 H=2606:00 +CPU= 16.113
  09:02:50 STEP 2607 H=2607:00 +CPU= 24.865
  09:03:06 STEP 2608 H=2608:00 +CPU= 16.194
  09:03:22 STEP 2609 H=2609:00 +CPU= 15.539
  09:03:47 STEP 2610 H=2610:00 +CPU= 25.315
  09:04:03 STEP 2611 H=2611:00 +CPU= 15.659
  09:04:19 STEP 2612 H=2612:00 +CPU= 16.219
  09:04:44 STEP 2613 H=2613:00 +CPU= 24.896
  09:05:00 STEP 2614 H=2614:00 +CPU= 16.356
  09:05:17 STEP 2615 H=2615:00 +CPU= 16.415
  09:05:46 STEP 2616 H=2616:00 +CPU= 29.245
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_108.zip
Uploading the intermediate file: upload_file_108.zip
  09:06:02 STEP 2617 H=2617:00 +CPU= 15.843
  09:06:18 STEP 2618 H=2618:00 +CPU= 15.919
  09:06:43 STEP 2619 H=2619:00 +CPU= 24.967
  09:06:59 STEP 2620 H=2620:00 +CPU= 16.283
  09:07:15 STEP 2621 H=2621:00 +CPU= 15.787
  09:07:40 STEP 2622 H=2622:00 +CPU= 25.374
  09:07:56 STEP 2623 H=2623:00 +CPU= 15.895
  09:08:12 STEP 2624 H=2624:00 +CPU= 16.282
  09:08:37 STEP 2625 H=2625:00 +CPU= 25.097
  09:08:54 STEP 2626 H=2626:00 +CPU= 16.550
  09:09:10 STEP 2627 H=2627:00 +CPU= 15.848
  09:09:37 STEP 2628 H=2628:00 +CPU= 27.121
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002628
  09:09:53 STEP 2629 H=2629:00 +CPU= 15.838
  09:10:09 STEP 2630 H=2630:00 +CPU= 16.201
  09:10:34 STEP 2631 H=2631:00 +CPU= 25.012
  09:10:50 STEP 2632 H=2632:00 +CPU= 16.325
  09:11:06 STEP 2633 H=2633:00 +CPU= 15.682
  09:11:31 STEP 2634 H=2634:00 +CPU= 25.411
  09:11:47 STEP 2635 H=2635:00 +CPU= 15.721
  09:12:04 STEP 2636 H=2636:00 +CPU= 16.402
  09:12:29 STEP 2637 H=2637:00 +CPU= 25.083
  09:12:45 STEP 2638 H=2638:00 +CPU= 16.429
  09:13:01 STEP 2639 H=2639:00 +CPU= 16.335
  09:13:31 STEP 2640 H=2640:00 +CPU= 29.190
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_109.zip
Uploading the intermediate file: upload_file_109.zip
  09:13:46 STEP 2641 H=2641:00 +CPU= 15.841
Uploading trickle at timestep: 9504000
  09:14:02 STEP 2642 H=2642:00 +CPU= 16.033
  09:14:27 STEP 2643 H=2643:00 +CPU= 24.635
  09:14:43 STEP 2644 H=2644:00 +CPU= 16.330
  09:14:59 STEP 2645 H=2645:00 +CPU= 15.642
  09:15:24 STEP 2646 H=2646:00 +CPU= 25.349
  09:15:40 STEP 2647 H=2647:00 +CPU= 15.829
  09:15:56 STEP 2648 H=2648:00 +CPU= 16.244
  09:16:21 STEP 2649 H=2649:00 +CPU= 24.993
  09:16:38 STEP 2650 H=2650:00 +CPU= 16.488
  09:16:54 STEP 2651 H=2651:00 +CPU= 15.872
  09:17:21 STEP 2652 H=2652:00 +CPU= 27.194
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002652
  09:17:37 STEP 2653 H=2653:00 +CPU= 15.879
  09:17:53 STEP 2654 H=2654:00 +CPU= 16.380
  09:18:18 STEP 2655 H=2655:00 +CPU= 24.738
  09:18:34 STEP 2656 H=2656:00 +CPU= 16.385
  09:18:50 STEP 2657 H=2657:00 +CPU= 15.824
  09:19:16 STEP 2658 H=2658:00 +CPU= 25.622
  09:19:32 STEP 2659 H=2659:00 +CPU= 15.738
  09:19:48 STEP 2660 H=2660:00 +CPU= 16.244
  09:20:13 STEP 2661 H=2661:00 +CPU= 25.023
  09:20:29 STEP 2662 H=2662:00 +CPU= 16.365
  09:20:46 STEP 2663 H=2663:00 +CPU= 16.304
  09:21:15 STEP 2664 H=2664:00 +CPU= 29.392
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_110.zip
Uploading the intermediate file: upload_file_110.zip
  09:21:31 STEP 2665 H=2665:00 +CPU= 15.827
  09:21:47 STEP 2666 H=2666:00 +CPU= 16.019
  09:22:12 STEP 2667 H=2667:00 +CPU= 24.848
  09:22:28 STEP 2668 H=2668:00 +CPU= 16.186
  09:22:44 STEP 2669 H=2669:00 +CPU= 15.784
  09:23:09 STEP 2670 H=2670:00 +CPU= 25.520
  09:23:25 STEP 2671 H=2671:00 +CPU= 15.804
  09:23:41 STEP 2672 H=2672:00 +CPU= 16.105
  09:24:06 STEP 2673 H=2673:00 +CPU= 24.915
  09:24:22 STEP 2674 H=2674:00 +CPU= 16.424
  09:24:38 STEP 2675 H=2675:00 +CPU= 15.973
  09:25:06 STEP 2676 H=2676:00 +CPU= 27.252
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002676
  09:25:22 STEP 2677 H=2677:00 +CPU= 15.986
  09:25:38 STEP 2678 H=2678:00 +CPU= 16.151
  09:26:03 STEP 2679 H=2679:00 +CPU= 24.827
  09:26:19 STEP 2680 H=2680:00 +CPU= 16.205
  09:26:35 STEP 2681 H=2681:00 +CPU= 15.658
  09:27:00 STEP 2682 H=2682:00 +CPU= 25.344
  09:27:16 STEP 2683 H=2683:00 +CPU= 15.747
  09:27:32 STEP 2684 H=2684:00 +CPU= 16.333
  09:27:57 STEP 2685 H=2685:00 +CPU= 25.118
  09:28:14 STEP 2686 H=2686:00 +CPU= 16.513
  09:28:30 STEP 2687 H=2687:00 +CPU= 16.332
  09:28:59 STEP 2688 H=2688:00 +CPU= 29.268
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_111.zip
Uploading the intermediate file: upload_file_111.zip
  09:29:15 STEP 2689 H=2689:00 +CPU= 15.647
  09:29:31 STEP 2690 H=2690:00 +CPU= 16.102
  09:29:56 STEP 2691 H=2691:00 +CPU= 24.969
  09:30:12 STEP 2692 H=2692:00 +CPU= 16.254
  09:30:28 STEP 2693 H=2693:00 +CPU= 15.616
  09:30:53 STEP 2694 H=2694:00 +CPU= 25.263
  09:31:09 STEP 2695 H=2695:00 +CPU= 15.876
  09:31:25 STEP 2696 H=2696:00 +CPU= 16.314
  09:31:51 STEP 2697 H=2697:00 +CPU= 25.177
  09:32:07 STEP 2698 H=2698:00 +CPU= 16.589
  09:32:23 STEP 2699 H=2699:00 +CPU= 15.885
  09:32:50 STEP 2700 H=2700:00 +CPU= 27.259
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002700
  09:33:06 STEP 2701 H=2701:00 +CPU= 15.790
  09:33:22 STEP 2702 H=2702:00 +CPU= 16.086
  09:33:47 STEP 2703 H=2703:00 +CPU= 24.854
  09:34:03 STEP 2704 H=2704:00 +CPU= 16.285
  09:34:19 STEP 2705 H=2705:00 +CPU= 15.671
  09:34:44 STEP 2706 H=2706:00 +CPU= 25.359
  09:35:00 STEP 2707 H=2707:00 +CPU= 15.581
  09:35:16 STEP 2708 H=2708:00 +CPU= 16.110
  09:35:41 STEP 2709 H=2709:00 +CPU= 24.885
  09:35:57 STEP 2710 H=2710:00 +CPU= 16.397
  09:36:14 STEP 2711 H=2711:00 +CPU= 16.588
  09:36:43 STEP 2712 H=2712:00 +CPU= 29.340
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_112.zip
Uploading the intermediate file: upload_file_112.zip
  09:36:59 STEP 2713 H=2713:00 +CPU= 15.826
  09:37:15 STEP 2714 H=2714:00 +CPU= 16.000
  09:37:40 STEP 2715 H=2715:00 +CPU= 24.890
  09:37:56 STEP 2716 H=2716:00 +CPU= 16.191
  09:38:12 STEP 2717 H=2717:00 +CPU= 15.563
  09:38:37 STEP 2718 H=2718:00 +CPU= 25.126
  09:38:52 STEP 2719 H=2719:00 +CPU= 15.578
  09:39:09 STEP 2720 H=2720:00 +CPU= 16.118
  09:39:33 STEP 2721 H=2721:00 +CPU= 24.646
  09:39:49 STEP 2722 H=2722:00 +CPU= 16.195
  09:40:05 STEP 2723 H=2723:00 +CPU= 15.752
  09:40:32 STEP 2724 H=2724:00 +CPU= 27.150
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002724
  09:40:48 STEP 2725 H=2725:00 +CPU= 15.825
  09:41:04 STEP 2726 H=2726:00 +CPU= 16.306
  09:41:29 STEP 2727 H=2727:00 +CPU= 24.899
  09:41:46 STEP 2728 H=2728:00 +CPU= 16.315
  09:42:02 STEP 2729 H=2729:00 +CPU= 15.946
  09:42:27 STEP 2730 H=2730:00 +CPU= 25.403
  09:42:43 STEP 2731 H=2731:00 +CPU= 15.942
  09:43:00 STEP 2732 H=2732:00 +CPU= 16.550
  09:43:25 STEP 2733 H=2733:00 +CPU= 25.035
  09:43:41 STEP 2734 H=2734:00 +CPU= 16.306
  09:43:57 STEP 2735 H=2735:00 +CPU= 16.448
  09:44:26 STEP 2736 H=2736:00 +CPU= 29.118
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_113.zip
Uploading the intermediate file: upload_file_113.zip
  09:44:42 STEP 2737 H=2737:00 +CPU= 15.627
  09:44:58 STEP 2738 H=2738:00 +CPU= 16.088
  09:45:23 STEP 2739 H=2739:00 +CPU= 24.788
  09:45:39 STEP 2740 H=2740:00 +CPU= 16.229
  09:45:55 STEP 2741 H=2741:00 +CPU= 15.843
  09:46:21 STEP 2742 H=2742:00 +CPU= 25.443
  09:46:36 STEP 2743 H=2743:00 +CPU= 15.756
  09:46:53 STEP 2744 H=2744:00 +CPU= 16.360
  09:47:18 STEP 2745 H=2745:00 +CPU= 25.195
  09:47:34 STEP 2746 H=2746:00 +CPU= 16.245
  09:47:50 STEP 2747 H=2747:00 +CPU= 15.994
  09:48:17 STEP 2748 H=2748:00 +CPU= 27.316
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002748
  09:48:33 STEP 2749 H=2749:00 +CPU= 15.871
  09:48:49 STEP 2750 H=2750:00 +CPU= 16.168
  09:49:14 STEP 2751 H=2751:00 +CPU= 24.857
  09:49:31 STEP 2752 H=2752:00 +CPU= 16.299
  09:49:46 STEP 2753 H=2753:00 +CPU= 15.709
  09:50:12 STEP 2754 H=2754:00 +CPU= 25.372
  09:50:28 STEP 2755 H=2755:00 +CPU= 15.954
  09:50:44 STEP 2756 H=2756:00 +CPU= 16.166
  09:51:09 STEP 2757 H=2757:00 +CPU= 24.858
  09:51:25 STEP 2758 H=2758:00 +CPU= 16.326
  09:51:41 STEP 2759 H=2759:00 +CPU= 16.431
  09:52:11 STEP 2760 H=2760:00 +CPU= 29.307
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_114.zip
Uploading the intermediate file: upload_file_114.zip
  09:52:26 STEP 2761 H=2761:00 +CPU= 15.636
  09:52:43 STEP 2762 H=2762:00 +CPU= 16.078
  09:53:07 STEP 2763 H=2763:00 +CPU= 24.781
  09:53:24 STEP 2764 H=2764:00 +CPU= 16.179
  09:53:39 STEP 2765 H=2765:00 +CPU= 15.611
  09:54:05 STEP 2766 H=2766:00 +CPU= 25.508
  09:54:20 STEP 2767 H=2767:00 +CPU= 15.830
  09:54:37 STEP 2768 H=2768:00 +CPU= 16.330
  09:55:02 STEP 2769 H=2769:00 +CPU= 24.792
  09:55:18 STEP 2770 H=2770:00 +CPU= 16.147
  09:55:34 STEP 2771 H=2771:00 +CPU= 15.984
  09:56:01 STEP 2772 H=2772:00 +CPU= 27.320
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002772
  09:56:17 STEP 2773 H=2773:00 +CPU= 16.081
  09:56:33 STEP 2774 H=2774:00 +CPU= 16.131
  09:56:58 STEP 2775 H=2775:00 +CPU= 24.577
  09:57:14 STEP 2776 H=2776:00 +CPU= 16.361
  09:57:30 STEP 2777 H=2777:00 +CPU= 15.692
  09:57:55 STEP 2778 H=2778:00 +CPU= 25.370
  09:58:11 STEP 2779 H=2779:00 +CPU= 15.704
  09:58:27 STEP 2780 H=2780:00 +CPU= 16.206
  09:58:52 STEP 2781 H=2781:00 +CPU= 24.705
  09:59:08 STEP 2782 H=2782:00 +CPU= 16.230
  09:59:25 STEP 2783 H=2783:00 +CPU= 16.369
  09:59:54 STEP 2784 H=2784:00 +CPU= 29.409
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_115.zip
Uploading the intermediate file: upload_file_115.zip
  10:00:10 STEP 2785 H=2785:00 +CPU= 15.812
  10:00:26 STEP 2786 H=2786:00 +CPU= 15.975
  10:00:50 STEP 2787 H=2787:00 +CPU= 24.599
  10:01:07 STEP 2788 H=2788:00 +CPU= 16.357
  10:01:22 STEP 2789 H=2789:00 +CPU= 15.709
  10:01:48 STEP 2790 H=2790:00 +CPU= 25.259
  10:02:03 STEP 2791 H=2791:00 +CPU= 15.758
  10:02:20 STEP 2792 H=2792:00 +CPU= 16.345
  10:02:45 STEP 2793 H=2793:00 +CPU= 24.775
  10:03:01 STEP 2794 H=2794:00 +CPU= 16.311
  10:03:17 STEP 2795 H=2795:00 +CPU= 15.760
  10:03:44 STEP 2796 H=2796:00 +CPU= 27.299
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002796
  10:04:00 STEP 2797 H=2797:00 +CPU= 16.132
  10:04:17 STEP 2798 H=2798:00 +CPU= 16.429
  10:04:42 STEP 2799 H=2799:00 +CPU= 25.028
  10:04:58 STEP 2800 H=2800:00 +CPU= 16.432
  10:05:14 STEP 2801 H=2801:00 +CPU= 15.764
  10:05:39 STEP 2802 H=2802:00 +CPU= 25.420
  10:05:55 STEP 2803 H=2803:00 +CPU= 15.923
  10:06:12 STEP 2804 H=2804:00 +CPU= 16.637
  10:06:37 STEP 2805 H=2805:00 +CPU= 24.930
  10:06:53 STEP 2806 H=2806:00 +CPU= 16.417
  10:07:09 STEP 2807 H=2807:00 +CPU= 16.340
  10:07:39 STEP 2808 H=2808:00 +CPU= 29.359
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_116.zip
Uploading the intermediate file: upload_file_116.zip
  10:07:55 STEP 2809 H=2809:00 +CPU= 15.864
  10:08:11 STEP 2810 H=2810:00 +CPU= 16.080
  10:08:36 STEP 2811 H=2811:00 +CPU= 24.981
  10:08:52 STEP 2812 H=2812:00 +CPU= 16.303
  10:09:08 STEP 2813 H=2813:00 +CPU= 15.808
  10:09:33 STEP 2814 H=2814:00 +CPU= 25.300
  10:09:49 STEP 2815 H=2815:00 +CPU= 15.958
  10:10:05 STEP 2816 H=2816:00 +CPU= 16.375
  10:10:30 STEP 2817 H=2817:00 +CPU= 24.739
  10:10:47 STEP 2818 H=2818:00 +CPU= 16.501
  10:11:03 STEP 2819 H=2819:00 +CPU= 15.853
  10:11:30 STEP 2820 H=2820:00 +CPU= 27.106
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002820
  10:11:46 STEP 2821 H=2821:00 +CPU= 16.198
  10:12:02 STEP 2822 H=2822:00 +CPU= 16.133
  10:12:27 STEP 2823 H=2823:00 +CPU= 24.889
  10:12:43 STEP 2824 H=2824:00 +CPU= 16.128
  10:12:59 STEP 2825 H=2825:00 +CPU= 15.668
  10:13:24 STEP 2826 H=2826:00 +CPU= 25.460
  10:13:40 STEP 2827 H=2827:00 +CPU= 15.827
  10:13:57 STEP 2828 H=2828:00 +CPU= 16.557
  10:14:21 STEP 2829 H=2829:00 +CPU= 24.840
  10:14:38 STEP 2830 H=2830:00 +CPU= 16.260
  10:14:54 STEP 2831 H=2831:00 +CPU= 16.349
  10:15:24 STEP 2832 H=2832:00 +CPU= 29.505
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_117.zip
Uploading the intermediate file: upload_file_117.zip
  10:15:40 STEP 2833 H=2833:00 +CPU= 15.985
  10:15:56 STEP 2834 H=2834:00 +CPU= 16.186
  10:16:21 STEP 2835 H=2835:00 +CPU= 24.777
  10:16:37 STEP 2836 H=2836:00 +CPU= 16.228
  10:16:52 STEP 2837 H=2837:00 +CPU= 15.621
  10:17:18 STEP 2838 H=2838:00 +CPU= 25.450
  10:17:34 STEP 2839 H=2839:00 +CPU= 15.774
  10:17:50 STEP 2840 H=2840:00 +CPU= 16.324
  10:18:15 STEP 2841 H=2841:00 +CPU= 24.963
  10:18:32 STEP 2842 H=2842:00 +CPU= 16.684
  10:18:48 STEP 2843 H=2843:00 +CPU= 16.001
  10:19:15 STEP 2844 H=2844:00 +CPU= 27.432
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002844
  10:19:31 STEP 2845 H=2845:00 +CPU= 16.030
  10:19:47 STEP 2846 H=2846:00 +CPU= 16.275
  10:20:12 STEP 2847 H=2847:00 +CPU= 24.825
  10:20:29 STEP 2848 H=2848:00 +CPU= 16.526
  10:20:45 STEP 2849 H=2849:00 +CPU= 15.881
  10:21:10 STEP 2850 H=2850:00 +CPU= 25.490
  10:21:26 STEP 2851 H=2851:00 +CPU= 15.857
  10:21:42 STEP 2852 H=2852:00 +CPU= 16.272
  10:22:07 STEP 2853 H=2853:00 +CPU= 24.910
  10:22:24 STEP 2854 H=2854:00 +CPU= 16.561
  10:22:40 STEP 2855 H=2855:00 +CPU= 16.545
  10:23:09 STEP 2856 H=2856:00 +CPU= 29.120
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_118.zip
Uploading the intermediate file: upload_file_118.zip
  10:23:25 STEP 2857 H=2857:00 +CPU= 15.585
  10:23:41 STEP 2858 H=2858:00 +CPU= 15.986
  10:24:06 STEP 2859 H=2859:00 +CPU= 24.719
  10:24:22 STEP 2860 H=2860:00 +CPU= 16.263
  10:24:38 STEP 2861 H=2861:00 +CPU= 15.818
  10:25:03 STEP 2862 H=2862:00 +CPU= 25.432
  10:25:19 STEP 2863 H=2863:00 +CPU= 15.869
  10:25:35 STEP 2864 H=2864:00 +CPU= 16.182
  10:26:00 STEP 2865 H=2865:00 +CPU= 25.113
  10:26:17 STEP 2866 H=2866:00 +CPU= 16.326
  10:26:33 STEP 2867 H=2867:00 +CPU= 15.887
  10:27:00 STEP 2868 H=2868:00 +CPU= 27.299
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002868
  10:27:16 STEP 2869 H=2869:00 +CPU= 16.091
  10:27:32 STEP 2870 H=2870:00 +CPU= 16.185
  10:27:57 STEP 2871 H=2871:00 +CPU= 24.726
  10:28:13 STEP 2872 H=2872:00 +CPU= 16.202
  10:28:29 STEP 2873 H=2873:00 +CPU= 15.657
  10:28:54 STEP 2874 H=2874:00 +CPU= 25.301
  10:29:10 STEP 2875 H=2875:00 +CPU= 16.075
  10:29:27 STEP 2876 H=2876:00 +CPU= 16.441
  10:29:52 STEP 2877 H=2877:00 +CPU= 25.034
  10:30:08 STEP 2878 H=2878:00 +CPU= 16.585
  10:30:25 STEP 2879 H=2879:00 +CPU= 16.311
  10:30:54 STEP 2880 H=2880:00 +CPU= 29.267
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_119.zip
Uploading the intermediate file: upload_file_119.zip
  10:31:10 STEP 2881 H=2881:00 +CPU= 15.841
Uploading trickle at timestep: 10368000
  10:31:26 STEP 2882 H=2882:00 +CPU= 16.135
  10:31:51 STEP 2883 H=2883:00 +CPU= 24.728
  10:32:07 STEP 2884 H=2884:00 +CPU= 16.208
  10:32:22 STEP 2885 H=2885:00 +CPU= 15.591
  10:32:48 STEP 2886 H=2886:00 +CPU= 25.263
  10:33:04 STEP 2887 H=2887:00 +CPU= 15.879
  10:33:20 STEP 2888 H=2888:00 +CPU= 16.330
  10:33:45 STEP 2889 H=2889:00 +CPU= 25.067
  10:34:01 STEP 2890 H=2890:00 +CPU= 16.364
  10:34:17 STEP 2891 H=2891:00 +CPU= 15.757
  10:34:45 STEP 2892 H=2892:00 +CPU= 27.503
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002892
  10:35:01 STEP 2893 H=2893:00 +CPU= 16.005
  10:35:17 STEP 2894 H=2894:00 +CPU= 16.235
  10:35:42 STEP 2895 H=2895:00 +CPU= 24.924
  10:35:58 STEP 2896 H=2896:00 +CPU= 16.394
  10:36:14 STEP 2897 H=2897:00 +CPU= 16.031
  10:36:40 STEP 2898 H=2898:00 +CPU= 25.240
  10:36:55 STEP 2899 H=2899:00 +CPU= 15.831
  10:37:12 STEP 2900 H=2900:00 +CPU= 16.268
  10:37:37 STEP 2901 H=2901:00 +CPU= 24.908
  10:37:53 STEP 2902 H=2902:00 +CPU= 16.391
  10:38:09 STEP 2903 H=2903:00 +CPU= 16.157
  10:38:38 STEP 2904 H=2904:00 +CPU= 29.169
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_120.zip
Uploading the intermediate file: upload_file_120.zip
  10:38:54 STEP 2905 H=2905:00 +CPU= 15.857
  10:39:10 STEP 2906 H=2906:00 +CPU= 15.867
  10:39:35 STEP 2907 H=2907:00 +CPU= 24.809
  10:39:51 STEP 2908 H=2908:00 +CPU= 16.230
  10:40:07 STEP 2909 H=2909:00 +CPU= 15.624
  10:40:32 STEP 2910 H=2910:00 +CPU= 25.170
  10:40:48 STEP 2911 H=2911:00 +CPU= 15.886
  10:41:04 STEP 2912 H=2912:00 +CPU= 16.620
  10:41:29 STEP 2913 H=2913:00 +CPU= 24.950
  10:41:46 STEP 2914 H=2914:00 +CPU= 16.449
  10:42:02 STEP 2915 H=2915:00 +CPU= 15.905
  10:42:29 STEP 2916 H=2916:00 +CPU= 27.343
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002916
  10:42:45 STEP 2917 H=2917:00 +CPU= 16.058
  10:43:01 STEP 2918 H=2918:00 +CPU= 16.146
  10:43:26 STEP 2919 H=2919:00 +CPU= 24.606
  10:43:42 STEP 2920 H=2920:00 +CPU= 16.231
  10:43:58 STEP 2921 H=2921:00 +CPU= 15.844
  10:44:23 STEP 2922 H=2922:00 +CPU= 25.287
  10:44:39 STEP 2923 H=2923:00 +CPU= 15.859
  10:44:55 STEP 2924 H=2924:00 +CPU= 16.205
  10:45:20 STEP 2925 H=2925:00 +CPU= 24.753
  10:45:37 STEP 2926 H=2926:00 +CPU= 16.517
  10:45:53 STEP 2927 H=2927:00 +CPU= 16.497
  10:46:22 STEP 2928 H=2928:00 +CPU= 29.331
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_121.zip
Uploading the intermediate file: upload_file_121.zip
  10:46:38 STEP 2929 H=2929:00 +CPU= 15.867
  10:46:54 STEP 2930 H=2930:00 +CPU= 16.014
  10:47:19 STEP 2931 H=2931:00 +CPU= 24.697
  10:47:35 STEP 2932 H=2932:00 +CPU= 16.318
  10:47:51 STEP 2933 H=2933:00 +CPU= 15.562
  10:48:16 STEP 2934 H=2934:00 +CPU= 25.528
  10:48:32 STEP 2935 H=2935:00 +CPU= 15.864
  10:48:49 STEP 2936 H=2936:00 +CPU= 16.207
  10:49:13 STEP 2937 H=2937:00 +CPU= 24.790
  10:49:30 STEP 2938 H=2938:00 +CPU= 16.470
  10:49:46 STEP 2939 H=2939:00 +CPU= 15.966
  10:50:13 STEP 2940 H=2940:00 +CPU= 27.140
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002940
  10:50:29 STEP 2941 H=2941:00 +CPU= 15.946
  10:50:45 STEP 2942 H=2942:00 +CPU= 16.274
  10:51:10 STEP 2943 H=2943:00 +CPU= 24.800
  10:51:26 STEP 2944 H=2944:00 +CPU= 16.403
  10:51:42 STEP 2945 H=2945:00 +CPU= 15.835
  10:52:07 STEP 2946 H=2946:00 +CPU= 24.815
  10:52:22 STEP 2947 H=2947:00 +CPU= 15.326
  10:52:38 STEP 2948 H=2948:00 +CPU= 15.912
  10:53:02 STEP 2949 H=2949:00 +CPU= 23.975
  10:53:17 STEP 2950 H=2950:00 +CPU= 15.215
  10:53:33 STEP 2951 H=2951:00 +CPU= 15.107
  10:53:59 STEP 2952 H=2952:00 +CPU= 26.639
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.13184430619152     
  MAXGPFV : MAX. VALUE =   0.745687376505413     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    309879338 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS774698.3 Mbytes/s, TOTAL TIME=    0.0078( 5.1%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 10:53:59 STEP 2952 H=2952:00 +CPU= 26.639
 END CNT3
 NSTEP =  2952 CNT0   000000000  23.089  23.089  23.091   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   182.1     0.0   182.1     1.0   276.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1661.0    1661.0      8.73      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     206.1     206.1      1.00      0.00
  10 SCAN2M - PHYSICS                             2953    9359.1    9359.1     45.38      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247    1095.3    1095.3      0.44      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      15.0      15.0      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    9596.6    9596.6     15.52      0.00
  14 SUINIF                                          1    1629.3    1629.3      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      40.4      40.4      0.02      0.00
  18 SUSPECG                                         1     313.5     313.5      0.00      0.00
  19 SUSPEC                                          1     321.3     321.3      0.00      0.00
  24 SUGRIDU                                         1     961.9     961.9      0.00      0.00
  25 SPECRT                                          1     167.2     167.2      0.00      0.00
  26 SUGRIDF                                         1     178.9     178.9      0.00      0.00
  27 RESTART FILES - WRITING                       123    2199.4    2199.4      0.44      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1706.9    1706.9      0.69      0.00
  31 POSDDH IN STEPO                                13       1.1       1.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2601.8    2601.8     12.61      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2107.0    2107.0     10.21      0.00
  39 SU0YOMB                                         1     298.7     298.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      11.2      11.2      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      86.2      86.2      0.42      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      22.5      22.5      0.11      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094     104.7     104.7      1.74      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     104.6     104.6      1.06      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      42.5      42.5      0.43      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      34.8      34.8      0.58      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      16.9      16.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      18.2      18.2      0.30      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      15.0      15.0      0.15      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      20.0      20.0      0.33      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      14.3      14.3      0.14      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    60908.1 CPU TIME   60868.6 VECTOR TIME    60868.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      174.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/31/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/31/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/31/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215234/ICMSHhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01dw_2019110100_123_993_12215234_0_r1213831643_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:57:22 (8609): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:33 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 10,623,600 60,868 0.0057
09 May 2023 16:53:33 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 10,368,000 59,483 0.0057
09 May 2023 16:53:27 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 9,504,000 54,840 0.0058
09 May 2023 16:53:24 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 8,640,000 50,208 0.0058
09 May 2023 16:53:20 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 7,776,000 45,565 0.0059
09 May 2023 16:53:17 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 6,912,000 40,922 0.0059
09 May 2023 16:53:11 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 6,048,000 36,289 0.0060
09 May 2023 16:53:07 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 5,184,000 31,656 0.0061
09 May 2023 16:53:04 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 4,320,000 27,014 0.0063
09 May 2023 16:53:01 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 3,456,000 22,381 0.0065
09 May 2023 16:52:55 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 2,592,000 17,738 0.0068
09 May 2023 16:52:52 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 1,728,000 12,693 0.0073
09 May 2023 16:52:47 1537784 22316637 oifs_43r3_01dw_2019110100_123_993_12215234_0 864,000 6,381 0.0074


©2024 climateprediction.net