climateprediction.net home page
Task 22293950

Task 22293950

Name oifs_43r3_ps_0293_1991050100_123_960_12176937_1
Workunit 12176937
Created 27 Dec 2022, 20:40:16 UTC
Sent 27 Dec 2022, 21:19:16 UTC
Report deadline 26 Jan 2023, 21:19:16 UTC
Received 17 Jan 2023, 20:28:56 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532160
Run time 11 hours 45 min 32 sec
CPU time 11 hours 34 min 57 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 8.21 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,396.39 MB
Peak swap size 4,978.07 MB
Peak disk usage 4,651.05 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
 STEP 2423 H=2423:00 +CPU= 11.453
  15:16:07 STEP 2424 H=2424:00 +CPU= 21.075
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_100.zip
Uploading the intermediate file: upload_file_100.zip
  15:16:18 STEP 2425 H=2425:00 +CPU= 11.133
  15:16:30 STEP 2426 H=2426:00 +CPU= 11.416
  15:16:47 STEP 2427 H=2427:00 +CPU= 17.634
  15:16:59 STEP 2428 H=2428:00 +CPU= 11.307
  15:17:10 STEP 2429 H=2429:00 +CPU= 11.310
  15:17:29 STEP 2430 H=2430:00 +CPU= 18.220
  15:17:40 STEP 2431 H=2431:00 +CPU= 11.207
  15:17:51 STEP 2432 H=2432:00 +CPU= 11.556
  15:18:09 STEP 2433 H=2433:00 +CPU= 17.814
  15:18:23 STEP 2434 H=2434:00 +CPU= 11.416
  15:18:36 STEP 2435 H=2435:00 +CPU= 11.511
  15:18:56 STEP 2436 H=2436:00 +CPU= 20.170
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002436
  15:19:07 STEP 2437 H=2437:00 +CPU= 11.022
  15:19:20 STEP 2438 H=2438:00 +CPU= 11.940
  15:19:45 STEP 2439 H=2439:00 +CPU= 17.871
  15:19:57 STEP 2440 H=2440:00 +CPU= 11.786
  15:20:09 STEP 2441 H=2441:00 +CPU= 11.712
  15:20:28 STEP 2442 H=2442:00 +CPU= 18.256
  15:20:40 STEP 2443 H=2443:00 +CPU= 11.504
  15:20:51 STEP 2444 H=2444:00 +CPU= 11.474
  15:21:09 STEP 2445 H=2445:00 +CPU= 17.836
  15:21:21 STEP 2446 H=2446:00 +CPU= 11.938
  15:21:34 STEP 2447 H=2447:00 +CPU= 12.028
  15:22:13 STEP 2448 H=2448:00 +CPU= 21.994
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_101.zip
Uploading the intermediate file: upload_file_101.zip
  15:22:25 STEP 2449 H=2449:00 +CPU= 11.506
  15:22:37 STEP 2450 H=2450:00 +CPU= 11.718
  15:22:55 STEP 2451 H=2451:00 +CPU= 18.184
  15:23:07 STEP 2452 H=2452:00 +CPU= 11.772
  15:23:19 STEP 2453 H=2453:00 +CPU= 11.452
  15:23:38 STEP 2454 H=2454:00 +CPU= 18.805
  15:23:49 STEP 2455 H=2455:00 +CPU= 11.722
  15:24:02 STEP 2456 H=2456:00 +CPU= 11.818
  15:24:21 STEP 2457 H=2457:00 +CPU= 18.410
  15:24:33 STEP 2458 H=2458:00 +CPU= 11.781
  15:24:45 STEP 2459 H=2459:00 +CPU= 11.081
  15:25:06 STEP 2460 H=2460:00 +CPU= 20.670
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002460
  15:25:18 STEP 2461 H=2461:00 +CPU= 11.588
  15:25:30 STEP 2462 H=2462:00 +CPU= 11.456
  15:25:48 STEP 2463 H=2463:00 +CPU= 18.164
  15:26:00 STEP 2464 H=2464:00 +CPU= 11.893
  15:26:11 STEP 2465 H=2465:00 +CPU= 11.318
  15:26:32 STEP 2466 H=2466:00 +CPU= 18.519
  15:26:43 STEP 2467 H=2467:00 +CPU= 11.005
  15:26:54 STEP 2468 H=2468:00 +CPU= 11.198
  15:27:12 STEP 2469 H=2469:00 +CPU= 17.856
  15:27:24 STEP 2470 H=2470:00 +CPU= 11.569
  15:27:36 STEP 2471 H=2471:00 +CPU= 11.479
  15:27:58 STEP 2472 H=2472:00 +CPU= 21.165
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_102.zip
Uploading the intermediate file: upload_file_102.zip
  15:28:09 STEP 2473 H=2473:00 +CPU= 11.196
  15:28:21 STEP 2474 H=2474:00 +CPU= 11.799
  15:28:40 STEP 2475 H=2475:00 +CPU= 17.643
  15:28:53 STEP 2476 H=2476:00 +CPU= 11.461
  15:29:05 STEP 2477 H=2477:00 +CPU= 11.334
  15:29:23 STEP 2478 H=2478:00 +CPU= 18.461
  15:29:35 STEP 2479 H=2479:00 +CPU= 11.206
  15:29:46 STEP 2480 H=2480:00 +CPU= 11.284
  15:30:04 STEP 2481 H=2481:00 +CPU= 17.650
  15:30:15 STEP 2482 H=2482:00 +CPU= 11.570
  15:30:27 STEP 2483 H=2483:00 +CPU= 11.069
  15:30:47 STEP 2484 H=2484:00 +CPU= 19.858
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002484
  15:30:59 STEP 2485 H=2485:00 +CPU= 11.046
  15:31:10 STEP 2486 H=2486:00 +CPU= 11.209
  15:31:28 STEP 2487 H=2487:00 +CPU= 17.634
  15:31:40 STEP 2488 H=2488:00 +CPU= 11.505
  15:31:52 STEP 2489 H=2489:00 +CPU= 11.061
  15:32:10 STEP 2490 H=2490:00 +CPU= 18.160
  15:32:22 STEP 2491 H=2491:00 +CPU= 11.103
  15:32:34 STEP 2492 H=2492:00 +CPU= 11.461
  15:32:52 STEP 2493 H=2493:00 +CPU= 17.720
  15:33:03 STEP 2494 H=2494:00 +CPU= 11.494
  15:33:18 STEP 2495 H=2495:00 +CPU= 11.661
  15:34:37 STEP 2496 H=2496:00 +CPU= 22.152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_103.zip
Uploading the intermediate file: upload_file_103.zip
  15:34:48 STEP 2497 H=2497:00 +CPU= 11.061
  15:34:59 STEP 2498 H=2498:00 +CPU= 11.231
  15:35:18 STEP 2499 H=2499:00 +CPU= 18.507
  15:35:30 STEP 2500 H=2500:00 +CPU= 11.422
  15:35:41 STEP 2501 H=2501:00 +CPU= 10.897
  15:36:00 STEP 2502 H=2502:00 +CPU= 18.878
  15:36:12 STEP 2503 H=2503:00 +CPU= 11.517
  15:36:23 STEP 2504 H=2504:00 +CPU= 11.462
  15:36:42 STEP 2505 H=2505:00 +CPU= 18.477
  15:36:54 STEP 2506 H=2506:00 +CPU= 11.656
  15:37:05 STEP 2507 H=2507:00 +CPU= 11.046
  15:37:26 STEP 2508 H=2508:00 +CPU= 20.251
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002508
  15:37:38 STEP 2509 H=2509:00 +CPU= 11.443
  15:37:50 STEP 2510 H=2510:00 +CPU= 11.660
  15:38:09 STEP 2511 H=2511:00 +CPU= 18.219
  15:38:21 STEP 2512 H=2512:00 +CPU= 12.004
  15:38:32 STEP 2513 H=2513:00 +CPU= 11.396
  15:38:51 STEP 2514 H=2514:00 +CPU= 18.699
  15:39:03 STEP 2515 H=2515:00 +CPU= 11.650
  15:39:15 STEP 2516 H=2516:00 +CPU= 11.843
  15:39:33 STEP 2517 H=2517:00 +CPU= 18.100
  15:39:45 STEP 2518 H=2518:00 +CPU= 11.747
  15:39:57 STEP 2519 H=2519:00 +CPU= 11.691
  15:40:20 STEP 2520 H=2520:00 +CPU= 20.993
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_104.zip
Uploading the intermediate file: upload_file_104.zip
  15:40:31 STEP 2521 H=2521:00 +CPU= 11.234
  15:40:43 STEP 2522 H=2522:00 +CPU= 11.578
  15:41:01 STEP 2523 H=2523:00 +CPU= 17.900
  15:41:13 STEP 2524 H=2524:00 +CPU= 11.885
  15:41:25 STEP 2525 H=2525:00 +CPU= 11.523
  15:41:45 STEP 2526 H=2526:00 +CPU= 18.837
  15:41:58 STEP 2527 H=2527:00 +CPU= 11.695
  15:42:10 STEP 2528 H=2528:00 +CPU= 12.042
  15:42:29 STEP 2529 H=2529:00 +CPU= 18.169
  15:42:41 STEP 2530 H=2530:00 +CPU= 11.770
  15:42:52 STEP 2531 H=2531:00 +CPU= 11.187
  15:43:12 STEP 2532 H=2532:00 +CPU= 19.417
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002532
  15:43:23 STEP 2533 H=2533:00 +CPU= 11.149
  15:43:35 STEP 2534 H=2534:00 +CPU= 11.427
  15:43:53 STEP 2535 H=2535:00 +CPU= 17.545
  15:44:06 STEP 2536 H=2536:00 +CPU= 11.590
  15:44:17 STEP 2537 H=2537:00 +CPU= 11.137
  15:44:35 STEP 2538 H=2538:00 +CPU= 17.948
  15:44:46 STEP 2539 H=2539:00 +CPU= 10.874
  15:44:58 STEP 2540 H=2540:00 +CPU= 11.163
  15:45:17 STEP 2541 H=2541:00 +CPU= 17.763
  15:45:28 STEP 2542 H=2542:00 +CPU= 11.338
  15:45:46 STEP 2543 H=2543:00 +CPU= 11.820
  15:46:50 STEP 2544 H=2544:00 +CPU= 21.295
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_105.zip
Uploading the intermediate file: upload_file_105.zip
  15:47:02 STEP 2545 H=2545:00 +CPU= 11.118
  15:47:14 STEP 2546 H=2546:00 +CPU= 11.457
Uploading trickle at timestep: 9158400
  15:47:32 STEP 2547 H=2547:00 +CPU= 17.573
  15:47:43 STEP 2548 H=2548:00 +CPU= 11.319
  15:47:55 STEP 2549 H=2549:00 +CPU= 11.122
  15:48:13 STEP 2550 H=2550:00 +CPU= 18.187
  15:48:28 STEP 2551 H=2551:00 +CPU= 11.206
  15:48:40 STEP 2552 H=2552:00 +CPU= 11.694
  15:48:58 STEP 2553 H=2553:00 +CPU= 17.799
  15:49:10 STEP 2554 H=2554:00 +CPU= 11.266
  15:49:22 STEP 2555 H=2555:00 +CPU= 11.488
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1991050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0293
(argv4) batchid: 960
(argv5) wuid: 12176937
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_309258bb3aa512ccaed4feca00749857 to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0293_1991050100_123_960_12176937.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0293_1991050100_123_960_12176937.zip
ic_ancil_file: ic_ancil_12176937
ifsdata_file: ifsdata_12176937
climate_data_file: clim_data_12176937
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d0e574da3f05fc2fc7a7b5c517f21c6b to: /var/lib/boinc-client/slots/3/ic_ancil_12176937.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12176937.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_89e2f107ae2ee85c107998f56f0add7e to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12176937.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12176937.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12176937.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12176937.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12176937.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12176937.xml
-- Model is restarting --
Adjusting last_iter, 2556, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12176937.xml
last_cpu_time: 36119
upload_file_number: 106
last_iter: 2543
last_upload: 9158400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162
The child process has been launched with process id: 70813
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:3900x-2:1:1:70813:70813] [20230101:155322:1672613602:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:54:23 STEP 2544 H=2544:00 +CPU= 20.584
  15:54:34 STEP 2545 H=2545:00 +CPU= 11.016
  15:54:46 STEP 2546 H=2546:00 +CPU= 11.505
  15:55:04 STEP 2547 H=2547:00 +CPU= 17.705
  15:55:15 STEP 2548 H=2548:00 +CPU= 11.063
  15:55:26 STEP 2549 H=2549:00 +CPU= 10.782
  15:55:43 STEP 2550 H=2550:00 +CPU= 17.485
  15:55:54 STEP 2551 H=2551:00 +CPU= 10.873
  15:56:05 STEP 2552 H=2552:00 +CPU= 10.876
  15:56:23 STEP 2553 H=2553:00 +CPU= 17.520
  15:56:34 STEP 2554 H=2554:00 +CPU= 11.443
  15:56:46 STEP 2555 H=2555:00 +CPU= 10.984
  15:57:07 STEP 2556 H=2556:00 +CPU= 20.565
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002556
  15:57:18 STEP 2557 H=2557:00 +CPU= 11.064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002556
  15:57:29 STEP 2558 H=2558:00 +CPU= 11.124
  15:57:47 STEP 2559 H=2559:00 +CPU= 17.937
  15:57:58 STEP 2560 H=2560:00 +CPU= 11.291
  15:58:09 STEP 2561 H=2561:00 +CPU= 11.062
  15:58:28 STEP 2562 H=2562:00 +CPU= 18.294
  15:58:39 STEP 2563 H=2563:00 +CPU= 11.157
  15:58:50 STEP 2564 H=2564:00 +CPU= 11.512
  15:59:09 STEP 2565 H=2565:00 +CPU= 18.424
  15:59:21 STEP 2566 H=2566:00 +CPU= 11.569
  15:59:33 STEP 2567 H=2567:00 +CPU= 11.428
  15:59:57 STEP 2568 H=2568:00 +CPU= 21.051
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_106.zip
Uploading the intermediate file: upload_file_106.zip
  16:00:08 STEP 2569 H=2569:00 +CPU= 10.976
  16:00:19 STEP 2570 H=2570:00 +CPU= 11.350
  16:00:38 STEP 2571 H=2571:00 +CPU= 17.946
  16:00:50 STEP 2572 H=2572:00 +CPU= 11.609
  16:01:01 STEP 2573 H=2573:00 +CPU= 10.964
  16:01:23 STEP 2574 H=2574:00 +CPU= 18.543
  16:01:36 STEP 2575 H=2575:00 +CPU= 11.545
  16:01:47 STEP 2576 H=2576:00 +CPU= 11.375
  16:02:05 STEP 2577 H=2577:00 +CPU= 17.703
  16:02:16 STEP 2578 H=2578:00 +CPU= 11.497
  16:02:28 STEP 2579 H=2579:00 +CPU= 11.173
  16:02:48 STEP 2580 H=2580:00 +CPU= 19.802
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002580
  16:03:01 STEP 2581 H=2581:00 +CPU= 11.263
  16:03:12 STEP 2582 H=2582:00 +CPU= 11.049
  16:03:29 STEP 2583 H=2583:00 +CPU= 17.414
  16:03:41 STEP 2584 H=2584:00 +CPU= 11.305
  16:03:52 STEP 2585 H=2585:00 +CPU= 10.903
  16:04:09 STEP 2586 H=2586:00 +CPU= 17.439
  16:04:20 STEP 2587 H=2587:00 +CPU= 10.993
  16:04:33 STEP 2588 H=2588:00 +CPU= 11.364
  16:04:51 STEP 2589 H=2589:00 +CPU= 17.564
  16:05:02 STEP 2590 H=2590:00 +CPU= 11.376
  16:05:15 STEP 2591 H=2591:00 +CPU= 11.058
  16:05:51 STEP 2592 H=2592:00 +CPU= 20.748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_107.zip
  16:06:02 STEP 2593 H=2593:00 +CPU= 11.172
Uploading the intermediate file: upload_file_107.zip
  16:06:13 STEP 2594 H=2594:00 +CPU= 11.332
  16:06:31 STEP 2595 H=2595:00 +CPU= 17.356
  16:06:42 STEP 2596 H=2596:00 +CPU= 11.623
  16:06:55 STEP 2597 H=2597:00 +CPU= 11.462
  16:07:14 STEP 2598 H=2598:00 +CPU= 18.242
  16:07:25 STEP 2599 H=2599:00 +CPU= 11.245
  16:07:38 STEP 2600 H=2600:00 +CPU= 11.577
  16:07:55 STEP 2601 H=2601:00 +CPU= 17.762
  16:08:07 STEP 2602 H=2602:00 +CPU= 11.291
  16:08:18 STEP 2603 H=2603:00 +CPU= 10.960
  16:08:38 STEP 2604 H=2604:00 +CPU= 19.474
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002604
  16:08:50 STEP 2605 H=2605:00 +CPU= 10.927
  16:09:02 STEP 2606 H=2606:00 +CPU= 11.311
  16:09:20 STEP 2607 H=2607:00 +CPU= 17.586
  16:09:36 STEP 2608 H=2608:00 +CPU= 11.540
  16:09:47 STEP 2609 H=2609:00 +CPU= 11.252
  16:10:05 STEP 2610 H=2610:00 +CPU= 17.875
  16:10:16 STEP 2611 H=2611:00 +CPU= 10.968
  16:10:29 STEP 2612 H=2612:00 +CPU= 11.499
  16:10:47 STEP 2613 H=2613:00 +CPU= 17.983
  16:11:00 STEP 2614 H=2614:00 +CPU= 11.445
  16:11:14 STEP 2615 H=2615:00 +CPU= 11.489
  16:12:22 STEP 2616 H=2616:00 +CPU= 20.750
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_108.zip
Uploading the intermediate file: upload_file_108.zip
  16:12:33 STEP 2617 H=2617:00 +CPU= 10.979
  16:12:45 STEP 2618 H=2618:00 +CPU= 11.415
  16:13:03 STEP 2619 H=2619:00 +CPU= 17.586
  16:13:14 STEP 2620 H=2620:00 +CPU= 11.708
  16:13:26 STEP 2621 H=2621:00 +CPU= 11.491
  16:13:44 STEP 2622 H=2622:00 +CPU= 17.943
  16:13:55 STEP 2623 H=2623:00 +CPU= 11.259
  16:14:07 STEP 2624 H=2624:00 +CPU= 11.330
  16:14:25 STEP 2625 H=2625:00 +CPU= 17.436
  16:14:36 STEP 2626 H=2626:00 +CPU= 11.215
  16:14:47 STEP 2627 H=2627:00 +CPU= 10.773
  16:15:07 STEP 2628 H=2628:00 +CPU= 19.476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002628
  16:15:18 STEP 2629 H=2629:00 +CPU= 10.862
  16:15:30 STEP 2630 H=2630:00 +CPU= 11.559
  16:15:47 STEP 2631 H=2631:00 +CPU= 17.410
  16:15:58 STEP 2632 H=2632:00 +CPU= 11.143
  16:16:09 STEP 2633 H=2633:00 +CPU= 10.677
  16:16:27 STEP 2634 H=2634:00 +CPU= 17.728
  16:16:38 STEP 2635 H=2635:00 +CPU= 10.781
  16:16:49 STEP 2636 H=2636:00 +CPU= 11.108
  16:17:07 STEP 2637 H=2637:00 +CPU= 17.651
  16:17:19 STEP 2638 H=2638:00 +CPU= 11.822
  16:17:37 STEP 2639 H=2639:00 +CPU= 11.548
  16:18:00 STEP 2640 H=2640:00 +CPU= 20.682
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_109.zip
Uploading the intermediate file: upload_file_109.zip
  16:18:11 STEP 2641 H=2641:00 +CPU= 10.851
  16:18:22 STEP 2642 H=2642:00 +CPU= 11.253
  16:18:40 STEP 2643 H=2643:00 +CPU= 17.323
  16:18:51 STEP 2644 H=2644:00 +CPU= 11.332
  16:19:02 STEP 2645 H=2645:00 +CPU= 10.994
  16:19:20 STEP 2646 H=2646:00 +CPU= 18.140
  16:19:32 STEP 2647 H=2647:00 +CPU= 11.313
  16:19:43 STEP 2648 H=2648:00 +CPU= 11.741
  16:20:01 STEP 2649 H=2649:00 +CPU= 17.725
  16:20:13 STEP 2650 H=2650:00 +CPU= 11.642
  16:20:24 STEP 2651 H=2651:00 +CPU= 11.121
  16:20:44 STEP 2652 H=2652:00 +CPU= 19.662
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002652
  16:20:55 STEP 2653 H=2653:00 +CPU= 11.265
  16:21:07 STEP 2654 H=2654:00 +CPU= 11.519
  16:21:24 STEP 2655 H=2655:00 +CPU= 17.424
  16:21:36 STEP 2656 H=2656:00 +CPU= 11.289
  16:21:47 STEP 2657 H=2657:00 +CPU= 10.955
  16:22:04 STEP 2658 H=2658:00 +CPU= 17.693
  16:22:16 STEP 2659 H=2659:00 +CPU= 11.124
  16:22:28 STEP 2660 H=2660:00 +CPU= 11.551
  16:22:48 STEP 2661 H=2661:00 +CPU= 18.216
  16:23:00 STEP 2662 H=2662:00 +CPU= 11.470
  16:23:15 STEP 2663 H=2663:00 +CPU= 11.292
  16:24:13 STEP 2664 H=2664:00 +CPU= 20.924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_110.zip
  16:24:25 STEP 2665 H=2665:00 +CPU= 10.902
Uploading the intermediate file: upload_file_110.zip
  16:24:36 STEP 2666 H=2666:00 +CPU= 11.213
  16:24:55 STEP 2667 H=2667:00 +CPU= 18.122
  16:25:06 STEP 2668 H=2668:00 +CPU= 11.322
  16:25:17 STEP 2669 H=2669:00 +CPU= 11.162
  16:25:36 STEP 2670 H=2670:00 +CPU= 18.536
  16:25:47 STEP 2671 H=2671:00 +CPU= 11.074
  16:25:58 STEP 2672 H=2672:00 +CPU= 11.389
  16:26:16 STEP 2673 H=2673:00 +CPU= 17.827
  16:26:28 STEP 2674 H=2674:00 +CPU= 11.320
  16:26:39 STEP 2675 H=2675:00 +CPU= 11.217
  16:27:01 STEP 2676 H=2676:00 +CPU= 19.781
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002676
  16:27:14 STEP 2677 H=2677:00 +CPU= 11.794
  16:27:26 STEP 2678 H=2678:00 +CPU= 11.518
  16:27:44 STEP 2679 H=2679:00 +CPU= 17.750
  16:27:55 STEP 2680 H=2680:00 +CPU= 11.639
  16:28:06 STEP 2681 H=2681:00 +CPU= 10.875
  16:28:24 STEP 2682 H=2682:00 +CPU= 17.636
  16:28:35 STEP 2683 H=2683:00 +CPU= 11.010
  16:28:46 STEP 2684 H=2684:00 +CPU= 11.183
  16:29:04 STEP 2685 H=2685:00 +CPU= 16.993
  16:29:15 STEP 2686 H=2686:00 +CPU= 11.338
  16:29:35 STEP 2687 H=2687:00 +CPU= 11.088
  16:31:15 STEP 2688 H=2688:00 +CPU= 20.672
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_111.zip
  16:31:26 STEP 2689 H=2689:00 +CPU= 10.795
Uploading the intermediate file: upload_file_111.zip
  16:31:37 STEP 2690 H=2690:00 +CPU= 11.098
  16:31:54 STEP 2691 H=2691:00 +CPU= 17.330
  16:32:05 STEP 2692 H=2692:00 +CPU= 10.978
  16:32:16 STEP 2693 H=2693:00 +CPU= 10.971
  16:32:34 STEP 2694 H=2694:00 +CPU= 17.584
  16:32:45 STEP 2695 H=2695:00 +CPU= 10.996
  16:32:56 STEP 2696 H=2696:00 +CPU= 11.157
  16:33:14 STEP 2697 H=2697:00 +CPU= 17.851
  16:33:27 STEP 2698 H=2698:00 +CPU= 11.427
  16:33:38 STEP 2699 H=2699:00 +CPU= 10.962
  16:33:58 STEP 2700 H=2700:00 +CPU= 19.716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002700
  16:34:09 STEP 2701 H=2701:00 +CPU= 11.260
  16:34:21 STEP 2702 H=2702:00 +CPU= 11.366
  16:34:39 STEP 2703 H=2703:00 +CPU= 17.856
  16:34:51 STEP 2704 H=2704:00 +CPU= 11.119
  16:35:02 STEP 2705 H=2705:00 +CPU= 10.961
  16:35:22 STEP 2706 H=2706:00 +CPU= 18.386
  16:35:33 STEP 2707 H=2707:00 +CPU= 11.076
  16:35:45 STEP 2708 H=2708:00 +CPU= 11.562
  16:36:03 STEP 2709 H=2709:00 +CPU= 17.924
  16:36:14 STEP 2710 H=2710:00 +CPU= 11.342
  16:36:26 STEP 2711 H=2711:00 +CPU= 11.249
  16:36:48 STEP 2712 H=2712:00 +CPU= 20.853
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_112.zip
Uploading the intermediate file: upload_file_112.zip
  16:36:59 STEP 2713 H=2713:00 +CPU= 11.018
  16:37:11 STEP 2714 H=2714:00 +CPU= 11.117
  16:37:29 STEP 2715 H=2715:00 +CPU= 17.947
  16:37:41 STEP 2716 H=2716:00 +CPU= 11.273
  16:37:52 STEP 2717 H=2717:00 +CPU= 10.949
  16:38:11 STEP 2718 H=2718:00 +CPU= 18.557
  16:38:22 STEP 2719 H=2719:00 +CPU= 11.301
  16:38:33 STEP 2720 H=2720:00 +CPU= 11.381
  16:38:51 STEP 2721 H=2721:00 +CPU= 18.005
  16:39:02 STEP 2722 H=2722:00 +CPU= 11.144
  16:39:13 STEP 2723 H=2723:00 +CPU= 10.583
  16:39:32 STEP 2724 H=2724:00 +CPU= 19.318
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002724
  16:39:43 STEP 2725 H=2725:00 +CPU= 10.883
  16:39:54 STEP 2726 H=2726:00 +CPU= 10.886
  16:40:12 STEP 2727 H=2727:00 +CPU= 17.249
  16:40:23 STEP 2728 H=2728:00 +CPU= 11.193
  16:40:34 STEP 2729 H=2729:00 +CPU= 10.708
  16:40:51 STEP 2730 H=2730:00 +CPU= 17.643
  16:41:02 STEP 2731 H=2731:00 +CPU= 11.036
  16:41:13 STEP 2732 H=2732:00 +CPU= 11.009
  16:41:31 STEP 2733 H=2733:00 +CPU= 17.629
  16:41:43 STEP 2734 H=2734:00 +CPU= 11.427
  16:41:56 STEP 2735 H=2735:00 +CPU= 11.262
  16:42:20 STEP 2736 H=2736:00 +CPU= 21.258
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_113.zip
Uploading the intermediate file: upload_file_113.zip
  16:42:31 STEP 2737 H=2737:00 +CPU= 11.120
  16:42:42 STEP 2738 H=2738:00 +CPU= 11.263
  16:43:00 STEP 2739 H=2739:00 +CPU= 17.668
  16:43:11 STEP 2740 H=2740:00 +CPU= 11.243
  16:43:23 STEP 2741 H=2741:00 +CPU= 11.049
  16:43:40 STEP 2742 H=2742:00 +CPU= 17.738
  16:43:51 STEP 2743 H=2743:00 +CPU= 10.949
  16:44:03 STEP 2744 H=2744:00 +CPU= 11.540
  16:44:21 STEP 2745 H=2745:00 +CPU= 17.827
  16:44:32 STEP 2746 H=2746:00 +CPU= 11.495
  16:44:43 STEP 2747 H=2747:00 +CPU= 11.112
  16:45:03 STEP 2748 H=2748:00 +CPU= 19.927
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002748
  16:45:15 STEP 2749 H=2749:00 +CPU= 11.303
  16:45:26 STEP 2750 H=2750:00 +CPU= 11.579
  16:45:44 STEP 2751 H=2751:00 +CPU= 17.767
  16:45:56 STEP 2752 H=2752:00 +CPU= 11.500
  16:46:07 STEP 2753 H=2753:00 +CPU= 11.122
  16:46:25 STEP 2754 H=2754:00 +CPU= 18.205
  16:46:36 STEP 2755 H=2755:00 +CPU= 11.136
  16:46:48 STEP 2756 H=2756:00 +CPU= 11.335
  16:47:06 STEP 2757 H=2757:00 +CPU= 18.067
  16:47:17 STEP 2758 H=2758:00 +CPU= 11.221
  16:47:29 STEP 2759 H=2759:00 +CPU= 11.306
  16:48:13 STEP 2760 H=2760:00 +CPU= 21.272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_114.zip
Uploading the intermediate file: upload_file_114.zip
  16:48:24 STEP 2761 H=2761:00 +CPU= 11.084
  16:48:36 STEP 2762 H=2762:00 +CPU= 11.238
  16:48:54 STEP 2763 H=2763:00 +CPU= 17.826
  16:49:06 STEP 2764 H=2764:00 +CPU= 11.723
  16:49:17 STEP 2765 H=2765:00 +CPU= 11.162
  16:49:35 STEP 2766 H=2766:00 +CPU= 17.936
  16:49:47 STEP 2767 H=2767:00 +CPU= 11.145
  16:49:58 STEP 2768 H=2768:00 +CPU= 11.459
  16:50:16 STEP 2769 H=2769:00 +CPU= 17.822
  16:50:28 STEP 2770 H=2770:00 +CPU= 11.554
  16:50:39 STEP 2771 H=2771:00 +CPU= 11.051
  16:50:59 STEP 2772 H=2772:00 +CPU= 19.910
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002772
  16:51:10 STEP 2773 H=2773:00 +CPU= 11.274
  16:51:22 STEP 2774 H=2774:00 +CPU= 11.596
  16:51:42 STEP 2775 H=2775:00 +CPU= 18.164
  16:51:55 STEP 2776 H=2776:00 +CPU= 11.765
  16:52:06 STEP 2777 H=2777:00 +CPU= 11.210
  16:52:25 STEP 2778 H=2778:00 +CPU= 18.581
  16:52:37 STEP 2779 H=2779:00 +CPU= 11.377
  16:52:48 STEP 2780 H=2780:00 +CPU= 11.574
  16:53:06 STEP 2781 H=2781:00 +CPU= 17.753
  16:53:18 STEP 2782 H=2782:00 +CPU= 11.504
  16:53:30 STEP 2783 H=2783:00 +CPU= 11.457
  16:53:52 STEP 2784 H=2784:00 +CPU= 21.053
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_115.zip
Uploading the intermediate file: upload_file_115.zip
  16:54:04 STEP 2785 H=2785:00 +CPU= 11.159
  16:54:15 STEP 2786 H=2786:00 +CPU= 11.431
Uploading trickle at timestep: 10022400
  16:54:33 STEP 2787 H=2787:00 +CPU= 17.647
  16:54:44 STEP 2788 H=2788:00 +CPU= 11.475
  16:54:56 STEP 2789 H=2789:00 +CPU= 11.082
  16:55:14 STEP 2790 H=2790:00 +CPU= 18.134
  16:55:25 STEP 2791 H=2791:00 +CPU= 11.237
  16:55:37 STEP 2792 H=2792:00 +CPU= 11.617
  16:55:55 STEP 2793 H=2793:00 +CPU= 17.819
  16:56:06 STEP 2794 H=2794:00 +CPU= 11.570
  16:56:18 STEP 2795 H=2795:00 +CPU= 11.412
  16:56:38 STEP 2796 H=2796:00 +CPU= 20.015
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002796
  16:56:49 STEP 2797 H=2797:00 +CPU= 11.298
  16:57:01 STEP 2798 H=2798:00 +CPU= 11.629
  16:57:18 STEP 2799 H=2799:00 +CPU= 17.603
  16:57:30 STEP 2800 H=2800:00 +CPU= 11.598
  16:57:41 STEP 2801 H=2801:00 +CPU= 11.156
  16:58:00 STEP 2802 H=2802:00 +CPU= 18.038
  16:58:11 STEP 2803 H=2803:00 +CPU= 11.291
  16:58:23 STEP 2804 H=2804:00 +CPU= 11.469
  16:58:41 STEP 2805 H=2805:00 +CPU= 17.758
  16:58:52 STEP 2806 H=2806:00 +CPU= 11.609
  16:59:04 STEP 2807 H=2807:00 +CPU= 11.550
  16:59:26 STEP 2808 H=2808:00 +CPU= 21.428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_116.zip
Uploading the intermediate file: upload_file_116.zip
  16:59:37 STEP 2809 H=2809:00 +CPU= 11.234
  16:59:49 STEP 2810 H=2810:00 +CPU= 11.516
  17:00:07 STEP 2811 H=2811:00 +CPU= 17.789
  17:00:19 STEP 2812 H=2812:00 +CPU= 11.519
  17:00:30 STEP 2813 H=2813:00 +CPU= 11.091
  17:00:48 STEP 2814 H=2814:00 +CPU= 18.028
  17:01:00 STEP 2815 H=2815:00 +CPU= 11.218
  17:01:11 STEP 2816 H=2816:00 +CPU= 11.433
  17:01:29 STEP 2817 H=2817:00 +CPU= 18.032
  09:49:31 STEP 2818 H=2818:00 +CPU= 11.489
  09:49:42 STEP 2819 H=2819:00 +CPU= 10.870
  09:50:01 STEP 2820 H=2820:00 +CPU= 19.186
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002820
  09:50:12 STEP 2821 H=2821:00 +CPU= 11.022
  09:50:23 STEP 2822 H=2822:00 +CPU= 11.358
  09:50:41 STEP 2823 H=2823:00 +CPU= 17.426
  09:50:52 STEP 2824 H=2824:00 +CPU= 11.324
  09:51:03 STEP 2825 H=2825:00 +CPU= 10.810
  09:51:20 STEP 2826 H=2826:00 +CPU= 17.503
  09:51:31 STEP 2827 H=2827:00 +CPU= 11.020
  09:51:43 STEP 2828 H=2828:00 +CPU= 11.175
  09:52:00 STEP 2829 H=2829:00 +CPU= 17.330
  09:52:11 STEP 2830 H=2830:00 +CPU= 11.038
  09:52:22 STEP 2831 H=2831:00 +CPU= 10.997
  09:52:45 STEP 2832 H=2832:00 +CPU= 20.634
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_117.zip
Uploading the intermediate file: upload_file_117.zip
  09:52:56 STEP 2833 H=2833:00 +CPU= 10.993
  09:53:07 STEP 2834 H=2834:00 +CPU= 11.570
  09:53:25 STEP 2835 H=2835:00 +CPU= 17.310
  09:53:36 STEP 2836 H=2836:00 +CPU= 11.374
  09:53:47 STEP 2837 H=2837:00 +CPU= 11.226
  09:54:05 STEP 2838 H=2838:00 +CPU= 17.637
  09:54:16 STEP 2839 H=2839:00 +CPU= 11.063
  09:54:28 STEP 2840 H=2840:00 +CPU= 11.351
  09:54:45 STEP 2841 H=2841:00 +CPU= 17.607
  09:54:57 STEP 2842 H=2842:00 +CPU= 11.426
  09:55:08 STEP 2843 H=2843:00 +CPU= 11.011
  09:55:27 STEP 2844 H=2844:00 +CPU= 19.311
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002844
  09:55:38 STEP 2845 H=2845:00 +CPU= 11.206
  09:55:50 STEP 2846 H=2846:00 +CPU= 11.557
  09:56:07 STEP 2847 H=2847:00 +CPU= 17.404
  09:56:19 STEP 2848 H=2848:00 +CPU= 11.407
  09:56:30 STEP 2849 H=2849:00 +CPU= 10.954
  09:56:47 STEP 2850 H=2850:00 +CPU= 17.842
  09:56:58 STEP 2851 H=2851:00 +CPU= 10.890
  09:57:10 STEP 2852 H=2852:00 +CPU= 11.328
  09:57:27 STEP 2853 H=2853:00 +CPU= 17.540
  09:57:39 STEP 2854 H=2854:00 +CPU= 11.467
  09:57:50 STEP 2855 H=2855:00 +CPU= 11.201
  09:58:11 STEP 2856 H=2856:00 +CPU= 20.701
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_118.zip
Uploading the intermediate file: upload_file_118.zip
  09:58:23 STEP 2857 H=2857:00 +CPU= 11.100
  09:58:34 STEP 2858 H=2858:00 +CPU= 11.176
  09:58:51 STEP 2859 H=2859:00 +CPU= 17.407
  09:59:03 STEP 2860 H=2860:00 +CPU= 11.531
  09:59:14 STEP 2861 H=2861:00 +CPU= 11.044
  09:59:32 STEP 2862 H=2862:00 +CPU= 17.815
  09:59:43 STEP 2863 H=2863:00 +CPU= 11.125
  09:59:54 STEP 2864 H=2864:00 +CPU= 11.296
  10:00:12 STEP 2865 H=2865:00 +CPU= 17.278
  10:00:23 STEP 2866 H=2866:00 +CPU= 11.340
  10:00:34 STEP 2867 H=2867:00 +CPU= 11.094
  10:00:54 STEP 2868 H=2868:00 +CPU= 19.543
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002868
  10:01:05 STEP 2869 H=2869:00 +CPU= 11.116
  10:01:16 STEP 2870 H=2870:00 +CPU= 11.283
  10:01:34 STEP 2871 H=2871:00 +CPU= 17.433
  10:01:45 STEP 2872 H=2872:00 +CPU= 11.413
  10:01:56 STEP 2873 H=2873:00 +CPU= 10.818
  10:02:14 STEP 2874 H=2874:00 +CPU= 17.769
  10:02:25 STEP 2875 H=2875:00 +CPU= 11.001
  10:02:37 STEP 2876 H=2876:00 +CPU= 11.325
  10:02:54 STEP 2877 H=2877:00 +CPU= 17.613
  10:03:06 STEP 2878 H=2878:00 +CPU= 11.548
  10:03:17 STEP 2879 H=2879:00 +CPU= 11.265
  10:03:39 STEP 2880 H=2880:00 +CPU= 20.864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_119.zip
Uploading the intermediate file: upload_file_119.zip
  10:03:50 STEP 2881 H=2881:00 +CPU= 11.037
  10:04:01 STEP 2882 H=2882:00 +CPU= 11.403
  10:04:19 STEP 2883 H=2883:00 +CPU= 17.505
  10:04:30 STEP 2884 H=2884:00 +CPU= 11.538
  10:04:41 STEP 2885 H=2885:00 +CPU= 11.008
  10:04:59 STEP 2886 H=2886:00 +CPU= 17.696
  10:05:10 STEP 2887 H=2887:00 +CPU= 10.921
  10:05:22 STEP 2888 H=2888:00 +CPU= 11.233
  10:05:39 STEP 2889 H=2889:00 +CPU= 17.438
  10:05:51 STEP 2890 H=2890:00 +CPU= 11.517
  10:06:02 STEP 2891 H=2891:00 +CPU= 11.131
  10:06:21 STEP 2892 H=2892:00 +CPU= 19.609
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002892
  10:06:32 STEP 2893 H=2893:00 +CPU= 10.961
  10:06:44 STEP 2894 H=2894:00 +CPU= 11.379
  10:07:01 STEP 2895 H=2895:00 +CPU= 17.370
  10:07:13 STEP 2896 H=2896:00 +CPU= 11.397
  10:07:23 STEP 2897 H=2897:00 +CPU= 10.959
  10:07:41 STEP 2898 H=2898:00 +CPU= 17.826
  10:07:52 STEP 2899 H=2899:00 +CPU= 11.127
  10:08:05 STEP 2900 H=2900:00 +CPU= 11.426
  10:08:24 STEP 2901 H=2901:00 +CPU= 17.763
  10:08:36 STEP 2902 H=2902:00 +CPU= 11.809
  10:08:47 STEP 2903 H=2903:00 +CPU= 11.505
  10:09:08 STEP 2904 H=2904:00 +CPU= 20.661
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_120.zip
Uploading the intermediate file: upload_file_120.zip
  10:09:19 STEP 2905 H=2905:00 +CPU= 10.880
  10:09:31 STEP 2906 H=2906:00 +CPU= 11.255
  10:09:48 STEP 2907 H=2907:00 +CPU= 17.588
  10:10:00 STEP 2908 H=2908:00 +CPU= 11.266
  10:10:11 STEP 2909 H=2909:00 +CPU= 10.987
  10:10:28 STEP 2910 H=2910:00 +CPU= 17.808
  10:10:40 STEP 2911 H=2911:00 +CPU= 11.140
  10:10:51 STEP 2912 H=2912:00 +CPU= 11.349
  10:11:08 STEP 2913 H=2913:00 +CPU= 17.394
  10:11:20 STEP 2914 H=2914:00 +CPU= 11.513
  10:11:32 STEP 2915 H=2915:00 +CPU= 11.170
  10:11:51 STEP 2916 H=2916:00 +CPU= 19.531
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002916
  10:12:03 STEP 2917 H=2917:00 +CPU= 11.208
  10:12:14 STEP 2918 H=2918:00 +CPU= 11.288
  10:12:33 STEP 2919 H=2919:00 +CPU= 17.549
  10:12:44 STEP 2920 H=2920:00 +CPU= 11.311
  10:12:55 STEP 2921 H=2921:00 +CPU= 10.973
  10:13:13 STEP 2922 H=2922:00 +CPU= 17.726
  10:13:23 STEP 2923 H=2923:00 +CPU= 10.836
  10:13:35 STEP 2924 H=2924:00 +CPU= 11.303
  10:13:53 STEP 2925 H=2925:00 +CPU= 17.823
  10:14:04 STEP 2926 H=2926:00 +CPU= 11.329
  10:14:15 STEP 2927 H=2927:00 +CPU= 11.363
  10:14:36 STEP 2928 H=2928:00 +CPU= 20.610
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_121.zip
Uploading the intermediate file: upload_file_121.zip
  10:14:47 STEP 2929 H=2929:00 +CPU= 10.870
  10:14:58 STEP 2930 H=2930:00 +CPU= 11.074
  10:15:16 STEP 2931 H=2931:00 +CPU= 17.370
  10:15:27 STEP 2932 H=2932:00 +CPU= 11.247
  10:15:38 STEP 2933 H=2933:00 +CPU= 10.908
  10:15:56 STEP 2934 H=2934:00 +CPU= 17.909
  10:16:07 STEP 2935 H=2935:00 +CPU= 10.927
  10:16:18 STEP 2936 H=2936:00 +CPU= 11.436
  10:16:36 STEP 2937 H=2937:00 +CPU= 17.486
  10:16:47 STEP 2938 H=2938:00 +CPU= 11.291
  10:16:58 STEP 2939 H=2939:00 +CPU= 11.008
  10:17:18 STEP 2940 H=2940:00 +CPU= 19.523
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002940
  10:17:29 STEP 2941 H=2941:00 +CPU= 10.897
  10:17:40 STEP 2942 H=2942:00 +CPU= 11.250
  10:17:58 STEP 2943 H=2943:00 +CPU= 17.607
  10:18:10 STEP 2944 H=2944:00 +CPU= 11.514
  10:18:21 STEP 2945 H=2945:00 +CPU= 10.958
  10:18:39 STEP 2946 H=2946:00 +CPU= 17.748
  10:18:50 STEP 2947 H=2947:00 +CPU= 11.113
  10:19:01 STEP 2948 H=2948:00 +CPU= 11.297
  10:19:19 STEP 2949 H=2949:00 +CPU= 17.770
  10:19:31 STEP 2950 H=2950:00 +CPU= 11.349
  10:19:42 STEP 2951 H=2951:00 +CPU= 11.441
  10:20:03 STEP 2952 H=2952:00 +CPU= 20.086
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176937/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_1991050100_123_960_12176937_1_r2103348162_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:23:28 (70810): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:06:12 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 10,623,600 41,697 0.0039
09 May 2023 16:06:10 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 10,022,400 39,415 0.0039
09 May 2023 16:05:28 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 9,158,400 35,973 0.0039
09 May 2023 16:05:28 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 9,158,400 35,973 0.0039
09 May 2023 16:05:25 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 8,294,400 32,659 0.0039
09 May 2023 16:05:23 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 6,912,000 27,073 0.0039
09 May 2023 16:05:21 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 6,048,000 23,702 0.0039
09 May 2023 16:05:19 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 5,184,000 20,343 0.0039
09 May 2023 16:05:16 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 4,320,000 17,004 0.0039
09 May 2023 16:05:13 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 3,456,000 13,636 0.0039
09 May 2023 16:00:43 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 2,592,000 10,224 0.0039
09 May 2023 16:00:40 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 1,728,000 6,802 0.0039
09 May 2023 16:00:36 1532160 22293950 oifs_43r3_ps_0293_1991050100_123_960_12176937_1 864,000 3,402 0.0039


©2024 climateprediction.net