climateprediction.net home page
Task 22300398

Task 22300398

Name oifs_43r3_ps_0593_2004050100_123_973_12190237_1
Workunit 12190237
Created 20 Jan 2023, 11:05:31 UTC
Sent 20 Jan 2023, 11:11:41 UTC
Report deadline 21 Mar 2023, 11:11:41 UTC
Received 21 Jan 2023, 16:00:00 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536819
Run time 18 hours 41 min 31 sec
CPU time 18 hours 27 min 25 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.14 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,806.28 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,821.51 MB
Stderr
<core_client_version>7.20.4</core_client_version>
<![CDATA[
<stderr_txt>
EP 2392 H=2392:00 +CPU= 19.155
  22:31:27 STEP 2393 H=2393:00 +CPU= 18.257
  22:31:57 STEP 2394 H=2394:00 +CPU= 29.662
  22:32:16 STEP 2395 H=2395:00 +CPU= 18.593
  22:32:35 STEP 2396 H=2396:00 +CPU= 18.836
  22:33:04 STEP 2397 H=2397:00 +CPU= 29.015
  22:33:23 STEP 2398 H=2398:00 +CPU= 19.145
  22:33:42 STEP 2399 H=2399:00 +CPU= 18.949
  22:34:17 STEP 2400 H=2400:00 +CPU= 33.837
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_99.zip
Uploading the intermediate file: upload_file_99.zip
  22:34:36 STEP 2401 H=2401:00 +CPU= 18.520
double free or corruption (!prev)
  22:34:55 STEP 2402 H=2402:00 +CPU= 18.774
  22:35:24 STEP 2403 H=2403:00 +CPU= 29.136
  22:35:43 STEP 2404 H=2404:00 +CPU= 19.184
  22:36:02 STEP 2405 H=2405:00 +CPU= 18.246
  22:36:32 STEP 2406 H=2406:00 +CPU= 29.763
  22:36:51 STEP 2407 H=2407:00 +CPU= 18.665
  22:37:10 STEP 2408 H=2408:00 +CPU= 18.898
  22:37:39 STEP 2409 H=2409:00 +CPU= 28.998
  22:37:59 STEP 2410 H=2410:00 +CPU= 19.358
  22:38:17 STEP 2411 H=2411:00 +CPU= 18.292
  22:38:49 STEP 2412 H=2412:00 +CPU= 32.093
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002412
  22:39:08 STEP 2413 H=2413:00 +CPU= 18.717
  22:39:27 STEP 2414 H=2414:00 +CPU= 18.861
  22:39:56 STEP 2415 H=2415:00 +CPU= 29.113
  22:40:16 STEP 2416 H=2416:00 +CPU= 19.211
  22:40:34 STEP 2417 H=2417:00 +CPU= 18.298
  22:41:04 STEP 2418 H=2418:00 +CPU= 29.694
  22:41:23 STEP 2419 H=2419:00 +CPU= 18.634
  22:41:42 STEP 2420 H=2420:00 +CPU= 18.861
  22:42:11 STEP 2421 H=2421:00 +CPU= 29.067
  22:42:31 STEP 2422 H=2422:00 +CPU= 19.066
  22:42:50 STEP 2423 H=2423:00 +CPU= 19.163
  22:43:24 STEP 2424 H=2424:00 +CPU= 33.938
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_100.zip
Uploading the intermediate file: upload_file_100.zip
  22:43:44 STEP 2425 H=2425:00 +CPU= 18.558
  22:44:02 STEP 2426 H=2426:00 +CPU= 18.770
  22:44:32 STEP 2427 H=2427:00 +CPU= 29.184
  22:44:51 STEP 2428 H=2428:00 +CPU= 19.202
  22:45:09 STEP 2429 H=2429:00 +CPU= 18.272
  22:45:39 STEP 2430 H=2430:00 +CPU= 29.735
  22:45:58 STEP 2431 H=2431:00 +CPU= 18.716
  22:46:17 STEP 2432 H=2432:00 +CPU= 18.920
  22:46:46 STEP 2433 H=2433:00 +CPU= 29.110
  22:47:06 STEP 2434 H=2434:00 +CPU= 19.205
  22:47:24 STEP 2435 H=2435:00 +CPU= 18.358
  22:47:57 STEP 2436 H=2436:00 +CPU= 32.079
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002436
  22:48:16 STEP 2437 H=2437:00 +CPU= 18.726
  22:48:34 STEP 2438 H=2438:00 +CPU= 18.816
  22:49:04 STEP 2439 H=2439:00 +CPU= 29.130
  22:49:23 STEP 2440 H=2440:00 +CPU= 19.242
  22:49:41 STEP 2441 H=2441:00 +CPU= 18.269
  22:50:11 STEP 2442 H=2442:00 +CPU= 29.701
  22:50:30 STEP 2443 H=2443:00 +CPU= 18.736
  22:50:49 STEP 2444 H=2444:00 +CPU= 18.915
  22:51:18 STEP 2445 H=2445:00 +CPU= 29.092
  22:51:38 STEP 2446 H=2446:00 +CPU= 19.156
  22:51:57 STEP 2447 H=2447:00 +CPU= 19.213
  22:52:31 STEP 2448 H=2448:00 +CPU= 33.913
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_101.zip
Uploading the intermediate file: upload_file_101.zip
  22:52:51 STEP 2449 H=2449:00 +CPU= 18.588
  22:53:10 STEP 2450 H=2450:00 +CPU= 18.838
  22:53:39 STEP 2451 H=2451:00 +CPU= 29.214
  22:53:58 STEP 2452 H=2452:00 +CPU= 19.267
  22:54:17 STEP 2453 H=2453:00 +CPU= 18.267
  22:54:47 STEP 2454 H=2454:00 +CPU= 29.771
  22:55:06 STEP 2455 H=2455:00 +CPU= 18.709
  22:55:25 STEP 2456 H=2456:00 +CPU= 18.953
  22:55:54 STEP 2457 H=2457:00 +CPU= 29.095
  22:56:13 STEP 2458 H=2458:00 +CPU= 19.287
  22:56:32 STEP 2459 H=2459:00 +CPU= 18.344
  22:57:04 STEP 2460 H=2460:00 +CPU= 32.118
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002460
  22:57:23 STEP 2461 H=2461:00 +CPU= 18.731
  22:57:42 STEP 2462 H=2462:00 +CPU= 18.825
  22:58:11 STEP 2463 H=2463:00 +CPU= 29.116
  22:58:31 STEP 2464 H=2464:00 +CPU= 19.271
  22:58:49 STEP 2465 H=2465:00 +CPU= 18.291
  22:59:19 STEP 2466 H=2466:00 +CPU= 29.656
  22:59:38 STEP 2467 H=2467:00 +CPU= 18.731
  22:59:57 STEP 2468 H=2468:00 +CPU= 18.891
  23:00:26 STEP 2469 H=2469:00 +CPU= 29.053
  23:00:45 STEP 2470 H=2470:00 +CPU= 19.104
  23:01:04 STEP 2471 H=2471:00 +CPU= 19.165
  23:01:39 STEP 2472 H=2472:00 +CPU= 33.845
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_102.zip
Uploading the intermediate file: upload_file_102.zip
  23:01:58 STEP 2473 H=2473:00 +CPU= 18.603
  23:02:17 STEP 2474 H=2474:00 +CPU= 18.787
  23:02:46 STEP 2475 H=2475:00 +CPU= 29.179
  23:03:06 STEP 2476 H=2476:00 +CPU= 19.242
  23:03:24 STEP 2477 H=2477:00 +CPU= 18.313
  23:03:54 STEP 2478 H=2478:00 +CPU= 29.731
  23:04:13 STEP 2479 H=2479:00 +CPU= 18.745
  23:04:32 STEP 2480 H=2480:00 +CPU= 18.900
  23:05:01 STEP 2481 H=2481:00 +CPU= 29.006
  23:05:21 STEP 2482 H=2482:00 +CPU= 19.253
  23:05:39 STEP 2483 H=2483:00 +CPU= 18.277
  23:06:11 STEP 2484 H=2484:00 +CPU= 32.174
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002484
  23:06:30 STEP 2485 H=2485:00 +CPU= 18.690
  23:06:49 STEP 2486 H=2486:00 +CPU= 18.799
  23:07:18 STEP 2487 H=2487:00 +CPU= 29.146
  23:07:38 STEP 2488 H=2488:00 +CPU= 19.147
  23:07:56 STEP 2489 H=2489:00 +CPU= 18.276
  23:08:26 STEP 2490 H=2490:00 +CPU= 29.700
  23:08:45 STEP 2491 H=2491:00 +CPU= 18.585
  23:09:04 STEP 2492 H=2492:00 +CPU= 18.842
  23:09:33 STEP 2493 H=2493:00 +CPU= 29.072
  23:09:52 STEP 2494 H=2494:00 +CPU= 19.085
  23:10:11 STEP 2495 H=2495:00 +CPU= 19.077
  23:10:46 STEP 2496 H=2496:00 +CPU= 34.052
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_103.zip
Uploading the intermediate file: upload_file_103.zip
  23:11:05 STEP 2497 H=2497:00 +CPU= 18.526
  23:11:24 STEP 2498 H=2498:00 +CPU= 18.748
  23:11:53 STEP 2499 H=2499:00 +CPU= 29.163
  23:12:13 STEP 2500 H=2500:00 +CPU= 19.129
  23:12:31 STEP 2501 H=2501:00 +CPU= 18.252
  23:13:01 STEP 2502 H=2502:00 +CPU= 29.773
  23:13:20 STEP 2503 H=2503:00 +CPU= 18.644
  23:13:39 STEP 2504 H=2504:00 +CPU= 18.896
  23:14:08 STEP 2505 H=2505:00 +CPU= 29.128
  23:14:28 STEP 2506 H=2506:00 +CPU= 19.188
  23:14:46 STEP 2507 H=2507:00 +CPU= 18.339
  23:15:18 STEP 2508 H=2508:00 +CPU= 32.163
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002508
  23:15:37 STEP 2509 H=2509:00 +CPU= 18.650
  23:15:56 STEP 2510 H=2510:00 +CPU= 18.836
  23:16:25 STEP 2511 H=2511:00 +CPU= 29.122
  23:16:45 STEP 2512 H=2512:00 +CPU= 19.101
  23:17:03 STEP 2513 H=2513:00 +CPU= 18.253
  23:17:33 STEP 2514 H=2514:00 +CPU= 29.705
  23:17:52 STEP 2515 H=2515:00 +CPU= 18.586
  23:18:11 STEP 2516 H=2516:00 +CPU= 18.836
  23:18:40 STEP 2517 H=2517:00 +CPU= 29.103
  23:18:59 STEP 2518 H=2518:00 +CPU= 19.183
  23:19:18 STEP 2519 H=2519:00 +CPU= 19.020
  23:19:53 STEP 2520 H=2520:00 +CPU= 33.970
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_104.zip
Uploading the intermediate file: upload_file_104.zip
  23:20:12 STEP 2521 H=2521:00 +CPU= 18.540
Uploading trickle at timestep: 9072000
  23:20:31 STEP 2522 H=2522:00 +CPU= 18.748
  23:21:00 STEP 2523 H=2523:00 +CPU= 29.143
  23:21:19 STEP 2524 H=2524:00 +CPU= 19.150
  23:21:38 STEP 2525 H=2525:00 +CPU= 18.308
  23:22:08 STEP 2526 H=2526:00 +CPU= 29.780
  23:22:26 STEP 2527 H=2527:00 +CPU= 18.636
  23:22:45 STEP 2528 H=2528:00 +CPU= 18.929
  23:23:15 STEP 2529 H=2529:00 +CPU= 29.093
  23:23:34 STEP 2530 H=2530:00 +CPU= 19.350
  23:23:53 STEP 2531 H=2531:00 +CPU= 18.353
  23:24:25 STEP 2532 H=2532:00 +CPU= 32.163
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002532
  23:24:44 STEP 2533 H=2533:00 +CPU= 18.597
  23:25:03 STEP 2534 H=2534:00 +CPU= 18.868
  23:25:32 STEP 2535 H=2535:00 +CPU= 29.064
  23:25:51 STEP 2536 H=2536:00 +CPU= 19.114
  23:26:10 STEP 2537 H=2537:00 +CPU= 18.305
  23:26:40 STEP 2538 H=2538:00 +CPU= 29.701
  23:26:58 STEP 2539 H=2539:00 +CPU= 18.582
  23:27:17 STEP 2540 H=2540:00 +CPU= 18.882
  23:27:47 STEP 2541 H=2541:00 +CPU= 29.066
  23:28:06 STEP 2542 H=2542:00 +CPU= 19.210
  23:28:25 STEP 2543 H=2543:00 +CPU= 18.930
  23:29:00 STEP 2544 H=2544:00 +CPU= 34.009
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_105.zip
Uploading the intermediate file: upload_file_105.zip
  23:29:19 STEP 2545 H=2545:00 +CPU= 18.485
  23:29:38 STEP 2546 H=2546:00 +CPU= 18.803
  23:30:07 STEP 2547 H=2547:00 +CPU= 29.180
  23:30:26 STEP 2548 H=2548:00 +CPU= 19.162
  23:30:45 STEP 2549 H=2549:00 +CPU= 18.308
  23:31:15 STEP 2550 H=2550:00 +CPU= 29.863
  23:31:33 STEP 2551 H=2551:00 +CPU= 18.659
  23:31:53 STEP 2552 H=2552:00 +CPU= 18.991
  23:32:22 STEP 2553 H=2553:00 +CPU= 29.059
  23:32:42 STEP 2554 H=2554:00 +CPU= 19.315
  23:33:00 STEP 2555 H=2555:00 +CPU= 18.379
  23:33:32 STEP 2556 H=2556:00 +CPU= 32.194
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002556
  23:33:51 STEP 2557 H=2557:00 +CPU= 18.612
  23:34:10 STEP 2558 H=2558:00 +CPU= 18.933
  23:34:39 STEP 2559 H=2559:00 +CPU= 29.114
  23:34:59 STEP 2560 H=2560:00 +CPU= 19.136
  23:35:17 STEP 2561 H=2561:00 +CPU= 18.407
  23:35:47 STEP 2562 H=2562:00 +CPU= 29.888
  23:36:06 STEP 2563 H=2563:00 +CPU= 18.752
  23:36:25 STEP 2564 H=2564:00 +CPU= 19.045
  23:36:54 STEP 2565 H=2565:00 +CPU= 29.110
  23:37:14 STEP 2566 H=2566:00 +CPU= 19.095
  23:37:34 STEP 2567 H=2567:00 +CPU= 18.954
  23:38:08 STEP 2568 H=2568:00 +CPU= 34.029
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_106.zip
Uploading the intermediate file: upload_file_106.zip
  23:38:27 STEP 2569 H=2569:00 +CPU= 18.487
  23:38:46 STEP 2570 H=2570:00 +CPU= 19.024
  23:39:16 STEP 2571 H=2571:00 +CPU= 29.265
  23:39:35 STEP 2572 H=2572:00 +CPU= 19.215
  23:39:54 STEP 2573 H=2573:00 +CPU= 18.490
  23:40:24 STEP 2574 H=2574:00 +CPU= 29.747
  23:40:42 STEP 2575 H=2575:00 +CPU= 18.648
  23:41:02 STEP 2576 H=2576:00 +CPU= 18.993
  23:41:31 STEP 2577 H=2577:00 +CPU= 29.145
  23:41:51 STEP 2578 H=2578:00 +CPU= 19.303
  23:42:09 STEP 2579 H=2579:00 +CPU= 18.364
  23:42:42 STEP 2580 H=2580:00 +CPU= 32.182
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002580
  23:43:00 STEP 2581 H=2581:00 +CPU= 18.627
  23:43:19 STEP 2582 H=2582:00 +CPU= 18.932
  23:43:49 STEP 2583 H=2583:00 +CPU= 29.118
  23:44:08 STEP 2584 H=2584:00 +CPU= 19.151
  23:44:27 STEP 2585 H=2585:00 +CPU= 18.432
  23:44:56 STEP 2586 H=2586:00 +CPU= 29.591
  23:45:15 STEP 2587 H=2587:00 +CPU= 18.542
  23:45:34 STEP 2588 H=2588:00 +CPU= 19.007
  23:46:03 STEP 2589 H=2589:00 +CPU= 29.056
  23:46:23 STEP 2590 H=2590:00 +CPU= 19.280
  23:46:42 STEP 2591 H=2591:00 +CPU= 18.859
  23:47:16 STEP 2592 H=2592:00 +CPU= 33.932
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_107.zip
Uploading the intermediate file: upload_file_107.zip
  23:47:35 STEP 2593 H=2593:00 +CPU= 18.399
  23:47:54 STEP 2594 H=2594:00 +CPU= 18.828
  23:48:24 STEP 2595 H=2595:00 +CPU= 29.105
  23:48:43 STEP 2596 H=2596:00 +CPU= 19.005
  23:49:01 STEP 2597 H=2597:00 +CPU= 18.271
  23:49:31 STEP 2598 H=2598:00 +CPU= 29.682
  23:49:50 STEP 2599 H=2599:00 +CPU= 18.535
  23:50:09 STEP 2600 H=2600:00 +CPU= 18.996
  23:50:38 STEP 2601 H=2601:00 +CPU= 28.996
  23:50:57 STEP 2602 H=2602:00 +CPU= 19.147
  23:51:16 STEP 2603 H=2603:00 +CPU= 18.299
  23:51:48 STEP 2604 H=2604:00 +CPU= 32.213
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002604
  23:52:07 STEP 2605 H=2605:00 +CPU= 18.523
  23:52:26 STEP 2606 H=2606:00 +CPU= 18.926
  23:52:55 STEP 2607 H=2607:00 +CPU= 29.032
  23:53:14 STEP 2608 H=2608:00 +CPU= 19.064
  23:53:33 STEP 2609 H=2609:00 +CPU= 18.306
  23:54:02 STEP 2610 H=2610:00 +CPU= 29.700
  23:54:21 STEP 2611 H=2611:00 +CPU= 18.635
  23:54:40 STEP 2612 H=2612:00 +CPU= 18.977
  23:55:09 STEP 2613 H=2613:00 +CPU= 28.922
  23:55:29 STEP 2614 H=2614:00 +CPU= 19.275
  23:55:48 STEP 2615 H=2615:00 +CPU= 18.798
  23:56:23 STEP 2616 H=2616:00 +CPU= 33.957
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_108.zip
Uploading the intermediate file: upload_file_108.zip
  23:56:41 STEP 2617 H=2617:00 +CPU= 18.413
  23:57:00 STEP 2618 H=2618:00 +CPU= 18.849
  23:57:30 STEP 2619 H=2619:00 +CPU= 29.040
  23:57:49 STEP 2620 H=2620:00 +CPU= 19.055
  23:58:07 STEP 2621 H=2621:00 +CPU= 18.329
  23:58:37 STEP 2622 H=2622:00 +CPU= 29.601
  23:58:56 STEP 2623 H=2623:00 +CPU= 18.556
  23:59:15 STEP 2624 H=2624:00 +CPU= 19.008
  23:59:44 STEP 2625 H=2625:00 +CPU= 28.917
  00:00:03 STEP 2626 H=2626:00 +CPU= 19.128
  00:00:22 STEP 2627 H=2627:00 +CPU= 18.250
  00:00:54 STEP 2628 H=2628:00 +CPU= 32.112
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002628
  00:01:13 STEP 2629 H=2629:00 +CPU= 18.582
  00:01:32 STEP 2630 H=2630:00 +CPU= 18.896
  00:02:01 STEP 2631 H=2631:00 +CPU= 28.989
  00:02:20 STEP 2632 H=2632:00 +CPU= 19.046
  00:02:39 STEP 2633 H=2633:00 +CPU= 18.326
  00:03:08 STEP 2634 H=2634:00 +CPU= 29.517
  00:03:27 STEP 2635 H=2635:00 +CPU= 18.530
  00:03:46 STEP 2636 H=2636:00 +CPU= 18.930
  00:04:15 STEP 2637 H=2637:00 +CPU= 28.873
  00:04:34 STEP 2638 H=2638:00 +CPU= 19.182
  00:04:53 STEP 2639 H=2639:00 +CPU= 18.844
  00:05:28 STEP 2640 H=2640:00 +CPU= 33.944
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_109.zip
Uploading the intermediate file: upload_file_109.zip
  00:05:47 STEP 2641 H=2641:00 +CPU= 18.393
  00:06:06 STEP 2642 H=2642:00 +CPU= 18.747
  00:06:35 STEP 2643 H=2643:00 +CPU= 28.912
  00:06:54 STEP 2644 H=2644:00 +CPU= 19.026
  00:07:12 STEP 2645 H=2645:00 +CPU= 18.241
  00:07:42 STEP 2646 H=2646:00 +CPU= 29.604
  00:08:01 STEP 2647 H=2647:00 +CPU= 18.500
  00:08:20 STEP 2648 H=2648:00 +CPU= 18.980
  00:08:49 STEP 2649 H=2649:00 +CPU= 28.974
  00:09:09 STEP 2650 H=2650:00 +CPU= 19.183
  00:09:27 STEP 2651 H=2651:00 +CPU= 18.323
  00:09:59 STEP 2652 H=2652:00 +CPU= 32.208
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002652
  00:10:18 STEP 2653 H=2653:00 +CPU= 18.555
  00:10:37 STEP 2654 H=2654:00 +CPU= 18.847
  00:11:06 STEP 2655 H=2655:00 +CPU= 28.995
  00:11:25 STEP 2656 H=2656:00 +CPU= 19.066
  00:11:44 STEP 2657 H=2657:00 +CPU= 18.239
  00:12:14 STEP 2658 H=2658:00 +CPU= 29.611
  00:12:32 STEP 2659 H=2659:00 +CPU= 18.540
  00:12:51 STEP 2660 H=2660:00 +CPU= 18.902
  00:13:20 STEP 2661 H=2661:00 +CPU= 28.870
  00:13:39 STEP 2662 H=2662:00 +CPU= 19.140
  00:13:59 STEP 2663 H=2663:00 +CPU= 18.933
  00:14:33 STEP 2664 H=2664:00 +CPU= 33.917
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_110.zip
Uploading the intermediate file: upload_file_110.zip
  00:14:52 STEP 2665 H=2665:00 +CPU= 18.445
  00:15:11 STEP 2666 H=2666:00 +CPU= 18.764
  00:15:40 STEP 2667 H=2667:00 +CPU= 28.994
  00:15:59 STEP 2668 H=2668:00 +CPU= 19.022
  00:16:18 STEP 2669 H=2669:00 +CPU= 18.200
  00:16:48 STEP 2670 H=2670:00 +CPU= 29.614
  00:17:06 STEP 2671 H=2671:00 +CPU= 18.610
  00:17:25 STEP 2672 H=2672:00 +CPU= 18.899
  00:17:55 STEP 2673 H=2673:00 +CPU= 28.932
  00:18:14 STEP 2674 H=2674:00 +CPU= 19.207
  00:18:32 STEP 2675 H=2675:00 +CPU= 18.234
  00:19:05 STEP 2676 H=2676:00 +CPU= 32.137
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002676
  00:19:23 STEP 2677 H=2677:00 +CPU= 18.634
  00:19:42 STEP 2678 H=2678:00 +CPU= 18.891
  00:20:12 STEP 2679 H=2679:00 +CPU= 28.978
  00:20:31 STEP 2680 H=2680:00 +CPU= 19.163
  00:20:49 STEP 2681 H=2681:00 +CPU= 18.336
  00:21:19 STEP 2682 H=2682:00 +CPU= 29.586
  00:21:38 STEP 2683 H=2683:00 +CPU= 18.554
  00:21:57 STEP 2684 H=2684:00 +CPU= 18.790
  00:22:26 STEP 2685 H=2685:00 +CPU= 28.991
  00:22:45 STEP 2686 H=2686:00 +CPU= 19.251
  00:23:04 STEP 2687 H=2687:00 +CPU= 19.018
  00:23:39 STEP 2688 H=2688:00 +CPU= 33.884
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_111.zip
Uploading the intermediate file: upload_file_111.zip
  00:23:58 STEP 2689 H=2689:00 +CPU= 18.497
  00:24:17 STEP 2690 H=2690:00 +CPU= 18.745
  00:24:46 STEP 2691 H=2691:00 +CPU= 29.024
  00:25:05 STEP 2692 H=2692:00 +CPU= 19.101
  00:25:24 STEP 2693 H=2693:00 +CPU= 18.292
  00:25:53 STEP 2694 H=2694:00 +CPU= 29.642
  00:26:12 STEP 2695 H=2695:00 +CPU= 18.639
  00:26:31 STEP 2696 H=2696:00 +CPU= 18.811
  00:27:01 STEP 2697 H=2697:00 +CPU= 29.123
  00:27:21 STEP 2698 H=2698:00 +CPU= 19.331
  00:27:39 STEP 2699 H=2699:00 +CPU= 18.289
  00:28:11 STEP 2700 H=2700:00 +CPU= 32.258
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002700
  00:28:30 STEP 2701 H=2701:00 +CPU= 18.587
  00:28:49 STEP 2702 H=2702:00 +CPU= 18.926
  00:29:18 STEP 2703 H=2703:00 +CPU= 28.929
  00:29:37 STEP 2704 H=2704:00 +CPU= 19.129
  00:29:56 STEP 2705 H=2705:00 +CPU= 18.322
  00:30:26 STEP 2706 H=2706:00 +CPU= 29.600
  00:30:44 STEP 2707 H=2707:00 +CPU= 18.607
  00:31:03 STEP 2708 H=2708:00 +CPU= 18.759
  00:31:33 STEP 2709 H=2709:00 +CPU= 29.250
  00:31:52 STEP 2710 H=2710:00 +CPU= 19.202
  00:32:11 STEP 2711 H=2711:00 +CPU= 19.126
  00:32:46 STEP 2712 H=2712:00 +CPU= 34.035
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_112.zip
Uploading the intermediate file: upload_file_112.zip
  00:33:05 STEP 2713 H=2713:00 +CPU= 18.518
  00:33:24 STEP 2714 H=2714:00 +CPU= 18.854
  00:33:53 STEP 2715 H=2715:00 +CPU= 29.006
  00:34:12 STEP 2716 H=2716:00 +CPU= 19.105
  00:34:31 STEP 2717 H=2717:00 +CPU= 18.374
  00:35:01 STEP 2718 H=2718:00 +CPU= 29.653
  00:35:20 STEP 2719 H=2719:00 +CPU= 18.658
  00:35:38 STEP 2720 H=2720:00 +CPU= 18.834
  00:36:08 STEP 2721 H=2721:00 +CPU= 29.092
  00:36:27 STEP 2722 H=2722:00 +CPU= 19.316
  00:36:46 STEP 2723 H=2723:00 +CPU= 18.304
  00:37:18 STEP 2724 H=2724:00 +CPU= 32.254
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002724
  00:37:37 STEP 2725 H=2725:00 +CPU= 18.594
  00:37:56 STEP 2726 H=2726:00 +CPU= 18.919
  00:38:25 STEP 2727 H=2727:00 +CPU= 29.027
  00:38:44 STEP 2728 H=2728:00 +CPU= 19.161
  00:39:03 STEP 2729 H=2729:00 +CPU= 18.266
  00:39:33 STEP 2730 H=2730:00 +CPU= 29.706
  00:39:51 STEP 2731 H=2731:00 +CPU= 18.617
  00:40:10 STEP 2732 H=2732:00 +CPU= 18.885
  00:40:40 STEP 2733 H=2733:00 +CPU= 29.014
  00:40:59 STEP 2734 H=2734:00 +CPU= 19.126
  00:41:18 STEP 2735 H=2735:00 +CPU= 18.914
  00:41:53 STEP 2736 H=2736:00 +CPU= 34.107
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_113.zip
Uploading the intermediate file: upload_file_113.zip
  00:42:12 STEP 2737 H=2737:00 +CPU= 18.557
  00:42:31 STEP 2738 H=2738:00 +CPU= 18.840
  00:43:00 STEP 2739 H=2739:00 +CPU= 28.950
  00:43:19 STEP 2740 H=2740:00 +CPU= 19.190
  00:43:38 STEP 2741 H=2741:00 +CPU= 18.280
  00:44:07 STEP 2742 H=2742:00 +CPU= 29.711
  00:44:26 STEP 2743 H=2743:00 +CPU= 18.643
  00:44:45 STEP 2744 H=2744:00 +CPU= 18.900
  00:45:14 STEP 2745 H=2745:00 +CPU= 28.960
  00:45:34 STEP 2746 H=2746:00 +CPU= 19.249
  00:45:52 STEP 2747 H=2747:00 +CPU= 18.261
  00:46:25 STEP 2748 H=2748:00 +CPU= 32.341
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002748
  00:46:44 STEP 2749 H=2749:00 +CPU= 18.661
  00:47:03 STEP 2750 H=2750:00 +CPU= 18.939
  00:47:32 STEP 2751 H=2751:00 +CPU= 29.070
  00:47:51 STEP 2752 H=2752:00 +CPU= 19.140
  00:48:10 STEP 2753 H=2753:00 +CPU= 18.345
  00:48:40 STEP 2754 H=2754:00 +CPU= 29.673
  00:48:58 STEP 2755 H=2755:00 +CPU= 18.611
  00:49:17 STEP 2756 H=2756:00 +CPU= 18.796
  00:49:46 STEP 2757 H=2757:00 +CPU= 27.782
  00:50:04 STEP 2758 H=2758:00 +CPU= 17.745
  00:50:22 STEP 2759 H=2759:00 +CPU= 17.678
  00:50:56 STEP 2760 H=2760:00 +CPU= 31.932
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_114.zip
Uploading the intermediate file: upload_file_114.zip
  00:51:15 STEP 2761 H=2761:00 +CPU= 16.780
Uploading trickle at timestep: 9936000
  00:51:33 STEP 2762 H=2762:00 +CPU= 14.387
  00:52:01 STEP 2763 H=2763:00 +CPU= 22.287
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0593
(argv4) batchid: 973
(argv5) wuid: 12190237
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a72bad0afd446db57f2f0817fe77ba7f to: /var/lib/boinc/slots/0/oifs_43r3_ps_0593_2004050100_123_973_12190237.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0593_2004050100_123_973_12190237.zip
ic_ancil_file: ic_ancil_12190237
ifsdata_file: ifsdata_12190237
climate_data_file: clim_data_12190237
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e8188cd663c4618bd8869b26cc676cd4 to: /var/lib/boinc/slots/0/ic_ancil_12190237.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12190237.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0fca70402edcb3ad04daced7f9181cc1 to: /var/lib/boinc/slots/0/ifsdata/ifsdata_12190237.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/0/ifsdata/ifsdata_12190237.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/0/159l_2/clim_data_12190237.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/0/159l_2/clim_data_12190237.zip
Checking for progress XML file: /var/lib/boinc/slots/0/progress_file_12190237.xml
Opened progress file ok : /var/lib/boinc/slots/0/progress_file_12190237.xml
-- Model is restarting --
Adjusting last_iter, 2764, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/0/progress_file_12190237.xml
last_cpu_time: 62645
upload_file_number: 115
last_iter: 2759
last_upload: 9936000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404
The child process has been launched with process id: 77279
Executing the command: /var/lib/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:science:1:1:77279:77279] [20230121:075417:1674309257:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:54:44 STEP 2760 H=2760:00 +CPU= 25.688
  07:55:00 STEP 2761 H=2761:00 +CPU= 15.953
  07:55:17 STEP 2762 H=2762:00 +CPU= 16.458
  07:55:43 STEP 2763 H=2763:00 +CPU= 25.574
  07:55:59 STEP 2764 H=2764:00 +CPU= 16.476
  07:56:15 STEP 2765 H=2765:00 +CPU= 15.983
  07:56:42 STEP 2766 H=2766:00 +CPU= 26.195
  07:56:58 STEP 2767 H=2767:00 +CPU= 15.996
  07:57:14 STEP 2768 H=2768:00 +CPU= 16.482
  07:57:40 STEP 2769 H=2769:00 +CPU= 25.587
  07:57:56 STEP 2770 H=2770:00 +CPU= 16.501
  07:58:12 STEP 2771 H=2771:00 +CPU= 15.959
  07:58:41 STEP 2772 H=2772:00 +CPU= 28.364
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002772
  07:58:57 STEP 2773 H=2773:00 +CPU= 15.979
  07:59:14 STEP 2774 H=2774:00 +CPU= 16.492
  07:59:39 STEP 2775 H=2775:00 +CPU= 25.549
  07:59:56 STEP 2776 H=2776:00 +CPU= 16.484
  08:00:12 STEP 2777 H=2777:00 +CPU= 15.950
  08:00:38 STEP 2778 H=2778:00 +CPU= 26.130
  08:00:54 STEP 2779 H=2779:00 +CPU= 15.964
  08:01:11 STEP 2780 H=2780:00 +CPU= 16.446
  08:01:36 STEP 2781 H=2781:00 +CPU= 25.546
  08:01:53 STEP 2782 H=2782:00 +CPU= 16.462
  08:02:09 STEP 2783 H=2783:00 +CPU= 16.455
  08:02:39 STEP 2784 H=2784:00 +CPU= 29.866
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_115.zip
Uploading the intermediate file: upload_file_115.zip
  08:02:55 STEP 2785 H=2785:00 +CPU= 15.926
  08:03:12 STEP 2786 H=2786:00 +CPU= 16.432
  08:03:38 STEP 2787 H=2787:00 +CPU= 25.563
  08:03:54 STEP 2788 H=2788:00 +CPU= 16.464
  08:04:10 STEP 2789 H=2789:00 +CPU= 15.948
  08:04:36 STEP 2790 H=2790:00 +CPU= 26.202
  08:04:52 STEP 2791 H=2791:00 +CPU= 15.968
  08:05:09 STEP 2792 H=2792:00 +CPU= 16.477
  08:05:35 STEP 2793 H=2793:00 +CPU= 25.556
  08:05:51 STEP 2794 H=2794:00 +CPU= 16.469
  08:06:07 STEP 2795 H=2795:00 +CPU= 15.951
  08:06:36 STEP 2796 H=2796:00 +CPU= 28.339
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002796
  08:06:52 STEP 2797 H=2797:00 +CPU= 15.949
  08:07:08 STEP 2798 H=2798:00 +CPU= 16.463
  08:07:34 STEP 2799 H=2799:00 +CPU= 25.536
  08:07:50 STEP 2800 H=2800:00 +CPU= 16.452
  08:08:07 STEP 2801 H=2801:00 +CPU= 15.962
  08:08:33 STEP 2802 H=2802:00 +CPU= 26.125
  08:08:49 STEP 2803 H=2803:00 +CPU= 15.926
  08:09:06 STEP 2804 H=2804:00 +CPU= 16.446
  08:09:31 STEP 2805 H=2805:00 +CPU= 25.542
  08:09:48 STEP 2806 H=2806:00 +CPU= 16.424
  08:10:04 STEP 2807 H=2807:00 +CPU= 16.407
  08:10:34 STEP 2808 H=2808:00 +CPU= 29.955
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_116.zip
Uploading the intermediate file: upload_file_116.zip
  08:10:51 STEP 2809 H=2809:00 +CPU= 15.939
  08:11:07 STEP 2810 H=2810:00 +CPU= 16.439
  08:11:33 STEP 2811 H=2811:00 +CPU= 25.567
  08:11:49 STEP 2812 H=2812:00 +CPU= 16.441
  08:12:05 STEP 2813 H=2813:00 +CPU= 15.936
  08:12:31 STEP 2814 H=2814:00 +CPU= 26.116
  08:12:47 STEP 2815 H=2815:00 +CPU= 15.951
  08:13:04 STEP 2816 H=2816:00 +CPU= 16.495
  08:13:30 STEP 2817 H=2817:00 +CPU= 25.535
  08:13:46 STEP 2818 H=2818:00 +CPU= 16.461
  08:14:02 STEP 2819 H=2819:00 +CPU= 15.960
  08:14:31 STEP 2820 H=2820:00 +CPU= 28.310
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002820
  08:14:47 STEP 2821 H=2821:00 +CPU= 15.970
  08:15:03 STEP 2822 H=2822:00 +CPU= 16.486
  08:15:29 STEP 2823 H=2823:00 +CPU= 25.564
  08:15:45 STEP 2824 H=2824:00 +CPU= 16.453
  08:16:01 STEP 2825 H=2825:00 +CPU= 15.954
  08:16:28 STEP 2826 H=2826:00 +CPU= 26.101
  08:16:44 STEP 2827 H=2827:00 +CPU= 15.933
  08:17:00 STEP 2828 H=2828:00 +CPU= 16.435
  08:17:26 STEP 2829 H=2829:00 +CPU= 25.508
  08:17:42 STEP 2830 H=2830:00 +CPU= 16.425
  08:17:59 STEP 2831 H=2831:00 +CPU= 16.427
  08:18:29 STEP 2832 H=2832:00 +CPU= 29.940
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_117.zip
Uploading the intermediate file: upload_file_117.zip
  08:18:45 STEP 2833 H=2833:00 +CPU= 15.951
  08:19:01 STEP 2834 H=2834:00 +CPU= 16.430
  08:19:27 STEP 2835 H=2835:00 +CPU= 25.527
  08:19:43 STEP 2836 H=2836:00 +CPU= 16.442
  08:20:00 STEP 2837 H=2837:00 +CPU= 15.941
  08:20:26 STEP 2838 H=2838:00 +CPU= 26.137
  08:20:42 STEP 2839 H=2839:00 +CPU= 15.941
  08:20:58 STEP 2840 H=2840:00 +CPU= 16.463
  08:21:24 STEP 2841 H=2841:00 +CPU= 25.567
  08:21:40 STEP 2842 H=2842:00 +CPU= 16.469
  08:21:56 STEP 2843 H=2843:00 +CPU= 15.946
  08:22:25 STEP 2844 H=2844:00 +CPU= 28.267
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002844
  08:22:41 STEP 2845 H=2845:00 +CPU= 15.962
  08:22:57 STEP 2846 H=2846:00 +CPU= 16.470
  08:23:23 STEP 2847 H=2847:00 +CPU= 25.496
  08:23:39 STEP 2848 H=2848:00 +CPU= 16.424
  08:23:55 STEP 2849 H=2849:00 +CPU= 15.926
  08:24:22 STEP 2850 H=2850:00 +CPU= 26.069
  08:24:38 STEP 2851 H=2851:00 +CPU= 15.925
  08:24:54 STEP 2852 H=2852:00 +CPU= 16.423
  08:25:20 STEP 2853 H=2853:00 +CPU= 25.470
  08:25:36 STEP 2854 H=2854:00 +CPU= 16.371
  08:25:52 STEP 2855 H=2855:00 +CPU= 16.388
  08:26:23 STEP 2856 H=2856:00 +CPU= 29.923
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_118.zip
Uploading the intermediate file: upload_file_118.zip
  08:26:39 STEP 2857 H=2857:00 +CPU= 15.898
  08:26:55 STEP 2858 H=2858:00 +CPU= 16.354
  08:27:21 STEP 2859 H=2859:00 +CPU= 25.449
  08:27:37 STEP 2860 H=2860:00 +CPU= 16.385
  08:27:53 STEP 2861 H=2861:00 +CPU= 15.898
  08:28:19 STEP 2862 H=2862:00 +CPU= 26.068
  08:28:35 STEP 2863 H=2863:00 +CPU= 15.935
  08:28:52 STEP 2864 H=2864:00 +CPU= 16.446
  08:29:17 STEP 2865 H=2865:00 +CPU= 25.473
  08:29:34 STEP 2866 H=2866:00 +CPU= 16.419
  08:29:50 STEP 2867 H=2867:00 +CPU= 15.903
  08:30:18 STEP 2868 H=2868:00 +CPU= 28.228
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002868
  08:30:34 STEP 2869 H=2869:00 +CPU= 15.904
  08:30:50 STEP 2870 H=2870:00 +CPU= 16.432
  08:31:16 STEP 2871 H=2871:00 +CPU= 25.507
  08:31:33 STEP 2872 H=2872:00 +CPU= 16.403
  08:31:48 STEP 2873 H=2873:00 +CPU= 15.896
  08:32:15 STEP 2874 H=2874:00 +CPU= 26.062
  08:32:31 STEP 2875 H=2875:00 +CPU= 15.884
  08:32:47 STEP 2876 H=2876:00 +CPU= 16.405
  08:33:13 STEP 2877 H=2877:00 +CPU= 25.460
  08:33:29 STEP 2878 H=2878:00 +CPU= 16.416
  08:33:46 STEP 2879 H=2879:00 +CPU= 16.391
  08:34:16 STEP 2880 H=2880:00 +CPU= 29.860
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_119.zip
Uploading the intermediate file: upload_file_119.zip
  08:34:32 STEP 2881 H=2881:00 +CPU= 15.853
  08:34:48 STEP 2882 H=2882:00 +CPU= 16.374
  08:35:14 STEP 2883 H=2883:00 +CPU= 25.490
  08:35:30 STEP 2884 H=2884:00 +CPU= 16.370
  08:35:46 STEP 2885 H=2885:00 +CPU= 15.875
  08:36:12 STEP 2886 H=2886:00 +CPU= 26.071
  08:36:28 STEP 2887 H=2887:00 +CPU= 15.918
  08:36:45 STEP 2888 H=2888:00 +CPU= 16.411
  08:37:10 STEP 2889 H=2889:00 +CPU= 25.467
  08:37:27 STEP 2890 H=2890:00 +CPU= 16.447
  08:37:43 STEP 2891 H=2891:00 +CPU= 15.941
  08:38:11 STEP 2892 H=2892:00 +CPU= 28.228
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002892
  08:38:27 STEP 2893 H=2893:00 +CPU= 15.899
  08:38:44 STEP 2894 H=2894:00 +CPU= 16.430
  08:39:09 STEP 2895 H=2895:00 +CPU= 25.433
  08:39:26 STEP 2896 H=2896:00 +CPU= 16.436
  08:39:42 STEP 2897 H=2897:00 +CPU= 15.924
  08:40:08 STEP 2898 H=2898:00 +CPU= 26.035
  08:40:24 STEP 2899 H=2899:00 +CPU= 15.884
  08:40:40 STEP 2900 H=2900:00 +CPU= 16.410
  08:41:06 STEP 2901 H=2901:00 +CPU= 25.451
  08:41:22 STEP 2902 H=2902:00 +CPU= 16.375
  08:41:39 STEP 2903 H=2903:00 +CPU= 16.355
  08:42:09 STEP 2904 H=2904:00 +CPU= 29.810
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_120.zip
Uploading the intermediate file: upload_file_120.zip
  08:42:25 STEP 2905 H=2905:00 +CPU= 15.877
  08:42:41 STEP 2906 H=2906:00 +CPU= 16.380
  08:43:07 STEP 2907 H=2907:00 +CPU= 25.460
  08:43:23 STEP 2908 H=2908:00 +CPU= 16.405
  08:43:39 STEP 2909 H=2909:00 +CPU= 15.920
  08:44:05 STEP 2910 H=2910:00 +CPU= 26.042
  08:44:21 STEP 2911 H=2911:00 +CPU= 15.895
  08:44:38 STEP 2912 H=2912:00 +CPU= 16.421
  08:45:03 STEP 2913 H=2913:00 +CPU= 25.462
  08:45:20 STEP 2914 H=2914:00 +CPU= 16.436
  08:45:36 STEP 2915 H=2915:00 +CPU= 15.908
  08:46:04 STEP 2916 H=2916:00 +CPU= 28.171
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002916
  08:46:20 STEP 2917 H=2917:00 +CPU= 15.937
  08:46:37 STEP 2918 H=2918:00 +CPU= 16.450
  08:47:02 STEP 2919 H=2919:00 +CPU= 25.487
  08:47:19 STEP 2920 H=2920:00 +CPU= 16.407
  08:47:35 STEP 2921 H=2921:00 +CPU= 15.908
  08:48:01 STEP 2922 H=2922:00 +CPU= 26.028
  08:48:17 STEP 2923 H=2923:00 +CPU= 15.882
  08:48:33 STEP 2924 H=2924:00 +CPU= 16.376
  08:48:59 STEP 2925 H=2925:00 +CPU= 25.429
  08:49:15 STEP 2926 H=2926:00 +CPU= 16.386
  08:49:32 STEP 2927 H=2927:00 +CPU= 16.365
  08:50:02 STEP 2928 H=2928:00 +CPU= 29.876
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_121.zip
Uploading the intermediate file: upload_file_121.zip
  08:50:18 STEP 2929 H=2929:00 +CPU= 15.889
  08:50:34 STEP 2930 H=2930:00 +CPU= 16.402
  08:51:00 STEP 2931 H=2931:00 +CPU= 25.487
  08:51:16 STEP 2932 H=2932:00 +CPU= 16.432
  08:51:32 STEP 2933 H=2933:00 +CPU= 15.902
  08:51:59 STEP 2934 H=2934:00 +CPU= 26.062
  08:52:15 STEP 2935 H=2935:00 +CPU= 15.905
  08:52:31 STEP 2936 H=2936:00 +CPU= 16.433
  08:52:57 STEP 2937 H=2937:00 +CPU= 25.509
  08:53:13 STEP 2938 H=2938:00 +CPU= 16.464
  08:53:29 STEP 2939 H=2939:00 +CPU= 15.937
  08:53:58 STEP 2940 H=2940:00 +CPU= 28.252
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002940
  08:54:14 STEP 2941 H=2941:00 +CPU= 15.942
  08:54:30 STEP 2942 H=2942:00 +CPU= 16.427
  08:54:56 STEP 2943 H=2943:00 +CPU= 25.573
  08:55:12 STEP 2944 H=2944:00 +CPU= 16.442
  08:55:28 STEP 2945 H=2945:00 +CPU= 15.915
  08:55:54 STEP 2946 H=2946:00 +CPU= 26.077
  08:56:10 STEP 2947 H=2947:00 +CPU= 15.927
  08:56:27 STEP 2948 H=2948:00 +CPU= 16.425
  08:56:52 STEP 2949 H=2949:00 +CPU= 25.528
  08:57:09 STEP 2950 H=2950:00 +CPU= 16.439
  08:57:25 STEP 2951 H=2951:00 +CPU= 16.442
  08:57:55 STEP 2952 H=2952:00 +CPU= 28.981
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190237/ICMUAhq0f+002928
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0593_2004050100_123_973_12190237_1_r1130267404_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
09:01:18 (77271): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:33:25 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 10,623,600 66,445 0.0063
09 May 2023 16:32:26 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 8,208,000 51,759 0.0063
09 May 2023 16:32:15 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 7,344,000 46,326 0.0063
09 May 2023 16:32:09 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 6,480,000 40,913 0.0063
09 May 2023 16:31:57 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 5,616,000 35,484 0.0063
09 May 2023 16:31:51 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 4,752,000 30,055 0.0063
09 May 2023 16:31:36 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 3,456,000 21,725 0.0063
09 May 2023 16:31:21 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 2,592,000 16,306 0.0063
09 May 2023 16:31:16 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 1,728,000 10,877 0.0063
09 May 2023 16:31:05 1536819 22300398 oifs_43r3_ps_0593_2004050100_123_973_12190237_1 864,000 5,457 0.0063


©2024 climateprediction.net