climateprediction.net home page
Task 22290989

Task 22290989

Name oifs_43r3_ps_0843_2018050100_123_987_12204487_0
Workunit 12204487
Created 24 Dec 2022, 21:42:29 UTC
Sent 31 Dec 2022, 15:33:09 UTC
Report deadline 30 Jan 2023, 15:33:09 UTC
Received 3 Jan 2023, 18:01:01 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1523867
Run time 21 hours 19 min 44 sec
CPU time 21 hours 16 min 38 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.17 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,400.36 MB
Peak swap size 4,978.06 MB
Peak disk usage 3,742.88 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
43r3_ps_12204487/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:30:15 STEP 2425 H=2425:00 +CPU= 19.480
  10:30:35 STEP 2426 H=2426:00 +CPU= 20.192
  10:31:07 STEP 2427 H=2427:00 +CPU= 31.100
  10:31:27 STEP 2428 H=2428:00 +CPU= 20.093
  10:31:47 STEP 2429 H=2429:00 +CPU= 19.322
  10:32:18 STEP 2430 H=2430:00 +CPU= 31.327
  10:32:38 STEP 2431 H=2431:00 +CPU= 19.639
  10:32:59 STEP 2432 H=2432:00 +CPU= 20.328
  10:33:30 STEP 2433 H=2433:00 +CPU= 31.352
  10:33:51 STEP 2434 H=2434:00 +CPU= 20.059
  10:34:10 STEP 2435 H=2435:00 +CPU= 19.436
  10:34:45 STEP 2436 H=2436:00 +CPU= 34.054
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002436
  10:35:04 STEP 2437 H=2437:00 +CPU= 19.472
  10:35:25 STEP 2438 H=2438:00 +CPU= 20.077
  10:35:56 STEP 2439 H=2439:00 +CPU= 30.678
  10:36:16 STEP 2440 H=2440:00 +CPU= 20.377
  10:36:36 STEP 2441 H=2441:00 +CPU= 19.464
  10:37:08 STEP 2442 H=2442:00 +CPU= 31.603
  10:37:28 STEP 2443 H=2443:00 +CPU= 19.603
  10:37:48 STEP 2444 H=2444:00 +CPU= 19.974
  10:38:19 STEP 2445 H=2445:00 +CPU= 30.760
  10:38:40 STEP 2446 H=2446:00 +CPU= 20.295
  10:39:00 STEP 2447 H=2447:00 +CPU= 20.093
  10:39:37 STEP 2448 H=2448:00 +CPU= 35.852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_101.zip
Uploading the intermediate file: upload_file_101.zip
  10:39:56 STEP 2449 H=2449:00 +CPU= 19.478
  10:40:16 STEP 2450 H=2450:00 +CPU= 19.844
  10:40:48 STEP 2451 H=2451:00 +CPU= 31.271
  10:41:08 STEP 2452 H=2452:00 +CPU= 20.037
  10:41:28 STEP 2453 H=2453:00 +CPU= 19.347
  10:42:00 STEP 2454 H=2454:00 +CPU= 31.522
  10:42:20 STEP 2455 H=2455:00 +CPU= 19.612
  10:42:40 STEP 2456 H=2456:00 +CPU= 19.838
  10:43:11 STEP 2457 H=2457:00 +CPU= 30.348
  10:43:31 STEP 2458 H=2458:00 +CPU= 20.212
  10:43:51 STEP 2459 H=2459:00 +CPU= 19.573
  10:44:25 STEP 2460 H=2460:00 +CPU= 33.787
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002460
  10:44:45 STEP 2461 H=2461:00 +CPU= 19.734
  10:45:06 STEP 2462 H=2462:00 +CPU= 19.999
  10:45:37 STEP 2463 H=2463:00 +CPU= 31.237
  10:45:58 STEP 2464 H=2464:00 +CPU= 20.311
  10:46:18 STEP 2465 H=2465:00 +CPU= 19.876
  10:46:50 STEP 2466 H=2466:00 +CPU= 31.247
  10:47:10 STEP 2467 H=2467:00 +CPU= 19.520
  10:47:30 STEP 2468 H=2468:00 +CPU= 20.379
  10:48:01 STEP 2469 H=2469:00 +CPU= 30.714
  10:48:22 STEP 2470 H=2470:00 +CPU= 20.317
  10:48:42 STEP 2471 H=2471:00 +CPU= 20.096
  10:49:19 STEP 2472 H=2472:00 +CPU= 36.146
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_102.zip
Uploading the intermediate file: upload_file_102.zip
  10:49:39 STEP 2473 H=2473:00 +CPU= 19.684
  10:49:59 STEP 2474 H=2474:00 +CPU= 20.194
  10:50:30 STEP 2475 H=2475:00 +CPU= 30.505
  10:50:51 STEP 2476 H=2476:00 +CPU= 20.693
  10:51:11 STEP 2477 H=2477:00 +CPU= 19.193
  10:51:42 STEP 2478 H=2478:00 +CPU= 31.150
  10:52:02 STEP 2479 H=2479:00 +CPU= 19.617
  10:52:23 STEP 2480 H=2480:00 +CPU= 20.191
  10:52:54 STEP 2481 H=2481:00 +CPU= 30.503
  10:53:14 STEP 2482 H=2482:00 +CPU= 20.225
  10:53:34 STEP 2483 H=2483:00 +CPU= 19.293
  10:54:08 STEP 2484 H=2484:00 +CPU= 34.165
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002484
  10:54:28 STEP 2485 H=2485:00 +CPU= 19.532
  10:54:48 STEP 2486 H=2486:00 +CPU= 19.841
  10:55:20 STEP 2487 H=2487:00 +CPU= 31.262
  10:55:40 STEP 2488 H=2488:00 +CPU= 20.149
  10:56:00 STEP 2489 H=2489:00 +CPU= 19.365
  10:56:32 STEP 2490 H=2490:00 +CPU= 31.927
  10:56:52 STEP 2491 H=2491:00 +CPU= 19.712
  10:57:13 STEP 2492 H=2492:00 +CPU= 19.895
  10:57:44 STEP 2493 H=2493:00 +CPU= 31.363
  10:58:05 STEP 2494 H=2494:00 +CPU= 20.462
  10:58:25 STEP 2495 H=2495:00 +CPU= 19.922
  10:59:02 STEP 2496 H=2496:00 +CPU= 36.259
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_103.zip
Uploading the intermediate file: upload_file_103.zip
  10:59:22 STEP 2497 H=2497:00 +CPU= 19.276
  10:59:42 STEP 2498 H=2498:00 +CPU= 20.188
  11:00:13 STEP 2499 H=2499:00 +CPU= 30.961
  11:00:34 STEP 2500 H=2500:00 +CPU= 20.708
  11:00:55 STEP 2501 H=2501:00 +CPU= 19.944
  11:01:27 STEP 2502 H=2502:00 +CPU= 31.542
  11:01:47 STEP 2503 H=2503:00 +CPU= 19.884
  11:02:07 STEP 2504 H=2504:00 +CPU= 20.236
  11:02:38 STEP 2505 H=2505:00 +CPU= 30.565
  11:02:59 STEP 2506 H=2506:00 +CPU= 20.161
  11:03:19 STEP 2507 H=2507:00 +CPU= 19.740
  11:03:53 STEP 2508 H=2508:00 +CPU= 34.265
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002508
  11:04:13 STEP 2509 H=2509:00 +CPU= 19.714
  11:04:34 STEP 2510 H=2510:00 +CPU= 20.080
  11:05:04 STEP 2511 H=2511:00 +CPU= 30.297
  11:05:25 STEP 2512 H=2512:00 +CPU= 19.995
  11:05:44 STEP 2513 H=2513:00 +CPU= 19.188
  11:06:16 STEP 2514 H=2514:00 +CPU= 31.874
  11:06:36 STEP 2515 H=2515:00 +CPU= 19.361
  11:06:56 STEP 2516 H=2516:00 +CPU= 19.902
  11:07:27 STEP 2517 H=2517:00 +CPU= 30.636
  11:07:48 STEP 2518 H=2518:00 +CPU= 20.301
  11:08:08 STEP 2519 H=2519:00 +CPU= 20.043
  11:08:45 STEP 2520 H=2520:00 +CPU= 36.048
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:09:04 STEP 2521 H=2521:00 +CPU= 19.409
  11:09:25 STEP 2522 H=2522:00 +CPU= 19.938
  11:09:57 STEP 2523 H=2523:00 +CPU= 31.436
  11:10:17 STEP 2524 H=2524:00 +CPU= 19.961
  11:10:37 STEP 2525 H=2525:00 +CPU= 19.727
  11:11:09 STEP 2526 H=2526:00 +CPU= 32.039
  11:11:29 STEP 2527 H=2527:00 +CPU= 19.355
  11:11:49 STEP 2528 H=2528:00 +CPU= 19.962
  11:12:21 STEP 2529 H=2529:00 +CPU= 31.055
  11:12:41 STEP 2530 H=2530:00 +CPU= 19.818
  11:13:00 STEP 2531 H=2531:00 +CPU= 19.420
  11:13:35 STEP 2532 H=2532:00 +CPU= 34.381
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002532
  11:13:55 STEP 2533 H=2533:00 +CPU= 19.654
  11:14:15 STEP 2534 H=2534:00 +CPU= 19.861
  11:14:46 STEP 2535 H=2535:00 +CPU= 30.673
  11:15:07 STEP 2536 H=2536:00 +CPU= 20.397
  11:15:27 STEP 2537 H=2537:00 +CPU= 19.662
  11:15:59 STEP 2538 H=2538:00 +CPU= 31.621
  11:16:19 STEP 2539 H=2539:00 +CPU= 19.523
  11:16:39 STEP 2540 H=2540:00 +CPU= 20.225
  11:17:11 STEP 2541 H=2541:00 +CPU= 30.880
  11:17:31 STEP 2542 H=2542:00 +CPU= 20.070
  11:17:51 STEP 2543 H=2543:00 +CPU= 20.054
  11:18:28 STEP 2544 H=2544:00 +CPU= 35.911
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:18:48 STEP 2545 H=2545:00 +CPU= 19.582
  11:19:08 STEP 2546 H=2546:00 +CPU= 19.936
  11:19:38 STEP 2547 H=2547:00 +CPU= 30.301
  11:19:59 STEP 2548 H=2548:00 +CPU= 20.328
  11:20:19 STEP 2549 H=2549:00 +CPU= 19.680
  11:20:51 STEP 2550 H=2550:00 +CPU= 31.550
  11:21:11 STEP 2551 H=2551:00 +CPU= 19.775
  11:21:32 STEP 2552 H=2552:00 +CPU= 20.191
  11:22:03 STEP 2553 H=2553:00 +CPU= 30.993
  11:22:23 STEP 2554 H=2554:00 +CPU= 20.099
  11:22:43 STEP 2555 H=2555:00 +CPU= 19.686
  11:23:18 STEP 2556 H=2556:00 +CPU= 33.997
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002556
  11:23:38 STEP 2557 H=2557:00 +CPU= 19.702
  11:23:58 STEP 2558 H=2558:00 +CPU= 19.901
  11:24:29 STEP 2559 H=2559:00 +CPU= 30.818
  11:24:50 STEP 2560 H=2560:00 +CPU= 20.350
  11:25:10 STEP 2561 H=2561:00 +CPU= 19.605
  11:25:41 STEP 2562 H=2562:00 +CPU= 31.299
  11:26:01 STEP 2563 H=2563:00 +CPU= 19.610
  11:26:21 STEP 2564 H=2564:00 +CPU= 19.858
  11:26:52 STEP 2565 H=2565:00 +CPU= 30.652
  11:27:13 STEP 2566 H=2566:00 +CPU= 20.211
  11:27:33 STEP 2567 H=2567:00 +CPU= 19.953
  11:28:10 STEP 2568 H=2568:00 +CPU= 36.271
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:28:30 STEP 2569 H=2569:00 +CPU= 19.985
  11:28:51 STEP 2570 H=2570:00 +CPU= 20.375
  11:29:22 STEP 2571 H=2571:00 +CPU= 30.550
  11:29:42 STEP 2572 H=2572:00 +CPU= 20.248
  11:30:02 STEP 2573 H=2573:00 +CPU= 19.486
  11:30:34 STEP 2574 H=2574:00 +CPU= 31.533
  11:30:54 STEP 2575 H=2575:00 +CPU= 19.922
  11:31:15 STEP 2576 H=2576:00 +CPU= 20.139
  11:31:46 STEP 2577 H=2577:00 +CPU= 30.471
  11:32:06 STEP 2578 H=2578:00 +CPU= 20.042
  11:32:25 STEP 2579 H=2579:00 +CPU= 19.207
  11:33:00 STEP 2580 H=2580:00 +CPU= 33.872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002580
  11:33:19 STEP 2581 H=2581:00 +CPU= 19.397
  11:33:39 STEP 2582 H=2582:00 +CPU= 19.697
  11:34:10 STEP 2583 H=2583:00 +CPU= 30.285
  11:34:30 STEP 2584 H=2584:00 +CPU= 19.839
  11:34:49 STEP 2585 H=2585:00 +CPU= 19.046
  11:35:21 STEP 2586 H=2586:00 +CPU= 30.844
  11:35:40 STEP 2587 H=2587:00 +CPU= 19.034
  11:36:00 STEP 2588 H=2588:00 +CPU= 19.954
  11:36:31 STEP 2589 H=2589:00 +CPU= 30.568
  11:36:52 STEP 2590 H=2590:00 +CPU= 20.237
  11:37:12 STEP 2591 H=2591:00 +CPU= 19.966
  11:37:48 STEP 2592 H=2592:00 +CPU= 35.946
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:38:08 STEP 2593 H=2593:00 +CPU= 19.349
  11:38:28 STEP 2594 H=2594:00 +CPU= 19.999
  11:38:59 STEP 2595 H=2595:00 +CPU= 30.499
  11:39:19 STEP 2596 H=2596:00 +CPU= 19.804
  11:39:39 STEP 2597 H=2597:00 +CPU= 19.293
  11:40:10 STEP 2598 H=2598:00 +CPU= 31.197
  11:40:30 STEP 2599 H=2599:00 +CPU= 19.577
  11:40:51 STEP 2600 H=2600:00 +CPU= 20.215
  11:41:22 STEP 2601 H=2601:00 +CPU= 30.703
  11:41:42 STEP 2602 H=2602:00 +CPU= 19.928
  11:42:02 STEP 2603 H=2603:00 +CPU= 19.220
  11:42:36 STEP 2604 H=2604:00 +CPU= 33.937
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002604
  11:42:56 STEP 2605 H=2605:00 +CPU= 19.537
  11:43:16 STEP 2606 H=2606:00 +CPU= 19.893
  11:43:47 STEP 2607 H=2607:00 +CPU= 30.390
  11:44:07 STEP 2608 H=2608:00 +CPU= 19.658
  11:44:27 STEP 2609 H=2609:00 +CPU= 19.696
  11:44:58 STEP 2610 H=2610:00 +CPU= 31.076
  11:45:18 STEP 2611 H=2611:00 +CPU= 19.450
  11:45:38 STEP 2612 H=2612:00 +CPU= 19.905
  11:46:09 STEP 2613 H=2613:00 +CPU= 30.495
  11:46:29 STEP 2614 H=2614:00 +CPU= 19.938
  11:46:49 STEP 2615 H=2615:00 +CPU= 20.002
  11:47:26 STEP 2616 H=2616:00 +CPU= 36.049
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:47:46 STEP 2617 H=2617:00 +CPU= 19.661
  11:48:06 STEP 2618 H=2618:00 +CPU= 20.116
  11:48:37 STEP 2619 H=2619:00 +CPU= 30.733
  11:48:58 STEP 2620 H=2620:00 +CPU= 20.063
  11:49:17 STEP 2621 H=2621:00 +CPU= 19.418
  11:49:49 STEP 2622 H=2622:00 +CPU= 31.270
  11:50:09 STEP 2623 H=2623:00 +CPU= 19.621
  11:50:29 STEP 2624 H=2624:00 +CPU= 19.651
  11:51:00 STEP 2625 H=2625:00 +CPU= 30.954
  11:51:20 STEP 2626 H=2626:00 +CPU= 19.895
  11:51:40 STEP 2627 H=2627:00 +CPU= 19.225
  11:52:14 STEP 2628 H=2628:00 +CPU= 33.846
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002628
  11:52:34 STEP 2629 H=2629:00 +CPU= 19.385
  11:52:54 STEP 2630 H=2630:00 +CPU= 20.266
  11:53:25 STEP 2631 H=2631:00 +CPU= 30.062
  11:53:45 STEP 2632 H=2632:00 +CPU= 20.263
  11:54:05 STEP 2633 H=2633:00 +CPU= 19.552
  11:54:37 STEP 2634 H=2634:00 +CPU= 31.293
  11:54:56 STEP 2635 H=2635:00 +CPU= 19.153
  11:55:16 STEP 2636 H=2636:00 +CPU= 19.731
  11:55:47 STEP 2637 H=2637:00 +CPU= 30.367
  11:56:07 STEP 2638 H=2638:00 +CPU= 19.772
  11:56:27 STEP 2639 H=2639:00 +CPU= 19.731
  11:57:04 STEP 2640 H=2640:00 +CPU= 35.859
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_109.zip
Uploading the intermediate file: upload_file_109.zip
  11:57:23 STEP 2641 H=2641:00 +CPU= 19.421
Uploading trickle at timestep: 9504000
  11:57:44 STEP 2642 H=2642:00 +CPU= 20.004
  11:58:15 STEP 2643 H=2643:00 +CPU= 31.244
  11:58:36 STEP 2644 H=2644:00 +CPU= 20.331
  11:58:56 STEP 2645 H=2645:00 +CPU= 19.851
  11:59:29 STEP 2646 H=2646:00 +CPU= 32.124
  11:59:49 STEP 2647 H=2647:00 +CPU= 19.930
  12:00:10 STEP 2648 H=2648:00 +CPU= 20.740
  12:00:45 STEP 2649 H=2649:00 +CPU= 34.259
  12:01:08 STEP 2650 H=2650:00 +CPU= 22.292
  12:01:29 STEP 2651 H=2651:00 +CPU= 20.797
  12:02:07 STEP 2652 H=2652:00 +CPU= 36.649
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002652
  12:02:29 STEP 2653 H=2653:00 +CPU= 21.476
  12:02:51 STEP 2654 H=2654:00 +CPU= 21.856
  12:03:26 STEP 2655 H=2655:00 +CPU= 33.717
  12:03:48 STEP 2656 H=2656:00 +CPU= 21.846
  12:04:10 STEP 2657 H=2657:00 +CPU= 21.474
  12:04:45 STEP 2658 H=2658:00 +CPU= 34.065
  12:05:06 STEP 2659 H=2659:00 +CPU= 21.414
  12:05:28 STEP 2660 H=2660:00 +CPU= 21.474
  12:06:04 STEP 2661 H=2661:00 +CPU= 34.351
  12:06:26 STEP 2662 H=2662:00 +CPU= 21.623
  12:06:48 STEP 2663 H=2663:00 +CPU= 21.535
  12:07:28 STEP 2664 H=2664:00 +CPU= 39.247
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:07:50 STEP 2665 H=2665:00 +CPU= 21.114
  12:08:12 STEP 2666 H=2666:00 +CPU= 21.886
  12:08:48 STEP 2667 H=2667:00 +CPU= 34.307
  12:09:11 STEP 2668 H=2668:00 +CPU= 22.150
  12:09:33 STEP 2669 H=2669:00 +CPU= 21.004
  12:10:08 STEP 2670 H=2670:00 +CPU= 34.107
  12:10:29 STEP 2671 H=2671:00 +CPU= 21.027
  12:10:52 STEP 2672 H=2672:00 +CPU= 22.223
  12:11:25 STEP 2673 H=2673:00 +CPU= 32.713
  12:11:48 STEP 2674 H=2674:00 +CPU= 21.773
  12:12:09 STEP 2675 H=2675:00 +CPU= 20.438
  12:12:46 STEP 2676 H=2676:00 +CPU= 36.044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002676
  12:13:07 STEP 2677 H=2677:00 +CPU= 20.517
  12:13:30 STEP 2678 H=2678:00 +CPU= 21.814
  12:14:04 STEP 2679 H=2679:00 +CPU= 33.525
  12:14:26 STEP 2680 H=2680:00 +CPU= 21.587
  12:14:50 STEP 2681 H=2681:00 +CPU= 21.965
  12:15:24 STEP 2682 H=2682:00 +CPU= 33.959
  12:15:46 STEP 2683 H=2683:00 +CPU= 21.129
  12:16:08 STEP 2684 H=2684:00 +CPU= 22.022
  12:16:43 STEP 2685 H=2685:00 +CPU= 34.063
  12:17:06 STEP 2686 H=2686:00 +CPU= 22.014
  12:17:28 STEP 2687 H=2687:00 +CPU= 21.588
  12:18:08 STEP 2688 H=2688:00 +CPU= 39.395
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:18:30 STEP 2689 H=2689:00 +CPU= 21.476
  12:18:52 STEP 2690 H=2690:00 +CPU= 21.612
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2018050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0843
(argv4) batchid: 987
(argv5) wuid: 12204487
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3a3d28376d2cf854d4ad957e5aad958c to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0843_2018050100_123_987_12204487.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0843_2018050100_123_987_12204487.zip
ic_ancil_file: ic_ancil_12204487
ifsdata_file: ifsdata_12204487
climate_data_file: clim_data_12204487
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e1155daffe27db90cc82f23a8d29912f to: /var/lib/boinc-client/slots/5/ic_ancil_12204487.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12204487.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_052f91f1907f60a6f0bdb4848bb9041d to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12204487.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12204487.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12204487.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12204487.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12204487.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12204487.xml
-- Model is restarting --
Adjusting last_iter, 2691, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12204487.xml
last_cpu_time: 69671
upload_file_number: 112
last_iter: 2687
last_upload: 9676800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142
The child process has been launched with process id: 54290
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:54290:54290] [20230101:122007:1672572007:0.035] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:20:54 STEP 2688 H=2688:00 +CPU= 38.585
  12:21:18 STEP 2689 H=2689:00 +CPU= 22.401
  12:21:40 STEP 2690 H=2690:00 +CPU= 21.145
  12:22:13 STEP 2691 H=2691:00 +CPU= 31.511
  12:22:36 STEP 2692 H=2692:00 +CPU= 22.584
  12:23:01 STEP 2693 H=2693:00 +CPU= 22.903
  12:23:43 STEP 2694 H=2694:00 +CPU= 37.674
  12:24:09 STEP 2695 H=2695:00 +CPU= 23.465
  12:24:34 STEP 2696 H=2696:00 +CPU= 22.449
  12:25:13 STEP 2697 H=2697:00 +CPU= 34.839
  12:25:40 STEP 2698 H=2698:00 +CPU= 24.227
  12:26:06 STEP 2699 H=2699:00 +CPU= 23.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:27:16 STEP 2700 H=2700:00 +CPU= 40.637
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002700
  12:27:40 STEP 2701 H=2701:00 +CPU= 22.314
  12:28:08 STEP 2702 H=2702:00 +CPU= 24.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:29:15 STEP 2703 H=2703:00 +CPU= 39.480
  12:29:43 STEP 2704 H=2704:00 +CPU= 24.186
  12:30:11 STEP 2705 H=2705:00 +CPU= 25.421
  12:30:56 STEP 2706 H=2706:00 +CPU= 39.612
  12:31:22 STEP 2707 H=2707:00 +CPU= 22.791
  12:31:48 STEP 2708 H=2708:00 +CPU= 23.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:32:54 STEP 2709 H=2709:00 +CPU= 37.495
  12:33:21 STEP 2710 H=2710:00 +CPU= 23.989
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:34:13 STEP 2711 H=2711:00 +CPU= 25.188
  12:35:00 STEP 2712 H=2712:00 +CPU= 41.462
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:35:26 STEP 2713 H=2713:00 +CPU= 23.004
  12:35:53 STEP 2714 H=2714:00 +CPU= 23.950
  12:36:34 STEP 2715 H=2715:00 +CPU= 36.748
  12:36:57 STEP 2716 H=2716:00 +CPU= 22.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:37:37 STEP 2717 H=2717:00 +CPU= 23.482
  12:38:21 STEP 2718 H=2718:00 +CPU= 37.916
  12:38:46 STEP 2719 H=2719:00 +CPU= 23.266
  12:39:15 STEP 2720 H=2720:00 +CPU= 24.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:40:08 STEP 2721 H=2721:00 +CPU= 36.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:40:47 STEP 2722 H=2722:00 +CPU= 24.379
  12:41:14 STEP 2723 H=2723:00 +CPU= 23.561
  12:42:00 STEP 2724 H=2724:00 +CPU= 40.958
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002724
  12:42:25 STEP 2725 H=2725:00 +CPU= 23.055
  12:42:52 STEP 2726 H=2726:00 +CPU= 23.714
  12:43:33 STEP 2727 H=2727:00 +CPU= 36.466
  12:43:59 STEP 2728 H=2728:00 +CPU= 23.374
  12:44:24 STEP 2729 H=2729:00 +CPU= 23.021
  12:45:07 STEP 2730 H=2730:00 +CPU= 37.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:45:44 STEP 2731 H=2731:00 +CPU= 23.019
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:46:24 STEP 2732 H=2732:00 +CPU= 24.304
  12:47:04 STEP 2733 H=2733:00 +CPU= 35.871
  12:47:30 STEP 2734 H=2734:00 +CPU= 23.654
  12:47:56 STEP 2735 H=2735:00 +CPU= 23.523
  12:48:43 STEP 2736 H=2736:00 +CPU= 42.052
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:49:09 STEP 2737 H=2737:00 +CPU= 22.951
  12:49:33 STEP 2738 H=2738:00 +CPU= 23.042
  12:50:19 STEP 2739 H=2739:00 +CPU= 38.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:50:54 STEP 2740 H=2740:00 +CPU= 23.019
  12:51:16 STEP 2741 H=2741:00 +CPU= 21.480
  12:51:50 STEP 2742 H=2742:00 +CPU= 33.747
  12:52:12 STEP 2743 H=2743:00 +CPU= 20.924
  12:52:33 STEP 2744 H=2744:00 +CPU= 21.045
  12:53:07 STEP 2745 H=2745:00 +CPU= 33.881
  12:53:29 STEP 2746 H=2746:00 +CPU= 21.573
  12:53:50 STEP 2747 H=2747:00 +CPU= 20.628
  12:54:27 STEP 2748 H=2748:00 +CPU= 37.281
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002748
  12:54:48 STEP 2749 H=2749:00 +CPU= 20.717
  12:55:09 STEP 2750 H=2750:00 +CPU= 21.054
  12:55:43 STEP 2751 H=2751:00 +CPU= 33.399
  12:56:06 STEP 2752 H=2752:00 +CPU= 21.919
  12:56:27 STEP 2753 H=2753:00 +CPU= 20.889
  12:57:00 STEP 2754 H=2754:00 +CPU= 33.349
  12:57:22 STEP 2755 H=2755:00 +CPU= 20.942
  12:57:43 STEP 2756 H=2756:00 +CPU= 21.655
  12:58:18 STEP 2757 H=2757:00 +CPU= 34.044
  12:58:40 STEP 2758 H=2758:00 +CPU= 21.407
  12:59:01 STEP 2759 H=2759:00 +CPU= 21.291
  12:59:42 STEP 2760 H=2760:00 +CPU= 39.741
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:00:05 STEP 2761 H=2761:00 +CPU= 21.964
  13:00:30 STEP 2762 H=2762:00 +CPU= 23.121
  13:01:05 STEP 2763 H=2763:00 +CPU= 33.483
  13:01:26 STEP 2764 H=2764:00 +CPU= 20.974
  13:01:48 STEP 2765 H=2765:00 +CPU= 20.985
  13:02:22 STEP 2766 H=2766:00 +CPU= 33.949
  13:02:43 STEP 2767 H=2767:00 +CPU= 20.586
  13:03:04 STEP 2768 H=2768:00 +CPU= 21.609
  13:03:38 STEP 2769 H=2769:00 +CPU= 33.245
  13:04:00 STEP 2770 H=2770:00 +CPU= 22.121
  13:04:21 STEP 2771 H=2771:00 +CPU= 20.515
  13:04:58 STEP 2772 H=2772:00 +CPU= 36.479
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002772
  13:05:19 STEP 2773 H=2773:00 +CPU= 21.138
  13:05:41 STEP 2774 H=2774:00 +CPU= 21.656
  13:06:14 STEP 2775 H=2775:00 +CPU= 32.380
  13:06:35 STEP 2776 H=2776:00 +CPU= 21.233
  13:06:56 STEP 2777 H=2777:00 +CPU= 20.748
  13:07:30 STEP 2778 H=2778:00 +CPU= 33.075
  13:07:50 STEP 2779 H=2779:00 +CPU= 20.541
  13:08:12 STEP 2780 H=2780:00 +CPU= 21.530
  13:08:45 STEP 2781 H=2781:00 +CPU= 32.734
  13:09:06 STEP 2782 H=2782:00 +CPU= 20.986
  13:09:28 STEP 2783 H=2783:00 +CPU= 21.651
  13:10:09 STEP 2784 H=2784:00 +CPU= 40.180
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:10:30 STEP 2785 H=2785:00 +CPU= 21.198
  13:10:52 STEP 2786 H=2786:00 +CPU= 21.430
  13:11:25 STEP 2787 H=2787:00 +CPU= 32.752
  13:11:47 STEP 2788 H=2788:00 +CPU= 21.798
  13:12:08 STEP 2789 H=2789:00 +CPU= 21.282
  13:12:42 STEP 2790 H=2790:00 +CPU= 33.208
  13:13:03 STEP 2791 H=2791:00 +CPU= 20.713
  13:13:24 STEP 2792 H=2792:00 +CPU= 21.303
  13:13:58 STEP 2793 H=2793:00 +CPU= 33.543
  13:14:20 STEP 2794 H=2794:00 +CPU= 21.660
  13:14:41 STEP 2795 H=2795:00 +CPU= 20.699
  13:15:18 STEP 2796 H=2796:00 +CPU= 36.521
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002796
  13:15:40 STEP 2797 H=2797:00 +CPU= 21.562
  13:16:02 STEP 2798 H=2798:00 +CPU= 22.321
  13:16:35 STEP 2799 H=2799:00 +CPU= 32.719
  13:16:57 STEP 2800 H=2800:00 +CPU= 21.164
  13:17:18 STEP 2801 H=2801:00 +CPU= 20.505
  13:17:51 STEP 2802 H=2802:00 +CPU= 32.862
  13:18:11 STEP 2803 H=2803:00 +CPU= 20.437
  13:18:33 STEP 2804 H=2804:00 +CPU= 21.591
  13:19:06 STEP 2805 H=2805:00 +CPU= 32.526
  13:19:27 STEP 2806 H=2806:00 +CPU= 21.379
  13:19:50 STEP 2807 H=2807:00 +CPU= 22.601
  13:20:29 STEP 2808 H=2808:00 +CPU= 38.448
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:20:50 STEP 2809 H=2809:00 +CPU= 20.880
  13:21:11 STEP 2810 H=2810:00 +CPU= 20.975
  13:21:44 STEP 2811 H=2811:00 +CPU= 32.111
  13:22:05 STEP 2812 H=2812:00 +CPU= 21.170
  13:22:27 STEP 2813 H=2813:00 +CPU= 21.160
  13:23:00 STEP 2814 H=2814:00 +CPU= 33.429
  13:23:21 STEP 2815 H=2815:00 +CPU= 20.261
  13:23:42 STEP 2816 H=2816:00 +CPU= 21.381
  13:24:16 STEP 2817 H=2817:00 +CPU= 33.176
  13:24:37 STEP 2818 H=2818:00 +CPU= 21.415
  13:24:58 STEP 2819 H=2819:00 +CPU= 20.533
  13:25:35 STEP 2820 H=2820:00 +CPU= 36.389
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002820
  13:25:56 STEP 2821 H=2821:00 +CPU= 20.473
  13:26:17 STEP 2822 H=2822:00 +CPU= 21.497
  13:26:50 STEP 2823 H=2823:00 +CPU= 32.790
  13:27:13 STEP 2824 H=2824:00 +CPU= 21.892
  13:27:34 STEP 2825 H=2825:00 +CPU= 21.054
  13:28:07 STEP 2826 H=2826:00 +CPU= 33.219
  13:28:28 STEP 2827 H=2827:00 +CPU= 20.968
  13:28:50 STEP 2828 H=2828:00 +CPU= 21.006
  13:29:23 STEP 2829 H=2829:00 +CPU= 33.018
  13:29:45 STEP 2830 H=2830:00 +CPU= 21.753
  13:30:07 STEP 2831 H=2831:00 +CPU= 21.650
  13:30:46 STEP 2832 H=2832:00 +CPU= 38.483
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:31:07 STEP 2833 H=2833:00 +CPU= 20.898
  13:31:28 STEP 2834 H=2834:00 +CPU= 21.318
  13:32:02 STEP 2835 H=2835:00 +CPU= 33.097
  13:32:24 STEP 2836 H=2836:00 +CPU= 21.837
  13:32:44 STEP 2837 H=2837:00 +CPU= 20.394
  13:33:18 STEP 2838 H=2838:00 +CPU= 33.827
  13:33:40 STEP 2839 H=2839:00 +CPU= 20.922
  13:34:01 STEP 2840 H=2840:00 +CPU= 21.226
  13:34:34 STEP 2841 H=2841:00 +CPU= 32.853
  13:34:56 STEP 2842 H=2842:00 +CPU= 21.258
  13:35:17 STEP 2843 H=2843:00 +CPU= 20.866
  13:35:54 STEP 2844 H=2844:00 +CPU= 36.901
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002844
  13:36:15 STEP 2845 H=2845:00 +CPU= 20.877
  13:36:37 STEP 2846 H=2846:00 +CPU= 21.939
  13:37:10 STEP 2847 H=2847:00 +CPU= 32.185
  13:37:31 STEP 2848 H=2848:00 +CPU= 21.174
  13:37:52 STEP 2849 H=2849:00 +CPU= 20.885
  13:38:26 STEP 2850 H=2850:00 +CPU= 33.710
  13:38:47 STEP 2851 H=2851:00 +CPU= 21.052
  13:39:09 STEP 2852 H=2852:00 +CPU= 20.914
  13:39:41 STEP 2853 H=2853:00 +CPU= 32.382
  13:40:02 STEP 2854 H=2854:00 +CPU= 20.855
  13:40:24 STEP 2855 H=2855:00 +CPU= 21.235
  13:41:02 STEP 2856 H=2856:00 +CPU= 38.046
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:41:24 STEP 2857 H=2857:00 +CPU= 21.072
  13:41:44 STEP 2858 H=2858:00 +CPU= 20.755
  13:42:18 STEP 2859 H=2859:00 +CPU= 33.131
  13:42:39 STEP 2860 H=2860:00 +CPU= 21.369
  13:43:00 STEP 2861 H=2861:00 +CPU= 20.489
  13:43:33 STEP 2862 H=2862:00 +CPU= 33.024
  13:43:54 STEP 2863 H=2863:00 +CPU= 20.421
  13:44:16 STEP 2864 H=2864:00 +CPU= 21.604
  13:44:49 STEP 2865 H=2865:00 +CPU= 33.139
  13:45:11 STEP 2866 H=2866:00 +CPU= 21.468
  13:45:32 STEP 2867 H=2867:00 +CPU= 21.166
  13:46:10 STEP 2868 H=2868:00 +CPU= 37.064
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002868
  13:46:31 STEP 2869 H=2869:00 +CPU= 21.059
  13:46:53 STEP 2870 H=2870:00 +CPU= 21.237
  13:47:26 STEP 2871 H=2871:00 +CPU= 33.037
  13:47:48 STEP 2872 H=2872:00 +CPU= 21.467
  13:48:08 STEP 2873 H=2873:00 +CPU= 20.655
  13:48:42 STEP 2874 H=2874:00 +CPU= 33.328
  13:49:03 STEP 2875 H=2875:00 +CPU= 20.724
  13:49:25 STEP 2876 H=2876:00 +CPU= 21.431
  13:49:58 STEP 2877 H=2877:00 +CPU= 33.051
  13:50:20 STEP 2878 H=2878:00 +CPU= 21.773
  13:50:41 STEP 2879 H=2879:00 +CPU= 21.176
  13:51:20 STEP 2880 H=2880:00 +CPU= 38.221
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:51:41 STEP 2881 H=2881:00 +CPU= 20.348
  13:52:02 STEP 2882 H=2882:00 +CPU= 21.104
  13:52:35 STEP 2883 H=2883:00 +CPU= 32.474
  13:52:56 STEP 2884 H=2884:00 +CPU= 21.076
  13:53:17 STEP 2885 H=2885:00 +CPU= 20.970
  13:53:51 STEP 2886 H=2886:00 +CPU= 33.150
  13:54:12 STEP 2887 H=2887:00 +CPU= 20.934
  13:54:33 STEP 2888 H=2888:00 +CPU= 21.355
  13:55:06 STEP 2889 H=2889:00 +CPU= 32.247
  13:55:28 STEP 2890 H=2890:00 +CPU= 21.637
  13:55:49 STEP 2891 H=2891:00 +CPU= 20.767
  13:56:25 STEP 2892 H=2892:00 +CPU= 36.161
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002892
  13:56:47 STEP 2893 H=2893:00 +CPU= 21.085
  13:57:08 STEP 2894 H=2894:00 +CPU= 21.084
  13:57:41 STEP 2895 H=2895:00 +CPU= 32.967
  13:58:03 STEP 2896 H=2896:00 +CPU= 21.541
  13:58:24 STEP 2897 H=2897:00 +CPU= 20.976
  13:58:58 STEP 2898 H=2898:00 +CPU= 33.964
  13:59:20 STEP 2899 H=2899:00 +CPU= 21.209
  13:59:41 STEP 2900 H=2900:00 +CPU= 20.855
  14:00:14 STEP 2901 H=2901:00 +CPU= 32.760
  14:00:36 STEP 2902 H=2902:00 +CPU= 21.605
  14:00:57 STEP 2903 H=2903:00 +CPU= 21.418
  14:01:37 STEP 2904 H=2904:00 +CPU= 38.926
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_120.zip
Uploading the intermediate file: upload_file_120.zip
  14:01:58 STEP 2905 H=2905:00 +CPU= 20.823
  14:02:20 STEP 2906 H=2906:00 +CPU= 21.559
  14:02:52 STEP 2907 H=2907:00 +CPU= 32.027
  14:03:14 STEP 2908 H=2908:00 +CPU= 21.603
  14:03:35 STEP 2909 H=2909:00 +CPU= 20.599
  14:04:08 STEP 2910 H=2910:00 +CPU= 33.273
  14:04:29 STEP 2911 H=2911:00 +CPU= 21.091
  14:04:51 STEP 2912 H=2912:00 +CPU= 21.644
  14:05:24 STEP 2913 H=2913:00 +CPU= 32.728
  14:05:47 STEP 2914 H=2914:00 +CPU= 22.185
  14:06:08 STEP 2915 H=2915:00 +CPU= 20.820
  14:06:45 STEP 2916 H=2916:00 +CPU= 36.855
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002916
  14:07:06 STEP 2917 H=2917:00 +CPU= 21.057
  14:07:28 STEP 2918 H=2918:00 +CPU= 21.379
  14:08:01 STEP 2919 H=2919:00 +CPU= 32.738
  14:08:22 STEP 2920 H=2920:00 +CPU= 21.216
  14:08:43 STEP 2921 H=2921:00 +CPU= 20.668
  14:09:17 STEP 2922 H=2922:00 +CPU= 33.377
  14:09:38 STEP 2923 H=2923:00 +CPU= 20.918
  14:10:00 STEP 2924 H=2924:00 +CPU= 21.683
  14:10:34 STEP 2925 H=2925:00 +CPU= 33.420
  14:10:55 STEP 2926 H=2926:00 +CPU= 21.312
  14:11:17 STEP 2927 H=2927:00 +CPU= 21.332
  14:11:55 STEP 2928 H=2928:00 +CPU= 38.435
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_121.zip
Uploading the intermediate file: upload_file_121.zip
  14:12:17 STEP 2929 H=2929:00 +CPU= 21.051
Uploading trickle at timestep: 10540800
  14:12:39 STEP 2930 H=2930:00 +CPU= 21.770
  14:13:13 STEP 2931 H=2931:00 +CPU= 33.531
  14:13:35 STEP 2932 H=2932:00 +CPU= 21.814
  14:13:56 STEP 2933 H=2933:00 +CPU= 21.081
  14:14:29 STEP 2934 H=2934:00 +CPU= 33.156
  14:14:50 STEP 2935 H=2935:00 +CPU= 20.576
  14:15:11 STEP 2936 H=2936:00 +CPU= 21.149
  14:15:45 STEP 2937 H=2937:00 +CPU= 33.152
  14:16:06 STEP 2938 H=2938:00 +CPU= 21.093
  14:16:28 STEP 2939 H=2939:00 +CPU= 21.319
  14:17:04 STEP 2940 H=2940:00 +CPU= 36.312
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002940
  14:17:25 STEP 2941 H=2941:00 +CPU= 20.848
  14:17:47 STEP 2942 H=2942:00 +CPU= 21.662
  14:18:21 STEP 2943 H=2943:00 +CPU= 33.604
  14:18:43 STEP 2944 H=2944:00 +CPU= 21.760
  14:19:05 STEP 2945 H=2945:00 +CPU= 21.189
  14:19:38 STEP 2946 H=2946:00 +CPU= 33.318
  14:19:59 STEP 2947 H=2947:00 +CPU= 20.250
  14:20:20 STEP 2948 H=2948:00 +CPU= 21.235
  14:20:54 STEP 2949 H=2949:00 +CPU= 33.551
  14:21:15 STEP 2950 H=2950:00 +CPU= 21.050
  14:21:36 STEP 2951 H=2951:00 +CPU= 20.960
  14:22:14 STEP 2952 H=2952:00 +CPU= 36.804
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204487/ICMGGhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0843_2018050100_123_987_12204487_0_r855702142_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:25:37 (54287): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:05:05 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 10,623,600 76,598 0.0072
09 May 2023 16:05:05 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 10,623,600 76,598 0.0072
09 May 2023 16:05:05 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 10,540,800 75,986 0.0072
09 May 2023 16:05:00 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 9,504,000 68,397 0.0072
09 May 2023 16:04:56 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 8,640,000 62,661 0.0073
09 May 2023 16:04:52 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 7,776,000 56,492 0.0073
09 May 2023 16:04:47 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 6,912,000 50,030 0.0072
09 May 2023 16:04:42 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 6,048,000 43,431 0.0072
09 May 2023 16:04:38 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 5,184,000 36,931 0.0071
09 May 2023 16:04:34 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 4,320,000 30,834 0.0071
09 May 2023 16:04:29 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 3,456,000 24,757 0.0072
09 May 2023 16:04:25 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 2,592,000 18,765 0.0072
09 May 2023 16:04:20 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 1,728,000 12,525 0.0072
09 May 2023 16:04:17 1523867 22290989 oifs_43r3_ps_0843_2018050100_123_987_12204487_0 864,000 6,500 0.0075


©2024 cpdn.org