<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000636
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:49:33 STEP 637 H= 637:00 +CPU= 21.900
11:49:57 STEP 638 H= 638:00 +CPU= 22.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:52:44 STEP 639 H= 639:00 +CPU= 35.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:55:57 STEP 640 H= 640:00 +CPU= 22.478
11:56:19 STEP 641 H= 641:00 +CPU= 21.764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:00:07 STEP 642 H= 642:00 +CPU= 35.839
12:00:29 STEP 643 H= 643:00 +CPU= 21.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:02 STEP 644 H= 644:00 +CPU= 22.136
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:05:17 STEP 645 H= 645:00 +CPU= 32.892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:06:48 STEP 646 H= 646:00 +CPU= 21.375
12:07:10 STEP 647 H= 647:00 +CPU= 21.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:09:30 STEP 648 H= 648:00 +CPU= 37.743
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_26.zip
Uploading the intermediate file: upload_file_26.zip
12:09:50 STEP 649 H= 649:00 +CPU= 20.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:11:32 STEP 650 H= 650:00 +CPU= 21.514
12:12:05 STEP 651 H= 651:00 +CPU= 32.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:13:48 STEP 652 H= 652:00 +CPU= 21.484
12:14:09 STEP 653 H= 653:00 +CPU= 20.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:15:52 STEP 654 H= 654:00 +CPU= 33.315
12:16:13 STEP 655 H= 655:00 +CPU= 20.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:17:47 STEP 656 H= 656:00 +CPU= 21.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:19:19 STEP 657 H= 657:00 +CPU= 31.926
12:19:41 STEP 658 H= 658:00 +CPU= 21.917
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:20:54 STEP 659 H= 659:00 +CPU= 21.032
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:22:42 STEP 660 H= 660:00 +CPU= 35.966
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000660
12:23:02 STEP 661 H= 661:00 +CPU= 20.630
12:23:23 STEP 662 H= 662:00 +CPU= 20.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:25:16 STEP 663 H= 663:00 +CPU= 32.111
12:25:37 STEP 664 H= 664:00 +CPU= 20.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:27:09 STEP 665 H= 665:00 +CPU= 20.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:28:32 STEP 666 H= 666:00 +CPU= 32.862
12:28:52 STEP 667 H= 667:00 +CPU= 20.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:30:04 STEP 668 H= 668:00 +CPU= 20.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:31:28 STEP 669 H= 669:00 +CPU= 33.103
12:31:50 STEP 670 H= 670:00 +CPU= 21.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:33:20 STEP 671 H= 671:00 +CPU= 20.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:35:21 STEP 672 H= 672:00 +CPU= 38.284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_27.zip
Uploading the intermediate file: upload_file_27.zip
12:35:42 STEP 673 H= 673:00 +CPU= 20.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:37:03 STEP 674 H= 674:00 +CPU= 21.273
12:37:36 STEP 675 H= 675:00 +CPU= 33.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:38:49 STEP 676 H= 676:00 +CPU= 21.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:40:22 STEP 677 H= 677:00 +CPU= 21.005
12:40:55 STEP 678 H= 678:00 +CPU= 32.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:42:26 STEP 679 H= 679:00 +CPU= 20.524
12:42:47 STEP 680 H= 680:00 +CPU= 21.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:44:22 STEP 681 H= 681:00 +CPU= 33.094
12:44:43 STEP 682 H= 682:00 +CPU= 20.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:46:15 STEP 683 H= 683:00 +CPU= 20.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:48:03 STEP 684 H= 684:00 +CPU= 35.626
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000684
12:48:23 STEP 685 H= 685:00 +CPU= 20.338
12:48:44 STEP 686 H= 686:00 +CPU= 20.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:29 STEP 687 H= 687:00 +CPU= 32.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:51:31 STEP 688 H= 688:00 +CPU= 21.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:52:52 STEP 689 H= 689:00 +CPU= 20.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:54:17 STEP 690 H= 690:00 +CPU= 34.162
12:54:38 STEP 691 H= 691:00 +CPU= 20.831
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:56:01 STEP 692 H= 692:00 +CPU= 21.378
12:56:33 STEP 693 H= 693:00 +CPU= 32.374
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:58:15 STEP 694 H= 694:00 +CPU= 20.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:59:29 STEP 695 H= 695:00 +CPU= 21.058
13:00:07 STEP 696 H= 696:00 +CPU= 38.073
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_28.zip
Uploading the intermediate file: upload_file_28.zip
13:00:27 STEP 697 H= 697:00 +CPU= 19.898
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:02:28 STEP 698 H= 698:00 +CPU= 20.980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:04:11 STEP 699 H= 699:00 +CPU= 32.876
13:04:33 STEP 700 H= 700:00 +CPU= 21.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:06:04 STEP 701 H= 701:00 +CPU= 20.199
13:06:38 STEP 702 H= 702:00 +CPU= 33.273
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:07:59 STEP 703 H= 703:00 +CPU= 20.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:09:21 STEP 704 H= 704:00 +CPU= 20.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:10:46 STEP 705 H= 705:00 +CPU= 33.497
13:11:08 STEP 706 H= 706:00 +CPU= 21.474
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:12:29 STEP 707 H= 707:00 +CPU= 20.996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:13:46 STEP 708 H= 708:00 +CPU= 35.983
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:14:58 STEP 709 H= 709:00 +CPU= 20.952
13:15:19 STEP 710 H= 710:00 +CPU= 20.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:17:24 STEP 711 H= 711:00 +CPU= 32.929
13:17:45 STEP 712 H= 712:00 +CPU= 21.166
13:18:05 STEP 713 H= 713:00 +CPU= 20.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:19:51 STEP 714 H= 714:00 +CPU= 34.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:21:33 STEP 715 H= 715:00 +CPU= 21.067
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0351
(argv4) batchid: 983
(argv5) wuid: 12199995
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_21841c4a3b3a87acc92a3d259d4d6b43 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
ic_ancil_file: ic_ancil_12199995
ifsdata_file: ifsdata_12199995
climate_data_file: clim_data_12199995
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7302110cfcabb8bf2d2ae055ebfd1a39 to: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_371800f48bbbcc6fbb994bebbb9f974a to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12199995.xml
-- Model is restarting --
Adjusting last_iter, 715, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
last_cpu_time: 18977
upload_file_number: 29
last_iter: 695
last_upload: 2505600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412
The child process has been launched with process id: 3286183
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:132317:1674102197:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:25:02 STEP 696 H= 696:00 +CPU= 38.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:26:14 STEP 697 H= 697:00 +CPU= 20.747
13:26:35 STEP 698 H= 698:00 +CPU= 21.028
13:27:08 STEP 699 H= 699:00 +CPU= 32.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:28:40 STEP 700 H= 700:00 +CPU= 21.165
13:29:01 STEP 701 H= 701:00 +CPU= 20.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:30:55 STEP 702 H= 702:00 +CPU= 33.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:32:18 STEP 703 H= 703:00 +CPU= 20.619
13:32:39 STEP 704 H= 704:00 +CPU= 20.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:34:24 STEP 705 H= 705:00 +CPU= 33.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:35:55 STEP 706 H= 706:00 +CPU= 21.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:37:16 STEP 707 H= 707:00 +CPU= 20.935
13:37:53 STEP 708 H= 708:00 +CPU= 36.657
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000708
13:39:25 STEP 709 H= 709:00 +CPU= 20.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:40:58 STEP 710 H= 710:00 +CPU= 21.436
13:41:31 STEP 711 H= 711:00 +CPU= 32.781
13:41:51 STEP 712 H= 712:00 +CPU= 20.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:43:33 STEP 713 H= 713:00 +CPU= 20.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:45:58 STEP 714 H= 714:00 +CPU= 33.533
13:46:18 STEP 715 H= 715:00 +CPU= 20.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:48:01 STEP 716 H= 716:00 +CPU= 21.284
13:48:34 STEP 717 H= 717:00 +CPU= 32.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:50:07 STEP 718 H= 718:00 +CPU= 21.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:51:59 STEP 719 H= 719:00 +CPU= 21.301
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:53:59 STEP 720 H= 720:00 +CPU= 38.790
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_29.zip
Uploading the intermediate file: upload_file_29.zip
13:54:20 STEP 721 H= 721:00 +CPU= 20.807
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:55:54 STEP 722 H= 722:00 +CPU= 21.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:57:37 STEP 723 H= 723:00 +CPU= 32.956
13:57:59 STEP 724 H= 724:00 +CPU= 21.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:59:40 STEP 725 H= 725:00 +CPU= 20.344
14:00:13 STEP 726 H= 726:00 +CPU= 33.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:34 STEP 727 H= 727:00 +CPU= 20.512
14:01:56 STEP 728 H= 728:00 +CPU= 21.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:40 STEP 729 H= 729:00 +CPU= 33.134
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.582] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2595MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SPCM
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SPCSI
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-SPCSI LDONEM=F SITNU (1657)
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SITNU
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : VERINT
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153853:1674110333:8136.585] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : VERINT_DGEMM_2
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153854:1674110334:8137.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3286183:3286183] [20230119:153854:1674110334:8137.585] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 00000000017117AF Unknown Unknown Unknown
oifs_43r3_model.e 0000000000A3E48D verint_ 168 verint.F90
oifs_43r3_model.e 0000000000CE5158 sitnu_ 133 sitnu.F90
oifs_43r3_model.e 000000000132D158 spcsi_ 367 spcsi.F90
oifs_43r3_model.e 00000000012F5708 spcm_ 269 spcm.F90
oifs_43r3_model.e 000000000057A965 stepo_ 405 stepo.F90
oifs_43r3_model.e 000000000055DEEC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0351
(argv4) batchid: 983
(argv5) wuid: 12199995
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_21841c4a3b3a87acc92a3d259d4d6b43 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
ic_ancil_file: ic_ancil_12199995
ifsdata_file: ifsdata_12199995
climate_data_file: clim_data_12199995
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7302110cfcabb8bf2d2ae055ebfd1a39 to: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_371800f48bbbcc6fbb994bebbb9f974a to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12199995.xml
-- Model is restarting --
Adjusting last_iter, 730, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
last_cpu_time: 19861
upload_file_number: 30
last_iter: 719
last_upload: 2592000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412
The child process has been launched with process id: 52418
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52418:52418] [20230119:195020:1674125420:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:28:20 STEP 720 H= 720:00 +CPU= 39.419
20:28:43 STEP 721 H= 721:00 +CPU= 22.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:31:27 STEP 722 H= 722:00 +CPU= 22.823
20:32:04 STEP 723 H= 723:00 +CPU= 35.479
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:48:18 STEP 724 H= 724:00 +CPU= 21.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:30 STEP 725 H= 725:00 +CPU= 20.596
20:51:06 STEP 726 H= 726:00 +CPU= 35.727
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:21 STEP 727 H= 727:00 +CPU= 22.218
21:12:43 STEP 728 H= 728:00 +CPU= 21.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:14:46 STEP 729 H= 729:00 +CPU= 31.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:16:30 STEP 730 H= 730:00 +CPU= 21.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:18:02 STEP 731 H= 731:00 +CPU= 20.182
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:37 STEP 732 H= 732:00 +CPU= 34.630
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:59 STEP 733 H= 733:00 +CPU= 21.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:42 STEP 734 H= 734:00 +CPU= 21.074
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:15 STEP 735 H= 735:00 +CPU= 32.135
21:24:36 STEP 736 H= 736:00 +CPU= 21.136
21:24:56 STEP 737 H= 737:00 +CPU= 19.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:50 STEP 738 H= 738:00 +CPU= 32.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:42 STEP 739 H= 739:00 +CPU= 20.126
21:29:03 STEP 740 H= 740:00 +CPU= 20.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:56 STEP 741 H= 741:00 +CPU= 31.832
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:26 STEP 742 H= 742:00 +CPU= 20.258
21:32:47 STEP 743 H= 743:00 +CPU= 21.366
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:47 STEP 744 H= 744:00 +CPU= 37.801
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_30.zip
Uploading the intermediate file: upload_file_30.zip
21:36:08 STEP 745 H= 745:00 +CPU= 21.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:39 STEP 746 H= 746:00 +CPU= 20.523
21:38:10 STEP 747 H= 747:00 +CPU= 30.995
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:40:01 STEP 748 H= 748:00 +CPU= 21.039
21:40:21 STEP 749 H= 749:00 +CPU= 20.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:26 STEP 750 H= 750:00 +CPU= 33.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:48 STEP 751 H= 751:00 +CPU= 20.445
21:45:09 STEP 752 H= 752:00 +CPU= 20.812
21:45:40 STEP 753 H= 753:00 +CPU= 30.999
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:32 STEP 754 H= 754:00 +CPU= 20.617
21:47:52 STEP 755 H= 755:00 +CPU= 20.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:39 STEP 756 H= 756:00 +CPU= 35.256
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:11 STEP 757 H= 757:00 +CPU= 19.956
21:51:32 STEP 758 H= 758:00 +CPU= 21.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:16 STEP 759 H= 759:00 +CPU= 32.529
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0351
(argv4) batchid: 983
(argv5) wuid: 12199995
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_21841c4a3b3a87acc92a3d259d4d6b43 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0351_2014050100_123_983_12199995.zip
ic_ancil_file: ic_ancil_12199995
ifsdata_file: ifsdata_12199995
climate_data_file: clim_data_12199995
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7302110cfcabb8bf2d2ae055ebfd1a39 to: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12199995.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_371800f48bbbcc6fbb994bebbb9f974a to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12199995.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12199995.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12199995.xml
-- Model is restarting --
Adjusting last_iter, 760, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12199995.xml
last_cpu_time: 20895
upload_file_number: 31
last_iter: 743
last_upload: 2678400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412
The child process has been launched with process id: 73908
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73908:73908] [20230119:215558:1674132958:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:57:28 STEP 744 H= 744:00 +CPU= 36.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:49 STEP 745 H= 745:00 +CPU= 20.315
21:59:10 STEP 746 H= 746:00 +CPU= 20.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:03 STEP 747 H= 747:00 +CPU= 32.082
22:01:25 STEP 748 H= 748:00 +CPU= 21.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:06 STEP 749 H= 749:00 +CPU= 20.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:41 STEP 750 H= 750:00 +CPU= 33.729
22:05:00 STEP 751 H= 751:00 +CPU= 19.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:33 STEP 752 H= 752:00 +CPU= 20.908
22:07:06 STEP 753 H= 753:00 +CPU= 32.472
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:08:59 STEP 754 H= 754:00 +CPU= 20.447
22:09:19 STEP 755 H= 755:00 +CPU= 20.208
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:11:26 STEP 756 H= 756:00 +CPU= 35.645
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:37 STEP 757 H= 757:00 +CPU= 20.662
22:13:59 STEP 758 H= 758:00 +CPU= 21.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:42 STEP 759 H= 759:00 +CPU= 32.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:05 STEP 760 H= 760:00 +CPU= 21.134
22:17:26 STEP 761 H= 761:00 +CPU= 20.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:19:10 STEP 762 H= 762:00 +CPU= 33.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:02 STEP 763 H= 763:00 +CPU= 20.213
22:21:23 STEP 764 H= 764:00 +CPU= 21.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:06 STEP 765 H= 765:00 +CPU= 31.785
22:23:26 STEP 766 H= 766:00 +CPU= 20.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:58 STEP 767 H= 767:00 +CPU= 20.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:27:18 STEP 768 H= 768:00 +CPU= 38.119
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMGGhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMSHhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199995/ICMUAhq0f+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0351_2014050100_123_983_12199995_1_r1537516412_31.zip
Uploading the intermediate file: upload_file_31.zip
22:27:38 STEP 769 H= 769:00 +CPU= 20.038
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:47 STEP 770 H= 770:00 +CPU= 18.641
22:29:19 STEP 771 H= 771:00 +CPU= 32.039
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:01 STEP 772 H= 772:00 +CPU= 20.834
22:31:21 STEP 773 H= 773:00 +CPU= 19.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:33:07 STEP 774 H= 774:00 +CPU= 33.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:34:59 STEP 775 H= 775:00 +CPU= 20.558
22:35:20 STEP 776 H= 776:00 +CPU= 21.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:23 STEP 777 H= 777:00 +CPU= 32.527
22:37:45 STEP 778 H= 778:00 +CPU= 21.618
22:38:05 STEP 779 H= 779:00 +CPU= 20.285
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:40:13 STEP 780 H= 780:00 +CPU= 36.565
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000780
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000780
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:41:44 STEP 781 H= 781:00 +CPU= 20.407
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
