<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
6 STEP 753 H= 188:15 +CPU= 53.587
09:29:30 STEP 754 H= 188:30 +CPU= 53.648
09:30:23 STEP 755 H= 188:45 +CPU= 51.907
09:31:30 STEP 756 H= 189:00 +CPU= 65.406
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000756
09:32:24 STEP 757 H= 189:15 +CPU= 53.069
09:33:18 STEP 758 H= 189:30 +CPU= 52.289
09:34:08 STEP 759 H= 189:45 +CPU= 49.134
09:35:05 STEP 760 H= 190:00 +CPU= 56.570
09:35:56 STEP 761 H= 190:15 +CPU= 50.265
09:36:54 STEP 762 H= 190:30 +CPU= 56.756
09:37:49 STEP 763 H= 190:45 +CPU= 54.404
09:38:43 STEP 764 H= 191:00 +CPU= 54.339
09:39:35 STEP 765 H= 191:15 +CPU= 51.560
09:40:42 STEP 766 H= 191:30 +CPU= 65.741
09:41:37 STEP 767 H= 191:45 +CPU= 54.015
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2dd
(argv4) batchid: 991
(argv5) wuid: 12209860
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_874d224882a87bb57a02a322a6e2cc7d to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
ic_ancil_file: ic_ancil_12209860
ifsdata_file: ifsdata_12209860
climate_data_file: clim_data_12209860
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0bedee92b194e210c7079dec78b14c92 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12209860.xml
-- Model is restarting --
Adjusting last_iter, 768, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
last_cpu_time: 61207
upload_file_number: 7
last_iter: 769
last_upload: 605700
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125
The child process has been launched with process id: 854809
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:854809:854809] [20230223:094256:1677174176:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125_7.zip
Uploading the intermediate file: upload_file_7.zip
09:44:39 STEP 720 H= 180:00 +CPU= 69.802
09:45:38 STEP 721 H= 180:15 +CPU= 56.546
09:46:36 STEP 722 H= 180:30 +CPU= 57.061
09:47:30 STEP 723 H= 180:45 +CPU= 53.770
09:48:27 STEP 724 H= 181:00 +CPU= 56.128
09:49:22 STEP 725 H= 181:15 +CPU= 54.043
09:50:15 STEP 726 H= 181:30 +CPU= 52.638
09:51:19 STEP 727 H= 181:45 +CPU= 59.156
09:52:18 STEP 728 H= 182:00 +CPU= 58.276
09:53:12 STEP 729 H= 182:15 +CPU= 53.708
09:54:16 STEP 730 H= 182:30 +CPU= 63.355
09:55:16 STEP 731 H= 182:45 +CPU= 58.560
09:56:31 STEP 732 H= 183:00 +CPU= 72.977
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000732
09:57:31 STEP 733 H= 183:15 +CPU= 57.764
09:58:30 STEP 734 H= 183:30 +CPU= 57.485
09:59:29 STEP 735 H= 183:45 +CPU= 57.868
10:00:29 STEP 736 H= 184:00 +CPU= 57.812
10:01:25 STEP 737 H= 184:15 +CPU= 55.687
10:02:17 STEP 738 H= 184:30 +CPU= 51.677
10:03:15 STEP 739 H= 184:45 +CPU= 55.068
10:04:10 STEP 740 H= 185:00 +CPU= 53.909
10:05:18 STEP 741 H= 185:15 +CPU= 65.912
10:06:07 STEP 742 H= 185:30 +CPU= 47.494
10:06:53 STEP 743 H= 185:45 +CPU= 45.097
10:07:56 STEP 744 H= 186:00 +CPU= 61.674
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000744
10:08:47 STEP 745 H= 186:15 +CPU= 49.823
10:09:42 STEP 746 H= 186:30 +CPU= 53.200
10:10:33 STEP 747 H= 186:45 +CPU= 50.160
10:11:26 STEP 748 H= 187:00 +CPU= 52.713
10:12:18 STEP 749 H= 187:15 +CPU= 51.930
10:13:11 STEP 750 H= 187:30 +CPU= 52.998
10:14:03 STEP 751 H= 187:45 +CPU= 50.628
10:14:54 STEP 752 H= 188:00 +CPU= 50.660
10:15:46 STEP 753 H= 188:15 +CPU= 51.921
10:16:38 STEP 754 H= 188:30 +CPU= 50.976
10:17:28 STEP 755 H= 188:45 +CPU= 48.358
10:18:33 STEP 756 H= 189:00 +CPU= 62.985
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000756
10:19:23 STEP 757 H= 189:15 +CPU= 49.590
10:20:09 STEP 758 H= 189:30 +CPU= 46.272
10:21:04 STEP 759 H= 189:45 +CPU= 53.116
10:21:54 STEP 760 H= 190:00 +CPU= 49.339
10:22:46 STEP 761 H= 190:15 +CPU= 51.670
10:23:38 STEP 762 H= 190:30 +CPU= 50.818
10:24:25 STEP 763 H= 190:45 +CPU= 46.976
10:25:15 STEP 764 H= 191:00 +CPU= 49.292
10:26:04 STEP 765 H= 191:15 +CPU= 48.848
10:26:55 STEP 766 H= 191:30 +CPU= 50.904
10:27:51 STEP 767 H= 191:45 +CPU= 51.850
10:29:09 STEP 768 H= 192:00 +CPU= 70.189
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000768
10:29:58 STEP 769 H= 192:15 +CPU= 48.332
10:30:47 STEP 770 H= 192:30 +CPU= 48.430
10:31:38 STEP 771 H= 192:45 +CPU= 50.188
10:32:28 STEP 772 H= 193:00 +CPU= 49.968
10:33:20 STEP 773 H= 193:15 +CPU= 51.098
10:34:12 STEP 774 H= 193:30 +CPU= 51.570
10:35:02 STEP 775 H= 193:45 +CPU= 49.155
10:35:55 STEP 776 H= 194:00 +CPU= 50.919
10:36:45 STEP 777 H= 194:15 +CPU= 49.853
10:37:38 STEP 778 H= 194:30 +CPU= 52.227
10:38:32 STEP 779 H= 194:45 +CPU= 51.765
10:39:35 STEP 780 H= 195:00 +CPU= 61.213
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000780
10:40:24 STEP 781 H= 195:15 +CPU= 49.225
10:41:15 STEP 782 H= 195:30 +CPU= 50.562
10:42:06 STEP 783 H= 195:45 +CPU= 50.351
10:42:59 STEP 784 H= 196:00 +CPU= 52.785
10:43:50 STEP 785 H= 196:15 +CPU= 50.389
10:44:43 STEP 786 H= 196:30 +CPU= 51.276
10:45:37 STEP 787 H= 196:45 +CPU= 50.428
10:46:26 STEP 788 H= 197:00 +CPU= 48.566
10:47:16 STEP 789 H= 197:15 +CPU= 49.808
10:48:09 STEP 790 H= 197:30 +CPU= 52.090
10:48:58 STEP 791 H= 197:45 +CPU= 47.788
10:50:01 STEP 792 H= 198:00 +CPU= 63.028
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000792
10:50:50 STEP 793 H= 198:15 +CPU= 48.462
10:51:35 STEP 794 H= 198:30 +CPU= 44.928
10:52:26 STEP 795 H= 198:45 +CPU= 50.884
10:53:19 STEP 796 H= 199:00 +CPU= 51.562
10:54:12 STEP 797 H= 199:15 +CPU= 52.986
10:55:05 STEP 798 H= 199:30 +CPU= 51.579
10:55:54 STEP 799 H= 199:45 +CPU= 48.829
10:56:46 STEP 800 H= 200:00 +CPU= 51.240
10:57:39 STEP 801 H= 200:15 +CPU= 51.894
10:58:31 STEP 802 H= 200:30 +CPU= 51.717
10:59:22 STEP 803 H= 200:45 +CPU= 51.364
11:00:28 STEP 804 H= 201:00 +CPU= 64.504
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000804
11:01:19 STEP 805 H= 201:15 +CPU= 50.529
11:02:12 STEP 806 H= 201:30 +CPU= 52.293
11:03:01 STEP 807 H= 201:45 +CPU= 48.983
11:03:50 STEP 808 H= 202:00 +CPU= 48.122
11:04:41 STEP 809 H= 202:15 +CPU= 50.024
11:05:21 STEP 810 H= 202:30 +CPU= 39.816
11:06:06 STEP 811 H= 202:45 +CPU= 44.775
11:06:47 STEP 812 H= 203:00 +CPU= 40.880
11:07:36 STEP 813 H= 203:15 +CPU= 49.218
11:08:22 STEP 814 H= 203:30 +CPU= 45.147
11:09:11 STEP 815 H= 203:45 +CPU= 48.473
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2dd
(argv4) batchid: 991
(argv5) wuid: 12209860
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_874d224882a87bb57a02a322a6e2cc7d to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
ic_ancil_file: ic_ancil_12209860
ifsdata_file: ifsdata_12209860
climate_data_file: clim_data_12209860
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0bedee92b194e210c7079dec78b14c92 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12209860.xml
-- Model is restarting --
Adjusting last_iter, 816, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
last_cpu_time: 66270
upload_file_number: 8
last_iter: 817
last_upload: 692100
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125
The child process has been launched with process id: 857189
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:857189:857189] [20230223:111040:1677179440:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:11:37 STEP 816 H= 204:00 +CPU= 47.780
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000816
11:12:41 STEP 817 H= 204:15 +CPU= 56.884
11:13:27 STEP 818 H= 204:30 +CPU= 45.903
11:14:16 STEP 819 H= 204:45 +CPU= 48.627
11:15:04 STEP 820 H= 205:00 +CPU= 48.350
11:15:56 STEP 821 H= 205:15 +CPU= 51.400
11:16:48 STEP 822 H= 205:30 +CPU= 50.874
11:17:42 STEP 823 H= 205:45 +CPU= 51.725
11:18:30 STEP 824 H= 206:00 +CPU= 47.595
11:19:20 STEP 825 H= 206:15 +CPU= 48.378
11:20:09 STEP 826 H= 206:30 +CPU= 48.176
11:20:57 STEP 827 H= 206:45 +CPU= 47.899
11:21:57 STEP 828 H= 207:00 +CPU= 58.817
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000828
11:22:48 STEP 829 H= 207:15 +CPU= 50.545
11:23:38 STEP 830 H= 207:30 +CPU= 49.896
11:24:28 STEP 831 H= 207:45 +CPU= 50.096
11:25:18 STEP 832 H= 208:00 +CPU= 49.293
11:26:09 STEP 833 H= 208:15 +CPU= 50.557
11:26:59 STEP 834 H= 208:30 +CPU= 49.514
11:27:45 STEP 835 H= 208:45 +CPU= 45.051
11:28:38 STEP 836 H= 209:00 +CPU= 52.840
11:29:28 STEP 837 H= 209:15 +CPU= 48.369
11:30:20 STEP 838 H= 209:30 +CPU= 48.920
11:31:11 STEP 839 H= 209:45 +CPU= 50.121
11:32:14 STEP 840 H= 210:00 +CPU= 62.058
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000840
11:33:05 STEP 841 H= 210:15 +CPU= 49.319
11:33:53 STEP 842 H= 210:30 +CPU= 46.910
11:34:43 STEP 843 H= 210:45 +CPU= 49.090
11:35:35 STEP 844 H= 211:00 +CPU= 51.721
11:36:24 STEP 845 H= 211:15 +CPU= 48.030
11:37:16 STEP 846 H= 211:30 +CPU= 51.672
11:38:08 STEP 847 H= 211:45 +CPU= 51.530
11:38:59 STEP 848 H= 212:00 +CPU= 50.330
11:39:48 STEP 849 H= 212:15 +CPU= 48.079
11:40:36 STEP 850 H= 212:30 +CPU= 47.389
11:41:27 STEP 851 H= 212:45 +CPU= 50.618
11:42:28 STEP 852 H= 213:00 +CPU= 59.922
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000852
11:43:18 STEP 853 H= 213:15 +CPU= 49.612
11:44:09 STEP 854 H= 213:30 +CPU= 50.237
11:44:58 STEP 855 H= 213:45 +CPU= 48.538
11:45:46 STEP 856 H= 214:00 +CPU= 46.477
11:46:32 STEP 857 H= 214:15 +CPU= 45.579
11:47:19 STEP 858 H= 214:30 +CPU= 47.200
11:48:06 STEP 859 H= 214:45 +CPU= 46.383
11:48:56 STEP 860 H= 215:00 +CPU= 49.673
11:49:44 STEP 861 H= 215:15 +CPU= 47.383
11:50:37 STEP 862 H= 215:30 +CPU= 50.917
11:51:26 STEP 863 H= 215:45 +CPU= 48.600
11:52:39 STEP 864 H= 216:00 +CPU= 65.810
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000864
11:53:31 STEP 865 H= 216:15 +CPU= 51.505
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000864
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125_8.zip
Uploading the intermediate file: upload_file_8.zip
11:54:20 STEP 866 H= 216:30 +CPU= 49.418
11:55:12 STEP 867 H= 216:45 +CPU= 51.001
11:56:02 STEP 868 H= 217:00 +CPU= 50.116
11:56:51 STEP 869 H= 217:15 +CPU= 48.772
11:57:40 STEP 870 H= 217:30 +CPU= 48.864
11:58:27 STEP 871 H= 217:45 +CPU= 46.189
11:59:17 STEP 872 H= 218:00 +CPU= 49.350
12:00:04 STEP 873 H= 218:15 +CPU= 46.375
12:00:55 STEP 874 H= 218:30 +CPU= 50.580
12:01:50 STEP 875 H= 218:45 +CPU= 51.752
12:02:55 STEP 876 H= 219:00 +CPU= 63.935
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000876
12:03:52 STEP 877 H= 219:15 +CPU= 52.067
12:04:41 STEP 878 H= 219:30 +CPU= 48.004
12:05:29 STEP 879 H= 219:45 +CPU= 47.257
12:06:22 STEP 880 H= 220:00 +CPU= 53.469
12:07:12 STEP 881 H= 220:15 +CPU= 49.724
12:08:01 STEP 882 H= 220:30 +CPU= 48.058
12:08:52 STEP 883 H= 220:45 +CPU= 50.346
12:09:42 STEP 884 H= 221:00 +CPU= 49.634
12:10:27 STEP 885 H= 221:15 +CPU= 45.428
12:11:14 STEP 886 H= 221:30 +CPU= 45.707
12:12:04 STEP 887 H= 221:45 +CPU= 49.260
12:13:02 STEP 888 H= 222:00 +CPU= 56.137
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000888
12:13:50 STEP 889 H= 222:15 +CPU= 48.032
12:14:38 STEP 890 H= 222:30 +CPU= 47.482
12:15:25 STEP 891 H= 222:45 +CPU= 46.693
12:16:12 STEP 892 H= 223:00 +CPU= 46.285
12:16:57 STEP 893 H= 223:15 +CPU= 44.860
12:17:48 STEP 894 H= 223:30 +CPU= 49.569
12:18:43 STEP 895 H= 223:45 +CPU= 48.761
12:19:28 STEP 896 H= 224:00 +CPU= 45.387
12:20:15 STEP 897 H= 224:15 +CPU= 46.405
12:21:03 STEP 898 H= 224:30 +CPU= 47.488
12:21:52 STEP 899 H= 224:45 +CPU= 48.086
12:22:58 STEP 900 H= 225:00 +CPU= 63.245
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000900
12:23:45 STEP 901 H= 225:15 +CPU= 46.872
12:24:36 STEP 902 H= 225:30 +CPU= 49.747
12:25:26 STEP 903 H= 225:45 +CPU= 49.393
12:26:17 STEP 904 H= 226:00 +CPU= 48.073
12:27:05 STEP 905 H= 226:15 +CPU= 47.773
12:27:51 STEP 906 H= 226:30 +CPU= 45.443
12:28:39 STEP 907 H= 226:45 +CPU= 47.537
12:29:30 STEP 908 H= 227:00 +CPU= 50.154
12:30:19 STEP 909 H= 227:15 +CPU= 48.681
12:31:09 STEP 910 H= 227:30 +CPU= 49.511
12:32:00 STEP 911 H= 227:45 +CPU= 50.231
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2dd
(argv4) batchid: 991
(argv5) wuid: 12209860
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_874d224882a87bb57a02a322a6e2cc7d to: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_bl_a2dd_2016092300_15_991_12209860.zip
ic_ancil_file: ic_ancil_12209860
ifsdata_file: ifsdata_12209860
climate_data_file: clim_data_12209860
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12209860.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0bedee92b194e210c7079dec78b14c92 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12209860.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12209860.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12209860.xml
-- Model is restarting --
Adjusting last_iter, 912, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
last_cpu_time: 71066
upload_file_number: 9
last_iter: 913
last_upload: 778500
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125
The child process has been launched with process id: 859396
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:AHogben-P1:1:1:859396:859396] [20230223:123329:1677184409:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
12:34:27 STEP 912 H= 228:00 +CPU= 48.824
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000912
12:35:20 STEP 913 H= 228:15 +CPU= 51.321
12:36:06 STEP 914 H= 228:30 +CPU= 45.576
12:36:55 STEP 915 H= 228:45 +CPU= 49.197
12:37:43 STEP 916 H= 229:00 +CPU= 47.003
12:38:30 STEP 917 H= 229:15 +CPU= 46.813
12:39:16 STEP 918 H= 229:30 +CPU= 46.478
12:40:06 STEP 919 H= 229:45 +CPU= 49.432
12:40:56 STEP 920 H= 230:00 +CPU= 49.218
12:41:40 STEP 921 H= 230:15 +CPU= 44.142
12:42:32 STEP 922 H= 230:30 +CPU= 50.784
12:43:21 STEP 923 H= 230:45 +CPU= 48.853
12:44:24 STEP 924 H= 231:00 +CPU= 62.080
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000924
12:45:14 STEP 925 H= 231:15 +CPU= 49.742
12:46:03 STEP 926 H= 231:30 +CPU= 47.894
12:46:52 STEP 927 H= 231:45 +CPU= 48.936
12:47:43 STEP 928 H= 232:00 +CPU= 50.442
12:48:32 STEP 929 H= 232:15 +CPU= 48.273
12:49:19 STEP 930 H= 232:30 +CPU= 46.900
12:50:08 STEP 931 H= 232:45 +CPU= 48.597
12:51:00 STEP 932 H= 233:00 +CPU= 50.162
12:51:49 STEP 933 H= 233:15 +CPU= 48.054
12:52:42 STEP 934 H= 233:30 +CPU= 51.180
12:53:33 STEP 935 H= 233:45 +CPU= 50.371
12:54:40 STEP 936 H= 234:00 +CPU= 65.536
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000936
12:55:26 STEP 937 H= 234:15 +CPU= 45.518
12:56:15 STEP 938 H= 234:30 +CPU= 48.084
12:57:03 STEP 939 H= 234:45 +CPU= 47.832
12:57:53 STEP 940 H= 235:00 +CPU= 49.750
12:58:40 STEP 941 H= 235:15 +CPU= 46.086
12:59:27 STEP 942 H= 235:30 +CPU= 45.871
13:00:16 STEP 943 H= 235:45 +CPU= 48.699
13:01:08 STEP 944 H= 236:00 +CPU= 51.339
13:01:56 STEP 945 H= 236:15 +CPU= 48.381
13:02:48 STEP 946 H= 236:30 +CPU= 51.005
13:03:47 STEP 947 H= 236:45 +CPU= 57.581
13:04:51 STEP 948 H= 237:00 +CPU= 62.394
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000948
13:05:46 STEP 949 H= 237:15 +CPU= 54.089
13:06:39 STEP 950 H= 237:30 +CPU= 52.388
13:07:34 STEP 951 H= 237:45 +CPU= 53.801
13:08:34 STEP 952 H= 238:00 +CPU= 58.696
13:09:33 STEP 953 H= 238:15 +CPU= 56.806
13:10:27 STEP 954 H= 238:30 +CPU= 52.653
13:11:24 STEP 955 H= 238:45 +CPU= 56.313
13:12:18 STEP 956 H= 239:00 +CPU= 53.135
13:13:10 STEP 957 H= 239:15 +CPU= 50.440
13:14:06 STEP 958 H= 239:30 +CPU= 54.859
13:15:02 STEP 959 H= 239:45 +CPU= 55.437
13:16:35 STEP 960 H= 240:00 +CPU= 79.483
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000960
13:17:32 STEP 961 H= 240:15 +CPU= 55.081
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209860/ICMUAh7zg+000960
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2dd_2016092300_15_991_12209860_0_r938476125_9.zip
Uploading the intermediate file: upload_file_9.zip
13:18:31 STEP 962 H= 240:30 +CPU= 57.730
13:19:28 STEP 963 H= 240:45 +CPU= 56.514
13:20:27 STEP 964 H= 241:00 +CPU= 58.181
13:21:29 STEP 965 H= 241:15 +CPU= 57.058
13:22:26 STEP 966 H= 241:30 +CPU= 52.729
13:23:21 STEP 967 H= 241:45 +CPU= 54.755
13:24:14 STEP 968 H= 242:00 +CPU= 52.191
13:25:10 STEP 969 H= 242:15 +CPU= 55.916
13:26:06 STEP 970 H= 242:30 +CPU= 54.796
13:27:07 STEP 971 H= 242:45 +CPU= 60.918
13:28:10 STEP 972 H= 243:00 +CPU= 61.595
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000972
13:28:59 STEP 973 H= 243:15 +CPU= 48.757
13:29:46 STEP 974 H= 243:30 +CPU= 46.564
13:30:39 STEP 975 H= 243:45 +CPU= 52.041
13:31:31 STEP 976 H= 244:00 +CPU= 51.767
13:32:22 STEP 977 H= 244:15 +CPU= 51.003
13:33:12 STEP 978 H= 244:30 +CPU= 50.010
13:34:04 STEP 979 H= 244:45 +CPU= 50.912
13:34:55 STEP 980 H= 245:00 +CPU= 51.122
13:35:48 STEP 981 H= 245:15 +CPU= 52.209
13:36:41 STEP 982 H= 245:30 +CPU= 52.491
13:37:35 STEP 983 H= 245:45 +CPU= 52.149
13:38:40 STEP 984 H= 246:00 +CPU= 64.463
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000984
13:39:32 STEP 985 H= 246:15 +CPU= 50.899
13:40:26 STEP 986 H= 246:30 +CPU= 53.665
13:41:15 STEP 987 H= 246:45 +CPU= 49.284
13:42:08 STEP 988 H= 247:00 +CPU= 51.240
13:42:58 STEP 989 H= 247:15 +CPU= 49.863
13:43:57 STEP 990 H= 247:30 +CPU= 56.795
13:44:49 STEP 991 H= 247:45 +CPU= 51.743
13:45:43 STEP 992 H= 248:00 +CPU= 53.201
13:46:31 STEP 993 H= 248:15 +CPU= 46.515
13:47:20 STEP 994 H= 248:30 +CPU= 49.123
13:48:17 STEP 995 H= 248:45 +CPU= 55.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:49:59 STEP 996 H= 249:00 +CPU= 68.577
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAh7zg+000996
13:50:50 STEP 997 H= 249:15 +CPU= 49.923
13:51:44 STEP 998 H= 249:30 +CPU= 52.942
13:52:39 STEP 999 H= 249:45 +CPU= 53.961
13:53:34 STEP 1000 H= 250:00 +CPU= 53.730
13:54:33 STEP 1001 H= 250:15 +CPU= 57.463
13:55:30 STEP 1002 H= 250:30 +CPU= 56.450
13:56:21 STEP 1003 H= 250:45 +CPU= 47.808
13:57:09 STEP 1004 H= 251:00 +CPU= 46.398
Abort request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01
AVE 0.136104235804716E+00 0.000000000000000E+00 0.100000000000000E+01
GPNORM RFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.143578286734569E-07 0.000000000000000E+00 0.321911249177541E-04
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.287080664428151E-01 0.000000000000000E+00 0.100000000000000E+01
NSTEP = 996 STEPO A00000000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 996 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000996 MODE=w
IO-STREAM CLOSED - ICMGGh7zg+000996
MPI-TASK: 1 - 296179402 BYTES IN 6 RECORDS TRANSFERRED IN 0.0009 SECONDS329088.2 Mbytes/s, TOTAL TIME= 0.0755( 1.2%)
NSTEP = 996 STEPO 0AA000000
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMSHh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMSHh7zg+000996
MPI-TASK: 1 - 707765250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0152 SECONDS 46563.5 Mbytes/s, TOTAL TIME= 0.5920( 2.6%)
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 4738870423 BYTES IN 125 RECORDS TRANSFERRED IN 0.0086 SECONDS551031.4 Mbytes/s, TOTAL TIME= 0.4999( 1.7%)
STEPO_FPOS WAS : B00000F00E
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 287605769 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0063( 3.2%)
STEPO_FPOS WAS : V00000000Y
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 296179402 BYTES IN 4 RECORDS TRANSFERRED IN 0.0006 SECONDS493632.3 Mbytes/s, TOTAL TIME= 0.0156( 3.8%)
STEPO_FPOS WAS : T00000000M
NSTEP = 996 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 996 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000996 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+000996
MPI-TASK: 1 - 296179393 BYTES IN 7 RECORDS TRANSFERRED IN 0.0008 SECONDS370224.2 Mbytes/s, TOTAL TIME= 0.0194( 4.1%)
13:49:59 STEP 996 H= 249:00 +CPU= 68.577
NSTEP = 997 STEPO 0AAA00AAA
13:50:50 STEP 997 H= 249:15 +CPU= 49.923
NSTEP = 998 STEPO 0AAA00AAA
13:51:44 STEP 998 H= 249:30 +CPU= 52.942
NSTEP = 999 STEPO 0AAA00AAA
13:52:39 STEP 999 H= 249:45 +CPU= 53.961
ISTEP= 1000 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 1000 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 1000 STEPO 0AAA00AAA
13:53:34 STEP 1000 H= 250:00 +CPU= 53.730
NSTEP = 1001 STEPO 0AAA00AAA
13:54:33 STEP 1001 H= 250:15 +CPU= 57.463
NSTEP = 1002 STEPO 0AAA00AAA
13:55:30 STEP 1002 H= 250:30 +CPU= 56.450
NSTEP = 1003 STEPO 0AAA00AAA
13:56:21 STEP 1003 H= 250:45 +CPU= 47.808
NSTEP = 1004 STEPO 0AAA00AAA
13:57:09 STEP 1004 H= 251:00 +CPU= 46.398
ISTEP= 1005 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 1005 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 1005 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
13:51:44 0AAA00AAA STEPO 999 52.943 52.943 53.821 76:14 78:14 0.33449293112747E-06 2GB 0MB
13:52:39 0AAA00AAA STEPO 1000 53.961 53.961 55.266 77:08 79:09 0.33449293112747E-06 2GB 0MB
13:53:34 0AAA00AAA STEPO 1001 53.730 53.730 54.518 78:02 80:04 0.33449293112747E-06 2GB 0MB
13:54:33 0AAA00AAA STEPO 1002 57.463 57.463 59.261 78:59 81:03 0.33449293112747E-06 2GB 0MB
13:55:30 0AAA00AAA STEPO 1003 56.450 56.450 57.703 79:56 82:01 0.33449293112747E-06 2GB 0MB
13:56:21 0AAA00AAA STEPO 1004 47.810 47.810 50.651 80:44 82:51 0.33449293112747E-06 2GB 0MB
13:57:09 0AAA00AAA STEPO 1005 46.398 46.398 47.898 81:30 83:39 0.33449293112747E-06 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 960",
CTIME = "00100000 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 948, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/6/progress_file_12209860.xml
<running_values>
<last_cpu_time>75969.980000</last_cpu_time>
<upload_file_number>10</upload_file_number>
<last_iter>1005</last_iter>
<last_upload>864900</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
</stderr_txt>
]]>