Name | oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0 |
Workunit | 12293142 |
Created | 13 Jun 2024, 2:59:30 UTC |
Sent | 14 Jun 2024, 9:13:57 UTC |
Report deadline | 13 Aug 2024, 9:13:57 UTC |
Received | 15 Jun 2024, 11:10:09 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 148 (0x00000094) Unknown error code |
Computer ID | 1082842 |
Run time | 32 min 35 sec |
CPU time | 8 min 29 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 5.90 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,451.79 MB |
Peak swap size | 5,981.08 MB |
Peak disk usage | 262.95 MB |
Stderr | <core_client_version>7.22.0</core_client_version> <![CDATA[ <message> process exited with code 148 (0x94, -108)</message> <stderr_txt> oinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 3, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 268 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 24486 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:24486:24486] [20240615:105108:1718441468:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:54:31 STEP 0 H= 0:00 +CPU= 22.220 Moving to projects directory: /d6/home/boinc/slots/4/ICMGGh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMSHh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMUAh7zg+000000 10:56:08 STEP 1 H= 0:15 +CPU= 15.299 10:58:15 STEP 2 H= 0:30 +CPU= 16.967 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fd158c54c87b603237fc81bf4c347a61 to: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip Unzipping the ifsdata_zip file: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Unzipping the climate data zip file: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 3, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 325 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 32247 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:32247:32247] [20240615:105957:1718441997:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fd158c54c87b603237fc81bf4c347a61 to: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip Unzipping the ifsdata_zip file: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Unzipping the climate data zip file: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 0, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 341 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 3942 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:3942:3942] [20240615:110400:1718442240:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:06:21 STEP 0 H= 0:00 +CPU= 19.672 Moving to projects directory: /d6/home/boinc/slots/4/ICMGGh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMSHh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMUAh7zg+000000 11:07:38 STEP 1 H= 0:15 +CPU= 15.383 11:08:49 STEP 2 H= 0:30 +CPU= 15.272 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fd158c54c87b603237fc81bf4c347a61 to: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip Unzipping the ifsdata_zip file: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Unzipping the climate data zip file: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 2, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 393 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 13895 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:13895:13895] [20240615:111208:1718442728:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process 11:13:49 STEP 0 H= 0:00 +CPU= 18.494 Resuming the child process Moving to projects directory: /d6/home/boinc/slots/4/ICMGGh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMSHh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMUAh7zg+000000 11:14:51 STEP 1 H= 0:15 +CPU= 15.949 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:16:06 STEP 2 H= 0:30 +CPU= 14.949 11:17:29 STEP 3 H= 0:45 +CPU= 15.432 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fd158c54c87b603237fc81bf4c347a61 to: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip Unzipping the ifsdata_zip file: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Unzipping the climate data zip file: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 4, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 467 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 21496 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:21496:21496] [20240615:111946:1718443186:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:25:13 STEP 0 H= 0:00 +CPU= 21.118 Moving to projects directory: /d6/home/boinc/slots/4/ICMGGh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMSHh7zg+000000 Moving to projects directory: /d6/home/boinc/slots/4/ICMUAh7zg+000000 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fd158c54c87b603237fc81bf4c347a61 to: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip Unzipping the ifsdata_zip file: /d6/home/boinc/slots/4/ifsdata/ifsdata_12293142.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Unzipping the climate data zip file: /d6/home/boinc/slots/4/159l_2/clim_data_12293142.zip Checking for progress XML file: /d6/home/boinc/slots/4/progress_file_12293142.xml Opened progress file ok : /d6/home/boinc/slots/4/progress_file_12293142.xml -- Model is restarting -- Adjusting last_iter, 1, to previous model restart step. Creating progress file: /d6/home/boinc/slots/4/progress_file_12293142.xml last_cpu_time: 494 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a3pr_2016092300_20_1018_12293142_0_r1279532432 The child process has been launched with process id: 30500 Executing the command: /d6/home/boinc/slots/4/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jmp01:1:1:30500:30500] [20240615:112752:1718443672:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Quit request received from the BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip Unzipping the IC ancils zip file: /d6/home/boinc/slots/4/ic_ancil_12293142.zip (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a3pr (argv4) batchid: 1018 (argv5) wuid: 12293142 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /d6/home/boinc/slots/4 Project directory is: /d6/home/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_12293142 ..mkdir for temp folder for results failed Copying: /d6/home/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_b434056dbd49eb5348507bf36b637329 to: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip Unzipping the namelist zip file: /d6/home/boinc/slots/4/oifs_43r3_bl_a3pr_2016092300_20_1018_12293142.zip ic_ancil_file: ic_ancil_12293142 ifsdata_file: ifsdata_12293142 climate_data_file: clim_data_12293142 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: to: /d6/home/boinc/slots/4/ic_ancil_12293142.zip ..Copying the IC ancils to the working directory failed </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org