Name | oifs_43r3_ps_1181_2021050100_123_946_12164270_2 |
Workunit | 12164270 |
Created | 13 Dec 2022, 10:04:32 UTC |
Sent | 13 Dec 2022, 10:09:00 UTC |
Report deadline | 12 Jan 2023, 10:09:00 UTC |
Received | 1 Jul 2023, 2:15:36 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Aborted by user |
Exit status | 203 (0x000000CB) EXIT_ABORTED_VIA_GUI |
Computer ID | 1479117 |
Run time | 2 days 18 hours 59 min 49 sec |
CPU time | 7 min 19 sec |
Validate state | Invalid |
Credit | 3,628.80 |
Device peak FLOPS | 4.50 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 3,585.17 MB |
Peak swap size | 4,974.81 MB |
Peak disk usage | 1,899.71 MB |
Stderr | <core_client_version>7.20.2</core_client_version> <![CDATA[ <message> aborted by user</message> <stderr_txt> _drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:380923:380923] [20230629:125959:1688068799:0.027] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:380923:380923] [20230629:125959:1688068799:0.027] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:380923:380923] [20230629:125959:1688068799:0.027] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:380923:380923] [20230629:125959:1688068799:0.027] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:380923:380923] [20230629:125959:1688068799:0.027] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1181 (argv4) batchid: 946 (argv5) wuid: 12164270 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /proj/boinc/slots/6 Project directory is: /proj/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_12164270 ..mkdir for temp folder for results failed Copying: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_eb696f350f96ba665f1e3663e6a2b720 to: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip Unzipping the namelist zip file: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip ic_ancil_file: ic_ancil_12164270 ifsdata_file: ifsdata_12164270 climate_data_file: clim_data_12164270 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /proj/boinc/slots/6/ic_ancil_12164270.zip Unzipping the IC ancils zip file: /proj/boinc/slots/6/ic_ancil_12164270.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8de872e8529053058a1813dead65d4c to: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip Unzipping the ifsdata_zip file: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip Unzipping the climate data zip file: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip ..Setting the core dump size to 0 failed Checking for progress XML file: /proj/boinc/slots/6/progress_file_12164270.xml Opened progress file ok : /proj/boinc/slots/6/progress_file_12164270.xml -- Model is restarting -- Adjusting last_iter, -999, to previous model restart step. Creating progress file: /proj/boinc/slots/6/progress_file_12164270.xml last_cpu_time: 327 upload_file_number: 1 last_iter: -985 last_upload: 3024000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1181_2021050100_123_946_12164270_2_r1777213756 The child process has been launched with process id: 2702 Executing the command: /proj/boinc/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:2702:2702] [20230629:220017:1688101217:0.008] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1181 (argv4) batchid: 946 (argv5) wuid: 12164270 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /proj/boinc/slots/6 Project directory is: /proj/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_12164270 ..mkdir for temp folder for results failed Copying: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_eb696f350f96ba665f1e3663e6a2b720 to: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip Unzipping the namelist zip file: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip ic_ancil_file: ic_ancil_12164270 ifsdata_file: ifsdata_12164270 climate_data_file: clim_data_12164270 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /proj/boinc/slots/6/ic_ancil_12164270.zip Unzipping the IC ancils zip file: /proj/boinc/slots/6/ic_ancil_12164270.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8de872e8529053058a1813dead65d4c to: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip Unzipping the ifsdata_zip file: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip Unzipping the climate data zip file: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip ..Setting the core dump size to 0 failed Checking for progress XML file: /proj/boinc/slots/6/progress_file_12164270.xml Opened progress file ok : /proj/boinc/slots/6/progress_file_12164270.xml -- Model is restarting -- Adjusting last_iter, 840, to previous model restart step. Creating progress file: /proj/boinc/slots/6/progress_file_12164270.xml last_cpu_time: 371 upload_file_number: 1 last_iter: 839 last_upload: 3024000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1181_2021050100_123_946_12164270_2_r1777213756 The child process has been launched with process id: 396007 Executing the command: /proj/boinc/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.042] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:396007:396007] [20230630:162120:1688167280:0.043] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1181 (argv4) batchid: 946 (argv5) wuid: 12164270 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /proj/boinc/slots/6 Project directory is: /proj/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_12164270 ..mkdir for temp folder for results failed Copying: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_eb696f350f96ba665f1e3663e6a2b720 to: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip Unzipping the namelist zip file: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip ic_ancil_file: ic_ancil_12164270 ifsdata_file: ifsdata_12164270 climate_data_file: clim_data_12164270 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /proj/boinc/slots/6/ic_ancil_12164270.zip Unzipping the IC ancils zip file: /proj/boinc/slots/6/ic_ancil_12164270.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8de872e8529053058a1813dead65d4c to: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip Unzipping the ifsdata_zip file: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip Unzipping the climate data zip file: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip ..Setting the core dump size to 0 failed Checking for progress XML file: /proj/boinc/slots/6/progress_file_12164270.xml Opened progress file ok : /proj/boinc/slots/6/progress_file_12164270.xml -- Model is restarting -- Adjusting last_iter, 840, to previous model restart step. Creating progress file: /proj/boinc/slots/6/progress_file_12164270.xml last_cpu_time: 429 upload_file_number: 1 last_iter: 839 last_upload: 3024000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1181_2021050100_123_946_12164270_2_r1777213756 The child process has been launched with process id: 407426 Executing the command: /proj/boinc/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:407426:407426] [20230630:171947:1688170787:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1181 (argv4) batchid: 946 (argv5) wuid: 12164270 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /proj/boinc/slots/6 Project directory is: /proj/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_12164270 ..mkdir for temp folder for results failed Copying: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_eb696f350f96ba665f1e3663e6a2b720 to: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip Unzipping the namelist zip file: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip ic_ancil_file: ic_ancil_12164270 ifsdata_file: ifsdata_12164270 climate_data_file: clim_data_12164270 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /proj/boinc/slots/6/ic_ancil_12164270.zip Unzipping the IC ancils zip file: /proj/boinc/slots/6/ic_ancil_12164270.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8de872e8529053058a1813dead65d4c to: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip Unzipping the ifsdata_zip file: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip Unzipping the climate data zip file: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip ..Setting the core dump size to 0 failed Checking for progress XML file: /proj/boinc/slots/6/progress_file_12164270.xml Opened progress file ok : /proj/boinc/slots/6/progress_file_12164270.xml -- Model is restarting -- Adjusting last_iter, -999, to previous model restart step. Creating progress file: /proj/boinc/slots/6/progress_file_12164270.xml last_cpu_time: 433 upload_file_number: 1 last_iter: -985 last_upload: 3024000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1181_2021050100_123_946_12164270_2_r1777213756 The child process has been launched with process id: 408134 Executing the command: /proj/boinc/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:408134:408134] [20230630:172339:1688171019:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1181 (argv4) batchid: 946 (argv5) wuid: 12164270 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /proj/boinc/slots/6 Project directory is: /proj/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_12164270 ..mkdir for temp folder for results failed Copying: /proj/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /proj/boinc/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_eb696f350f96ba665f1e3663e6a2b720 to: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip Unzipping the namelist zip file: /proj/boinc/slots/6/oifs_43r3_ps_1181_2021050100_123_946_12164270.zip ic_ancil_file: ic_ancil_12164270 ifsdata_file: ifsdata_12164270 climate_data_file: clim_data_12164270 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /proj/boinc/slots/6/ic_ancil_12164270.zip Unzipping the IC ancils zip file: /proj/boinc/slots/6/ic_ancil_12164270.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8de872e8529053058a1813dead65d4c to: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip Unzipping the ifsdata_zip file: /proj/boinc/slots/6/ifsdata/ifsdata_12164270.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip Unzipping the climate data zip file: /proj/boinc/slots/6/159l_2/clim_data_12164270.zip ..Setting the core dump size to 0 failed Checking for progress XML file: /proj/boinc/slots/6/progress_file_12164270.xml Opened progress file ok : /proj/boinc/slots/6/progress_file_12164270.xml -- Model is restarting -- Adjusting last_iter, -999, to previous model restart step. Creating progress file: /proj/boinc/slots/6/progress_file_12164270.xml last_cpu_time: 436 upload_file_number: 1 last_iter: -985 last_upload: 3024000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1181_2021050100_123_946_12164270_2_r1777213756 The child process has been launched with process id: 409261 Executing the command: /proj/boinc/slots/6/oifs_43r3_model.exe Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.074] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.075] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:reno.shadybrook.net:1:1:409261:409261] [20230630:172932:1688171372:0.075] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Abort request received from the BOINC client, ending the child process </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 15:45:00 | 1479117 | 22250190 | oifs_43r3_ps_1181_2021050100_123_946_12164270_2 | 2,592,000 | 22,646 | 0.0087 |
09 May 2023 15:44:37 | 1479117 | 22250190 | oifs_43r3_ps_1181_2021050100_123_946_12164270_2 | 1,728,000 | 14,734 | 0.0085 |
09 May 2023 15:42:15 | 1479117 | 22250190 | oifs_43r3_ps_1181_2021050100_123_946_12164270_2 | 864,000 | 7,132 | 0.0083 |
©2024 cpdn.org