Name | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 |
Workunit | 12163429 |
Created | 30 Nov 2022, 14:40:13 UTC |
Sent | 30 Nov 2022, 15:25:51 UTC |
Report deadline | 30 Dec 2022, 15:25:51 UTC |
Received | 4 Dec 2022, 23:15:45 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 148 (0x00000094) Unknown error code |
Computer ID | 1531033 |
Run time | 10 hours 30 min 52 sec |
CPU time | 15 sec |
Validate state | Invalid |
Credit | 2,661.12 |
Device peak FLOPS | 7.38 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.01 x86_64-pc-linux-gnu |
Peak working set size | 3,047.63 MB |
Peak swap size | 3,644.91 MB |
Peak disk usage | 4,284.76 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 148 (0x94, -108)</message> <stderr_txt> 163429 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_88dee6c4553d95262ee1e6b679b0bd0a to: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b6ea1a525722378a533accf44b8271f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0340_2021050100_123_945_12163429_2_r36499071 The child process has been launched with process id: 263226 Executing the command: /var/lib/boinc-client/slots/2/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263226:263226] [20221205:102213:1670188933:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 0340 (argv4) batchid: 945 (argv5) wuid: 12163429 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163429 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1254395aea54f7a338c0b1eff2ad65aa to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip ic_ancil_file: ic_ancil_12163429 ifsdata_file: ifsdata_12163429 climate_data_file: clim_data_12163429 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_88dee6c4553d95262ee1e6b679b0bd0a to: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b6ea1a525722378a533accf44b8271f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0340_2021050100_123_945_12163429_2_r36499071 The child process has been launched with process id: 263288 Executing the command: /var/lib/boinc-client/slots/2/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:263288:263288] [20221205:102345:1670189025:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 0340 (argv4) batchid: 945 (argv5) wuid: 12163429 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163429 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1254395aea54f7a338c0b1eff2ad65aa to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip ic_ancil_file: ic_ancil_12163429 ifsdata_file: ifsdata_12163429 climate_data_file: clim_data_12163429 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_88dee6c4553d95262ee1e6b679b0bd0a to: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b6ea1a525722378a533accf44b8271f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0340_2021050100_123_945_12163429_2_r36499071 The child process has been launched with process id: 265696 Executing the command: /var/lib/boinc-client/slots/2/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265696:265696] [20221205:102628:1670189188:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 0340 (argv4) batchid: 945 (argv5) wuid: 12163429 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163429 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1254395aea54f7a338c0b1eff2ad65aa to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip ic_ancil_file: ic_ancil_12163429 ifsdata_file: ifsdata_12163429 climate_data_file: clim_data_12163429 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_88dee6c4553d95262ee1e6b679b0bd0a to: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b6ea1a525722378a533accf44b8271f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0340_2021050100_123_945_12163429_2_r36499071 The child process has been launched with process id: 265813 Executing the command: /var/lib/boinc-client/slots/2/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:orinoco:1:1:265813:265813] [20221205:102758:1670189278:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process double free or corruption (top) (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 0340 (argv4) batchid: 945 (argv5) wuid: 12163429 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163429 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1254395aea54f7a338c0b1eff2ad65aa to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0340_2021050100_123_945_12163429.zip ic_ancil_file: ic_ancil_12163429 ifsdata_file: ifsdata_12163429 climate_data_file: clim_data_12163429 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_88dee6c4553d95262ee1e6b679b0bd0a to: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12163429.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b6ea1a525722378a533accf44b8271f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12163429.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12163429.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0340_2021050100_123_945_12163429_2_r36499071 The child process has been launched with process id: 3890 Executing the command: /var/lib/boinc-client/slots/2/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:orinoco:1:1:3890:3890] [20221205:103202:1670189522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/s </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 15:33:49 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,987,200 | 2,007 | 0.0010 |
09 May 2023 15:33:49 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,900,800 | 1,327 | 0.0007 |
09 May 2023 15:33:46 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,814,400 | 664 | 0.0004 |
09 May 2023 15:33:42 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,728,000 | 1,611 | 0.0009 |
09 May 2023 15:31:08 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,641,600 | 1,023 | 0.0006 |
09 May 2023 15:31:08 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,555,200 | 545 | 0.0004 |
09 May 2023 15:27:09 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,468,800 | 4,538 | 0.0031 |
09 May 2023 15:27:09 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,382,400 | 3,892 | 0.0028 |
09 May 2023 15:27:00 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,296,000 | 3,234 | 0.0025 |
09 May 2023 15:27:00 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,209,600 | 2,595 | 0.0021 |
09 May 2023 15:26:52 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,123,200 | 1,954 | 0.0017 |
09 May 2023 15:26:52 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 1,036,800 | 1,324 | 0.0013 |
09 May 2023 15:26:43 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 950,400 | 720 | 0.0008 |
09 May 2023 15:26:25 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 864,000 | 5,192 | 0.0060 |
09 May 2023 15:26:17 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 777,600 | 4,548 | 0.0058 |
09 May 2023 15:26:17 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 691,200 | 3,875 | 0.0056 |
09 May 2023 15:26:07 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 604,800 | 3,285 | 0.0054 |
09 May 2023 15:26:08 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 518,400 | 2,709 | 0.0052 |
09 May 2023 15:25:58 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 432,000 | 2,101 | 0.0049 |
09 May 2023 15:25:58 | 1531033 | 22248612 | oifs_43r3_ps_0340_2021050100_123_945_12163429_2 | 345,600 | 1,383 | 0.0040 |
©2024 cpdn.org