Name | oifs_43r3_ps_0515_1996050100_123_965_12182159_0 |
Workunit | 12182159 |
Created | 22 Dec 2022, 11:10:48 UTC |
Sent | 20 Jan 2023, 10:32:21 UTC |
Report deadline | 21 Mar 2023, 10:32:21 UTC |
Received | 21 Jan 2023, 1:17:30 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1534746 |
Run time | 57 min 35 sec |
CPU time | 14 min 59 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 5.61 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,472.58 MB |
Peak swap size | 4,974.14 MB |
Peak disk usage | 1,209.77 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1996050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0515 (argv4) batchid: 965 (argv5) wuid: 12182159 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc/slots/7 Project directory is: /var/lib/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159 Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_67d34c420fdbe3edf016c7f0cc811dec to: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip Unzipping the namelist zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip ic_ancil_file: ic_ancil_12182159 ifsdata_file: ifsdata_12182159 climate_data_file: clim_data_12182159 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_9f73cf09585dc8649b199fa12c060a92 to: /var/lib/boinc/slots/7/ic_ancil_12182159.zip Unzipping the IC ancils zip file: /var/lib/boinc/slots/7/ic_ancil_12182159.zip Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1c08ca4058722773a88870fc054d80d0 to: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip Unzipping the ifsdata_zip file: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Unzipping the climate data zip file: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Checking for progress XML file: /var/lib/boinc/slots/7/progress_file_12182159.xml Creating progress file: /var/lib/boinc/slots/7/progress_file_12182159.xml last_cpu_time: 0 upload_file_number: 0 last_iter: 0 last_upload: 0 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0515_1996050100_123_965_12182159_0_r1496828168 The child process has been launched with process id: 1846 Executing the command: /var/lib/boinc/slots/7/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:1846:1846] [20230120:173521:1674210921:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:35:54 STEP 0 H= 0:00 +CPU= 28.734 Moving to projects directory: /var/lib/boinc/slots/7/ICMGGhq0f+000000 Moving to projects directory: /var/lib/boinc/slots/7/ICMSHhq0f+000000 Moving to projects directory: /var/lib/boinc/slots/7/ICMUAhq0f+000000 17:36:16 STEP 1 H= 1:00 +CPU= 21.436 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:36:34 STEP 2 H= 2:00 +CPU= 16.183 17:37:03 STEP 3 H= 3:00 +CPU= 28.947 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:37:22 STEP 4 H= 4:00 +CPU= 17.085 17:37:38 STEP 5 H= 5:00 +CPU= 16.138 17:38:02 STEP 6 H= 6:00 +CPU= 24.205 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:38:18 STEP 7 H= 7:00 +CPU= 13.481 17:38:31 STEP 8 H= 8:00 +CPU= 13.692 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:38:55 STEP 9 H= 9:00 +CPU= 21.847 17:39:10 STEP 10 H= 10:00 +CPU= 14.899 17:39:25 STEP 11 H= 11:00 +CPU= 14.388 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:39:54 STEP 12 H= 12:00 +CPU= 26.926 Moving to projects directory: /var/lib/boinc/slots/7/ICMGGhq0f+000012 Moving to projects directory: /var/lib/boinc/slots/7/ICMSHhq0f+000012 Moving to projects directory: /var/lib/boinc/slots/7/ICMUAhq0f+000012 17:40:08 STEP 13 H= 13:00 +CPU= 14.407 17:40:22 STEP 14 H= 14:00 +CPU= 13.810 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:40:47 STEP 15 H= 15:00 +CPU= 23.254 17:41:01 STEP 16 H= 16:00 +CPU= 13.966 17:41:15 STEP 17 H= 17:00 +CPU= 13.809 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:41:42 STEP 18 H= 18:00 +CPU= 25.330 17:41:57 STEP 19 H= 19:00 +CPU= 14.938 17:42:12 STEP 20 H= 20:00 +CPU= 14.980 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 18:24:35 STEP 21 H= 21:00 +CPU= 51.242 18:24:51 STEP 22 H= 22:00 +CPU= 15.910 Suspend request received from the BOINC client, suspending the child process Resuming the child process 18:25:10 STEP 23 H= 23:00 +CPU= 16.639 Suspend request received from the BOINC client, suspending the child process Resuming the child process 18:25:57 STEP 24 H= 24:00 +CPU= 34.290 Moving to projects directory: /var/lib/boinc/slots/7/ICMGGhq0f+000024 Moving to projects directory: /var/lib/boinc/slots/7/ICMSHhq0f+000024 Moving to projects directory: /var/lib/boinc/slots/7/ICMUAhq0f+000024 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMGGhq0f+000000 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMSHhq0f+000000 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMUAhq0f+000000 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMGGhq0f+000012 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMSHhq0f+000012 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159/ICMUAhq0f+000012 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0515_1996050100_123_965_12182159_0_r1496828168_0.zip Uploading the intermediate file: upload_file_0.zip Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 22:30:21 STEP 25 H= 25:00 +CPU= 71.273 22:30:36 STEP 26 H= 26:00 +CPU= 15.474 Suspend request received from the BOINC client, suspending the child process Resuming the child process 22:31:04 STEP 27 H= 27:00 +CPU= 25.714 22:31:20 STEP 28 H= 28:00 +CPU= 15.812 23:23:20 STEP 29 H= 29:00 +CPU= 26.128 (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1996050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0515 (argv4) batchid: 965 (argv5) wuid: 12182159 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc/slots/7 Project directory is: /var/lib/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159 ..mkdir for temp folder for results failed Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_67d34c420fdbe3edf016c7f0cc811dec to: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip Unzipping the namelist zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip ic_ancil_file: ic_ancil_12182159 ifsdata_file: ifsdata_12182159 climate_data_file: clim_data_12182159 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_9f73cf09585dc8649b199fa12c060a92 to: /var/lib/boinc/slots/7/ic_ancil_12182159.zip Unzipping the IC ancils zip file: /var/lib/boinc/slots/7/ic_ancil_12182159.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1c08ca4058722773a88870fc054d80d0 to: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip Unzipping the ifsdata_zip file: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Unzipping the climate data zip file: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Checking for progress XML file: /var/lib/boinc/slots/7/progress_file_12182159.xml Opened progress file ok : /var/lib/boinc/slots/7/progress_file_12182159.xml -- Model is restarting -- Adjusting last_iter, 29, to previous model restart step. Creating progress file: /var/lib/boinc/slots/7/progress_file_12182159.xml last_cpu_time: 644 upload_file_number: 1 last_iter: 23 last_upload: 86400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0515_1996050100_123_965_12182159_0_r1496828168 The child process has been launched with process id: 2244 Executing the command: /var/lib/boinc/slots/7/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2244:2244] [20230120:232334:1674231814:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:42:56 STEP 24 H= 24:00 +CPU=105.223 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1996050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0515 (argv4) batchid: 965 (argv5) wuid: 12182159 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc/slots/7 Project directory is: /var/lib/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159 ..mkdir for temp folder for results failed Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1996050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0515 (argv4) batchid: 965 (argv5) wuid: 12182159 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc/slots/7 Project directory is: /var/lib/boinc/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182159 ..mkdir for temp folder for results failed Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_67d34c420fdbe3edf016c7f0cc811dec to: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip Unzipping the namelist zip file: /var/lib/boinc/slots/7/oifs_43r3_ps_0515_1996050100_123_965_12182159.zip ic_ancil_file: ic_ancil_12182159 ifsdata_file: ifsdata_12182159 climate_data_file: clim_data_12182159 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_9f73cf09585dc8649b199fa12c060a92 to: /var/lib/boinc/slots/7/ic_ancil_12182159.zip Unzipping the IC ancils zip file: /var/lib/boinc/slots/7/ic_ancil_12182159.zip ..mkdir for ifsdata folder failed 06:21:55 STEP 25 H= 25:00 +CPU=239.390 Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1c08ca4058722773a88870fc054d80d0 to: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip Unzipping the ifsdata_zip file: /var/lib/boinc/slots/7/ifsdata/ifsdata_12182159.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Unzipping the climate data zip file: /var/lib/boinc/slots/7/159l_2/clim_data_12182159.zip Checking for progress XML file: /var/lib/boinc/slots/7/progress_file_12182159.xml Opened progress file ok : /var/lib/boinc/slots/7/progress_file_12182159.xml -- Model is restarting -- Adjusting last_iter, 25, to previous model restart step. Creating progress file: /var/lib/boinc/slots/7/progress_file_12182159.xml last_cpu_time: 762 upload_file_number: 1 last_iter: 23 last_upload: 86400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0515_1996050100_123_965_12182159_0_r1496828168 The child process has been launched with process id: 2899 Executing the command: /var/lib/boinc/slots/7/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:vm9:1:1:2899:2899] [20230121:062158:1674256918:0.004] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process The child process terminated with status: 0 ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 climateprediction.net