Name | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 |
Workunit | 12164896 |
Created | 29 Nov 2022, 12:21:28 UTC |
Sent | 30 Nov 2022, 6:19:36 UTC |
Report deadline | 30 Dec 2022, 6:19:36 UTC |
Received | 30 Nov 2022, 9:54:30 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Aborted by user |
Exit status | 203 (0x000000CB) EXIT_ABORTED_VIA_GUI |
Computer ID | 1534233 |
Run time | 2 hours 14 min 52 sec |
CPU time | 13 sec |
Validate state | Invalid |
Credit | 967.68 |
Device peak FLOPS | 4.05 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.01 x86_64-pc-linux-gnu |
Peak working set size | 4,397.73 MB |
Peak swap size | 4,977.96 MB |
Peak disk usage | 2,045.55 MB |
Stderr | <core_client_version>7.16.16</core_client_version> <![CDATA[ <message> aborted by user</message> <stderr_txt> ir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 9677 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:9677:9677] [20221130:032615:1669796775:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 03:27:22 STEP 96 H= 96:00 +CPU= 53.042 03:28:08 STEP 97 H= 97:00 +CPU= 29.296 03:28:55 STEP 98 H= 98:00 +CPU= 30.447 03:29:54 STEP 99 H= 99:00 +CPU= 48.076 03:30:28 STEP 100 H= 100:00 +CPU= 30.382 03:30:59 STEP 101 H= 101:00 +CPU= 29.396 03:31:51 STEP 102 H= 102:00 +CPU= 48.559 03:32:23 STEP 103 H= 103:00 +CPU= 29.458 03:32:55 STEP 104 H= 104:00 +CPU= 30.287 03:33:46 STEP 105 H= 105:00 +CPU= 47.536 03:34:18 STEP 106 H= 106:00 +CPU= 30.379 03:34:49 STEP 107 H= 107:00 +CPU= 29.499 03:35:45 STEP 108 H= 108:00 +CPU= 52.672 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000108 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000108 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000108 03:36:16 STEP 109 H= 109:00 +CPU= 29.546 03:36:50 STEP 110 H= 110:00 +CPU= 30.443 03:37:40 STEP 111 H= 111:00 +CPU= 47.691 03:38:13 STEP 112 H= 112:00 +CPU= 30.446 03:38:45 STEP 113 H= 113:00 +CPU= 29.555 03:39:37 STEP 114 H= 114:00 +CPU= 48.607 03:40:09 STEP 115 H= 115:00 +CPU= 29.531 03:40:42 STEP 116 H= 116:00 +CPU= 30.315 03:41:33 STEP 117 H= 117:00 +CPU= 47.592 03:42:06 STEP 118 H= 118:00 +CPU= 30.327 03:42:37 STEP 119 H= 119:00 +CPU= 30.252 03:43:38 STEP 120 H= 120:00 +CPU= 55.473 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000120 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000120 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000108 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837_1.zip Uploading the intermediate file: upload_file_1.zip Uploading trickle at timestep: 432000 03:44:10 STEP 121 H= 121:00 +CPU= 29.566 03:44:43 STEP 122 H= 122:00 +CPU= 30.394 03:45:33 STEP 123 H= 123:00 +CPU= 47.554 03:46:06 STEP 124 H= 124:00 +CPU= 30.393 03:46:37 STEP 125 H= 125:00 +CPU= 29.541 03:47:28 STEP 126 H= 126:00 +CPU= 48.614 03:48:00 STEP 127 H= 127:00 +CPU= 29.609 03:48:32 STEP 128 H= 128:00 +CPU= 30.374 03:49:23 STEP 129 H= 129:00 +CPU= 47.669 03:49:55 STEP 130 H= 130:00 +CPU= 30.460 03:50:27 STEP 131 H= 131:00 +CPU= 29.699 03:51:24 STEP 132 H= 132:00 +CPU= 52.908 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000132 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000132 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000132 03:51:55 STEP 133 H= 133:00 +CPU= 29.575 03:52:27 STEP 134 H= 134:00 +CPU= 30.494 03:53:18 STEP 135 H= 135:00 +CPU= 47.750 03:53:51 STEP 136 H= 136:00 +CPU= 30.486 03:54:22 STEP 137 H= 137:00 +CPU= 29.597 03:55:14 STEP 138 H= 138:00 +CPU= 48.709 03:55:46 STEP 139 H= 139:00 +CPU= 29.669 03:56:18 STEP 140 H= 140:00 +CPU= 30.501 03:57:09 STEP 141 H= 141:00 +CPU= 47.716 03:57:42 STEP 142 H= 142:00 +CPU= 30.452 03:58:14 STEP 143 H= 143:00 +CPU= 30.442 03:59:14 STEP 144 H= 144:00 +CPU= 55.273 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000144 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000144 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000132 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837_2.zip Uploading the intermediate file: upload_file_2.zip Uploading trickle at timestep: 518400 03:59:45 STEP 145 H= 145:00 +CPU= 29.639 04:00:19 STEP 146 H= 146:00 +CPU= 30.643 04:01:10 STEP 147 H= 147:00 +CPU= 47.951 04:01:43 STEP 148 H= 148:00 +CPU= 30.614 04:02:15 STEP 149 H= 149:00 +CPU= 29.822 04:03:07 STEP 150 H= 150:00 +CPU= 48.975 04:03:42 STEP 151 H= 151:00 +CPU= 29.886 04:04:16 STEP 152 H= 152:00 +CPU= 31.053 04:05:08 STEP 153 H= 153:00 +CPU= 47.974 04:05:40 STEP 154 H= 154:00 +CPU= 30.722 04:06:12 STEP 155 H= 155:00 +CPU= 29.900 04:07:09 STEP 156 H= 156:00 +CPU= 53.043 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000156 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000156 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000156 04:07:41 STEP 157 H= 157:00 +CPU= 29.892 04:08:13 STEP 158 H= 158:00 +CPU= 30.742 04:09:10 STEP 159 H= 159:00 +CPU= 48.473 04:09:49 STEP 160 H= 160:00 +CPU= 31.341 04:10:25 STEP 161 H= 161:00 +CPU= 30.279 04:11:22 STEP 162 H= 162:00 +CPU= 49.502 04:11:56 STEP 163 H= 163:00 +CPU= 30.192 04:12:31 STEP 164 H= 164:00 +CPU= 31.044 04:13:26 STEP 165 H= 165:00 +CPU= 48.387 04:14:02 STEP 166 H= 166:00 +CPU= 30.989 04:14:35 STEP 167 H= 167:00 +CPU= 30.765 04:15:42 STEP 168 H= 168:00 +CPU= 56.283 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000168 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000168 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000156 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837_3.zip Uploading the intermediate file: upload_file_3.zip Uploading trickle at timestep: 604800 04:16:17 STEP 169 H= 169:00 +CPU= 30.045 04:16:52 STEP 170 H= 170:00 +CPU= 30.950 04:17:47 STEP 171 H= 171:00 +CPU= 48.294 04:18:22 STEP 172 H= 172:00 +CPU= 30.944 04:18:55 STEP 173 H= 173:00 +CPU= 29.978 04:19:51 STEP 174 H= 174:00 +CPU= 49.298 04:20:24 STEP 175 H= 175:00 +CPU= 30.128 04:20:59 STEP 176 H= 176:00 +CPU= 30.970 04:21:53 STEP 177 H= 177:00 +CPU= 48.303 04:22:28 STEP 178 H= 178:00 +CPU= 31.033 04:23:00 STEP 179 H= 179:00 +CPU= 29.910 04:23:57 STEP 180 H= 180:00 +CPU= 53.123 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000180 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000180 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000180 04:24:32 STEP 181 H= 181:00 +CPU= 30.159 04:25:13 STEP 182 H= 182:00 +CPU= 31.364 04:26:10 STEP 183 H= 183:00 +CPU= 48.422 04:26:43 STEP 184 H= 184:00 +CPU= 30.748 04:27:15 STEP 185 H= 185:00 +CPU= 29.894 04:28:08 STEP 186 H= 186:00 +CPU= 49.080 04:28:42 STEP 187 H= 187:00 +CPU= 29.985 04:29:15 STEP 188 H= 188:00 +CPU= 30.771 04:30:06 STEP 189 H= 189:00 +CPU= 47.936 04:30:39 STEP 190 H= 190:00 +CPU= 30.826 04:31:12 STEP 191 H= 191:00 +CPU= 30.743 04:32:15 STEP 192 H= 192:00 +CPU= 56.009 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhpi1+000192 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhpi1+000192 Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhpi1+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMGGhpi1+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMSHhpi1+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896/ICMUAhpi1+000180 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837_4.zip Uploading the intermediate file: upload_file_4.zip Uploading trickle at timestep: 691200 04:32:48 STEP 193 H= 193:00 +CPU= 30.418 (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 8577 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.006] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.006] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.007] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.007] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.007] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.008] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.009] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.009] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.010] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.010] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.010] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.011] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.015] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.015] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.016] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:8577:8577] [20221130:043441:1669800881:0.016] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 04:35:54 STEP 192 H= 192:00 +CPU= 55.485 (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 7357 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.006] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.006] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.007] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.007] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.008] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.008] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.009] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.009] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.010] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.010] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:7357:7357] [20221130:043740:1669801060:0.015] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 22920 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:22920:22920] [20221130:043858:1669801138:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 31091 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:31091:31091] [20221130:044003:1669801203:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 1807 (argv4) batchid: 946 (argv5) wuid: 12164896 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/5 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.01 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164896 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_0547b75cf36478704912a194ad99e259 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_1807_2021050100_123_946_12164896.zip ic_ancil_file: ic_ancil_12164896 ifsdata_file: ifsdata_12164896 climate_data_file: clim_data_12164896 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 Copying IC ancils from: ../../projects/climateprediction.net/jf_1301d26c6254c9acd665a99f46937aa2 to: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12164896.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8e202e8b300424e4f2ed7c0a75913ea to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12164896.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12164896.zip total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_1807_2021050100_123_946_12164896_0_r1620727837 The child process has been launched with process id: 10027 Executing the command: /var/lib/boinc-client/slots/5/./master.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.009] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.009] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.010] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.010] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.010] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.011] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.011] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.012] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.013] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.014] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:ratchet:1:1:10027:10027] [20221130:044401:1669801441:0.014] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Quit request received from BOINC client, ending the child process </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 15:11:23 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 691,200 | 3,589 | 0.0052 |
09 May 2023 15:11:15 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 604,800 | 2,699 | 0.0045 |
09 May 2023 15:11:15 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 518,400 | 1,815 | 0.0035 |
09 May 2023 15:11:15 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 432,000 | 940 | 0.0022 |
09 May 2023 15:10:45 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 345,600 | 3,480 | 0.0101 |
09 May 2023 15:10:45 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 259,200 | 2,616 | 0.0101 |
09 May 2023 15:10:45 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 172,800 | 1,761 | 0.0102 |
09 May 2023 15:10:24 | 1534233 | 22246900 | oifs_43r3_ps_1807_2021050100_123_946_12164896_0 | 86,400 | 908 | 0.0105 |
©2024 cpdn.org