Name | oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0 |
Workunit | 12211286 |
Created | 13 Feb 2023, 20:17:31 UTC |
Sent | 14 Feb 2023, 4:01:28 UTC |
Report deadline | 15 Apr 2023, 4:01:28 UTC |
Received | 15 Feb 2023, 11:23:55 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1495420 |
Run time | 3 hours 15 min 1 sec |
CPU time | 3 hours 11 min 28 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 5.91 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.11 x86_64-pc-linux-gnu |
Peak working set size | 5,577.31 MB |
Peak swap size | 5,930.79 MB |
Peak disk usage | 1,293.98 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> _12211286/ICMGGh7zg+000072 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000072 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000072 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000084 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000084 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000084 Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0_r1883319543_0.zip Uploading the intermediate file: upload_file_0.zip 23:44:43 STEP 97 H= 24:15 +CPU= 20.195 23:45:04 STEP 98 H= 24:30 +CPU= 21.346 23:45:24 STEP 99 H= 24:45 +CPU= 19.533 23:45:45 STEP 100 H= 25:00 +CPU= 20.881 23:46:05 STEP 101 H= 25:15 +CPU= 20.515 23:46:26 STEP 102 H= 25:30 +CPU= 21.120 23:46:47 STEP 103 H= 25:45 +CPU= 21.042 23:47:08 STEP 104 H= 26:00 +CPU= 20.326 23:47:29 STEP 105 H= 26:15 +CPU= 20.894 23:47:47 STEP 106 H= 26:30 +CPU= 17.962 23:48:08 STEP 107 H= 26:45 +CPU= 20.791 23:48:33 STEP 108 H= 27:00 +CPU= 25.505 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000108 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000108 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000108 23:48:56 STEP 109 H= 27:15 +CPU= 22.854 23:49:17 STEP 110 H= 27:30 +CPU= 20.990 23:49:38 STEP 111 H= 27:45 +CPU= 21.515 23:49:59 STEP 112 H= 28:00 +CPU= 20.089 23:50:17 STEP 113 H= 28:15 +CPU= 18.358 23:50:36 STEP 114 H= 28:30 +CPU= 18.785 23:50:55 STEP 115 H= 28:45 +CPU= 18.639 23:51:15 STEP 116 H= 29:00 +CPU= 20.600 23:51:37 STEP 117 H= 29:15 +CPU= 22.125 23:51:59 STEP 118 H= 29:30 +CPU= 21.712 23:52:19 STEP 119 H= 29:45 +CPU= 20.143 23:52:41 STEP 120 H= 30:00 +CPU= 21.485 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000120 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000120 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000120 23:53:03 STEP 121 H= 30:15 +CPU= 22.437 23:53:26 STEP 122 H= 30:30 +CPU= 22.349 23:53:46 STEP 123 H= 30:45 +CPU= 20.232 23:54:06 STEP 124 H= 31:00 +CPU= 19.737 23:54:28 STEP 125 H= 31:15 +CPU= 22.564 23:54:49 STEP 126 H= 31:30 +CPU= 20.738 23:55:07 STEP 127 H= 31:45 +CPU= 17.718 23:55:27 STEP 128 H= 32:00 +CPU= 20.733 23:55:48 STEP 129 H= 32:15 +CPU= 20.223 23:56:09 STEP 130 H= 32:30 +CPU= 21.253 23:56:26 STEP 131 H= 32:45 +CPU= 16.989 23:56:53 STEP 132 H= 33:00 +CPU= 26.965 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000132 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000132 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000132 23:57:15 STEP 133 H= 33:15 +CPU= 22.115 23:57:36 STEP 134 H= 33:30 +CPU= 20.786 23:57:56 STEP 135 H= 33:45 +CPU= 20.482 23:58:19 STEP 136 H= 34:00 +CPU= 22.362 23:58:40 STEP 137 H= 34:15 +CPU= 21.684 23:59:03 STEP 138 H= 34:30 +CPU= 22.060 23:59:23 STEP 139 H= 34:45 +CPU= 20.258 23:59:44 STEP 140 H= 35:00 +CPU= 20.663 00:00:04 STEP 141 H= 35:15 +CPU= 19.974 00:00:25 STEP 142 H= 35:30 +CPU= 21.434 00:00:48 STEP 143 H= 35:45 +CPU= 22.689 00:01:19 STEP 144 H= 36:00 +CPU= 30.708 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000144 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000144 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000144 00:01:41 STEP 145 H= 36:15 +CPU= 22.149 00:02:03 STEP 146 H= 36:30 +CPU= 22.283 00:02:26 STEP 147 H= 36:45 +CPU= 22.628 00:02:50 STEP 148 H= 37:00 +CPU= 23.257 00:03:12 STEP 149 H= 37:15 +CPU= 22.027 00:03:34 STEP 150 H= 37:30 +CPU= 21.957 00:03:57 STEP 151 H= 37:45 +CPU= 22.016 00:04:19 STEP 152 H= 38:00 +CPU= 22.305 00:04:42 STEP 153 H= 38:15 +CPU= 22.728 00:05:05 STEP 154 H= 38:30 +CPU= 22.753 00:05:27 STEP 155 H= 38:45 +CPU= 21.851 00:05:57 STEP 156 H= 39:00 +CPU= 29.521 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000156 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000156 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000156 00:06:19 STEP 157 H= 39:15 +CPU= 22.164 00:06:42 STEP 158 H= 39:30 +CPU= 22.753 00:07:05 STEP 159 H= 39:45 +CPU= 22.930 00:07:28 STEP 160 H= 40:00 +CPU= 22.514 00:07:50 STEP 161 H= 40:15 +CPU= 22.322 00:08:14 STEP 162 H= 40:30 +CPU= 23.372 00:08:37 STEP 163 H= 40:45 +CPU= 23.191 00:09:01 STEP 164 H= 41:00 +CPU= 23.799 00:09:24 STEP 165 H= 41:15 +CPU= 23.333 00:09:48 STEP 166 H= 41:30 +CPU= 23.169 00:10:10 STEP 167 H= 41:45 +CPU= 21.893 00:10:39 STEP 168 H= 42:00 +CPU= 28.588 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000168 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000168 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000168 00:11:01 STEP 169 H= 42:15 +CPU= 22.340 00:11:24 STEP 170 H= 42:30 +CPU= 22.373 00:11:47 STEP 171 H= 42:45 +CPU= 22.745 00:12:11 STEP 172 H= 43:00 +CPU= 23.307 00:12:33 STEP 173 H= 43:15 +CPU= 22.365 00:12:56 STEP 174 H= 43:30 +CPU= 22.550 00:13:19 STEP 175 H= 43:45 +CPU= 22.375 00:13:42 STEP 176 H= 44:00 +CPU= 23.337 00:14:05 STEP 177 H= 44:15 +CPU= 22.293 00:14:27 STEP 178 H= 44:30 +CPU= 21.989 00:14:50 STEP 179 H= 44:45 +CPU= 23.011 00:15:19 STEP 180 H= 45:00 +CPU= 28.393 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000180 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000180 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000180 00:15:42 STEP 181 H= 45:15 +CPU= 22.658 00:16:04 STEP 182 H= 45:30 +CPU= 21.896 00:16:25 STEP 183 H= 45:45 +CPU= 21.142 00:16:48 STEP 184 H= 46:00 +CPU= 23.180 00:17:10 STEP 185 H= 46:15 +CPU= 21.677 00:17:32 STEP 186 H= 46:30 +CPU= 21.916 00:17:55 STEP 187 H= 46:45 +CPU= 22.362 00:18:17 STEP 188 H= 47:00 +CPU= 22.774 00:18:39 STEP 189 H= 47:15 +CPU= 21.660 00:19:01 STEP 190 H= 47:30 +CPU= 21.917 00:19:23 STEP 191 H= 47:45 +CPU= 21.977 00:19:55 STEP 192 H= 48:00 +CPU= 30.843 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000192 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000192 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000192 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000096 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000096 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000096 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000108 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000108 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000108 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000120 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000120 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000120 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000132 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000132 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000132 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000144 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000144 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000144 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000156 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000156 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000156 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000168 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000168 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000168 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000180 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000180 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000180 Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0_r1883319543_1.zip Uploading the intermediate file: upload_file_1.zip 00:20:18 STEP 193 H= 48:15 +CPU= 22.089 00:20:41 STEP 194 H= 48:30 +CPU= 23.179 00:21:04 STEP 195 H= 48:45 +CPU= 22.707 00:21:28 STEP 196 H= 49:00 +CPU= 22.844 00:21:50 STEP 197 H= 49:15 +CPU= 21.987 00:22:12 STEP 198 H= 49:30 +CPU= 22.197 00:22:35 STEP 199 H= 49:45 +CPU= 21.997 00:22:57 STEP 200 H= 50:00 +CPU= 22.520 00:23:20 STEP 201 H= 50:15 +CPU= 22.092 00:23:43 STEP 202 H= 50:30 +CPU= 22.386 00:24:07 STEP 203 H= 50:45 +CPU= 23.139 00:24:37 STEP 204 H= 51:00 +CPU= 29.710 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000204 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000204 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000204 00:25:01 STEP 205 H= 51:15 +CPU= 22.414 00:25:23 STEP 206 H= 51:30 +CPU= 22.595 00:25:46 STEP 207 H= 51:45 +CPU= 22.016 00:26:11 STEP 208 H= 52:00 +CPU= 23.133 00:26:34 STEP 209 H= 52:15 +CPU= 22.538 00:26:55 STEP 210 H= 52:30 +CPU= 21.059 00:27:19 STEP 211 H= 52:45 +CPU= 22.754 00:27:43 STEP 212 H= 53:00 +CPU= 23.979 00:28:06 STEP 213 H= 53:15 +CPU= 22.606 00:28:30 STEP 214 H= 53:30 +CPU= 22.121 00:28:53 STEP 215 H= 53:45 +CPU= 22.480 00:29:24 STEP 216 H= 54:00 +CPU= 29.689 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000216 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000216 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000216 00:29:47 STEP 217 H= 54:15 +CPU= 22.961 00:30:11 STEP 218 H= 54:30 +CPU= 23.332 00:30:33 STEP 219 H= 54:45 +CPU= 21.868 00:30:56 STEP 220 H= 55:00 +CPU= 22.293 00:31:19 STEP 221 H= 55:15 +CPU= 22.683 00:31:41 STEP 222 H= 55:30 +CPU= 22.287 00:32:04 STEP 223 H= 55:45 +CPU= 22.066 00:32:28 STEP 224 H= 56:00 +CPU= 23.944 00:32:52 STEP 225 H= 56:15 +CPU= 23.065 00:33:15 STEP 226 H= 56:30 +CPU= 22.606 00:33:39 STEP 227 H= 56:45 +CPU= 23.657 00:34:09 STEP 228 H= 57:00 +CPU= 29.193 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000228 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000228 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000228 00:34:32 STEP 229 H= 57:15 +CPU= 22.522 00:34:54 STEP 230 H= 57:30 +CPU= 22.178 00:35:17 STEP 231 H= 57:45 +CPU= 22.254 00:35:41 STEP 232 H= 58:00 +CPU= 24.061 00:36:06 STEP 233 H= 58:15 +CPU= 23.819 00:36:31 STEP 234 H= 58:30 +CPU= 23.796 00:36:55 STEP 235 H= 58:45 +CPU= 23.301 00:37:20 STEP 236 H= 59:00 +CPU= 23.950 00:37:43 STEP 237 H= 59:15 +CPU= 22.896 00:38:07 STEP 238 H= 59:30 +CPU= 23.477 00:38:30 STEP 239 H= 59:45 +CPU= 23.165 00:39:02 STEP 240 H= 60:00 +CPU= 31.101 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000240 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000240 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000240 00:39:26 STEP 241 H= 60:15 +CPU= 23.403 00:39:48 STEP 242 H= 60:30 +CPU= 21.858 00:40:11 STEP 243 H= 60:45 +CPU= 21.706 00:40:34 STEP 244 H= 61:00 +CPU= 23.394 00:40:58 STEP 245 H= 61:15 +CPU= 22.955 00:41:20 STEP 246 H= 61:30 +CPU= 22.362 00:41:44 STEP 247 H= 61:45 +CPU= 22.869 00:42:08 STEP 248 H= 62:00 +CPU= 23.774 00:42:30 STEP 249 H= 62:15 +CPU= 22.370 00:42:53 STEP 250 H= 62:30 +CPU= 22.615 00:43:16 STEP 251 H= 62:45 +CPU= 22.324 00:43:46 STEP 252 H= 63:00 +CPU= 29.110 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000252 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000252 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000252 00:44:10 STEP 253 H= 63:15 +CPU= 22.864 00:44:33 STEP 254 H= 63:30 +CPU= 23.057 00:44:55 STEP 255 H= 63:45 +CPU= 22.359 00:45:20 STEP 256 H= 64:00 +CPU= 24.171 00:45:43 STEP 257 H= 64:15 +CPU= 22.372 00:46:06 STEP 258 H= 64:30 +CPU= 23.028 00:46:29 STEP 259 H= 64:45 +CPU= 21.965 00:46:51 STEP 260 H= 65:00 +CPU= 22.217 00:47:14 STEP 261 H= 65:15 +CPU= 22.692 00:47:37 STEP 262 H= 65:30 +CPU= 23.307 00:48:00 STEP 263 H= 65:45 +CPU= 22.369 00:48:29 STEP 264 H= 66:00 +CPU= 28.585 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000264 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000264 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000264 00:48:50 STEP 265 H= 66:15 +CPU= 21.000 00:49:13 STEP 266 H= 66:30 +CPU= 22.662 00:49:35 STEP 267 H= 66:45 +CPU= 22.285 00:49:59 STEP 268 H= 67:00 +CPU= 23.408 00:50:23 STEP 269 H= 67:15 +CPU= 23.085 00:50:46 STEP 270 H= 67:30 +CPU= 22.553 00:51:09 STEP 271 H= 67:45 +CPU= 23.246 00:51:34 STEP 272 H= 68:00 +CPU= 23.961 00:51:57 STEP 273 H= 68:15 +CPU= 23.388 00:52:20 STEP 274 H= 68:30 +CPU= 22.691 00:52:44 STEP 275 H= 68:45 +CPU= 23.227 00:53:14 STEP 276 H= 69:00 +CPU= 29.871 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000276 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000276 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000276 00:53:37 STEP 277 H= 69:15 +CPU= 22.734 00:54:01 STEP 278 H= 69:30 +CPU= 22.755 00:54:24 STEP 279 H= 69:45 +CPU= 23.132 00:54:49 STEP 280 H= 70:00 +CPU= 24.201 00:55:12 STEP 281 H= 70:15 +CPU= 22.769 00:55:36 STEP 282 H= 70:30 +CPU= 22.545 00:55:58 STEP 283 H= 70:45 +CPU= 22.153 00:56:23 STEP 284 H= 71:00 +CPU= 24.010 00:56:48 STEP 285 H= 71:15 +CPU= 23.923 00:57:12 STEP 286 H= 71:30 +CPU= 23.461 00:57:35 STEP 287 H= 71:45 +CPU= 22.407 00:58:09 STEP 288 H= 72:00 +CPU= 33.230 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000288 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000288 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000288 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000192 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000192 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000192 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000204 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000204 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000204 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000216 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000216 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000216 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000228 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000228 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000228 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000240 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000240 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000240 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000252 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000252 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000252 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000264 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000264 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000264 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000276 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000276 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000276 Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0_r1883319543_2.zip Uploading the intermediate file: upload_file_2.zip 00:58:33 STEP 289 H= 72:15 +CPU= 23.192 00:58:56 STEP 290 H= 72:30 +CPU= 22.032 00:59:20 STEP 291 H= 72:45 +CPU= 23.525 00:59:45 STEP 292 H= 73:00 +CPU= 24.275 01:00:08 STEP 293 H= 73:15 +CPU= 23.075 01:00:32 STEP 294 H= 73:30 +CPU= 22.837 01:00:57 STEP 295 H= 73:45 +CPU= 23.471 01:01:20 STEP 296 H= 74:00 +CPU= 23.094 01:01:44 STEP 297 H= 74:15 +CPU= 23.256 01:02:07 STEP 298 H= 74:30 +CPU= 22.794 01:02:31 STEP 299 H= 74:45 +CPU= 22.964 01:03:02 STEP 300 H= 75:00 +CPU= 29.545 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000300 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000300 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000300 01:03:25 STEP 301 H= 75:15 +CPU= 22.567 01:03:49 STEP 302 H= 75:30 +CPU= 23.371 01:04:14 STEP 303 H= 75:45 +CPU= 23.462 01:04:39 STEP 304 H= 76:00 +CPU= 24.119 01:05:03 STEP 305 H= 76:15 +CPU= 23.543 01:05:27 STEP 306 H= 76:30 +CPU= 23.235 01:05:51 STEP 307 H= 76:45 +CPU= 23.243 01:06:15 STEP 308 H= 77:00 +CPU= 24.865 01:06:39 STEP 309 H= 77:15 +CPU= 23.601 01:07:04 STEP 310 H= 77:30 +CPU= 23.932 01:07:29 STEP 311 H= 77:45 +CPU= 23.069 01:07:59 STEP 312 H= 78:00 +CPU= 29.817 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000312 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000312 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000312 01:08:23 STEP 313 H= 78:15 +CPU= 24.012 01:08:47 STEP 314 H= 78:30 +CPU= 23.115 01:09:10 STEP 315 H= 78:45 +CPU= 22.629 01:09:35 STEP 316 H= 79:00 +CPU= 24.490 01:09:59 STEP 317 H= 79:15 +CPU= 23.280 01:10:21 STEP 318 H= 79:30 +CPU= 21.484 01:10:45 STEP 319 H= 79:45 +CPU= 23.519 01:11:10 STEP 320 H= 80:00 +CPU= 24.096 01:11:33 STEP 321 H= 80:15 +CPU= 23.255 01:11:56 STEP 322 H= 80:30 +CPU= 23.312 01:12:19 STEP 323 H= 80:45 +CPU= 22.538 01:12:50 STEP 324 H= 81:00 +CPU= 30.157 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000324 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000324 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000324 01:13:14 STEP 325 H= 81:15 +CPU= 23.576 01:13:38 STEP 326 H= 81:30 +CPU= 23.180 01:14:01 STEP 327 H= 81:45 +CPU= 22.915 01:14:25 STEP 328 H= 82:00 +CPU= 23.998 01:14:49 STEP 329 H= 82:15 +CPU= 23.076 01:15:12 STEP 330 H= 82:30 +CPU= 22.739 01:15:36 STEP 331 H= 82:45 +CPU= 24.170 01:16:02 STEP 332 H= 83:00 +CPU= 24.679 01:16:25 STEP 333 H= 83:15 +CPU= 23.301 01:16:49 STEP 334 H= 83:30 +CPU= 23.647 01:17:13 STEP 335 H= 83:45 +CPU= 23.293 01:17:48 STEP 336 H= 84:00 +CPU= 33.222 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000336 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000336 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000336 01:18:12 STEP 337 H= 84:15 +CPU= 23.240 01:18:35 STEP 338 H= 84:30 +CPU= 23.242 01:18:58 STEP 339 H= 84:45 +CPU= 22.880 01:19:22 STEP 340 H= 85:00 +CPU= 23.166 01:19:45 STEP 341 H= 85:15 +CPU= 22.091 01:20:08 STEP 342 H= 85:30 +CPU= 22.851 01:20:32 STEP 343 H= 85:45 +CPU= 23.686 01:20:57 STEP 344 H= 86:00 +CPU= 24.382 01:21:20 STEP 345 H= 86:15 +CPU= 22.383 01:21:43 STEP 346 H= 86:30 +CPU= 23.746 01:22:07 STEP 347 H= 86:45 +CPU= 23.517 01:22:38 STEP 348 H= 87:00 +CPU= 29.907 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000348 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000348 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000348 01:23:01 STEP 349 H= 87:15 +CPU= 23.491 01:23:25 STEP 350 H= 87:30 +CPU= 23.450 01:23:48 STEP 351 H= 87:45 +CPU= 22.329 01:24:12 STEP 352 H= 88:00 +CPU= 23.309 01:24:36 STEP 353 H= 88:15 +CPU= 23.339 01:24:59 STEP 354 H= 88:30 +CPU= 22.857 01:25:22 STEP 355 H= 88:45 +CPU= 22.452 01:25:45 STEP 356 H= 89:00 +CPU= 22.839 01:26:08 STEP 357 H= 89:15 +CPU= 22.694 01:26:31 STEP 358 H= 89:30 +CPU= 23.687 01:26:56 STEP 359 H= 89:45 +CPU= 23.158 01:27:25 STEP 360 H= 90:00 +CPU= 29.003 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000360 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000360 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000360 01:27:47 STEP 361 H= 90:15 +CPU= 22.168 01:28:10 STEP 362 H= 90:30 +CPU= 22.477 01:28:35 STEP 363 H= 90:45 +CPU= 24.096 01:29:00 STEP 364 H= 91:00 +CPU= 24.971 01:29:23 STEP 365 H= 91:15 +CPU= 22.945 01:29:48 STEP 366 H= 91:30 +CPU= 23.851 01:30:12 STEP 367 H= 91:45 +CPU= 24.016 01:30:36 STEP 368 H= 92:00 +CPU= 23.976 01:31:00 STEP 369 H= 92:15 +CPU= 22.820 01:31:23 STEP 370 H= 92:30 +CPU= 22.926 01:31:46 STEP 371 H= 92:45 +CPU= 22.713 01:32:17 STEP 372 H= 93:00 +CPU= 31.391 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000372 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000372 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000372 01:32:42 STEP 373 H= 93:15 +CPU= 24.325 01:33:07 STEP 374 H= 93:30 +CPU= 23.961 01:33:30 STEP 375 H= 93:45 +CPU= 23.169 01:33:55 STEP 376 H= 94:00 +CPU= 24.971 01:34:18 STEP 377 H= 94:15 +CPU= 22.615 01:34:40 STEP 378 H= 94:30 +CPU= 21.595 01:35:03 STEP 379 H= 94:45 +CPU= 22.536 01:35:25 STEP 380 H= 95:00 +CPU= 22.628 01:35:48 STEP 381 H= 95:15 +CPU= 22.418 01:36:11 STEP 382 H= 95:30 +CPU= 23.043 01:36:34 STEP 383 H= 95:45 +CPU= 22.729 01:37:06 STEP 384 H= 96:00 +CPU= 31.670 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000384 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000384 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000384 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000288 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000288 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000288 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000300 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000300 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000300 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000312 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000312 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000312 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000324 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000324 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000324 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000336 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000336 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000336 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000348 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000348 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000348 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000360 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000360 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000360 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000372 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000372 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000372 Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0_r1883319543_3.zip Uploading the intermediate file: upload_file_3.zip 01:37:29 STEP 385 H= 96:15 +CPU= 22.635 01:37:53 STEP 386 H= 96:30 +CPU= 22.843 01:38:16 STEP 387 H= 96:45 +CPU= 21.995 01:38:39 STEP 388 H= 97:00 +CPU= 23.400 01:39:03 STEP 389 H= 97:15 +CPU= 23.769 01:39:29 STEP 390 H= 97:30 +CPU= 23.734 01:39:52 STEP 391 H= 97:45 +CPU= 22.786 01:40:15 STEP 392 H= 98:00 +CPU= 22.697 01:40:37 STEP 393 H= 98:15 +CPU= 22.062 01:40:59 STEP 394 H= 98:30 +CPU= 21.664 01:41:22 STEP 395 H= 98:45 +CPU= 22.481 01:41:52 STEP 396 H= 99:00 +CPU= 30.251 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000396 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000396 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000396 01:42:16 STEP 397 H= 99:15 +CPU= 23.762 01:42:40 STEP 398 H= 99:30 +CPU= 23.621 01:43:04 STEP 399 H= 99:45 +CPU= 23.740 01:43:30 STEP 400 H= 100:00 +CPU= 24.256 01:43:53 STEP 401 H= 100:15 +CPU= 23.434 01:44:18 STEP 402 H= 100:30 +CPU= 24.302 01:44:43 STEP 403 H= 100:45 +CPU= 24.272 01:45:07 STEP 404 H= 101:00 +CPU= 24.254 01:45:31 STEP 405 H= 101:15 +CPU= 23.265 01:45:54 STEP 406 H= 101:30 +CPU= 23.526 01:46:19 STEP 407 H= 101:45 +CPU= 23.737 01:46:49 STEP 408 H= 102:00 +CPU= 29.729 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000408 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000408 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000408 01:47:12 STEP 409 H= 102:15 +CPU= 23.276 01:47:35 STEP 410 H= 102:30 +CPU= 22.547 01:47:57 STEP 411 H= 102:45 +CPU= 21.982 01:48:21 STEP 412 H= 103:00 +CPU= 23.527 01:48:45 STEP 413 H= 103:15 +CPU= 23.733 01:49:08 STEP 414 H= 103:30 +CPU= 23.004 01:49:33 STEP 415 H= 103:45 +CPU= 24.033 01:49:57 STEP 416 H= 104:00 +CPU= 24.391 01:50:20 STEP 417 H= 104:15 +CPU= 22.668 01:50:44 STEP 418 H= 104:30 +CPU= 23.395 01:51:07 STEP 419 H= 104:45 +CPU= 23.415 01:51:38 STEP 420 H= 105:00 +CPU= 30.349 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000420 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000420 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000420 01:52:03 STEP 421 H= 105:15 +CPU= 23.721 01:52:27 STEP 422 H= 105:30 +CPU= 23.717 01:52:50 STEP 423 H= 105:45 +CPU= 22.638 01:53:15 STEP 424 H= 106:00 +CPU= 24.424 01:53:38 STEP 425 H= 106:15 +CPU= 23.009 01:54:02 STEP 426 H= 106:30 +CPU= 23.532 01:54:26 STEP 427 H= 106:45 +CPU= 23.351 01:54:50 STEP 428 H= 107:00 +CPU= 23.908 01:55:13 STEP 429 H= 107:15 +CPU= 22.987 01:55:36 STEP 430 H= 107:30 +CPU= 23.175 01:55:58 STEP 431 H= 107:45 +CPU= 21.643 01:56:32 STEP 432 H= 108:00 +CPU= 33.041 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000432 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000432 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000432 01:56:56 STEP 433 H= 108:15 +CPU= 23.665 01:57:19 STEP 434 H= 108:30 +CPU= 22.736 01:57:43 STEP 435 H= 108:45 +CPU= 23.832 01:58:08 STEP 436 H= 109:00 +CPU= 24.636 01:58:31 STEP 437 H= 109:15 +CPU= 23.203 01:58:55 STEP 438 H= 109:30 +CPU= 23.416 01:59:19 STEP 439 H= 109:45 +CPU= 23.600 01:59:44 STEP 440 H= 110:00 +CPU= 24.473 02:00:08 STEP 441 H= 110:15 +CPU= 23.459 02:00:31 STEP 442 H= 110:30 +CPU= 23.374 02:00:54 STEP 443 H= 110:45 +CPU= 22.648 02:01:25 STEP 444 H= 111:00 +CPU= 30.554 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000444 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000444 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000444 02:01:48 STEP 445 H= 111:15 +CPU= 23.324 02:02:12 STEP 446 H= 111:30 +CPU= 23.760 02:02:36 STEP 447 H= 111:45 +CPU= 23.756 02:03:02 STEP 448 H= 112:00 +CPU= 25.385 02:03:26 STEP 449 H= 112:15 +CPU= 22.907 02:03:49 STEP 450 H= 112:30 +CPU= 22.944 02:04:11 STEP 451 H= 112:45 +CPU= 22.475 02:04:36 STEP 452 H= 113:00 +CPU= 24.415 02:05:00 STEP 453 H= 113:15 +CPU= 23.398 02:05:24 STEP 454 H= 113:30 +CPU= 23.600 02:05:48 STEP 455 H= 113:45 +CPU= 23.562 02:06:18 STEP 456 H= 114:00 +CPU= 29.343 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000456 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000456 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000456 02:06:42 STEP 457 H= 114:15 +CPU= 23.973 02:07:06 STEP 458 H= 114:30 +CPU= 23.895 02:07:29 STEP 459 H= 114:45 +CPU= 22.676 02:07:53 STEP 460 H= 115:00 +CPU= 23.448 02:08:15 STEP 461 H= 115:15 +CPU= 22.202 02:08:37 STEP 462 H= 115:30 +CPU= 22.037 02:08:59 STEP 463 H= 115:45 +CPU= 21.884 02:09:23 STEP 464 H= 116:00 +CPU= 23.854 02:09:47 STEP 465 H= 116:15 +CPU= 22.743 02:10:10 STEP 466 H= 116:30 +CPU= 23.605 02:10:35 STEP 467 H= 116:45 +CPU= 23.609 02:11:06 STEP 468 H= 117:00 +CPU= 30.698 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000468 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000468 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000468 02:11:29 STEP 469 H= 117:15 +CPU= 23.773 02:11:53 STEP 470 H= 117:30 +CPU= 23.011 02:12:17 STEP 471 H= 117:45 +CPU= 23.455 02:12:42 STEP 472 H= 118:00 +CPU= 24.481 02:13:05 STEP 473 H= 118:15 +CPU= 22.896 02:13:29 STEP 474 H= 118:30 +CPU= 23.412 02:13:53 STEP 475 H= 118:45 +CPU= 23.494 02:14:17 STEP 476 H= 119:00 +CPU= 24.039 02:14:42 STEP 477 H= 119:15 +CPU= 23.663 02:15:06 STEP 478 H= 119:30 +CPU= 23.756 02:15:31 STEP 479 H= 119:45 +CPU= 23.802 02:16:04 STEP 480 H= 120:00 +CPU= 32.772 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000480 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000480 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000480 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000384 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000384 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000384 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000396 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000396 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000396 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000408 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000408 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000408 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000420 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000420 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000420 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000432 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000432 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000432 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000444 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000444 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000444 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000456 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000456 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000456 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMGGh7zg+000468 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMSHh7zg+000468 Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211286/ICMUAh7zg+000468 Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gz_2016092300_15_991_12211286_0_r1883319543_4.zip Uploading the intermediate file: upload_file_4.zip 02:16:29 STEP 481 H= 120:15 +CPU= 24.122 02:16:51 STEP 482 H= 120:30 +CPU= 22.431 02:17:13 STEP 483 H= 120:45 +CPU= 21.639 02:17:38 STEP 484 H= 121:00 +CPU= 24.700 02:18:02 STEP 485 H= 121:15 +CPU= 22.716 02:18:27 STEP 486 H= 121:30 +CPU= 23.539 02:18:51 STEP 487 H= 121:45 +CPU= 23.450 02:19:14 STEP 488 H= 122:00 +CPU= 22.856 02:19:38 STEP 489 H= 122:15 +CPU= 23.854 02:20:01 STEP 490 H= 122:30 +CPU= 22.698 02:20:24 STEP 491 H= 122:45 +CPU= 23.630 02:20:55 STEP 492 H= 123:00 +CPU= 30.320 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMGGh7zg+000492 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMSHh7zg+000492 Moving to projects directory: /mnt/sn770/boinc-client/slots/8/ICMUAh7zg+000492 02:21:18 STEP 493 H= 123:15 +CPU= 23.558 02:21:42 STEP 494 H= 123:30 +CPU= 23.690 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.933] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5594MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.946] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.946] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil)) [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.946] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.946] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.946] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5594 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022157:1676456517:11636.948] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/mnt/sn770/boinc-client/slots/8/oifs_43r3_model.exe' : sigcontextptr=0x7ffd954b3f50 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/mnt/sn770/boinc-client/slots/8/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:? [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022158:1676456518:11637.948] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/mnt/sn770/boinc-client/slots/8/oifs_43r3_model.exe' : sigcontextptr=0x7ffd954b3e60 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/mnt/sn770/boinc-client/slots/8/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022159:1676456519:11638.078] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:S8026:1:1:2351248:2351248] [20230215:022159:1676456519:11638.078] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC4A8F Unknown Unknown Unknown oifs_43r3_model.e 00000000012D283B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 00000000012BA8D9 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000012B0762 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000001163FC3 callpar_ 869 callpar.F90 oifs_43r3_model.e 00000000010B682F ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 00000000010A915C ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90 oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90 oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 AVE 0.228334752101582E-05 0.000000000000000E+00 0.567209524693124E-02 GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM AVE 0.859064438098084E-05 0.000000000000000E+00 0.696525034000389E-02 GPNORM SNOW AVERAGE MINIMUM MAXIMUM AVE 0.354614117857887E-04 0.000000000000000E+00 0.174761694679782E-01 GPNORM RAIN AVERAGE MINIMUM MAXIMUM AVE 0.629440261127092E-05 0.000000000000000E+00 0.643069297630786E-02 GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM AVE 0.204884038871233E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.223781308156780E-05 0.000000000000000E+00 0.644092189382611E-02 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.849382234380279E-05 0.000000000000000E+00 0.736918689888690E-02 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.204930323384711E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.214741340696915E-04 0.000000000000000E+00 0.212276988600047E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.953076681310341E-05 0.000000000000000E+00 0.503461635139729E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.421705058046813E-05 0.000000000000000E+00 0.162596845104553E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.635338653239582E-06 0.000000000000000E+00 0.849190224365947E-02 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.111287567575885E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 492 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 492 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000492 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000492 MPI-TASK: 1 - 302346506 BYTES IN 6 RECORDS TRANSFERRED IN 0.0004 SECONDS755866.2 Mbytes/s, TOTAL TIME= 0.0097( 4.1%) NSTEP = 492 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000492 MODE=a IO-STREAM CLOSED - ./ICMSHh7zg+000492 MPI-TASK: 1 - 707765250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0108 SECONDS 65533.8 Mbytes/s, TOTAL TIME= 0.2724( 4.0%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000492 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000492 MPI-TASK: 1 - 4837544087 BYTES IN 125 RECORDS TRANSFERRED IN 0.0078 SECONDS620198.0 Mbytes/s, TOTAL TIME= 0.2163( 3.6%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000492 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000492 MPI-TASK: 1 - 293772873 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0047( 4.3%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000492 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000492 MPI-TASK: 1 - 302346506 BYTES IN 4 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0077( 3.9%) STEPO_FPOS WAS : T00000000M NSTEP = 492 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 492 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000492 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000492 MPI-TASK: 1 - 302346497 BYTES IN 7 RECORDS TRANSFERRED IN 0.0005 SECONDS604693.0 Mbytes/s, TOTAL TIME= 0.0108( 4.6%) 02:20:55 STEP 492 H= 123:00 +CPU= 30.320 NSTEP = 493 STEPO 0AAA00AAA 02:21:18 STEP 493 H= 123:15 +CPU= 23.558 NSTEP = 494 STEPO 0AAA00AAA 02:21:42 STEP 494 H= 123:30 +CPU= 23.690 ISTEP= 495 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 495 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 495 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 02:20:26 FULLPOS-B DYNFPOS 492 1.267 1.267 1.267 189:57 192:25 0.27600812550717E-04 2GB 0MB 02:20:29 FULLPOS-V DYNFPOS 492 3.118 3.118 3.119 190:00 192:28 0.27600812550717E-04 2GB 0MB 02:20:30 FULLPOS-T DYNFPOS 492 0.609 0.609 0.609 190:00 192:29 0.27600812550717E-04 2GB 0MB 02:20:30 0AAA00AAA STEPO 492 0.590 0.590 0.590 190:01 192:29 0.27600812550717E-04 2GB 0MB 02:20:55 0AAA00AAA STEPO 493 24.597 24.597 24.599 190:26 192:54 0.27600812550717E-04 2GB 0MB 02:21:18 0AAA00AAA STEPO 494 23.558 23.558 23.560 190:49 193:17 0.27600812550717E-04 2GB 0MB 02:21:42 0AAA00AAA STEPO 495 23.690 23.690 23.692 191:13 193:41 0.27600812550717E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 480", CTIME = "00050000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 468, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /mnt/sn770/boinc-client/slots/8/progress_file_12211286.xml <running_values> <last_cpu_time>11485.130000</last_cpu_time> <upload_file_number>5</upload_file_number> <last_iter>495</last_iter> <last_upload>432000</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org