Name | oifs_43r3_bl_a17v_2016092300_15_991_12208366_2 |
Workunit | 12208366 |
Created | 18 Feb 2023, 15:14:33 UTC |
Sent | 18 Feb 2023, 15:15:39 UTC |
Report deadline | 19 Apr 2023, 15:15:39 UTC |
Received | 18 Feb 2023, 20:24:53 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1533065 |
Run time | 4 hours 8 min 35 sec |
CPU time | 3 hours 57 min 6 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 5.34 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.11 x86_64-pc-linux-gnu |
Peak working set size | 5,071.74 MB |
Peak swap size | 5,930.78 MB |
Peak disk usage | 1,375.50 MB |
Stderr | <core_client_version>7.20.2</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> 6733287:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:161447:1676733287:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:161447:1676733287:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil)) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:161447:1676733287:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil)) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:161447:1676733287:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil)) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:161447:1676733287:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 16:15:26 STEP 0 H= 0:00 +CPU= 33.305 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000000 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000000 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000000 16:15:55 STEP 1 H= 0:15 +CPU= 27.672 16:16:24 STEP 2 H= 0:30 +CPU= 27.501 16:16:53 STEP 3 H= 0:45 +CPU= 26.995 16:17:20 STEP 4 H= 1:00 +CPU= 27.323 16:17:49 STEP 5 H= 1:15 +CPU= 27.202 16:18:19 STEP 6 H= 1:30 +CPU= 28.712 16:18:47 STEP 7 H= 1:45 +CPU= 27.347 16:19:15 STEP 8 H= 2:00 +CPU= 27.935 16:19:44 STEP 9 H= 2:15 +CPU= 27.405 16:20:12 STEP 10 H= 2:30 +CPU= 27.109 16:20:41 STEP 11 H= 2:45 +CPU= 28.290 16:21:17 STEP 12 H= 3:00 +CPU= 35.019 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000012 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000012 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000012 16:21:46 STEP 13 H= 3:15 +CPU= 28.135 16:22:17 STEP 14 H= 3:30 +CPU= 28.694 16:22:45 STEP 15 H= 3:45 +CPU= 27.787 16:23:15 STEP 16 H= 4:00 +CPU= 29.364 16:23:46 STEP 17 H= 4:15 +CPU= 29.500 16:24:16 STEP 18 H= 4:30 +CPU= 28.805 16:24:46 STEP 19 H= 4:45 +CPU= 27.932 16:25:15 STEP 20 H= 5:00 +CPU= 27.881 16:25:44 STEP 21 H= 5:15 +CPU= 27.478 16:26:14 STEP 22 H= 5:30 +CPU= 29.017 16:26:42 STEP 23 H= 5:45 +CPU= 27.040 16:27:15 STEP 24 H= 6:00 +CPU= 33.207 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000024 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000024 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000024 16:27:43 STEP 25 H= 6:15 +CPU= 27.029 16:28:14 STEP 26 H= 6:30 +CPU= 28.573 16:28:44 STEP 27 H= 6:45 +CPU= 28.332 16:29:13 STEP 28 H= 7:00 +CPU= 28.334 16:29:43 STEP 29 H= 7:15 +CPU= 28.968 16:30:13 STEP 30 H= 7:30 +CPU= 29.159 16:30:43 STEP 31 H= 7:45 +CPU= 27.679 16:31:12 STEP 32 H= 8:00 +CPU= 28.079 16:31:43 STEP 33 H= 8:15 +CPU= 29.365 16:32:13 STEP 34 H= 8:30 +CPU= 28.695 16:32:42 STEP 35 H= 8:45 +CPU= 27.362 16:33:18 STEP 36 H= 9:00 +CPU= 34.689 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000036 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000036 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000036 16:33:47 STEP 37 H= 9:15 +CPU= 27.722 16:34:15 STEP 38 H= 9:30 +CPU= 27.921 16:34:44 STEP 39 H= 9:45 +CPU= 27.919 16:35:13 STEP 40 H= 10:00 +CPU= 28.262 16:35:42 STEP 41 H= 10:15 +CPU= 27.606 16:36:13 STEP 42 H= 10:30 +CPU= 29.872 16:36:43 STEP 43 H= 10:45 +CPU= 29.029 16:37:12 STEP 44 H= 11:00 +CPU= 28.360 16:37:40 STEP 45 H= 11:15 +CPU= 27.337 16:38:09 STEP 46 H= 11:30 +CPU= 27.989 16:38:38 STEP 47 H= 11:45 +CPU= 27.520 16:39:19 STEP 48 H= 12:00 +CPU= 39.958 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000048 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000048 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000048 16:39:48 STEP 49 H= 12:15 +CPU= 28.410 16:40:17 STEP 50 H= 12:30 +CPU= 27.920 16:40:45 STEP 51 H= 12:45 +CPU= 27.710 16:41:15 STEP 52 H= 13:00 +CPU= 28.953 16:41:45 STEP 53 H= 13:15 +CPU= 27.987 16:42:14 STEP 54 H= 13:30 +CPU= 28.237 16:42:44 STEP 55 H= 13:45 +CPU= 28.367 16:43:13 STEP 56 H= 14:00 +CPU= 28.226 16:43:41 STEP 57 H= 14:15 +CPU= 27.097 16:44:10 STEP 58 H= 14:30 +CPU= 27.056 16:44:39 STEP 59 H= 14:45 +CPU= 27.366 16:45:17 STEP 60 H= 15:00 +CPU= 36.084 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000060 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000060 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000060 16:45:46 STEP 61 H= 15:15 +CPU= 28.115 16:46:16 STEP 62 H= 15:30 +CPU= 27.885 16:46:45 STEP 63 H= 15:45 +CPU= 27.722 16:47:15 STEP 64 H= 16:00 +CPU= 28.198 16:47:43 STEP 65 H= 16:15 +CPU= 28.305 16:48:12 STEP 66 H= 16:30 +CPU= 27.721 16:48:41 STEP 67 H= 16:45 +CPU= 27.616 16:49:10 STEP 68 H= 17:00 +CPU= 28.182 16:49:38 STEP 69 H= 17:15 +CPU= 27.246 16:50:07 STEP 70 H= 17:30 +CPU= 27.673 16:50:35 STEP 71 H= 17:45 +CPU= 26.813 16:51:08 STEP 72 H= 18:00 +CPU= 33.036 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000072 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000072 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000072 16:51:39 STEP 73 H= 18:15 +CPU= 28.911 16:52:08 STEP 74 H= 18:30 +CPU= 28.120 16:52:37 STEP 75 H= 18:45 +CPU= 27.430 16:53:07 STEP 76 H= 19:00 +CPU= 28.711 16:53:36 STEP 77 H= 19:15 +CPU= 27.174 16:54:04 STEP 78 H= 19:30 +CPU= 27.225 16:54:34 STEP 79 H= 19:45 +CPU= 29.542 16:55:03 STEP 80 H= 20:00 +CPU= 27.988 16:55:31 STEP 81 H= 20:15 +CPU= 27.476 16:55:59 STEP 82 H= 20:30 +CPU= 26.812 16:56:28 STEP 83 H= 20:45 +CPU= 27.631 16:57:04 STEP 84 H= 21:00 +CPU= 35.532 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000084 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000084 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000084 16:57:32 STEP 85 H= 21:15 +CPU= 26.801 16:58:00 STEP 86 H= 21:30 +CPU= 27.266 16:58:29 STEP 87 H= 21:45 +CPU= 27.581 16:59:00 STEP 88 H= 22:00 +CPU= 29.967 16:59:30 STEP 89 H= 22:15 +CPU= 27.995 17:00:01 STEP 90 H= 22:30 +CPU= 30.469 17:00:30 STEP 91 H= 22:45 +CPU= 28.237 17:00:59 STEP 92 H= 23:00 +CPU= 27.759 17:01:27 STEP 93 H= 23:15 +CPU= 27.555 17:01:57 STEP 94 H= 23:30 +CPU= 28.047 17:02:26 STEP 95 H= 23:45 +CPU= 27.909 17:03:06 STEP 96 H= 24:00 +CPU= 38.888 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000096 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000096 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000084 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000084 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000084 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a17v_2016092300_15_991_12208366_2_r1288515771_0.zip Uploading the intermediate file: upload_file_0.zip 17:03:36 STEP 97 H= 24:15 +CPU= 27.735 17:04:06 STEP 98 H= 24:30 +CPU= 28.665 17:04:34 STEP 99 H= 24:45 +CPU= 26.906 17:05:03 STEP 100 H= 25:00 +CPU= 27.930 17:05:32 STEP 101 H= 25:15 +CPU= 28.239 17:06:02 STEP 102 H= 25:30 +CPU= 28.260 17:06:33 STEP 103 H= 25:45 +CPU= 28.844 17:07:08 STEP 104 H= 26:00 +CPU= 32.673 17:07:42 STEP 105 H= 26:15 +CPU= 33.607 17:08:21 STEP 106 H= 26:30 +CPU= 36.784 17:09:00 STEP 107 H= 26:45 +CPU= 37.433 17:09:45 STEP 108 H= 27:00 +CPU= 43.660 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000108 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000108 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000108 17:10:23 STEP 109 H= 27:15 +CPU= 36.415 17:11:00 STEP 110 H= 27:30 +CPU= 36.093 17:11:37 STEP 111 H= 27:45 +CPU= 35.883 17:12:16 STEP 112 H= 28:00 +CPU= 36.515 17:12:55 STEP 113 H= 28:15 +CPU= 35.964 17:13:35 STEP 114 H= 28:30 +CPU= 39.224 17:14:12 STEP 115 H= 28:45 +CPU= 35.925 17:14:51 STEP 116 H= 29:00 +CPU= 38.100 17:15:30 STEP 117 H= 29:15 +CPU= 37.103 17:16:07 STEP 118 H= 29:30 +CPU= 34.626 17:16:44 STEP 119 H= 29:45 +CPU= 36.270 17:17:30 STEP 120 H= 30:00 +CPU= 44.550 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000120 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000120 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000120 17:18:05 STEP 121 H= 30:15 +CPU= 34.862 17:18:44 STEP 122 H= 30:30 +CPU= 36.286 17:19:25 STEP 123 H= 30:45 +CPU= 37.456 17:20:02 STEP 124 H= 31:00 +CPU= 36.362 17:20:38 STEP 125 H= 31:15 +CPU= 34.930 17:21:17 STEP 126 H= 31:30 +CPU= 36.638 17:21:57 STEP 127 H= 31:45 +CPU= 37.711 17:22:34 STEP 128 H= 32:00 +CPU= 34.754 17:23:11 STEP 129 H= 32:15 +CPU= 35.961 17:23:48 STEP 130 H= 32:30 +CPU= 35.777 17:24:26 STEP 131 H= 32:45 +CPU= 36.451 17:25:10 STEP 132 H= 33:00 +CPU= 43.275 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000132 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000132 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000132 17:25:48 STEP 133 H= 33:15 +CPU= 35.780 17:26:27 STEP 134 H= 33:30 +CPU= 37.029 17:27:05 STEP 135 H= 33:45 +CPU= 36.111 17:27:44 STEP 136 H= 34:00 +CPU= 37.260 17:28:22 STEP 137 H= 34:15 +CPU= 37.412 17:28:59 STEP 138 H= 34:30 +CPU= 35.018 17:29:35 STEP 139 H= 34:45 +CPU= 35.296 17:30:13 STEP 140 H= 35:00 +CPU= 36.616 17:30:51 STEP 141 H= 35:15 +CPU= 36.403 17:31:27 STEP 142 H= 35:30 +CPU= 35.516 17:32:04 STEP 143 H= 35:45 +CPU= 35.193 17:32:54 STEP 144 H= 36:00 +CPU= 47.539 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000144 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000144 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000144 17:33:29 STEP 145 H= 36:15 +CPU= 34.329 17:34:08 STEP 146 H= 36:30 +CPU= 36.975 17:34:45 STEP 147 H= 36:45 +CPU= 36.165 17:35:23 STEP 148 H= 37:00 +CPU= 35.506 17:35:59 STEP 149 H= 37:15 +CPU= 35.529 17:36:38 STEP 150 H= 37:30 +CPU= 36.990 17:37:15 STEP 151 H= 37:45 +CPU= 36.196 17:37:54 STEP 152 H= 38:00 +CPU= 37.194 17:38:32 STEP 153 H= 38:15 +CPU= 36.696 17:39:12 STEP 154 H= 38:30 +CPU= 36.967 17:39:47 STEP 155 H= 38:45 +CPU= 34.730 17:40:36 STEP 156 H= 39:00 +CPU= 46.472 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000156 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000156 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000156 17:41:14 STEP 157 H= 39:15 +CPU= 36.861 17:41:50 STEP 158 H= 39:30 +CPU= 35.502 17:42:28 STEP 159 H= 39:45 +CPU= 36.801 17:43:08 STEP 160 H= 40:00 +CPU= 37.809 17:43:43 STEP 161 H= 40:15 +CPU= 34.837 17:44:22 STEP 162 H= 40:30 +CPU= 36.503 17:45:01 STEP 163 H= 40:45 +CPU= 38.416 17:45:40 STEP 164 H= 41:00 +CPU= 36.906 17:46:16 STEP 165 H= 41:15 +CPU= 34.547 17:46:53 STEP 166 H= 41:30 +CPU= 35.925 17:47:30 STEP 167 H= 41:45 +CPU= 35.609 17:48:14 STEP 168 H= 42:00 +CPU= 42.494 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000168 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000168 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000168 17:48:51 STEP 169 H= 42:15 +CPU= 35.920 17:49:30 STEP 170 H= 42:30 +CPU= 36.654 17:50:09 STEP 171 H= 42:45 +CPU= 37.087 17:50:46 STEP 172 H= 43:00 +CPU= 35.323 17:51:24 STEP 173 H= 43:15 +CPU= 37.420 17:52:04 STEP 174 H= 43:30 +CPU= 37.627 17:52:41 STEP 175 H= 43:45 +CPU= 35.816 17:53:20 STEP 176 H= 44:00 +CPU= 36.812 17:53:57 STEP 177 H= 44:15 +CPU= 35.861 17:54:33 STEP 178 H= 44:30 +CPU= 34.879 17:55:08 STEP 179 H= 44:45 +CPU= 34.756 17:55:56 STEP 180 H= 45:00 +CPU= 45.343 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000180 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000180 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000180 17:56:33 STEP 181 H= 45:15 +CPU= 36.047 17:57:08 STEP 182 H= 45:30 +CPU= 33.892 17:57:45 STEP 183 H= 45:45 +CPU= 35.960 17:58:22 STEP 184 H= 46:00 +CPU= 36.008 17:59:01 STEP 185 H= 46:15 +CPU= 35.883 17:59:39 STEP 186 H= 46:30 +CPU= 36.360 18:00:16 STEP 187 H= 46:45 +CPU= 35.784 18:00:55 STEP 188 H= 47:00 +CPU= 36.066 18:01:31 STEP 189 H= 47:15 +CPU= 35.424 18:02:09 STEP 190 H= 47:30 +CPU= 36.787 18:02:49 STEP 191 H= 47:45 +CPU= 37.678 18:03:38 STEP 192 H= 48:00 +CPU= 46.651 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000192 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000192 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000180 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a17v_2016092300_15_991_12208366_2_r1288515771_1.zip Uploading the intermediate file: upload_file_1.zip 18:04:15 STEP 193 H= 48:15 +CPU= 34.995 18:04:55 STEP 194 H= 48:30 +CPU= 37.887 18:05:33 STEP 195 H= 48:45 +CPU= 35.873 18:06:11 STEP 196 H= 49:00 +CPU= 36.327 18:06:48 STEP 197 H= 49:15 +CPU= 36.330 18:07:27 STEP 198 H= 49:30 +CPU= 36.772 18:08:04 STEP 199 H= 49:45 +CPU= 34.977 18:08:43 STEP 200 H= 50:00 +CPU= 38.009 18:09:23 STEP 201 H= 50:15 +CPU= 38.366 18:10:04 STEP 202 H= 50:30 +CPU= 40.287 18:10:48 STEP 203 H= 50:45 +CPU= 41.693 18:11:40 STEP 204 H= 51:00 +CPU= 50.256 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000204 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000204 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000204 18:12:23 STEP 205 H= 51:15 +CPU= 40.869 18:13:06 STEP 206 H= 51:30 +CPU= 41.066 18:13:48 STEP 207 H= 51:45 +CPU= 40.546 18:14:32 STEP 208 H= 52:00 +CPU= 41.396 18:15:12 STEP 209 H= 52:15 +CPU= 39.446 18:15:53 STEP 210 H= 52:30 +CPU= 38.396 18:16:35 STEP 211 H= 52:45 +CPU= 40.959 18:17:18 STEP 212 H= 53:00 +CPU= 40.554 18:18:00 STEP 213 H= 53:15 +CPU= 40.018 18:18:45 STEP 214 H= 53:30 +CPU= 43.135 18:19:30 STEP 215 H= 53:45 +CPU= 41.261 18:20:22 STEP 216 H= 54:00 +CPU= 48.930 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000216 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000216 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000216 18:21:07 STEP 217 H= 54:15 +CPU= 42.842 18:21:50 STEP 218 H= 54:30 +CPU= 40.948 18:22:31 STEP 219 H= 54:45 +CPU= 40.125 18:23:14 STEP 220 H= 55:00 +CPU= 40.648 18:23:59 STEP 221 H= 55:15 +CPU= 41.998 18:24:40 STEP 222 H= 55:30 +CPU= 39.605 18:25:21 STEP 223 H= 55:45 +CPU= 40.212 18:26:07 STEP 224 H= 56:00 +CPU= 41.717 18:26:49 STEP 225 H= 56:15 +CPU= 40.197 18:27:30 STEP 226 H= 56:30 +CPU= 39.083 18:28:11 STEP 227 H= 56:45 +CPU= 39.727 18:29:03 STEP 228 H= 57:00 +CPU= 49.169 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000228 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000228 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000228 18:29:44 STEP 229 H= 57:15 +CPU= 39.325 18:30:26 STEP 230 H= 57:30 +CPU= 39.898 18:31:08 STEP 231 H= 57:45 +CPU= 40.451 18:31:52 STEP 232 H= 58:00 +CPU= 42.809 18:32:33 STEP 233 H= 58:15 +CPU= 39.574 18:33:16 STEP 234 H= 58:30 +CPU= 40.809 18:33:57 STEP 235 H= 58:45 +CPU= 40.238 18:34:41 STEP 236 H= 59:00 +CPU= 40.818 18:35:21 STEP 237 H= 59:15 +CPU= 39.149 18:36:03 STEP 238 H= 59:30 +CPU= 40.140 18:36:45 STEP 239 H= 59:45 +CPU= 40.331 18:37:40 STEP 240 H= 60:00 +CPU= 52.158 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000240 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000240 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000240 18:38:25 STEP 241 H= 60:15 +CPU= 42.739 18:39:11 STEP 242 H= 60:30 +CPU= 43.553 18:39:52 STEP 243 H= 60:45 +CPU= 39.389 18:40:35 STEP 244 H= 61:00 +CPU= 41.087 18:41:18 STEP 245 H= 61:15 +CPU= 41.220 18:42:03 STEP 246 H= 61:30 +CPU= 41.044 18:42:45 STEP 247 H= 61:45 +CPU= 39.916 18:43:27 STEP 248 H= 62:00 +CPU= 40.037 18:44:08 STEP 249 H= 62:15 +CPU= 40.028 18:44:51 STEP 250 H= 62:30 +CPU= 41.270 18:45:31 STEP 251 H= 62:45 +CPU= 38.878 18:46:23 STEP 252 H= 63:00 +CPU= 48.618 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000252 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000252 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000252 18:47:06 STEP 253 H= 63:15 +CPU= 41.247 18:47:47 STEP 254 H= 63:30 +CPU= 39.224 18:48:31 STEP 255 H= 63:45 +CPU= 41.137 18:49:12 STEP 256 H= 64:00 +CPU= 40.165 18:49:54 STEP 257 H= 64:15 +CPU= 40.033 18:50:35 STEP 258 H= 64:30 +CPU= 39.536 18:51:19 STEP 259 H= 64:45 +CPU= 42.655 18:52:00 STEP 260 H= 65:00 +CPU= 40.084 18:52:42 STEP 261 H= 65:15 +CPU= 39.831 18:53:23 STEP 262 H= 65:30 +CPU= 39.470 18:54:05 STEP 263 H= 65:45 +CPU= 40.412 18:54:55 STEP 264 H= 66:00 +CPU= 48.049 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000264 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000264 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000264 18:55:38 STEP 265 H= 66:15 +CPU= 40.783 18:56:22 STEP 266 H= 66:30 +CPU= 42.234 18:57:02 STEP 267 H= 66:45 +CPU= 37.842 18:57:46 STEP 268 H= 67:00 +CPU= 42.232 18:58:28 STEP 269 H= 67:15 +CPU= 39.538 18:59:10 STEP 270 H= 67:30 +CPU= 41.198 18:59:52 STEP 271 H= 67:45 +CPU= 39.758 19:00:34 STEP 272 H= 68:00 +CPU= 40.562 19:01:17 STEP 273 H= 68:15 +CPU= 40.775 19:01:57 STEP 274 H= 68:30 +CPU= 38.659 19:02:42 STEP 275 H= 68:45 +CPU= 42.027 19:03:34 STEP 276 H= 69:00 +CPU= 50.013 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000276 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000276 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000276 19:04:15 STEP 277 H= 69:15 +CPU= 39.805 19:04:55 STEP 278 H= 69:30 +CPU= 38.961 19:05:36 STEP 279 H= 69:45 +CPU= 39.600 19:06:21 STEP 280 H= 70:00 +CPU= 42.456 19:07:01 STEP 281 H= 70:15 +CPU= 38.591 19:07:43 STEP 282 H= 70:30 +CPU= 39.901 19:08:25 STEP 283 H= 70:45 +CPU= 39.925 19:09:06 STEP 284 H= 71:00 +CPU= 39.948 19:09:48 STEP 285 H= 71:15 +CPU= 39.892 19:10:30 STEP 286 H= 71:30 +CPU= 40.429 19:11:15 STEP 287 H= 71:45 +CPU= 42.836 19:12:11 STEP 288 H= 72:00 +CPU= 52.566 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000288 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000288 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000276 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000276 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000276 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a17v_2016092300_15_991_12208366_2_r1288515771_2.zip Uploading the intermediate file: upload_file_2.zip 19:12:55 STEP 289 H= 72:15 +CPU= 39.800 19:13:37 STEP 290 H= 72:30 +CPU= 39.660 19:14:18 STEP 291 H= 72:45 +CPU= 39.585 19:15:00 STEP 292 H= 73:00 +CPU= 40.489 19:15:42 STEP 293 H= 73:15 +CPU= 40.040 19:16:24 STEP 294 H= 73:30 +CPU= 40.354 19:17:04 STEP 295 H= 73:45 +CPU= 39.007 19:17:47 STEP 296 H= 74:00 +CPU= 41.061 19:18:31 STEP 297 H= 74:15 +CPU= 41.508 19:19:15 STEP 298 H= 74:30 +CPU= 42.366 19:19:57 STEP 299 H= 74:45 +CPU= 40.938 19:20:51 STEP 300 H= 75:00 +CPU= 50.897 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000300 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000300 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000300 19:21:34 STEP 301 H= 75:15 +CPU= 41.826 19:22:16 STEP 302 H= 75:30 +CPU= 40.142 19:22:58 STEP 303 H= 75:45 +CPU= 41.218 19:23:41 STEP 304 H= 76:00 +CPU= 40.927 19:24:23 STEP 305 H= 76:15 +CPU= 40.316 19:25:07 STEP 306 H= 76:30 +CPU= 41.656 19:25:50 STEP 307 H= 76:45 +CPU= 41.152 19:26:31 STEP 308 H= 77:00 +CPU= 39.933 19:27:12 STEP 309 H= 77:15 +CPU= 39.314 19:27:55 STEP 310 H= 77:30 +CPU= 40.575 19:28:37 STEP 311 H= 77:45 +CPU= 40.349 19:29:29 STEP 312 H= 78:00 +CPU= 49.867 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000312 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000312 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000312 19:30:14 STEP 313 H= 78:15 +CPU= 41.007 19:30:54 STEP 314 H= 78:30 +CPU= 38.827 19:31:37 STEP 315 H= 78:45 +CPU= 40.230 19:32:18 STEP 316 H= 79:00 +CPU= 39.548 19:33:02 STEP 317 H= 79:15 +CPU= 42.585 19:33:46 STEP 318 H= 79:30 +CPU= 40.312 19:34:24 STEP 319 H= 79:45 +CPU= 35.784 19:35:04 STEP 320 H= 80:00 +CPU= 38.186 19:35:41 STEP 321 H= 80:15 +CPU= 35.843 19:36:16 STEP 322 H= 80:30 +CPU= 34.897 19:36:53 STEP 323 H= 80:45 +CPU= 34.577 19:37:39 STEP 324 H= 81:00 +CPU= 44.045 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000324 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000324 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000324 19:38:17 STEP 325 H= 81:15 +CPU= 36.353 19:38:53 STEP 326 H= 81:30 +CPU= 34.792 19:39:30 STEP 327 H= 81:45 +CPU= 35.559 19:40:07 STEP 328 H= 82:00 +CPU= 36.146 19:40:45 STEP 329 H= 82:15 +CPU= 36.275 19:41:23 STEP 330 H= 82:30 +CPU= 36.840 19:42:00 STEP 331 H= 82:45 +CPU= 34.894 19:42:36 STEP 332 H= 83:00 +CPU= 35.316 19:43:11 STEP 333 H= 83:15 +CPU= 34.616 19:43:49 STEP 334 H= 83:30 +CPU= 36.108 19:44:27 STEP 335 H= 83:45 +CPU= 35.846 19:45:15 STEP 336 H= 84:00 +CPU= 46.465 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000336 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000336 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000336 19:45:56 STEP 337 H= 84:15 +CPU= 39.432 19:46:31 STEP 338 H= 84:30 +CPU= 34.386 19:47:11 STEP 339 H= 84:45 +CPU= 37.858 19:47:48 STEP 340 H= 85:00 +CPU= 36.259 19:48:25 STEP 341 H= 85:15 +CPU= 35.705 19:49:03 STEP 342 H= 85:30 +CPU= 36.837 19:49:39 STEP 343 H= 85:45 +CPU= 34.697 19:50:17 STEP 344 H= 86:00 +CPU= 36.405 19:50:53 STEP 345 H= 86:15 +CPU= 35.092 19:51:31 STEP 346 H= 86:30 +CPU= 36.047 19:52:09 STEP 347 H= 86:45 +CPU= 36.505 19:52:55 STEP 348 H= 87:00 +CPU= 43.317 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000348 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000348 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000348 19:53:31 STEP 349 H= 87:15 +CPU= 35.018 19:54:08 STEP 350 H= 87:30 +CPU= 35.222 19:54:46 STEP 351 H= 87:45 +CPU= 36.560 19:55:24 STEP 352 H= 88:00 +CPU= 36.315 19:56:02 STEP 353 H= 88:15 +CPU= 36.107 19:56:38 STEP 354 H= 88:30 +CPU= 35.471 19:57:15 STEP 355 H= 88:45 +CPU= 35.131 19:57:53 STEP 356 H= 89:00 +CPU= 35.797 19:58:32 STEP 357 H= 89:15 +CPU= 36.873 19:59:08 STEP 358 H= 89:30 +CPU= 35.080 19:59:43 STEP 359 H= 89:45 +CPU= 34.021 20:00:31 STEP 360 H= 90:00 +CPU= 44.868 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000360 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000360 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000360 20:01:07 STEP 361 H= 90:15 +CPU= 35.821 20:01:44 STEP 362 H= 90:30 +CPU= 35.632 20:02:23 STEP 363 H= 90:45 +CPU= 37.172 20:03:00 STEP 364 H= 91:00 +CPU= 35.783 20:03:36 STEP 365 H= 91:15 +CPU= 35.239 20:04:13 STEP 366 H= 91:30 +CPU= 35.573 20:04:51 STEP 367 H= 91:45 +CPU= 36.833 20:05:32 STEP 368 H= 92:00 +CPU= 38.822 20:06:09 STEP 369 H= 92:15 +CPU= 35.121 20:06:45 STEP 370 H= 92:30 +CPU= 34.772 20:07:26 STEP 371 H= 92:45 +CPU= 37.674 20:08:12 STEP 372 H= 93:00 +CPU= 43.983 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000372 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000372 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000372 20:08:49 STEP 373 H= 93:15 +CPU= 35.431 20:09:26 STEP 374 H= 93:30 +CPU= 35.734 20:10:02 STEP 375 H= 93:45 +CPU= 35.249 20:10:41 STEP 376 H= 94:00 +CPU= 36.486 20:11:19 STEP 377 H= 94:15 +CPU= 37.225 20:11:57 STEP 378 H= 94:30 +CPU= 36.415 20:12:33 STEP 379 H= 94:45 +CPU= 34.694 20:13:13 STEP 380 H= 95:00 +CPU= 38.704 20:13:53 STEP 381 H= 95:15 +CPU= 38.524 20:14:30 STEP 382 H= 95:30 +CPU= 34.840 20:15:08 STEP 383 H= 95:45 +CPU= 36.357 20:16:00 STEP 384 H= 96:00 +CPU= 49.344 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000384 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000384 Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMGGh7zg+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMSHh7zg+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208366/ICMUAh7zg+000372 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a17v_2016092300_15_991_12208366_2_r1288515771_3.zip Uploading the intermediate file: upload_file_3.zip 20:16:38 STEP 385 H= 96:15 +CPU= 35.341 20:17:16 STEP 386 H= 96:30 +CPU= 36.542 20:17:55 STEP 387 H= 96:45 +CPU= 36.470 20:18:34 STEP 388 H= 97:00 +CPU= 36.782 20:19:09 STEP 389 H= 97:15 +CPU= 33.941 20:19:47 STEP 390 H= 97:30 +CPU= 36.569 20:20:26 STEP 391 H= 97:45 +CPU= 37.744 20:21:05 STEP 392 H= 98:00 +CPU= 36.441 20:21:43 STEP 393 H= 98:15 +CPU= 37.091 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.070] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.085] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.085] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil)) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.085] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.085] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.085] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.087] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202211:1676748131:14844.096] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' : sigcontextptr=0x7fff9e76d650 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:? [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202212:1676748132:14845.096] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' : sigcontextptr=0x7fff9e76d560 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202213:1676748133:14845.960] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:WRZTELEBIMWSKL01:1:1:6640:6640] [20230218:202213:1676748133:14845.960] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC4A8F Unknown Unknown Unknown oifs_43r3_model.e 00000000012D283B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 00000000012BA8D9 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000012B0762 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000001163FC3 callpar_ 869 callpar.F90 oifs_43r3_model.e 00000000010B682F ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 00000000010A915C ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90 oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90 oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.174705108590019E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 384 STEPO F00000000 CREATE RESTART FILE ./srf00040000.0001 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./srf00040000.0001 MODE=w IO-STREAM CLOSED - ./srf00040000.0001 MPI-TASK: 1 - ************ BYTES IN 34 RECORDS TRANSFERRED IN 2.8520 SECONDS******** Mbytes/s, TOTAL TIME= 3.7811(75.4%) CREATE RESTART CONTROL FILE ./rcf WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00031200.0001 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 384 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000384 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000384 MPI-TASK: 1 - 304038826 BYTES IN 6 RECORDS TRANSFERRED IN 0.0004 SECONDS760097.0 Mbytes/s, TOTAL TIME= 0.0113( 3.5%) NSTEP = 384 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000384 MODE=a IO-STREAM CLOSED - ./ICMSHh7zg+000384 MPI-TASK: 1 - 707765250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0212 SECONDS 33385.2 Mbytes/s, TOTAL TIME= 0.4398( 4.8%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000384 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000384 MPI-TASK: 1 - 4864621207 BYTES IN 125 RECORDS TRANSFERRED IN 0.0077 SECONDS631769.0 Mbytes/s, TOTAL TIME= 0.3698( 2.1%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000384 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000384 MPI-TASK: 1 - 295465193 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0057( 3.5%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000384 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000384 MPI-TASK: 1 - 304038826 BYTES IN 4 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0055( 3.6%) STEPO_FPOS WAS : T00000000M NSTEP = 384 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 384 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000384 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000384 MPI-TASK: 1 - 304038817 BYTES IN 7 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0115( 2.6%) 20:16:00 STEP 384 H= 96:00 +CPU= 49.344 ISTEP= 385 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 385 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 385 STEPO 0AAA00AAA 20:16:38 STEP 385 H= 96:15 +CPU= 35.341 NSTEP = 386 STEPO 0AAA00AAA 20:17:16 STEP 386 H= 96:30 +CPU= 36.542 NSTEP = 387 STEPO 0AAA00AAA 20:17:55 STEP 387 H= 96:45 +CPU= 36.470 NSTEP = 388 STEPO 0AAA00AAA 20:18:34 STEP 388 H= 97:00 +CPU= 36.782 NSTEP = 389 STEPO 0AAA00AAA 20:19:09 STEP 389 H= 97:15 +CPU= 33.941 ISTEP= 390 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 390 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 390 STEPO 0AAA00AAA 20:19:47 STEP 390 H= 97:30 +CPU= 36.569 NSTEP = 391 STEPO 0AAA00AAA 20:20:26 STEP 391 H= 97:45 +CPU= 37.744 NSTEP = 392 STEPO 0AAA00AAA 20:21:05 STEP 392 H= 98:00 +CPU= 36.441 NSTEP = 393 STEPO 0AAA00AAA 20:21:43 STEP 393 H= 98:15 +CPU= 37.091 NSTEP = 394 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 20:17:55 0AAA00AAA STEPO 388 36.470 36.470 38.575 233:01 243:08 0.33214618415141E-04 2GB 0MB 20:18:34 0AAA00AAA STEPO 389 36.782 36.782 38.728 233:38 243:46 0.33214618415141E-04 2GB 0MB 20:19:09 0AAA00AAA STEPO 390 33.941 33.941 34.952 234:12 244:21 0.33214618415141E-04 2GB 0MB 20:19:47 0AAA00AAA STEPO 391 36.569 36.569 37.956 234:48 244:59 0.33214618415141E-04 2GB 0MB 20:20:26 0AAA00AAA STEPO 392 37.744 37.744 39.387 235:26 245:39 0.33214618415141E-04 2GB 0MB 20:21:05 0AAA00AAA STEPO 393 36.442 36.442 38.613 236:02 246:17 0.33214618415141E-04 2GB 0MB 20:21:43 0AAA00AAA STEPO 394 37.091 37.091 38.489 236:39 246:56 0.33214618415141E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 384", CTIME = "00040000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 372, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/4/progress_file_12208366.xml <running_values> <last_cpu_time>14226.280000</last_cpu_time> <upload_file_number>4</upload_file_number> <last_iter>394</last_iter> <last_upload>345600</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org