climateprediction.net home page
Task 22283987

Task 22283987

Name oifs_43r3_ps_0273_2012050100_123_981_12197917_0
Workunit 12197917
Created 24 Dec 2022, 4:32:24 UTC
Sent 12 Jan 2023, 15:04:15 UTC
Report deadline 11 Feb 2023, 15:04:15 UTC
Received 14 Jan 2023, 10:53:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1532184
Run time 13 hours 51 min 35 sec
CPU time 13 hours 49 min 27 sec
Validate state Invalid
Credit 10,765.44
Device peak FLOPS 6.86 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.19 MB
Peak swap size 4,978.06 MB
Peak disk usage 3,244.04 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
e_85.zip
  00:33:49 STEP 2065 H=2065:00 +CPU= 15.223
  00:34:05 STEP 2066 H=2066:00 +CPU= 15.678
  00:34:29 STEP 2067 H=2067:00 +CPU= 24.013
  00:34:45 STEP 2068 H=2068:00 +CPU= 15.548
  00:35:00 STEP 2069 H=2069:00 +CPU= 15.138
  00:35:24 STEP 2070 H=2070:00 +CPU= 24.533
  00:35:39 STEP 2071 H=2071:00 +CPU= 15.237
  00:35:55 STEP 2072 H=2072:00 +CPU= 15.639
  00:36:19 STEP 2073 H=2073:00 +CPU= 24.087
  00:36:35 STEP 2074 H=2074:00 +CPU= 15.660
  00:36:50 STEP 2075 H=2075:00 +CPU= 15.251
  00:37:16 STEP 2076 H=2076:00 +CPU= 26.347
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002076
  00:37:32 STEP 2077 H=2077:00 +CPU= 15.131
  00:37:47 STEP 2078 H=2078:00 +CPU= 15.496
  00:38:11 STEP 2079 H=2079:00 +CPU= 24.067
  00:38:27 STEP 2080 H=2080:00 +CPU= 15.621
  00:38:42 STEP 2081 H=2081:00 +CPU= 15.142
  00:39:06 STEP 2082 H=2082:00 +CPU= 24.439
  00:39:22 STEP 2083 H=2083:00 +CPU= 15.166
  00:39:37 STEP 2084 H=2084:00 +CPU= 15.564
  00:40:01 STEP 2085 H=2085:00 +CPU= 24.104
  00:40:17 STEP 2086 H=2086:00 +CPU= 15.567
  00:40:32 STEP 2087 H=2087:00 +CPU= 15.642
  00:41:01 STEP 2088 H=2088:00 +CPU= 28.477
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_86.zip
Uploading the intermediate file: upload_file_86.zip
  00:41:16 STEP 2089 H=2089:00 +CPU= 15.203
  00:41:32 STEP 2090 H=2090:00 +CPU= 15.508
  00:41:56 STEP 2091 H=2091:00 +CPU= 24.244
  00:42:12 STEP 2092 H=2092:00 +CPU= 15.724
  00:42:27 STEP 2093 H=2093:00 +CPU= 15.114
  00:42:51 STEP 2094 H=2094:00 +CPU= 24.600
  00:43:07 STEP 2095 H=2095:00 +CPU= 15.290
  00:43:22 STEP 2096 H=2096:00 +CPU= 15.620
  00:43:46 STEP 2097 H=2097:00 +CPU= 24.088
  00:44:02 STEP 2098 H=2098:00 +CPU= 15.627
  00:44:17 STEP 2099 H=2099:00 +CPU= 15.316
  00:44:44 STEP 2100 H=2100:00 +CPU= 26.611
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002100
  00:44:59 STEP 2101 H=2101:00 +CPU= 15.328
  00:45:15 STEP 2102 H=2102:00 +CPU= 15.629
  00:45:39 STEP 2103 H=2103:00 +CPU= 24.223
  00:45:55 STEP 2104 H=2104:00 +CPU= 15.817
  00:46:10 STEP 2105 H=2105:00 +CPU= 15.311
  00:46:35 STEP 2106 H=2106:00 +CPU= 24.535
  00:46:50 STEP 2107 H=2107:00 +CPU= 15.217
  00:47:06 STEP 2108 H=2108:00 +CPU= 15.635
  00:47:30 STEP 2109 H=2109:00 +CPU= 24.213
  00:47:45 STEP 2110 H=2110:00 +CPU= 15.622
  00:48:01 STEP 2111 H=2111:00 +CPU= 15.715
  00:48:30 STEP 2112 H=2112:00 +CPU= 28.442
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_87.zip
Uploading the intermediate file: upload_file_87.zip
  00:48:45 STEP 2113 H=2113:00 +CPU= 15.229
  00:49:00 STEP 2114 H=2114:00 +CPU= 15.561
  00:49:25 STEP 2115 H=2115:00 +CPU= 24.142
  00:49:40 STEP 2116 H=2116:00 +CPU= 15.591
  00:49:55 STEP 2117 H=2117:00 +CPU= 15.074
  00:50:20 STEP 2118 H=2118:00 +CPU= 24.474
  00:50:35 STEP 2119 H=2119:00 +CPU= 15.261
  00:50:51 STEP 2120 H=2120:00 +CPU= 15.609
  00:51:15 STEP 2121 H=2121:00 +CPU= 24.095
  00:51:30 STEP 2122 H=2122:00 +CPU= 15.713
  00:51:46 STEP 2123 H=2123:00 +CPU= 15.322
  00:52:12 STEP 2124 H=2124:00 +CPU= 26.597
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002124
  00:52:28 STEP 2125 H=2125:00 +CPU= 15.309
  00:52:43 STEP 2126 H=2126:00 +CPU= 15.501
  00:53:07 STEP 2127 H=2127:00 +CPU= 24.023
  00:53:23 STEP 2128 H=2128:00 +CPU= 15.701
  00:53:38 STEP 2129 H=2129:00 +CPU= 15.095
  00:54:03 STEP 2130 H=2130:00 +CPU= 24.609
  00:54:18 STEP 2131 H=2131:00 +CPU= 15.316
  00:54:33 STEP 2132 H=2132:00 +CPU= 15.481
  00:54:57 STEP 2133 H=2133:00 +CPU= 24.026
  00:55:13 STEP 2134 H=2134:00 +CPU= 15.749
  00:55:29 STEP 2135 H=2135:00 +CPU= 15.751
  00:55:58 STEP 2136 H=2136:00 +CPU= 28.544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_88.zip
Uploading the intermediate file: upload_file_88.zip
  00:56:13 STEP 2137 H=2137:00 +CPU= 15.316
Uploading trickle at timestep: 7689600
  00:56:29 STEP 2138 H=2138:00 +CPU= 15.714
  00:56:53 STEP 2139 H=2139:00 +CPU= 24.070
  00:57:08 STEP 2140 H=2140:00 +CPU= 15.780
  00:57:24 STEP 2141 H=2141:00 +CPU= 15.213
  00:57:48 STEP 2142 H=2142:00 +CPU= 24.559
  00:58:04 STEP 2143 H=2143:00 +CPU= 15.270
  00:58:19 STEP 2144 H=2144:00 +CPU= 15.733
  00:58:43 STEP 2145 H=2145:00 +CPU= 24.062
  00:58:59 STEP 2146 H=2146:00 +CPU= 15.797
  00:59:14 STEP 2147 H=2147:00 +CPU= 15.295
  00:59:41 STEP 2148 H=2148:00 +CPU= 26.676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002148
  00:59:56 STEP 2149 H=2149:00 +CPU= 15.374
  01:00:12 STEP 2150 H=2150:00 +CPU= 15.781
  01:00:37 STEP 2151 H=2151:00 +CPU= 24.292
  01:00:52 STEP 2152 H=2152:00 +CPU= 15.778
  01:01:08 STEP 2153 H=2153:00 +CPU= 15.245
  01:01:32 STEP 2154 H=2154:00 +CPU= 24.624
  01:01:47 STEP 2155 H=2155:00 +CPU= 15.265
  01:02:03 STEP 2156 H=2156:00 +CPU= 15.630
  01:02:27 STEP 2157 H=2157:00 +CPU= 24.144
  01:02:43 STEP 2158 H=2158:00 +CPU= 15.819
  01:02:59 STEP 2159 H=2159:00 +CPU= 15.782
  01:03:27 STEP 2160 H=2160:00 +CPU= 28.433
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_89.zip
Uploading the intermediate file: upload_file_89.zip
  01:03:43 STEP 2161 H=2161:00 +CPU= 15.271
  01:03:58 STEP 2162 H=2162:00 +CPU= 15.565
  01:04:22 STEP 2163 H=2163:00 +CPU= 24.233
  01:04:38 STEP 2164 H=2164:00 +CPU= 15.755
  01:04:53 STEP 2165 H=2165:00 +CPU= 15.206
  01:05:18 STEP 2166 H=2166:00 +CPU= 24.387
  01:05:33 STEP 2167 H=2167:00 +CPU= 15.291
  01:05:49 STEP 2168 H=2168:00 +CPU= 15.669
  01:06:13 STEP 2169 H=2169:00 +CPU= 24.191
  01:06:29 STEP 2170 H=2170:00 +CPU= 15.767
  01:06:44 STEP 2171 H=2171:00 +CPU= 15.474
  01:07:11 STEP 2172 H=2172:00 +CPU= 26.553
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002172
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            1  MAX ETADOT VERTICAL VEL.=   3.042046641653121E-008
  LON  =    56.2500000000000       degrees
  LAT  =   -40.9343383242788       degrees
  01:07:26 STEP 2173 H=2173:00 +CPU= 15.343
  01:07:42 STEP 2174 H=2174:00 +CPU= 15.518
  01:08:06 STEP 2175 H=2175:00 +CPU= 24.059
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           30  MAX ETADOT VERTICAL VEL.=   8.123954837961050E-008
  LON  =    59.0625000000000       degrees
  LAT  =   -42.0558239509352       degrees
  01:08:21 STEP 2176 H=2176:00 +CPU= 15.735
  01:08:37 STEP 2177 H=2177:00 +CPU= 15.205
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           32  MAX ETADOT VERTICAL VEL.=   6.940006171829750E-008
  LON  =    61.8750000000000       degrees
  LAT  =   -43.1773092288349       degrees
  01:09:01 STEP 2178 H=2178:00 +CPU= 24.566
  01:09:16 STEP 2179 H=2179:00 +CPU= 15.293
  01:09:32 STEP 2180 H=2180:00 +CPU= 15.701
  01:09:56 STEP 2181 H=2181:00 +CPU= 24.295
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            3  MAX ETADOT VERTICAL VEL.=   7.193960294604756E-008
  LON  =    66.0937500000000       degrees
  LAT  =   -45.4202786265483       degrees
  01:10:12 STEP 2182 H=2182:00 +CPU= 15.682
  01:10:28 STEP 2183 H=2183:00 +CPU= 15.777
  01:10:56 STEP 2184 H=2184:00 +CPU= 28.386
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_90.zip
Uploading the intermediate file: upload_file_90.zip
  01:11:12 STEP 2185 H=2185:00 +CPU= 15.250
  01:11:27 STEP 2186 H=2186:00 +CPU= 15.572
  01:11:51 STEP 2187 H=2187:00 +CPU= 24.036
  01:12:07 STEP 2188 H=2188:00 +CPU= 15.808
  01:12:22 STEP 2189 H=2189:00 +CPU= 15.322
  01:12:47 STEP 2190 H=2190:00 +CPU= 24.662
  01:13:02 STEP 2191 H=2191:00 +CPU= 15.283
  01:13:18 STEP 2192 H=2192:00 +CPU= 15.652
  01:13:42 STEP 2193 H=2193:00 +CPU= 24.033
  01:13:58 STEP 2194 H=2194:00 +CPU= 15.809
  01:14:13 STEP 2195 H=2195:00 +CPU= 15.411
  01:14:40 STEP 2196 H=2196:00 +CPU= 26.684
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002196
  01:14:55 STEP 2197 H=2197:00 +CPU= 15.240
  01:15:11 STEP 2198 H=2198:00 +CPU= 15.658
  01:15:35 STEP 2199 H=2199:00 +CPU= 24.176
  01:15:51 STEP 2200 H=2200:00 +CPU= 15.846
  01:16:06 STEP 2201 H=2201:00 +CPU= 15.114
  01:16:31 STEP 2202 H=2202:00 +CPU= 24.704
  01:16:46 STEP 2203 H=2203:00 +CPU= 15.333
  01:17:02 STEP 2204 H=2204:00 +CPU= 15.598
  01:17:25 STEP 2205 H=2205:00 +CPU= 23.986
  01:17:41 STEP 2206 H=2206:00 +CPU= 15.711
  01:17:57 STEP 2207 H=2207:00 +CPU= 15.751
  01:18:26 STEP 2208 H=2208:00 +CPU= 28.744
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_91.zip
Uploading the intermediate file: upload_file_91.zip
  01:18:41 STEP 2209 H=2209:00 +CPU= 15.172
  01:18:56 STEP 2210 H=2210:00 +CPU= 15.588
  01:19:21 STEP 2211 H=2211:00 +CPU= 24.194
  01:19:36 STEP 2212 H=2212:00 +CPU= 15.676
  01:19:52 STEP 2213 H=2213:00 +CPU= 15.114
  01:20:16 STEP 2214 H=2214:00 +CPU= 24.570
  01:20:31 STEP 2215 H=2215:00 +CPU= 15.321
  01:20:47 STEP 2216 H=2216:00 +CPU= 15.642
  01:21:11 STEP 2217 H=2217:00 +CPU= 24.109
  01:21:27 STEP 2218 H=2218:00 +CPU= 15.746
  01:21:42 STEP 2219 H=2219:00 +CPU= 15.247
  01:22:09 STEP 2220 H=2220:00 +CPU= 26.407
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002220
  01:22:24 STEP 2221 H=2221:00 +CPU= 15.282
  01:22:40 STEP 2222 H=2222:00 +CPU= 15.614
  01:23:04 STEP 2223 H=2223:00 +CPU= 24.022
  01:23:19 STEP 2224 H=2224:00 +CPU= 15.666
  01:23:34 STEP 2225 H=2225:00 +CPU= 15.216
  01:23:59 STEP 2226 H=2226:00 +CPU= 24.609
  01:24:14 STEP 2227 H=2227:00 +CPU= 15.213
  01:24:30 STEP 2228 H=2228:00 +CPU= 15.555
  01:24:54 STEP 2229 H=2229:00 +CPU= 24.018
  01:25:10 STEP 2230 H=2230:00 +CPU= 15.763
  01:25:25 STEP 2231 H=2231:00 +CPU= 15.821
  01:25:54 STEP 2232 H=2232:00 +CPU= 28.363
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_92.zip
Uploading the intermediate file: upload_file_92.zip
  01:26:09 STEP 2233 H=2233:00 +CPU= 15.260
  01:26:25 STEP 2234 H=2234:00 +CPU= 15.480
  01:26:48 STEP 2235 H=2235:00 +CPU= 23.885
  01:27:04 STEP 2236 H=2236:00 +CPU= 15.563
  01:27:19 STEP 2237 H=2237:00 +CPU= 15.088
  01:27:44 STEP 2238 H=2238:00 +CPU= 24.472
  01:27:59 STEP 2239 H=2239:00 +CPU= 15.255
  01:28:14 STEP 2240 H=2240:00 +CPU= 15.649
  01:28:39 STEP 2241 H=2241:00 +CPU= 24.053
  01:28:54 STEP 2242 H=2242:00 +CPU= 15.723
  01:29:10 STEP 2243 H=2243:00 +CPU= 15.309
  01:29:36 STEP 2244 H=2244:00 +CPU= 26.302
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002244
  01:29:51 STEP 2245 H=2245:00 +CPU= 15.196
  01:30:07 STEP 2246 H=2246:00 +CPU= 15.668
  01:30:31 STEP 2247 H=2247:00 +CPU= 24.180
  01:30:47 STEP 2248 H=2248:00 +CPU= 15.735
  01:31:02 STEP 2249 H=2249:00 +CPU= 15.055
  01:31:26 STEP 2250 H=2250:00 +CPU= 24.565
  01:31:42 STEP 2251 H=2251:00 +CPU= 15.240
  01:31:57 STEP 2252 H=2252:00 +CPU= 15.524
  01:32:21 STEP 2253 H=2253:00 +CPU= 24.018
  01:32:37 STEP 2254 H=2254:00 +CPU= 15.682
  01:32:53 STEP 2255 H=2255:00 +CPU= 15.742
  01:33:21 STEP 2256 H=2256:00 +CPU= 28.327
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_93.zip
Uploading the intermediate file: upload_file_93.zip
  01:33:36 STEP 2257 H=2257:00 +CPU= 15.163
  01:33:52 STEP 2258 H=2258:00 +CPU= 15.579
  01:34:16 STEP 2259 H=2259:00 +CPU= 24.002
  01:34:31 STEP 2260 H=2260:00 +CPU= 15.589
  01:34:46 STEP 2261 H=2261:00 +CPU= 15.241
  01:35:11 STEP 2262 H=2262:00 +CPU= 24.555
  01:35:26 STEP 2263 H=2263:00 +CPU= 15.170
  01:35:42 STEP 2264 H=2264:00 +CPU= 15.563
  01:36:06 STEP 2265 H=2265:00 +CPU= 24.117
  01:36:22 STEP 2266 H=2266:00 +CPU= 15.732
  01:36:37 STEP 2267 H=2267:00 +CPU= 15.276
  01:37:03 STEP 2268 H=2268:00 +CPU= 26.552
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002268
  01:37:19 STEP 2269 H=2269:00 +CPU= 15.207
  01:37:34 STEP 2270 H=2270:00 +CPU= 15.508
  01:37:58 STEP 2271 H=2271:00 +CPU= 24.101
  01:38:14 STEP 2272 H=2272:00 +CPU= 15.635
  01:38:29 STEP 2273 H=2273:00 +CPU= 15.117
  01:38:54 STEP 2274 H=2274:00 +CPU= 24.490
  01:39:09 STEP 2275 H=2275:00 +CPU= 15.153
  01:39:24 STEP 2276 H=2276:00 +CPU= 15.495
  01:39:48 STEP 2277 H=2277:00 +CPU= 24.074
  01:40:04 STEP 2278 H=2278:00 +CPU= 15.677
  01:40:20 STEP 2279 H=2279:00 +CPU= 15.745
  01:40:48 STEP 2280 H=2280:00 +CPU= 28.487
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_94.zip
Uploading the intermediate file: upload_file_94.zip
  01:41:03 STEP 2281 H=2281:00 +CPU= 15.134
  01:41:19 STEP 2282 H=2282:00 +CPU= 15.644
  01:41:43 STEP 2283 H=2283:00 +CPU= 24.108
  01:41:59 STEP 2284 H=2284:00 +CPU= 15.680
  01:42:14 STEP 2285 H=2285:00 +CPU= 15.208
  01:42:39 STEP 2286 H=2286:00 +CPU= 24.678
  01:42:54 STEP 2287 H=2287:00 +CPU= 15.409
  01:43:10 STEP 2288 H=2288:00 +CPU= 15.607
  01:43:34 STEP 2289 H=2289:00 +CPU= 24.069
  01:43:49 STEP 2290 H=2290:00 +CPU= 15.610
  01:44:05 STEP 2291 H=2291:00 +CPU= 15.377
  01:44:31 STEP 2292 H=2292:00 +CPU= 26.314
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002292
  01:44:46 STEP 2293 H=2293:00 +CPU= 15.202
  01:45:02 STEP 2294 H=2294:00 +CPU= 15.654
  01:45:26 STEP 2295 H=2295:00 +CPU= 24.120
  01:45:42 STEP 2296 H=2296:00 +CPU= 15.858
  01:45:57 STEP 2297 H=2297:00 +CPU= 15.182
  01:46:22 STEP 2298 H=2298:00 +CPU= 24.617
  01:46:37 STEP 2299 H=2299:00 +CPU= 15.194
  01:46:53 STEP 2300 H=2300:00 +CPU= 15.679
  01:47:17 STEP 2301 H=2301:00 +CPU= 24.106
  01:47:32 STEP 2302 H=2302:00 +CPU= 15.665
  01:47:48 STEP 2303 H=2303:00 +CPU= 15.675
  01:48:17 STEP 2304 H=2304:00 +CPU= 28.457
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_95.zip
Uploading the intermediate file: upload_file_95.zip
  01:48:32 STEP 2305 H=2305:00 +CPU= 15.277
  01:48:47 STEP 2306 H=2306:00 +CPU= 15.509
  01:49:11 STEP 2307 H=2307:00 +CPU= 23.972
  01:49:27 STEP 2308 H=2308:00 +CPU= 15.636
  01:49:42 STEP 2309 H=2309:00 +CPU= 15.231
  01:50:07 STEP 2310 H=2310:00 +CPU= 24.428
  01:50:22 STEP 2311 H=2311:00 +CPU= 15.299
  01:50:38 STEP 2312 H=2312:00 +CPU= 15.669
  01:51:02 STEP 2313 H=2313:00 +CPU= 24.067
  01:51:17 STEP 2314 H=2314:00 +CPU= 15.701
  01:51:33 STEP 2315 H=2315:00 +CPU= 15.291
  01:51:59 STEP 2316 H=2316:00 +CPU= 26.418
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002316
  01:52:14 STEP 2317 H=2317:00 +CPU= 15.193
  01:52:30 STEP 2318 H=2318:00 +CPU= 15.619
  01:52:54 STEP 2319 H=2319:00 +CPU= 24.205
  01:53:10 STEP 2320 H=2320:00 +CPU= 15.760
  01:53:25 STEP 2321 H=2321:00 +CPU= 15.173
  01:53:50 STEP 2322 H=2322:00 +CPU= 24.567
  01:54:05 STEP 2323 H=2323:00 +CPU= 15.272
  01:54:21 STEP 2324 H=2324:00 +CPU= 15.720
  01:54:45 STEP 2325 H=2325:00 +CPU= 24.101
  01:55:00 STEP 2326 H=2326:00 +CPU= 15.704
  01:55:16 STEP 2327 H=2327:00 +CPU= 15.692
  01:55:44 STEP 2328 H=2328:00 +CPU= 28.396
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_96.zip
Uploading the intermediate file: upload_file_96.zip
  01:56:00 STEP 2329 H=2329:00 +CPU= 15.367
  01:56:15 STEP 2330 H=2330:00 +CPU= 15.628
  01:56:40 STEP 2331 H=2331:00 +CPU= 24.173
  01:56:55 STEP 2332 H=2332:00 +CPU= 15.754
  01:57:11 STEP 2333 H=2333:00 +CPU= 15.216
  01:57:35 STEP 2334 H=2334:00 +CPU= 24.639
  01:57:51 STEP 2335 H=2335:00 +CPU= 15.408
  01:58:06 STEP 2336 H=2336:00 +CPU= 15.558
  01:58:31 STEP 2337 H=2337:00 +CPU= 24.298
  01:58:46 STEP 2338 H=2338:00 +CPU= 15.741
  01:59:02 STEP 2339 H=2339:00 +CPU= 15.301
  01:59:28 STEP 2340 H=2340:00 +CPU= 26.594
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002340
  01:59:43 STEP 2341 H=2341:00 +CPU= 15.251
  01:59:59 STEP 2342 H=2342:00 +CPU= 15.569
  02:00:23 STEP 2343 H=2343:00 +CPU= 24.095
  02:00:39 STEP 2344 H=2344:00 +CPU= 15.650
  02:00:54 STEP 2345 H=2345:00 +CPU= 15.203
  02:01:19 STEP 2346 H=2346:00 +CPU= 24.673
  02:01:34 STEP 2347 H=2347:00 +CPU= 15.291
  02:01:49 STEP 2348 H=2348:00 +CPU= 15.533
  02:02:13 STEP 2349 H=2349:00 +CPU= 23.924
  02:02:29 STEP 2350 H=2350:00 +CPU= 15.689
  02:02:45 STEP 2351 H=2351:00 +CPU= 15.672
  02:03:13 STEP 2352 H=2352:00 +CPU= 28.415
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_97.zip
Uploading the intermediate file: upload_file_97.zip
  02:03:29 STEP 2353 H=2353:00 +CPU= 15.322
  02:03:44 STEP 2354 H=2354:00 +CPU= 15.605
  02:04:08 STEP 2355 H=2355:00 +CPU= 24.142
  02:04:24 STEP 2356 H=2356:00 +CPU= 15.637
  02:04:39 STEP 2357 H=2357:00 +CPU= 15.176
  02:05:04 STEP 2358 H=2358:00 +CPU= 24.481
  02:05:19 STEP 2359 H=2359:00 +CPU= 15.326
  02:05:35 STEP 2360 H=2360:00 +CPU= 15.590
  02:05:59 STEP 2361 H=2361:00 +CPU= 24.082
  02:06:14 STEP 2362 H=2362:00 +CPU= 15.760
  02:06:30 STEP 2363 H=2363:00 +CPU= 15.310
  02:06:56 STEP 2364 H=2364:00 +CPU= 26.410
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002364
  02:07:11 STEP 2365 H=2365:00 +CPU= 15.351
  02:07:27 STEP 2366 H=2366:00 +CPU= 15.754
  02:07:51 STEP 2367 H=2367:00 +CPU= 24.071
  02:08:07 STEP 2368 H=2368:00 +CPU= 15.773
  02:08:22 STEP 2369 H=2369:00 +CPU= 15.114
  02:08:47 STEP 2370 H=2370:00 +CPU= 24.450
  02:09:02 STEP 2371 H=2371:00 +CPU= 15.133
  02:09:17 STEP 2372 H=2372:00 +CPU= 15.567
  02:09:41 STEP 2373 H=2373:00 +CPU= 24.021
  02:09:57 STEP 2374 H=2374:00 +CPU= 15.617
  02:10:13 STEP 2375 H=2375:00 +CPU= 15.743
  02:10:41 STEP 2376 H=2376:00 +CPU= 28.499
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_98.zip
Uploading the intermediate file: upload_file_98.zip
  02:10:57 STEP 2377 H=2377:00 +CPU= 15.276
Uploading trickle at timestep: 8553600
  02:11:12 STEP 2378 H=2378:00 +CPU= 15.556
  02:11:36 STEP 2379 H=2379:00 +CPU= 24.104
  02:11:52 STEP 2380 H=2380:00 +CPU= 15.604
  02:12:07 STEP 2381 H=2381:00 +CPU= 15.201
  02:12:32 STEP 2382 H=2382:00 +CPU= 24.616
  02:12:47 STEP 2383 H=2383:00 +CPU= 15.304
  02:13:03 STEP 2384 H=2384:00 +CPU= 15.700
  02:13:27 STEP 2385 H=2385:00 +CPU= 24.072
  02:13:42 STEP 2386 H=2386:00 +CPU= 15.751
  02:13:58 STEP 2387 H=2387:00 +CPU= 15.356
  02:14:24 STEP 2388 H=2388:00 +CPU= 26.500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002388
  02:14:40 STEP 2389 H=2389:00 +CPU= 15.336
  02:14:55 STEP 2390 H=2390:00 +CPU= 15.562
  02:15:19 STEP 2391 H=2391:00 +CPU= 24.223
  02:15:35 STEP 2392 H=2392:00 +CPU= 15.674
  02:15:50 STEP 2393 H=2393:00 +CPU= 15.093
  02:16:15 STEP 2394 H=2394:00 +CPU= 24.486
  02:16:30 STEP 2395 H=2395:00 +CPU= 15.213
  02:16:45 STEP 2396 H=2396:00 +CPU= 15.530
  02:17:09 STEP 2397 H=2397:00 +CPU= 23.902
  02:17:25 STEP 2398 H=2398:00 +CPU= 15.687
  02:17:41 STEP 2399 H=2399:00 +CPU= 15.823
  02:18:10 STEP 2400 H=2400:00 +CPU= 28.703
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_99.zip
Uploading the intermediate file: upload_file_99.zip
  02:18:25 STEP 2401 H=2401:00 +CPU= 15.198
  02:18:40 STEP 2402 H=2402:00 +CPU= 15.452
  02:19:04 STEP 2403 H=2403:00 +CPU= 24.016
  02:19:20 STEP 2404 H=2404:00 +CPU= 15.631
  02:19:35 STEP 2405 H=2405:00 +CPU= 15.229
  02:20:00 STEP 2406 H=2406:00 +CPU= 24.513
  02:20:15 STEP 2407 H=2407:00 +CPU= 15.178
  02:20:30 STEP 2408 H=2408:00 +CPU= 15.662
  02:20:55 STEP 2409 H=2409:00 +CPU= 24.183
  02:21:11 STEP 2410 H=2410:00 +CPU= 15.860
  02:21:26 STEP 2411 H=2411:00 +CPU= 15.340
  02:21:52 STEP 2412 H=2412:00 +CPU= 26.431
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002412
  02:22:08 STEP 2413 H=2413:00 +CPU= 15.331
  02:22:23 STEP 2414 H=2414:00 +CPU= 15.419
  02:22:47 STEP 2415 H=2415:00 +CPU= 24.137
  02:23:03 STEP 2416 H=2416:00 +CPU= 15.789
  02:23:18 STEP 2417 H=2417:00 +CPU= 15.246
  02:23:43 STEP 2418 H=2418:00 +CPU= 24.536
  02:23:58 STEP 2419 H=2419:00 +CPU= 15.321
  02:24:14 STEP 2420 H=2420:00 +CPU= 15.532
  02:24:38 STEP 2421 H=2421:00 +CPU= 24.076
  02:24:53 STEP 2422 H=2422:00 +CPU= 15.597
  02:25:09 STEP 2423 H=2423:00 +CPU= 15.705
  02:25:37 STEP 2424 H=2424:00 +CPU= 28.169
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_100.zip
Uploading the intermediate file: upload_file_100.zip
  02:25:52 STEP 2425 H=2425:00 +CPU= 15.264
  02:26:08 STEP 2426 H=2426:00 +CPU= 15.569
  02:26:32 STEP 2427 H=2427:00 +CPU= 24.256
  02:26:48 STEP 2428 H=2428:00 +CPU= 15.891
  02:27:03 STEP 2429 H=2429:00 +CPU= 15.198
  02:27:28 STEP 2430 H=2430:00 +CPU= 24.617
  02:27:43 STEP 2431 H=2431:00 +CPU= 15.214
  02:27:59 STEP 2432 H=2432:00 +CPU= 15.563
  02:28:23 STEP 2433 H=2433:00 +CPU= 24.223
  02:28:39 STEP 2434 H=2434:00 +CPU= 15.741
  02:28:54 STEP 2435 H=2435:00 +CPU= 15.274
  02:29:21 STEP 2436 H=2436:00 +CPU= 26.563
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002436
  02:29:36 STEP 2437 H=2437:00 +CPU= 15.261
  02:29:52 STEP 2438 H=2438:00 +CPU= 15.667
  02:30:16 STEP 2439 H=2439:00 +CPU= 24.162
  02:30:31 STEP 2440 H=2440:00 +CPU= 15.572
  02:30:46 STEP 2441 H=2441:00 +CPU= 15.082
  02:31:11 STEP 2442 H=2442:00 +CPU= 24.468
  02:31:26 STEP 2443 H=2443:00 +CPU= 15.370
  02:31:42 STEP 2444 H=2444:00 +CPU= 15.549
  02:32:06 STEP 2445 H=2445:00 +CPU= 23.891
  02:32:21 STEP 2446 H=2446:00 +CPU= 15.713
  02:32:37 STEP 2447 H=2447:00 +CPU= 15.733
  02:33:05 STEP 2448 H=2448:00 +CPU= 27.771
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_101.zip
Uploading the intermediate file: upload_file_101.zip
  02:33:20 STEP 2449 H=2449:00 +CPU= 14.770
  02:33:35 STEP 2450 H=2450:00 +CPU= 15.116
  02:33:59 STEP 2451 H=2451:00 +CPU= 23.953
  02:34:14 STEP 2452 H=2452:00 +CPU= 15.176
  02:34:29 STEP 2453 H=2453:00 +CPU= 14.922
  02:34:53 STEP 2454 H=2454:00 +CPU= 23.798
  02:35:07 STEP 2455 H=2455:00 +CPU= 14.687
  02:35:23 STEP 2456 H=2456:00 +CPU= 15.193
  02:35:46 STEP 2457 H=2457:00 +CPU= 23.504
  02:36:01 STEP 2458 H=2458:00 +CPU= 15.220
  02:36:16 STEP 2459 H=2459:00 +CPU= 14.855
  02:36:42 STEP 2460 H=2460:00 +CPU= 25.927
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002460
  02:36:57 STEP 2461 H=2461:00 +CPU= 14.849
  02:37:12 STEP 2462 H=2462:00 +CPU= 15.299
  02:37:36 STEP 2463 H=2463:00 +CPU= 23.502
  02:37:51 STEP 2464 H=2464:00 +CPU= 15.175
  02:38:06 STEP 2465 H=2465:00 +CPU= 14.728
  02:38:29 STEP 2466 H=2466:00 +CPU= 23.798
  02:38:44 STEP 2467 H=2467:00 +CPU= 14.801
  02:38:59 STEP 2468 H=2468:00 +CPU= 15.248
  02:39:23 STEP 2469 H=2469:00 +CPU= 23.343
  02:39:38 STEP 2470 H=2470:00 +CPU= 15.119
  02:39:53 STEP 2471 H=2471:00 +CPU= 15.237
  02:40:21 STEP 2472 H=2472:00 +CPU= 27.541
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_102.zip
Uploading the intermediate file: upload_file_102.zip
  02:40:36 STEP 2473 H=2473:00 +CPU= 14.841
  02:40:51 STEP 2474 H=2474:00 +CPU= 15.286
  02:41:14 STEP 2475 H=2475:00 +CPU= 23.417
  02:41:29 STEP 2476 H=2476:00 +CPU= 15.014
  02:41:44 STEP 2477 H=2477:00 +CPU= 14.699
  02:42:08 STEP 2478 H=2478:00 +CPU= 23.860
  02:42:23 STEP 2479 H=2479:00 +CPU= 14.894
  02:42:38 STEP 2480 H=2480:00 +CPU= 15.162
  02:43:01 STEP 2481 H=2481:00 +CPU= 23.472
  02:43:17 STEP 2482 H=2482:00 +CPU= 15.246
  02:43:31 STEP 2483 H=2483:00 +CPU= 14.681
  02:43:57 STEP 2484 H=2484:00 +CPU= 25.640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002484
  02:44:12 STEP 2485 H=2485:00 +CPU= 14.778
  02:44:27 STEP 2486 H=2486:00 +CPU= 15.083
  02:44:50 STEP 2487 H=2487:00 +CPU= 23.377
  02:45:06 STEP 2488 H=2488:00 +CPU= 15.337
  02:45:20 STEP 2489 H=2489:00 +CPU= 14.855
  02:45:44 STEP 2490 H=2490:00 +CPU= 23.797
  02:45:59 STEP 2491 H=2491:00 +CPU= 14.695
  02:46:14 STEP 2492 H=2492:00 +CPU= 15.189
  02:46:38 STEP 2493 H=2493:00 +CPU= 23.534
  02:46:53 STEP 2494 H=2494:00 +CPU= 15.150
  02:47:08 STEP 2495 H=2495:00 +CPU= 15.188
  02:47:35 STEP 2496 H=2496:00 +CPU= 27.394
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_103.zip
Uploading the intermediate file: upload_file_103.zip
  02:47:50 STEP 2497 H=2497:00 +CPU= 14.811
  02:48:05 STEP 2498 H=2498:00 +CPU= 15.031
  02:48:29 STEP 2499 H=2499:00 +CPU= 23.239
  02:48:44 STEP 2500 H=2500:00 +CPU= 15.237
  02:48:59 STEP 2501 H=2501:00 +CPU= 14.785
  02:49:22 STEP 2502 H=2502:00 +CPU= 23.810
  02:49:37 STEP 2503 H=2503:00 +CPU= 14.730
  02:49:52 STEP 2504 H=2504:00 +CPU= 15.112
  02:50:16 STEP 2505 H=2505:00 +CPU= 23.466
  02:50:31 STEP 2506 H=2506:00 +CPU= 15.283
  02:50:46 STEP 2507 H=2507:00 +CPU= 14.780
  02:51:11 STEP 2508 H=2508:00 +CPU= 25.700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002508
  02:51:26 STEP 2509 H=2509:00 +CPU= 14.773
  02:51:41 STEP 2510 H=2510:00 +CPU= 15.027
  02:52:05 STEP 2511 H=2511:00 +CPU= 23.286
  02:52:20 STEP 2512 H=2512:00 +CPU= 15.159
  02:52:35 STEP 2513 H=2513:00 +CPU= 14.817
  02:52:58 STEP 2514 H=2514:00 +CPU= 23.815
  02:53:13 STEP 2515 H=2515:00 +CPU= 14.663
  02:53:28 STEP 2516 H=2516:00 +CPU= 15.068
  02:53:52 STEP 2517 H=2517:00 +CPU= 23.503
  02:54:07 STEP 2518 H=2518:00 +CPU= 15.112
  02:54:22 STEP 2519 H=2519:00 +CPU= 15.292
  02:54:49 STEP 2520 H=2520:00 +CPU= 27.313
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_104.zip
Uploading the intermediate file: upload_file_104.zip
  02:55:04 STEP 2521 H=2521:00 +CPU= 14.792
  02:55:19 STEP 2522 H=2522:00 +CPU= 15.077
  02:55:43 STEP 2523 H=2523:00 +CPU= 23.326
  02:55:58 STEP 2524 H=2524:00 +CPU= 15.191
  02:56:12 STEP 2525 H=2525:00 +CPU= 14.749
  02:56:36 STEP 2526 H=2526:00 +CPU= 23.949
  02:56:51 STEP 2527 H=2527:00 +CPU= 14.814
  02:57:06 STEP 2528 H=2528:00 +CPU= 15.181
  02:57:30 STEP 2529 H=2529:00 +CPU= 23.341
  02:57:45 STEP 2530 H=2530:00 +CPU= 14.994
  02:57:59 STEP 2531 H=2531:00 +CPU= 14.699
  02:58:25 STEP 2532 H=2532:00 +CPU= 25.596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002532
  02:58:40 STEP 2533 H=2533:00 +CPU= 14.686
  02:58:55 STEP 2534 H=2534:00 +CPU= 15.192
  02:59:18 STEP 2535 H=2535:00 +CPU= 23.337
  02:59:33 STEP 2536 H=2536:00 +CPU= 15.188
  02:59:48 STEP 2537 H=2537:00 +CPU= 14.679
  03:00:12 STEP 2538 H=2538:00 +CPU= 23.651
  03:00:27 STEP 2539 H=2539:00 +CPU= 14.720
  03:00:42 STEP 2540 H=2540:00 +CPU= 14.992
  03:01:05 STEP 2541 H=2541:00 +CPU= 23.396
  03:01:20 STEP 2542 H=2542:00 +CPU= 15.102
  03:01:35 STEP 2543 H=2543:00 +CPU= 15.163
  03:02:03 STEP 2544 H=2544:00 +CPU= 27.470
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476_105.zip
Uploading the intermediate file: upload_file_105.zip
  03:02:17 STEP 2545 H=2545:00 +CPU= 14.798
  03:02:33 STEP 2546 H=2546:00 +CPU= 15.080
  03:02:56 STEP 2547 H=2547:00 +CPU= 23.496
  03:03:11 STEP 2548 H=2548:00 +CPU= 15.140
  03:03:26 STEP 2549 H=2549:00 +CPU= 14.714
  03:03:50 STEP 2550 H=2550:00 +CPU= 23.627
  03:04:04 STEP 2551 H=2551:00 +CPU= 14.779
  03:04:19 STEP 2552 H=2552:00 +CPU= 15.069
  03:04:43 STEP 2553 H=2553:00 +CPU= 23.351
  03:04:58 STEP 2554 H=2554:00 +CPU= 15.174
  03:05:13 STEP 2555 H=2555:00 +CPU= 14.774
  03:05:38 STEP 2556 H=2556:00 +CPU= 25.690
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002556
  03:05:53 STEP 2557 H=2557:00 +CPU= 14.810
  03:06:08 STEP 2558 H=2558:00 +CPU= 15.148
  03:06:32 STEP 2559 H=2559:00 +CPU= 23.369
  03:06:47 STEP 2560 H=2560:00 +CPU= 15.233
  03:07:02 STEP 2561 H=2561:00 +CPU= 14.627
  03:07:25 STEP 2562 H=2562:00 +CPU= 23.707
  03:07:40 STEP 2563 H=2563:00 +CPU= 14.820
  03:07:55 STEP 2564 H=2564:00 +CPU= 15.079
  03:08:19 STEP 2565 H=2565:00 +CPU= 23.401
  03:08:34 STEP 2566 H=2566:00 +CPU= 15.117
  03:08:49 STEP 2567 H=2567:00 +CPU= 15.177
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2012050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0273
(argv4) batchid: 981
(argv5) wuid: 12197917
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197917
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5c0d829a019fce6e2e12e0938bf23e6d to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0273_2012050100_123_981_12197917.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0273_2012050100_123_981_12197917.zip
ic_ancil_file: ic_ancil_12197917
ifsdata_file: ifsdata_12197917
climate_data_file: clim_data_12197917
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5e3a49ee56b7abc242b09fcd8fc3de99 to: /var/lib/boinc-client/slots/1/ic_ancil_12197917.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12197917.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e00351230b79938c5a48fd9ec6eda0fb to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12197917.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12197917.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12197917.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12197917.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12197917.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12197917.xml
-- Model is restarting --
Adjusting last_iter, 2568, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12197917.xml
last_cpu_time: 49767
upload_file_number: 106
last_iter: 2567
last_upload: 9158400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0273_2012050100_123_981_12197917_0_r1657810476
The child process has been launched with process id: 1434
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114824:1673693304:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
ECCODES ERROR   :  IO ERROR: Inappropriate ioctl for device (Inappropriate ioctl for device)
 GRIB_READ_BYTES_INT        50000                       4  FAILED         -11
 GRIB_API ERROR MSG: Input output problem
MPL_ABORT: CALLED FROM PROCESSOR      1 THRD     1
 MPL_ABORT: THRD           1   GRIB_READ_BYTES_INT FAILED
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1135 MB (maxheap), 361 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       RERESF 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        IOSTREAM_MIX:IO_GET 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         IOSTREAM_MIX:READ_RECORD 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >MPL-IOSTREAM READ_RECORD ( 650) 
[EC_DRHOOK:W31Ub20:1:1:1434:1434] [20230114:114825:1673693305:1.628] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GRIB_API:IGRIB_READ_BYTES_INT 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/1/oifs_43r3_model.exe' : sigcontextptr=0x7ffe98fe8b60
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with plain hex-dump
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x839273] : 0x839273
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x839879] : 0x839879
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x8c2957] : 0x8c2957
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x8c3229] : 0x8c3229
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0xa044bc] : 0xa044bc
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x9e49b1] : 0x9e49b1
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x9d8ba9] : 0x9d8ba9
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x54b4a0] : 0x54b4a0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x546a18] : 0x546a18
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x546412] : 0x546412
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x545e28] : 0x545e28
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x40708d] : 0x40708d
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x40220f] : 0x40220f
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4021a2] : 0x4021a2
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x1dca390] : 0x1dca390
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x40206e] : 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
abort: 
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:19:07 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 8,553,600 46,284 0.0054
09 May 2023 16:19:07 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 7,689,600 41,797 0.0054
09 May 2023 16:19:07 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 6,825,600 37,321 0.0055
09 May 2023 16:18:27 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 5,961,600 32,835 0.0055
09 May 2023 16:18:24 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 5,097,600 28,340 0.0056
09 May 2023 16:18:21 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 4,233,600 23,835 0.0056
09 May 2023 16:18:15 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 3,369,600 19,013 0.0056
09 May 2023 16:18:15 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 2,505,600 14,139 0.0056
09 May 2023 16:16:57 1532184 22283987 oifs_43r3_ps_0273_2012050100_123_981_12197917_0 864,000 4,863 0.0056


©2024 climateprediction.net