climateprediction.net home page
Task 22268066

Task 22268066

Name oifs_43r3_ps_0275_1997050100_123_966_12182919_0
Workunit 12182919
Created 22 Dec 2022, 13:10:27 UTC
Sent 20 Jan 2023, 23:50:48 UTC
Report deadline 21 Mar 2023, 23:50:48 UTC
Received 21 Jan 2023, 11:19:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1510542
Run time 10 hours 41 min 38 sec
CPU time 10 hours 34 min 49 sec
Validate state Invalid
Credit 12,216.96
Device peak FLOPS 6.42 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,411.69 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,030.07 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
o projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_83.zip
Uploading the intermediate file: upload_file_83.zip
  01:11:36 STEP 2017 H=2017:00 +CPU= 11.493
  01:11:48 STEP 2018 H=2018:00 +CPU= 11.628
  01:12:07 STEP 2019 H=2019:00 +CPU= 18.979
  01:12:18 STEP 2020 H=2020:00 +CPU= 11.736
  01:12:30 STEP 2021 H=2021:00 +CPU= 11.425
  01:12:49 STEP 2022 H=2022:00 +CPU= 19.136
  01:13:00 STEP 2023 H=2023:00 +CPU= 11.505
  01:13:12 STEP 2024 H=2024:00 +CPU= 11.780
  01:13:31 STEP 2025 H=2025:00 +CPU= 18.879
  01:13:43 STEP 2026 H=2026:00 +CPU= 11.745
  01:13:54 STEP 2027 H=2027:00 +CPU= 11.462
  01:14:15 STEP 2028 H=2028:00 +CPU= 20.539
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002028
  01:14:26 STEP 2029 H=2029:00 +CPU= 11.436
  01:14:38 STEP 2030 H=2030:00 +CPU= 11.651
  01:14:57 STEP 2031 H=2031:00 +CPU= 18.799
  01:15:08 STEP 2032 H=2032:00 +CPU= 11.773
  01:15:20 STEP 2033 H=2033:00 +CPU= 11.537
  01:15:39 STEP 2034 H=2034:00 +CPU= 19.111
  01:15:51 STEP 2035 H=2035:00 +CPU= 11.480
  01:16:02 STEP 2036 H=2036:00 +CPU= 11.809
  01:16:21 STEP 2037 H=2037:00 +CPU= 18.880
  01:16:33 STEP 2038 H=2038:00 +CPU= 11.703
  01:16:45 STEP 2039 H=2039:00 +CPU= 11.840
  01:17:07 STEP 2040 H=2040:00 +CPU= 21.687
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_84.zip
Uploading the intermediate file: upload_file_84.zip
  01:17:18 STEP 2041 H=2041:00 +CPU= 11.380
  01:17:30 STEP 2042 H=2042:00 +CPU= 11.604
  01:17:49 STEP 2043 H=2043:00 +CPU= 18.876
  01:18:00 STEP 2044 H=2044:00 +CPU= 11.635
  01:18:12 STEP 2045 H=2045:00 +CPU= 11.399
  01:18:31 STEP 2046 H=2046:00 +CPU= 19.006
  01:18:42 STEP 2047 H=2047:00 +CPU= 11.544
  01:18:54 STEP 2048 H=2048:00 +CPU= 11.665
  01:19:13 STEP 2049 H=2049:00 +CPU= 18.817
  01:19:24 STEP 2050 H=2050:00 +CPU= 11.671
  01:19:36 STEP 2051 H=2051:00 +CPU= 11.403
  01:19:56 STEP 2052 H=2052:00 +CPU= 20.408
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002052
  01:20:08 STEP 2053 H=2053:00 +CPU= 11.391
  01:20:19 STEP 2054 H=2054:00 +CPU= 11.554
  01:20:38 STEP 2055 H=2055:00 +CPU= 18.748
  01:20:50 STEP 2056 H=2056:00 +CPU= 11.726
  01:21:01 STEP 2057 H=2057:00 +CPU= 11.529
  01:21:20 STEP 2058 H=2058:00 +CPU= 19.045
  01:21:32 STEP 2059 H=2059:00 +CPU= 11.430
  01:21:43 STEP 2060 H=2060:00 +CPU= 11.654
  01:22:02 STEP 2061 H=2061:00 +CPU= 18.829
  01:22:14 STEP 2062 H=2062:00 +CPU= 11.668
  01:22:26 STEP 2063 H=2063:00 +CPU= 11.767
  01:22:47 STEP 2064 H=2064:00 +CPU= 21.749
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_85.zip
Uploading the intermediate file: upload_file_85.zip
  01:22:59 STEP 2065 H=2065:00 +CPU= 11.365
  01:23:10 STEP 2066 H=2066:00 +CPU= 11.569
  01:23:29 STEP 2067 H=2067:00 +CPU= 18.736
  01:23:41 STEP 2068 H=2068:00 +CPU= 11.645
  01:23:52 STEP 2069 H=2069:00 +CPU= 11.432
  01:24:11 STEP 2070 H=2070:00 +CPU= 18.998
  01:24:23 STEP 2071 H=2071:00 +CPU= 11.516
  01:24:35 STEP 2072 H=2072:00 +CPU= 11.734
  01:24:53 STEP 2073 H=2073:00 +CPU= 18.757
  01:25:05 STEP 2074 H=2074:00 +CPU= 11.689
  01:25:16 STEP 2075 H=2075:00 +CPU= 11.423
  01:25:37 STEP 2076 H=2076:00 +CPU= 20.568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002076
  01:25:48 STEP 2077 H=2077:00 +CPU= 11.460
  01:26:00 STEP 2078 H=2078:00 +CPU= 11.629
  01:26:19 STEP 2079 H=2079:00 +CPU= 18.755
  01:26:31 STEP 2080 H=2080:00 +CPU= 11.769
  01:26:42 STEP 2081 H=2081:00 +CPU= 11.502
  01:27:01 STEP 2082 H=2082:00 +CPU= 19.043
  01:27:13 STEP 2083 H=2083:00 +CPU= 11.438
  01:27:24 STEP 2084 H=2084:00 +CPU= 11.763
  01:27:43 STEP 2085 H=2085:00 +CPU= 18.766
  01:27:55 STEP 2086 H=2086:00 +CPU= 11.702
  01:28:07 STEP 2087 H=2087:00 +CPU= 11.712
  01:28:28 STEP 2088 H=2088:00 +CPU= 21.704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_86.zip
Uploading the intermediate file: upload_file_86.zip
  01:28:40 STEP 2089 H=2089:00 +CPU= 11.424
  01:28:51 STEP 2090 H=2090:00 +CPU= 11.543
  01:29:10 STEP 2091 H=2091:00 +CPU= 18.792
  01:29:22 STEP 2092 H=2092:00 +CPU= 11.667
  01:29:33 STEP 2093 H=2093:00 +CPU= 11.355
  01:29:52 STEP 2094 H=2094:00 +CPU= 18.988
  01:30:04 STEP 2095 H=2095:00 +CPU= 11.402
  01:30:15 STEP 2096 H=2096:00 +CPU= 11.666
  01:30:34 STEP 2097 H=2097:00 +CPU= 18.788
  01:30:46 STEP 2098 H=2098:00 +CPU= 11.683
  01:30:57 STEP 2099 H=2099:00 +CPU= 11.450
  01:31:18 STEP 2100 H=2100:00 +CPU= 20.621
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002100
  01:31:29 STEP 2101 H=2101:00 +CPU= 11.500
  01:31:41 STEP 2102 H=2102:00 +CPU= 11.676
  01:32:00 STEP 2103 H=2103:00 +CPU= 18.759
  01:32:12 STEP 2104 H=2104:00 +CPU= 11.780
  01:32:23 STEP 2105 H=2105:00 +CPU= 11.488
  01:32:42 STEP 2106 H=2106:00 +CPU= 19.080
  01:32:54 STEP 2107 H=2107:00 +CPU= 11.455
  01:33:05 STEP 2108 H=2108:00 +CPU= 11.762
  01:33:24 STEP 2109 H=2109:00 +CPU= 18.765
  01:33:36 STEP 2110 H=2110:00 +CPU= 11.708
  01:33:48 STEP 2111 H=2111:00 +CPU= 11.763
  01:34:10 STEP 2112 H=2112:00 +CPU= 21.785
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_87.zip
Uploading the intermediate file: upload_file_87.zip
  01:34:21 STEP 2113 H=2113:00 +CPU= 11.384
  01:34:32 STEP 2114 H=2114:00 +CPU= 11.604
  01:34:51 STEP 2115 H=2115:00 +CPU= 18.833
  01:35:03 STEP 2116 H=2116:00 +CPU= 11.797
  01:35:15 STEP 2117 H=2117:00 +CPU= 11.412
  01:35:34 STEP 2118 H=2118:00 +CPU= 19.093
  01:35:45 STEP 2119 H=2119:00 +CPU= 11.459
  01:35:57 STEP 2120 H=2120:00 +CPU= 11.645
  01:36:16 STEP 2121 H=2121:00 +CPU= 18.735
  01:36:27 STEP 2122 H=2122:00 +CPU= 11.638
  01:36:39 STEP 2123 H=2123:00 +CPU= 11.428
  01:36:59 STEP 2124 H=2124:00 +CPU= 20.482
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002124
  01:37:11 STEP 2125 H=2125:00 +CPU= 11.430
  01:37:22 STEP 2126 H=2126:00 +CPU= 11.624
  01:37:41 STEP 2127 H=2127:00 +CPU= 18.721
  01:37:52 STEP 2128 H=2128:00 +CPU= 11.593
  01:38:04 STEP 2129 H=2129:00 +CPU= 11.459
  01:38:23 STEP 2130 H=2130:00 +CPU= 19.066
  01:38:34 STEP 2131 H=2131:00 +CPU= 11.425
  01:38:46 STEP 2132 H=2132:00 +CPU= 11.701
  01:39:05 STEP 2133 H=2133:00 +CPU= 18.776
  01:39:17 STEP 2134 H=2134:00 +CPU= 11.667
  01:39:28 STEP 2135 H=2135:00 +CPU= 11.740
  01:39:50 STEP 2136 H=2136:00 +CPU= 21.682
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_88.zip
Uploading the intermediate file: upload_file_88.zip
  01:40:01 STEP 2137 H=2137:00 +CPU= 11.406
  01:40:13 STEP 2138 H=2138:00 +CPU= 11.610
  01:40:32 STEP 2139 H=2139:00 +CPU= 18.798
  01:40:44 STEP 2140 H=2140:00 +CPU= 11.711
  01:40:55 STEP 2141 H=2141:00 +CPU= 11.562
  01:41:14 STEP 2142 H=2142:00 +CPU= 19.132
  01:41:26 STEP 2143 H=2143:00 +CPU= 11.448
  01:41:37 STEP 2144 H=2144:00 +CPU= 11.716
  01:41:56 STEP 2145 H=2145:00 +CPU= 18.896
  01:42:08 STEP 2146 H=2146:00 +CPU= 11.772
  01:42:20 STEP 2147 H=2147:00 +CPU= 11.433
  01:42:40 STEP 2148 H=2148:00 +CPU= 20.670
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002148
  01:42:52 STEP 2149 H=2149:00 +CPU= 11.543
  01:43:03 STEP 2150 H=2150:00 +CPU= 11.628
  01:43:22 STEP 2151 H=2151:00 +CPU= 18.790
  01:43:34 STEP 2152 H=2152:00 +CPU= 11.673
  01:43:45 STEP 2153 H=2153:00 +CPU= 11.500
  01:44:05 STEP 2154 H=2154:00 +CPU= 19.053
  01:44:16 STEP 2155 H=2155:00 +CPU= 11.445
  01:44:28 STEP 2156 H=2156:00 +CPU= 11.714
  01:44:46 STEP 2157 H=2157:00 +CPU= 18.756
  01:44:58 STEP 2158 H=2158:00 +CPU= 11.725
  01:45:10 STEP 2159 H=2159:00 +CPU= 11.782
  01:45:32 STEP 2160 H=2160:00 +CPU= 21.664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_89.zip
Uploading the intermediate file: upload_file_89.zip
  01:45:43 STEP 2161 H=2161:00 +CPU= 11.489
  01:45:55 STEP 2162 H=2162:00 +CPU= 11.645
  01:46:14 STEP 2163 H=2163:00 +CPU= 18.920
  01:46:25 STEP 2164 H=2164:00 +CPU= 11.694
  01:46:37 STEP 2165 H=2165:00 +CPU= 11.425
  01:46:56 STEP 2166 H=2166:00 +CPU= 19.114
  01:47:07 STEP 2167 H=2167:00 +CPU= 11.454
  01:47:19 STEP 2168 H=2168:00 +CPU= 11.715
  01:47:38 STEP 2169 H=2169:00 +CPU= 18.726
  01:47:50 STEP 2170 H=2170:00 +CPU= 11.716
  01:48:01 STEP 2171 H=2171:00 +CPU= 11.433
  01:48:22 STEP 2172 H=2172:00 +CPU= 20.509
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002172
  01:48:33 STEP 2173 H=2173:00 +CPU= 11.462
  01:48:45 STEP 2174 H=2174:00 +CPU= 11.680
  01:49:03 STEP 2175 H=2175:00 +CPU= 18.701
  01:49:15 STEP 2176 H=2176:00 +CPU= 11.694
  01:49:27 STEP 2177 H=2177:00 +CPU= 11.491
  01:49:46 STEP 2178 H=2178:00 +CPU= 19.128
  01:49:57 STEP 2179 H=2179:00 +CPU= 11.435
  01:50:09 STEP 2180 H=2180:00 +CPU= 11.665
  01:50:28 STEP 2181 H=2181:00 +CPU= 18.762
  01:50:39 STEP 2182 H=2182:00 +CPU= 11.649
  01:50:51 STEP 2183 H=2183:00 +CPU= 11.771
  01:51:13 STEP 2184 H=2184:00 +CPU= 21.726
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_90.zip
Uploading the intermediate file: upload_file_90.zip
  01:51:24 STEP 2185 H=2185:00 +CPU= 11.384
  01:51:36 STEP 2186 H=2186:00 +CPU= 11.623
Uploading trickle at timestep: 7862400
  01:51:55 STEP 2187 H=2187:00 +CPU= 18.758
  01:52:06 STEP 2188 H=2188:00 +CPU= 11.665
  01:52:18 STEP 2189 H=2189:00 +CPU= 11.381
  01:52:37 STEP 2190 H=2190:00 +CPU= 19.097
  01:52:48 STEP 2191 H=2191:00 +CPU= 11.386
  01:53:00 STEP 2192 H=2192:00 +CPU= 11.686
  01:53:19 STEP 2193 H=2193:00 +CPU= 18.803
  01:53:30 STEP 2194 H=2194:00 +CPU= 11.760
  01:53:42 STEP 2195 H=2195:00 +CPU= 11.450
  01:54:02 STEP 2196 H=2196:00 +CPU= 20.561
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002196
  01:54:14 STEP 2197 H=2197:00 +CPU= 11.462
  01:54:26 STEP 2198 H=2198:00 +CPU= 11.672
  01:54:44 STEP 2199 H=2199:00 +CPU= 18.839
  01:54:56 STEP 2200 H=2200:00 +CPU= 11.695
  01:55:08 STEP 2201 H=2201:00 +CPU= 11.414
  01:55:27 STEP 2202 H=2202:00 +CPU= 19.147
  01:55:38 STEP 2203 H=2203:00 +CPU= 11.439
  01:55:50 STEP 2204 H=2204:00 +CPU= 11.738
  01:56:09 STEP 2205 H=2205:00 +CPU= 18.761
  01:56:20 STEP 2206 H=2206:00 +CPU= 11.704
  01:56:32 STEP 2207 H=2207:00 +CPU= 11.798
  01:56:54 STEP 2208 H=2208:00 +CPU= 21.794
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_91.zip
Uploading the intermediate file: upload_file_91.zip
  01:57:06 STEP 2209 H=2209:00 +CPU= 11.455
  01:57:17 STEP 2210 H=2210:00 +CPU= 11.667
  01:57:36 STEP 2211 H=2211:00 +CPU= 18.878
  01:57:48 STEP 2212 H=2212:00 +CPU= 11.697
  01:57:59 STEP 2213 H=2213:00 +CPU= 11.429
  01:58:18 STEP 2214 H=2214:00 +CPU= 19.109
  01:58:30 STEP 2215 H=2215:00 +CPU= 11.557
  01:58:42 STEP 2216 H=2216:00 +CPU= 11.747
  01:59:00 STEP 2217 H=2217:00 +CPU= 18.740
  01:59:12 STEP 2218 H=2218:00 +CPU= 11.738
  01:59:24 STEP 2219 H=2219:00 +CPU= 11.440
  01:59:44 STEP 2220 H=2220:00 +CPU= 20.618
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002220
  01:59:56 STEP 2221 H=2221:00 +CPU= 11.536
  02:00:08 STEP 2222 H=2222:00 +CPU= 11.734
  02:00:26 STEP 2223 H=2223:00 +CPU= 18.770
  02:00:38 STEP 2224 H=2224:00 +CPU= 11.891
  02:00:50 STEP 2225 H=2225:00 +CPU= 11.494
  02:01:09 STEP 2226 H=2226:00 +CPU= 19.107
  02:01:20 STEP 2227 H=2227:00 +CPU= 11.536
  02:01:32 STEP 2228 H=2228:00 +CPU= 11.715
  02:01:51 STEP 2229 H=2229:00 +CPU= 18.804
  02:02:03 STEP 2230 H=2230:00 +CPU= 11.690
  02:02:14 STEP 2231 H=2231:00 +CPU= 11.784
  02:02:36 STEP 2232 H=2232:00 +CPU= 21.771
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_92.zip
Uploading the intermediate file: upload_file_92.zip
  02:02:48 STEP 2233 H=2233:00 +CPU= 11.342
  02:02:59 STEP 2234 H=2234:00 +CPU= 11.720
  02:03:18 STEP 2235 H=2235:00 +CPU= 18.829
  02:03:30 STEP 2236 H=2236:00 +CPU= 11.656
  02:03:41 STEP 2237 H=2237:00 +CPU= 11.414
  02:04:00 STEP 2238 H=2238:00 +CPU= 19.087
  02:04:12 STEP 2239 H=2239:00 +CPU= 11.415
  02:04:23 STEP 2240 H=2240:00 +CPU= 11.628
  02:04:42 STEP 2241 H=2241:00 +CPU= 18.816
  02:04:54 STEP 2242 H=2242:00 +CPU= 11.660
  02:05:05 STEP 2243 H=2243:00 +CPU= 11.425
  02:05:26 STEP 2244 H=2244:00 +CPU= 20.518
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002244
  02:05:37 STEP 2245 H=2245:00 +CPU= 11.440
  02:05:49 STEP 2246 H=2246:00 +CPU= 11.663
  02:06:08 STEP 2247 H=2247:00 +CPU= 18.822
  02:06:19 STEP 2248 H=2248:00 +CPU= 11.724
  02:06:31 STEP 2249 H=2249:00 +CPU= 11.416
  02:06:50 STEP 2250 H=2250:00 +CPU= 19.085
  02:07:01 STEP 2251 H=2251:00 +CPU= 11.442
  02:07:13 STEP 2252 H=2252:00 +CPU= 11.685
  02:07:32 STEP 2253 H=2253:00 +CPU= 18.771
  02:07:44 STEP 2254 H=2254:00 +CPU= 11.733
  02:07:55 STEP 2255 H=2255:00 +CPU= 11.769
  02:08:17 STEP 2256 H=2256:00 +CPU= 21.677
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_93.zip
Uploading the intermediate file: upload_file_93.zip
  02:08:29 STEP 2257 H=2257:00 +CPU= 11.430
  02:08:40 STEP 2258 H=2258:00 +CPU= 11.598
  02:08:59 STEP 2259 H=2259:00 +CPU= 18.839
  02:09:11 STEP 2260 H=2260:00 +CPU= 11.689
  02:09:22 STEP 2261 H=2261:00 +CPU= 11.378
  02:09:41 STEP 2262 H=2262:00 +CPU= 18.957
  02:09:53 STEP 2263 H=2263:00 +CPU= 11.418
  02:10:04 STEP 2264 H=2264:00 +CPU= 11.716
  02:10:23 STEP 2265 H=2265:00 +CPU= 18.836
  02:10:35 STEP 2266 H=2266:00 +CPU= 11.734
  02:10:46 STEP 2267 H=2267:00 +CPU= 11.395
  02:11:07 STEP 2268 H=2268:00 +CPU= 20.561
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002268
  02:11:18 STEP 2269 H=2269:00 +CPU= 11.407
  02:11:30 STEP 2270 H=2270:00 +CPU= 11.651
  02:11:49 STEP 2271 H=2271:00 +CPU= 18.778
  02:12:00 STEP 2272 H=2272:00 +CPU= 11.713
  02:12:12 STEP 2273 H=2273:00 +CPU= 11.444
  02:12:31 STEP 2274 H=2274:00 +CPU= 19.119
  02:12:43 STEP 2275 H=2275:00 +CPU= 11.530
  02:12:54 STEP 2276 H=2276:00 +CPU= 11.691
  02:13:13 STEP 2277 H=2277:00 +CPU= 18.832
  02:13:25 STEP 2278 H=2278:00 +CPU= 11.829
  02:13:37 STEP 2279 H=2279:00 +CPU= 11.784
  02:13:59 STEP 2280 H=2280:00 +CPU= 21.722
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_94.zip
Uploading the intermediate file: upload_file_94.zip
  02:14:10 STEP 2281 H=2281:00 +CPU= 11.339
  02:14:21 STEP 2282 H=2282:00 +CPU= 11.615
  02:14:40 STEP 2283 H=2283:00 +CPU= 18.781
  02:14:52 STEP 2284 H=2284:00 +CPU= 11.730
  02:15:03 STEP 2285 H=2285:00 +CPU= 11.392
  02:15:23 STEP 2286 H=2286:00 +CPU= 19.085
  02:15:34 STEP 2287 H=2287:00 +CPU= 11.363
  02:15:46 STEP 2288 H=2288:00 +CPU= 11.651
  02:16:04 STEP 2289 H=2289:00 +CPU= 18.699
  02:16:16 STEP 2290 H=2290:00 +CPU= 11.702
  02:16:27 STEP 2291 H=2291:00 +CPU= 11.402
  02:16:48 STEP 2292 H=2292:00 +CPU= 20.612
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002292
  02:16:59 STEP 2293 H=2293:00 +CPU= 11.416
  02:17:11 STEP 2294 H=2294:00 +CPU= 11.692
  02:17:30 STEP 2295 H=2295:00 +CPU= 18.755
  02:17:42 STEP 2296 H=2296:00 +CPU= 11.774
  02:17:53 STEP 2297 H=2297:00 +CPU= 11.450
  02:18:12 STEP 2298 H=2298:00 +CPU= 19.081
  02:18:24 STEP 2299 H=2299:00 +CPU= 11.467
  02:18:35 STEP 2300 H=2300:00 +CPU= 11.728
  02:18:54 STEP 2301 H=2301:00 +CPU= 18.749
  02:19:06 STEP 2302 H=2302:00 +CPU= 11.712
  02:19:18 STEP 2303 H=2303:00 +CPU= 11.731
  02:19:39 STEP 2304 H=2304:00 +CPU= 21.795
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_95.zip
Uploading the intermediate file: upload_file_95.zip
  02:19:51 STEP 2305 H=2305:00 +CPU= 11.405
  02:20:03 STEP 2306 H=2306:00 +CPU= 11.630
  02:20:21 STEP 2307 H=2307:00 +CPU= 18.809
  02:20:33 STEP 2308 H=2308:00 +CPU= 11.701
  02:20:45 STEP 2309 H=2309:00 +CPU= 11.395
  02:21:03 STEP 2310 H=2310:00 +CPU= 18.925
  02:21:15 STEP 2311 H=2311:00 +CPU= 11.424
  02:21:27 STEP 2312 H=2312:00 +CPU= 11.647
  02:21:45 STEP 2313 H=2313:00 +CPU= 18.791
  02:21:57 STEP 2314 H=2314:00 +CPU= 11.680
  02:22:08 STEP 2315 H=2315:00 +CPU= 11.412
  02:22:29 STEP 2316 H=2316:00 +CPU= 20.501
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002316
  02:22:40 STEP 2317 H=2317:00 +CPU= 11.430
  02:22:52 STEP 2318 H=2318:00 +CPU= 11.620
  02:23:11 STEP 2319 H=2319:00 +CPU= 18.686
  02:23:22 STEP 2320 H=2320:00 +CPU= 11.694
  02:23:34 STEP 2321 H=2321:00 +CPU= 11.532
  02:23:53 STEP 2322 H=2322:00 +CPU= 19.184
  02:24:05 STEP 2323 H=2323:00 +CPU= 11.508
  02:24:16 STEP 2324 H=2324:00 +CPU= 11.703
  02:24:35 STEP 2325 H=2325:00 +CPU= 18.862
  02:24:47 STEP 2326 H=2326:00 +CPU= 11.736
  02:24:59 STEP 2327 H=2327:00 +CPU= 11.786
  02:25:21 STEP 2328 H=2328:00 +CPU= 21.737
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_96.zip
Uploading the intermediate file: upload_file_96.zip
  02:25:32 STEP 2329 H=2329:00 +CPU= 11.474
  02:25:44 STEP 2330 H=2330:00 +CPU= 11.637
  02:26:03 STEP 2331 H=2331:00 +CPU= 18.993
  02:26:14 STEP 2332 H=2332:00 +CPU= 11.608
  02:26:26 STEP 2333 H=2333:00 +CPU= 11.446
  02:26:45 STEP 2334 H=2334:00 +CPU= 19.049
  02:26:56 STEP 2335 H=2335:00 +CPU= 11.458
  02:27:08 STEP 2336 H=2336:00 +CPU= 11.731
  02:27:27 STEP 2337 H=2337:00 +CPU= 18.808
  02:27:39 STEP 2338 H=2338:00 +CPU= 11.706
  02:27:50 STEP 2339 H=2339:00 +CPU= 11.430
  02:28:11 STEP 2340 H=2340:00 +CPU= 20.580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002340
  02:28:22 STEP 2341 H=2341:00 +CPU= 11.467
  02:28:34 STEP 2342 H=2342:00 +CPU= 11.664
  02:28:53 STEP 2343 H=2343:00 +CPU= 18.783
  02:29:04 STEP 2344 H=2344:00 +CPU= 11.769
  02:29:16 STEP 2345 H=2345:00 +CPU= 11.482
  02:29:35 STEP 2346 H=2346:00 +CPU= 19.003
  02:29:46 STEP 2347 H=2347:00 +CPU= 11.414
  02:29:58 STEP 2348 H=2348:00 +CPU= 11.698
  02:30:17 STEP 2349 H=2349:00 +CPU= 18.817
  02:30:29 STEP 2350 H=2350:00 +CPU= 11.811
  02:30:40 STEP 2351 H=2351:00 +CPU= 11.749
  02:31:02 STEP 2352 H=2352:00 +CPU= 21.721
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_97.zip
Uploading the intermediate file: upload_file_97.zip
  02:31:14 STEP 2353 H=2353:00 +CPU= 11.438
  02:31:25 STEP 2354 H=2354:00 +CPU= 11.566
  02:31:44 STEP 2355 H=2355:00 +CPU= 18.820
  02:31:56 STEP 2356 H=2356:00 +CPU= 11.783
  02:32:07 STEP 2357 H=2357:00 +CPU= 11.401
  02:32:26 STEP 2358 H=2358:00 +CPU= 19.059
  02:32:38 STEP 2359 H=2359:00 +CPU= 11.401
  02:32:49 STEP 2360 H=2360:00 +CPU= 11.624
  02:33:08 STEP 2361 H=2361:00 +CPU= 18.784
  02:33:20 STEP 2362 H=2362:00 +CPU= 11.680
  02:33:31 STEP 2363 H=2363:00 +CPU= 11.365
  02:33:52 STEP 2364 H=2364:00 +CPU= 20.497
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002364
  02:34:03 STEP 2365 H=2365:00 +CPU= 11.423
  02:34:15 STEP 2366 H=2366:00 +CPU= 11.585
  02:34:33 STEP 2367 H=2367:00 +CPU= 18.636
  02:34:45 STEP 2368 H=2368:00 +CPU= 11.679
  02:34:57 STEP 2369 H=2369:00 +CPU= 11.460
  02:35:16 STEP 2370 H=2370:00 +CPU= 19.115
  02:35:27 STEP 2371 H=2371:00 +CPU= 11.479
  02:35:39 STEP 2372 H=2372:00 +CPU= 11.722
  02:35:58 STEP 2373 H=2373:00 +CPU= 18.888
  02:36:10 STEP 2374 H=2374:00 +CPU= 11.674
  02:36:21 STEP 2375 H=2375:00 +CPU= 11.756
  02:36:43 STEP 2376 H=2376:00 +CPU= 21.690
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_98.zip
Uploading the intermediate file: upload_file_98.zip
  02:36:54 STEP 2377 H=2377:00 +CPU= 11.350
  02:37:06 STEP 2378 H=2378:00 +CPU= 11.625
  02:37:25 STEP 2379 H=2379:00 +CPU= 18.864
  02:37:37 STEP 2380 H=2380:00 +CPU= 11.756
  02:37:48 STEP 2381 H=2381:00 +CPU= 11.474
  02:38:07 STEP 2382 H=2382:00 +CPU= 19.001
  02:38:19 STEP 2383 H=2383:00 +CPU= 11.482
  02:38:30 STEP 2384 H=2384:00 +CPU= 11.695
  02:38:49 STEP 2385 H=2385:00 +CPU= 18.813
  02:39:01 STEP 2386 H=2386:00 +CPU= 11.707
  02:39:12 STEP 2387 H=2387:00 +CPU= 11.514
  02:39:33 STEP 2388 H=2388:00 +CPU= 20.556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002388
  02:39:44 STEP 2389 H=2389:00 +CPU= 11.438
  02:39:56 STEP 2390 H=2390:00 +CPU= 11.672
  02:40:15 STEP 2391 H=2391:00 +CPU= 18.752
  02:40:27 STEP 2392 H=2392:00 +CPU= 11.743
  02:40:38 STEP 2393 H=2393:00 +CPU= 11.510
  02:40:57 STEP 2394 H=2394:00 +CPU= 19.122
  02:41:09 STEP 2395 H=2395:00 +CPU= 11.437
  02:41:20 STEP 2396 H=2396:00 +CPU= 11.700
  02:41:39 STEP 2397 H=2397:00 +CPU= 18.784
  02:41:51 STEP 2398 H=2398:00 +CPU= 11.757
  02:42:03 STEP 2399 H=2399:00 +CPU= 11.754
  02:42:24 STEP 2400 H=2400:00 +CPU= 21.835
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_99.zip
Uploading the intermediate file: upload_file_99.zip
  02:42:36 STEP 2401 H=2401:00 +CPU= 11.503
  02:42:48 STEP 2402 H=2402:00 +CPU= 11.657
  02:43:07 STEP 2403 H=2403:00 +CPU= 18.846
  02:43:18 STEP 2404 H=2404:00 +CPU= 11.892
  02:43:30 STEP 2405 H=2405:00 +CPU= 11.432
  02:43:49 STEP 2406 H=2406:00 +CPU= 19.130
  02:44:01 STEP 2407 H=2407:00 +CPU= 11.542
  02:44:12 STEP 2408 H=2408:00 +CPU= 11.676
  02:44:31 STEP 2409 H=2409:00 +CPU= 18.772
  02:44:43 STEP 2410 H=2410:00 +CPU= 11.688
  02:44:54 STEP 2411 H=2411:00 +CPU= 11.457
  02:45:15 STEP 2412 H=2412:00 +CPU= 20.572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002412
  02:45:26 STEP 2413 H=2413:00 +CPU= 11.446
  02:45:38 STEP 2414 H=2414:00 +CPU= 11.695
  02:45:57 STEP 2415 H=2415:00 +CPU= 18.670
  02:46:08 STEP 2416 H=2416:00 +CPU= 11.733
  02:46:20 STEP 2417 H=2417:00 +CPU= 11.398
  02:46:39 STEP 2418 H=2418:00 +CPU= 19.126
  02:46:50 STEP 2419 H=2419:00 +CPU= 11.452
  02:47:02 STEP 2420 H=2420:00 +CPU= 11.738
  02:47:21 STEP 2421 H=2421:00 +CPU= 18.770
  02:47:32 STEP 2422 H=2422:00 +CPU= 11.642
  02:47:44 STEP 2423 H=2423:00 +CPU= 11.757
  02:48:06 STEP 2424 H=2424:00 +CPU= 21.727
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_100.zip
Uploading the intermediate file: upload_file_100.zip
  02:48:17 STEP 2425 H=2425:00 +CPU= 11.358
  02:48:29 STEP 2426 H=2426:00 +CPU= 11.697
Uploading trickle at timestep: 8726400
  02:48:48 STEP 2427 H=2427:00 +CPU= 18.841
  02:49:00 STEP 2428 H=2428:00 +CPU= 11.753
  02:49:11 STEP 2429 H=2429:00 +CPU= 11.354
  02:49:30 STEP 2430 H=2430:00 +CPU= 19.086
  02:49:42 STEP 2431 H=2431:00 +CPU= 11.496
  02:49:53 STEP 2432 H=2432:00 +CPU= 11.677
  02:50:12 STEP 2433 H=2433:00 +CPU= 18.757
  02:50:24 STEP 2434 H=2434:00 +CPU= 11.658
  02:50:35 STEP 2435 H=2435:00 +CPU= 11.377
  02:50:56 STEP 2436 H=2436:00 +CPU= 20.493
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002436
  02:51:07 STEP 2437 H=2437:00 +CPU= 11.389
  02:51:19 STEP 2438 H=2438:00 +CPU= 11.594
  02:51:37 STEP 2439 H=2439:00 +CPU= 18.710
  02:51:49 STEP 2440 H=2440:00 +CPU= 11.599
  02:52:01 STEP 2441 H=2441:00 +CPU= 11.489
  02:52:20 STEP 2442 H=2442:00 +CPU= 19.012
  02:52:31 STEP 2443 H=2443:00 +CPU= 11.502
  02:52:43 STEP 2444 H=2444:00 +CPU= 11.766
  02:53:02 STEP 2445 H=2445:00 +CPU= 18.778
  02:53:13 STEP 2446 H=2446:00 +CPU= 11.670
  02:53:25 STEP 2447 H=2447:00 +CPU= 11.698
  02:53:47 STEP 2448 H=2448:00 +CPU= 21.680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_101.zip
Uploading the intermediate file: upload_file_101.zip
  02:53:58 STEP 2449 H=2449:00 +CPU= 11.433
  02:54:10 STEP 2450 H=2450:00 +CPU= 11.631
  02:54:29 STEP 2451 H=2451:00 +CPU= 18.902
  02:54:40 STEP 2452 H=2452:00 +CPU= 11.725
  02:54:52 STEP 2453 H=2453:00 +CPU= 11.388
  02:55:11 STEP 2454 H=2454:00 +CPU= 19.085
  02:55:22 STEP 2455 H=2455:00 +CPU= 11.411
  02:55:34 STEP 2456 H=2456:00 +CPU= 11.670
  02:55:53 STEP 2457 H=2457:00 +CPU= 18.766
  02:56:04 STEP 2458 H=2458:00 +CPU= 11.675
  02:56:16 STEP 2459 H=2459:00 +CPU= 11.437
  02:56:37 STEP 2460 H=2460:00 +CPU= 20.601
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002460
  02:56:48 STEP 2461 H=2461:00 +CPU= 11.483
  02:57:00 STEP 2462 H=2462:00 +CPU= 11.709
  02:57:19 STEP 2463 H=2463:00 +CPU= 18.838
  02:57:30 STEP 2464 H=2464:00 +CPU= 11.695
  02:57:42 STEP 2465 H=2465:00 +CPU= 11.471
  02:58:01 STEP 2466 H=2466:00 +CPU= 19.063
  02:58:12 STEP 2467 H=2467:00 +CPU= 11.493
  02:58:24 STEP 2468 H=2468:00 +CPU= 11.679
  02:58:43 STEP 2469 H=2469:00 +CPU= 18.831
  02:58:55 STEP 2470 H=2470:00 +CPU= 11.690
  02:59:06 STEP 2471 H=2471:00 +CPU= 11.779
  02:59:28 STEP 2472 H=2472:00 +CPU= 21.728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_102.zip
Uploading the intermediate file: upload_file_102.zip
  02:59:40 STEP 2473 H=2473:00 +CPU= 11.376
  02:59:51 STEP 2474 H=2474:00 +CPU= 11.728
  03:00:10 STEP 2475 H=2475:00 +CPU= 19.019
  03:00:22 STEP 2476 H=2476:00 +CPU= 11.634
  03:00:33 STEP 2477 H=2477:00 +CPU= 11.446
  03:00:52 STEP 2478 H=2478:00 +CPU= 19.056
  03:01:04 STEP 2479 H=2479:00 +CPU= 11.434
  03:01:16 STEP 2480 H=2480:00 +CPU= 11.617
  03:01:34 STEP 2481 H=2481:00 +CPU= 18.785
  03:01:46 STEP 2482 H=2482:00 +CPU= 11.627
  03:01:57 STEP 2483 H=2483:00 +CPU= 11.356
  03:02:18 STEP 2484 H=2484:00 +CPU= 20.648
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002484
  03:02:29 STEP 2485 H=2485:00 +CPU= 11.473
  03:02:41 STEP 2486 H=2486:00 +CPU= 11.633
  03:03:00 STEP 2487 H=2487:00 +CPU= 18.873
  03:03:12 STEP 2488 H=2488:00 +CPU= 11.704
  03:03:23 STEP 2489 H=2489:00 +CPU= 11.414
  03:03:42 STEP 2490 H=2490:00 +CPU= 19.178
  03:03:54 STEP 2491 H=2491:00 +CPU= 11.419
  03:04:05 STEP 2492 H=2492:00 +CPU= 11.617
  03:04:24 STEP 2493 H=2493:00 +CPU= 18.811
  03:04:36 STEP 2494 H=2494:00 +CPU= 11.677
  03:04:47 STEP 2495 H=2495:00 +CPU= 11.658
  03:05:09 STEP 2496 H=2496:00 +CPU= 21.734
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_103.zip
Uploading the intermediate file: upload_file_103.zip
  03:05:21 STEP 2497 H=2497:00 +CPU= 11.429
  03:05:32 STEP 2498 H=2498:00 +CPU= 11.642
  03:05:51 STEP 2499 H=2499:00 +CPU= 18.914
  03:06:03 STEP 2500 H=2500:00 +CPU= 11.718
  03:06:14 STEP 2501 H=2501:00 +CPU= 11.423
  03:06:34 STEP 2502 H=2502:00 +CPU= 19.078
  03:06:45 STEP 2503 H=2503:00 +CPU= 11.400
  03:06:57 STEP 2504 H=2504:00 +CPU= 11.722
  03:07:16 STEP 2505 H=2505:00 +CPU= 18.847
  03:07:27 STEP 2506 H=2506:00 +CPU= 11.712
  03:07:39 STEP 2507 H=2507:00 +CPU= 11.531
  03:07:59 STEP 2508 H=2508:00 +CPU= 20.712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002508
  03:08:11 STEP 2509 H=2509:00 +CPU= 11.503
  03:08:23 STEP 2510 H=2510:00 +CPU= 11.787
  03:08:42 STEP 2511 H=2511:00 +CPU= 18.861
  03:08:53 STEP 2512 H=2512:00 +CPU= 11.744
  03:09:05 STEP 2513 H=2513:00 +CPU= 11.491
  03:09:24 STEP 2514 H=2514:00 +CPU= 19.106
  03:09:36 STEP 2515 H=2515:00 +CPU= 11.544
  03:09:47 STEP 2516 H=2516:00 +CPU= 11.719
  03:10:06 STEP 2517 H=2517:00 +CPU= 18.941
  03:10:18 STEP 2518 H=2518:00 +CPU= 11.684
  03:10:30 STEP 2519 H=2519:00 +CPU= 11.858
  03:10:52 STEP 2520 H=2520:00 +CPU= 22.017
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_104.zip
Uploading the intermediate file: upload_file_104.zip
  03:11:03 STEP 2521 H=2521:00 +CPU= 11.494
  03:11:15 STEP 2522 H=2522:00 +CPU= 11.674
  03:11:34 STEP 2523 H=2523:00 +CPU= 18.872
  03:11:46 STEP 2524 H=2524:00 +CPU= 11.810
  03:11:57 STEP 2525 H=2525:00 +CPU= 11.426
  03:12:16 STEP 2526 H=2526:00 +CPU= 19.000
  03:12:28 STEP 2527 H=2527:00 +CPU= 11.438
  03:12:39 STEP 2528 H=2528:00 +CPU= 11.736
  03:12:58 STEP 2529 H=2529:00 +CPU= 18.727
  03:13:10 STEP 2530 H=2530:00 +CPU= 11.662
  03:13:21 STEP 2531 H=2531:00 +CPU= 11.448
  03:13:42 STEP 2532 H=2532:00 +CPU= 20.561
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002532
  03:13:53 STEP 2533 H=2533:00 +CPU= 11.448
  03:14:05 STEP 2534 H=2534:00 +CPU= 11.671
  03:14:24 STEP 2535 H=2535:00 +CPU= 18.686
  03:14:35 STEP 2536 H=2536:00 +CPU= 11.685
  03:14:47 STEP 2537 H=2537:00 +CPU= 11.587
  03:15:06 STEP 2538 H=2538:00 +CPU= 18.936
  03:15:17 STEP 2539 H=2539:00 +CPU= 11.356
  03:15:29 STEP 2540 H=2540:00 +CPU= 11.732
  03:15:48 STEP 2541 H=2541:00 +CPU= 18.661
  03:15:59 STEP 2542 H=2542:00 +CPU= 11.571
  03:16:11 STEP 2543 H=2543:00 +CPU= 11.710
  03:16:33 STEP 2544 H=2544:00 +CPU= 21.801
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_105.zip
Uploading the intermediate file: upload_file_105.zip
  03:16:44 STEP 2545 H=2545:00 +CPU= 11.512
  03:16:56 STEP 2546 H=2546:00 +CPU= 11.622
  03:17:15 STEP 2547 H=2547:00 +CPU= 18.830
  03:17:26 STEP 2548 H=2548:00 +CPU= 11.692
  03:17:38 STEP 2549 H=2549:00 +CPU= 11.433
  03:17:57 STEP 2550 H=2550:00 +CPU= 19.140
  03:18:08 STEP 2551 H=2551:00 +CPU= 11.489
  03:18:20 STEP 2552 H=2552:00 +CPU= 11.759
  03:18:39 STEP 2553 H=2553:00 +CPU= 18.848
  03:18:51 STEP 2554 H=2554:00 +CPU= 11.703
  03:19:02 STEP 2555 H=2555:00 +CPU= 11.559
  03:19:23 STEP 2556 H=2556:00 +CPU= 20.604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002556
  03:19:35 STEP 2557 H=2557:00 +CPU= 11.585
  03:19:47 STEP 2558 H=2558:00 +CPU= 12.321
  03:20:07 STEP 2559 H=2559:00 +CPU= 19.420
  03:20:19 STEP 2560 H=2560:00 +CPU= 11.783
  03:20:35 STEP 2561 H=2561:00 +CPU= 11.807
  03:20:56 STEP 2562 H=2562:00 +CPU= 21.044
  03:21:10 STEP 2563 H=2563:00 +CPU= 14.027
  03:21:22 STEP 2564 H=2564:00 +CPU= 11.694
  03:22:52 STEP 2565 H=2565:00 +CPU= 19.843
  03:23:08 STEP 2566 H=2566:00 +CPU= 11.943
  03:23:25 STEP 2567 H=2567:00 +CPU= 12.258
  03:24:14 STEP 2568 H=2568:00 +CPU= 24.040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_106.zip
  03:24:26 STEP 2569 H=2569:00 +CPU= 11.752
Uploading the intermediate file: upload_file_106.zip
  03:24:39 STEP 2570 H=2570:00 +CPU= 12.398
  03:25:00 STEP 2571 H=2571:00 +CPU= 20.803
  03:25:13 STEP 2572 H=2572:00 +CPU= 12.285
  03:25:24 STEP 2573 H=2573:00 +CPU= 11.661
  03:25:45 STEP 2574 H=2574:00 +CPU= 20.209
  03:25:57 STEP 2575 H=2575:00 +CPU= 12.053
  03:26:09 STEP 2576 H=2576:00 +CPU= 12.326
  03:26:48 STEP 2577 H=2577:00 +CPU= 19.738
  03:27:01 STEP 2578 H=2578:00 +CPU= 11.885
  03:27:14 STEP 2579 H=2579:00 +CPU= 12.140
  03:27:39 STEP 2580 H=2580:00 +CPU= 22.467
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002580
  03:27:51 STEP 2581 H=2581:00 +CPU= 11.960
  03:28:04 STEP 2582 H=2582:00 +CPU= 12.327
  03:28:24 STEP 2583 H=2583:00 +CPU= 19.780
  03:28:36 STEP 2584 H=2584:00 +CPU= 11.658
  03:28:48 STEP 2585 H=2585:00 +CPU= 11.553
  03:29:08 STEP 2586 H=2586:00 +CPU= 19.961
  03:29:19 STEP 2587 H=2587:00 +CPU= 11.424
  03:29:32 STEP 2588 H=2588:00 +CPU= 11.978
  03:30:04 STEP 2589 H=2589:00 +CPU= 19.113
  03:30:16 STEP 2590 H=2590:00 +CPU= 11.683
  03:30:28 STEP 2591 H=2591:00 +CPU= 11.943
  03:31:04 STEP 2592 H=2592:00 +CPU= 21.955
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_107.zip
Uploading the intermediate file: upload_file_107.zip
  03:31:16 STEP 2593 H=2593:00 +CPU= 11.458
  03:31:28 STEP 2594 H=2594:00 +CPU= 11.833
  03:32:20 STEP 2595 H=2595:00 +CPU= 20.411
  03:32:33 STEP 2596 H=2596:00 +CPU= 11.699
  03:32:44 STEP 2597 H=2597:00 +CPU= 11.501
  03:33:04 STEP 2598 H=2598:00 +CPU= 19.282
  03:33:15 STEP 2599 H=2599:00 +CPU= 11.625
  03:33:27 STEP 2600 H=2600:00 +CPU= 11.865
  03:33:49 STEP 2601 H=2601:00 +CPU= 19.185
  03:34:01 STEP 2602 H=2602:00 +CPU= 11.865
  03:34:12 STEP 2603 H=2603:00 +CPU= 11.576
  03:34:35 STEP 2604 H=2604:00 +CPU= 21.447
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002604
  03:34:47 STEP 2605 H=2605:00 +CPU= 11.962
  03:34:59 STEP 2606 H=2606:00 +CPU= 11.876
  03:35:19 STEP 2607 H=2607:00 +CPU= 19.549
  03:35:32 STEP 2608 H=2608:00 +CPU= 11.918
  03:35:43 STEP 2609 H=2609:00 +CPU= 11.489
  03:36:04 STEP 2610 H=2610:00 +CPU= 19.562
  03:36:16 STEP 2611 H=2611:00 +CPU= 11.674
  03:36:28 STEP 2612 H=2612:00 +CPU= 12.241
  03:36:47 STEP 2613 H=2613:00 +CPU= 18.993
  03:36:59 STEP 2614 H=2614:00 +CPU= 11.873
  03:37:12 STEP 2615 H=2615:00 +CPU= 12.185
  03:37:42 STEP 2616 H=2616:00 +CPU= 21.830
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_108.zip
Uploading the intermediate file: upload_file_108.zip
  03:37:54 STEP 2617 H=2617:00 +CPU= 11.615
  03:38:05 STEP 2618 H=2618:00 +CPU= 11.800
  03:38:25 STEP 2619 H=2619:00 +CPU= 19.340
  03:38:37 STEP 2620 H=2620:00 +CPU= 11.884
  03:38:48 STEP 2621 H=2621:00 +CPU= 11.599
  03:39:08 STEP 2622 H=2622:00 +CPU= 19.348
  03:39:19 STEP 2623 H=2623:00 +CPU= 11.605
  03:39:31 STEP 2624 H=2624:00 +CPU= 11.934
  03:39:51 STEP 2625 H=2625:00 +CPU= 19.058
  03:40:02 STEP 2626 H=2626:00 +CPU= 11.787
  03:40:14 STEP 2627 H=2627:00 +CPU= 11.596
  03:40:36 STEP 2628 H=2628:00 +CPU= 22.110
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002628
  03:40:48 STEP 2629 H=2629:00 +CPU= 11.702
  03:41:00 STEP 2630 H=2630:00 +CPU= 11.902
  03:41:21 STEP 2631 H=2631:00 +CPU= 19.866
  03:41:34 STEP 2632 H=2632:00 +CPU= 13.007
  03:41:46 STEP 2633 H=2633:00 +CPU= 11.844
  03:42:09 STEP 2634 H=2634:00 +CPU= 22.288
  03:42:22 STEP 2635 H=2635:00 +CPU= 13.447
  03:42:34 STEP 2636 H=2636:00 +CPU= 11.856
  03:42:53 STEP 2637 H=2637:00 +CPU= 18.959
  03:43:05 STEP 2638 H=2638:00 +CPU= 11.987
  03:43:18 STEP 2639 H=2639:00 +CPU= 11.976
  03:43:42 STEP 2640 H=2640:00 +CPU= 22.155
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182919/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0275_1997050100_123_966_12182919_0_r1122481258_109.zip
Uploading the intermediate file: upload_file_109.zip
  03:43:54 STEP 2641 H=2641:00 +CPU= 11.729
  03:44:06 STEP 2642 H=2642:00 +CPU= 11.825
  03:44:26 STEP 2643 H=2643:00 +CPU= 19.810
  03:44:38 STEP 2644 H=2644:00 +CPU= 11.805
  03:44:50 STEP 2645 H=2645:00 +CPU= 11.467
  03:45:09 STEP 2646 H=2646:00 +CPU= 19.280
  03:45:21 STEP 2647 H=2647:00 +CPU= 11.715
  03:45:33 STEP 2648 H=2648:00 +CPU= 11.854
  03:45:52 STEP 2649 H=2649:00 +CPU= 19.081
  03:46:04 STEP 2650 H=2650:00 +CPU= 11.897
  03:46:16 STEP 2651 H=2651:00 +CPU= 11.675
  03:46:46 STEP 2652 H=2652:00 +CPU= 20.807
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002652
  03:46:57 STEP 2653 H=2653:00 +CPU= 11.581
  03:47:09 STEP 2654 H=2654:00 +CPU= 11.815
  03:47:31 STEP 2655 H=2655:00 +CPU= 20.324
  03:47:43 STEP 2656 H=2656:00 +CPU= 12.292
  03:47:55 STEP 2657 H=2657:00 +CPU= 11.511
  03:48:14 STEP 2658 H=2658:00 +CPU= 19.264
  03:48:26 STEP 2659 H=2659:00 +CPU= 11.700
  03:48:38 STEP 2660 H=2660:00 +CPU= 11.758
  03:48:57 STEP 2661 H=2661:00 +CPU= 18.930
  03:49:09 STEP 2662 H=2662:00 +CPU= 11.963
  03:49:22 STEP 2663 H=2663:00 +CPU= 12.082
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:32:58 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 8,726,400 34,643 0.0040
09 May 2023 16:32:52 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 7,862,400 31,227 0.0040
09 May 2023 16:32:46 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 6,998,400 27,816 0.0040
09 May 2023 16:32:40 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 6,134,400 24,408 0.0040
09 May 2023 16:32:34 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 5,270,400 21,002 0.0040
09 May 2023 16:32:28 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 4,406,400 17,586 0.0040
09 May 2023 16:32:23 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 3,542,400 14,196 0.0040
09 May 2023 16:32:16 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 2,678,400 10,796 0.0040
09 May 2023 16:32:11 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 1,728,000 6,922 0.0040
09 May 2023 16:32:11 1510542 22268066 oifs_43r3_ps_0275_1997050100_123_966_12182919_0 864,000 3,497 0.0040


©2024 climateprediction.net