climateprediction.net home page
Task 22279760

Task 22279760

Name oifs_43r3_ps_0297_2008050100_123_977_12193941_0
Workunit 12193941
Created 23 Dec 2022, 18:04:08 UTC
Sent 29 Dec 2022, 13:28:51 UTC
Report deadline 28 Jan 2023, 13:28:51 UTC
Received 30 Dec 2022, 8:02:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1535374
Run time 17 hours 59 min 53 sec
CPU time 17 hours 57 min 57 sec
Validate state Invalid
Credit 13,668.48
Device peak FLOPS 5.45 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,410.18 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,435.49 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
prediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_90.zip
Uploading the intermediate file: upload_file_90.zip
  03:54:12 STEP 2185 H=2185:00 +CPU= 21.027
  03:54:33 STEP 2186 H=2186:00 +CPU= 20.789
  03:55:06 STEP 2187 H=2187:00 +CPU= 33.173
  03:55:27 STEP 2188 H=2188:00 +CPU= 20.509
  03:55:49 STEP 2189 H=2189:00 +CPU= 21.859
  03:56:24 STEP 2190 H=2190:00 +CPU= 35.270
  03:56:46 STEP 2191 H=2191:00 +CPU= 21.704
  03:57:09 STEP 2192 H=2192:00 +CPU= 22.687
  03:57:42 STEP 2193 H=2193:00 +CPU= 33.317
  03:58:03 STEP 2194 H=2194:00 +CPU= 21.116
  03:58:25 STEP 2195 H=2195:00 +CPU= 21.269
  03:59:01 STEP 2196 H=2196:00 +CPU= 35.896
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002196
  03:59:22 STEP 2197 H=2197:00 +CPU= 21.172
  03:59:45 STEP 2198 H=2198:00 +CPU= 22.557
  04:00:19 STEP 2199 H=2199:00 +CPU= 34.420
  04:00:41 STEP 2200 H=2200:00 +CPU= 21.803
  04:01:02 STEP 2201 H=2201:00 +CPU= 20.903
  04:01:38 STEP 2202 H=2202:00 +CPU= 35.768
  04:01:59 STEP 2203 H=2203:00 +CPU= 20.937
  04:02:21 STEP 2204 H=2204:00 +CPU= 21.987
  04:02:55 STEP 2205 H=2205:00 +CPU= 33.902
  04:03:16 STEP 2206 H=2206:00 +CPU= 21.131
  04:03:39 STEP 2207 H=2207:00 +CPU= 22.479
  04:04:17 STEP 2208 H=2208:00 +CPU= 38.452
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_91.zip
Uploading the intermediate file: upload_file_91.zip
  04:04:38 STEP 2209 H=2209:00 +CPU= 20.092
  04:04:59 STEP 2210 H=2210:00 +CPU= 21.881
  04:05:33 STEP 2211 H=2211:00 +CPU= 33.344
  04:05:55 STEP 2212 H=2212:00 +CPU= 21.642
  04:06:17 STEP 2213 H=2213:00 +CPU= 22.129
  04:06:55 STEP 2214 H=2214:00 +CPU= 38.195
  04:07:16 STEP 2215 H=2215:00 +CPU= 20.924
  04:07:39 STEP 2216 H=2216:00 +CPU= 22.753
  04:08:12 STEP 2217 H=2217:00 +CPU= 33.139
  04:08:33 STEP 2218 H=2218:00 +CPU= 21.036
  04:08:55 STEP 2219 H=2219:00 +CPU= 21.553
  04:09:30 STEP 2220 H=2220:00 +CPU= 35.277
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002220
  04:09:51 STEP 2221 H=2221:00 +CPU= 20.689
  04:10:14 STEP 2222 H=2222:00 +CPU= 22.840
  04:10:48 STEP 2223 H=2223:00 +CPU= 34.191
  04:11:10 STEP 2224 H=2224:00 +CPU= 21.566
  04:11:32 STEP 2225 H=2225:00 +CPU= 22.373
  04:12:05 STEP 2226 H=2226:00 +CPU= 32.824
  04:12:26 STEP 2227 H=2227:00 +CPU= 20.595
  04:12:50 STEP 2228 H=2228:00 +CPU= 23.683
  04:13:23 STEP 2229 H=2229:00 +CPU= 33.498
  04:13:45 STEP 2230 H=2230:00 +CPU= 21.599
  04:14:08 STEP 2231 H=2231:00 +CPU= 22.471
  04:14:49 STEP 2232 H=2232:00 +CPU= 41.359
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_92.zip
Uploading the intermediate file: upload_file_92.zip
  04:15:13 STEP 2233 H=2233:00 +CPU= 23.499
  04:15:36 STEP 2234 H=2234:00 +CPU= 22.754
  04:16:11 STEP 2235 H=2235:00 +CPU= 34.969
  04:16:33 STEP 2236 H=2236:00 +CPU= 21.983
  04:16:54 STEP 2237 H=2237:00 +CPU= 20.986
  04:17:31 STEP 2238 H=2238:00 +CPU= 36.854
  04:17:54 STEP 2239 H=2239:00 +CPU= 22.704
  04:18:18 STEP 2240 H=2240:00 +CPU= 23.823
  04:18:52 STEP 2241 H=2241:00 +CPU= 34.227
  04:19:15 STEP 2242 H=2242:00 +CPU= 23.108
  04:19:37 STEP 2243 H=2243:00 +CPU= 21.864
  04:20:17 STEP 2244 H=2244:00 +CPU= 39.985
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002244
  04:20:41 STEP 2245 H=2245:00 +CPU= 23.587
  04:21:04 STEP 2246 H=2246:00 +CPU= 22.771
  04:21:38 STEP 2247 H=2247:00 +CPU= 33.817
  04:22:00 STEP 2248 H=2248:00 +CPU= 22.080
  04:22:22 STEP 2249 H=2249:00 +CPU= 22.457
  04:22:58 STEP 2250 H=2250:00 +CPU= 35.872
  04:23:21 STEP 2251 H=2251:00 +CPU= 22.006
  04:23:43 STEP 2252 H=2252:00 +CPU= 22.165
  04:24:19 STEP 2253 H=2253:00 +CPU= 36.453
  04:24:43 STEP 2254 H=2254:00 +CPU= 23.100
  04:25:07 STEP 2255 H=2255:00 +CPU= 24.222
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0297
(argv4) batchid: 977
(argv5) wuid: 12193941
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/36
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ab2f20d06eba2b47c415b454dd61fd41 to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0297_2008050100_123_977_12193941.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0297_2008050100_123_977_12193941.zip
ic_ancil_file: ic_ancil_12193941
ifsdata_file: ifsdata_12193941
climate_data_file: clim_data_12193941
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_23bbae457edaf8656c43fc54e4688d1d to: /var/lib/boinc-client/slots/36/ic_ancil_12193941.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/36/ic_ancil_12193941.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9cf6cce91555b68f2766415f1925ef27 to: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12193941.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12193941.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/36/159l_2/clim_data_12193941.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/36/159l_2/clim_data_12193941.zip
Checking for progress XML file: /var/lib/boinc-client/slots/36/progress_file_12193941.xml
Opened progress file ok : /var/lib/boinc-client/slots/36/progress_file_12193941.xml
-- Model is restarting --
Adjusting last_iter, 2256, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/36/progress_file_12193941.xml
last_cpu_time: 53264
upload_file_number: 93
last_iter: 2255
last_upload: 8035200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217
The child process has been launched with process id: 32629
Executing the command: /var/lib/boinc-client/slots/36/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:L-7113-1:1:1:32629:32629] [20221230:042628:1672374388:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  04:27:11 STEP 2256 H=2256:00 +CPU= 37.813
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_93.zip
Uploading the intermediate file: upload_file_93.zip
  04:27:33 STEP 2257 H=2257:00 +CPU= 21.656
  04:27:55 STEP 2258 H=2258:00 +CPU= 22.481
  04:28:31 STEP 2259 H=2259:00 +CPU= 35.788
  04:28:54 STEP 2260 H=2260:00 +CPU= 22.306
  04:29:17 STEP 2261 H=2261:00 +CPU= 23.865
  04:29:54 STEP 2262 H=2262:00 +CPU= 36.752
  04:30:18 STEP 2263 H=2263:00 +CPU= 23.896
  04:30:42 STEP 2264 H=2264:00 +CPU= 23.654
  04:31:20 STEP 2265 H=2265:00 +CPU= 38.345
  04:31:43 STEP 2266 H=2266:00 +CPU= 22.846
  04:32:05 STEP 2267 H=2267:00 +CPU= 22.014
  04:32:44 STEP 2268 H=2268:00 +CPU= 38.829
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002268
  04:33:05 STEP 2269 H=2269:00 +CPU= 20.441
  04:33:27 STEP 2270 H=2270:00 +CPU= 21.923
  04:34:02 STEP 2271 H=2271:00 +CPU= 35.087
  04:34:24 STEP 2272 H=2272:00 +CPU= 22.388
  04:34:46 STEP 2273 H=2273:00 +CPU= 22.180
  04:35:26 STEP 2274 H=2274:00 +CPU= 39.292
  04:35:51 STEP 2275 H=2275:00 +CPU= 25.132
  04:36:13 STEP 2276 H=2276:00 +CPU= 22.141
  04:36:52 STEP 2277 H=2277:00 +CPU= 38.920
  04:37:13 STEP 2278 H=2278:00 +CPU= 20.890
  04:37:34 STEP 2279 H=2279:00 +CPU= 21.080
  04:38:15 STEP 2280 H=2280:00 +CPU= 40.881
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_94.zip
Uploading the intermediate file: upload_file_94.zip
  04:38:37 STEP 2281 H=2281:00 +CPU= 21.912
  04:39:02 STEP 2282 H=2282:00 +CPU= 24.479
  04:39:36 STEP 2283 H=2283:00 +CPU= 34.078
  04:40:00 STEP 2284 H=2284:00 +CPU= 24.174
  04:40:24 STEP 2285 H=2285:00 +CPU= 23.816
  04:40:59 STEP 2286 H=2286:00 +CPU= 34.553
  04:41:23 STEP 2287 H=2287:00 +CPU= 24.277
  04:41:45 STEP 2288 H=2288:00 +CPU= 21.622
  04:42:19 STEP 2289 H=2289:00 +CPU= 34.720
  04:42:44 STEP 2290 H=2290:00 +CPU= 24.199
  04:43:04 STEP 2291 H=2291:00 +CPU= 20.767
  04:43:42 STEP 2292 H=2292:00 +CPU= 37.162
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002292
  04:44:03 STEP 2293 H=2293:00 +CPU= 21.309
  04:44:24 STEP 2294 H=2294:00 +CPU= 20.788
  04:44:59 STEP 2295 H=2295:00 +CPU= 34.897
  04:45:21 STEP 2296 H=2296:00 +CPU= 21.795
  04:45:41 STEP 2297 H=2297:00 +CPU= 20.614
  04:46:21 STEP 2298 H=2298:00 +CPU= 39.607
  04:46:43 STEP 2299 H=2299:00 +CPU= 21.486
  04:47:05 STEP 2300 H=2300:00 +CPU= 22.515
  04:47:40 STEP 2301 H=2301:00 +CPU= 34.670
  04:48:06 STEP 2302 H=2302:00 +CPU= 25.940
  04:48:27 STEP 2303 H=2303:00 +CPU= 21.053
  04:49:06 STEP 2304 H=2304:00 +CPU= 39.073
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_95.zip
Uploading the intermediate file: upload_file_95.zip
  04:49:30 STEP 2305 H=2305:00 +CPU= 23.341
  04:49:51 STEP 2306 H=2306:00 +CPU= 21.070
  04:50:24 STEP 2307 H=2307:00 +CPU= 33.396
  04:50:46 STEP 2308 H=2308:00 +CPU= 21.564
  04:51:08 STEP 2309 H=2309:00 +CPU= 21.810
  04:51:43 STEP 2310 H=2310:00 +CPU= 35.645
  04:52:05 STEP 2311 H=2311:00 +CPU= 21.881
  04:52:27 STEP 2312 H=2312:00 +CPU= 22.119
  04:53:00 STEP 2313 H=2313:00 +CPU= 32.344
  04:53:21 STEP 2314 H=2314:00 +CPU= 21.661
  04:53:43 STEP 2315 H=2315:00 +CPU= 21.425
  04:54:19 STEP 2316 H=2316:00 +CPU= 35.990
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002316
  04:54:40 STEP 2317 H=2317:00 +CPU= 20.917
  04:55:03 STEP 2318 H=2318:00 +CPU= 22.497
  04:55:36 STEP 2319 H=2319:00 +CPU= 33.427
  04:55:59 STEP 2320 H=2320:00 +CPU= 23.062
  04:56:20 STEP 2321 H=2321:00 +CPU= 20.880
  04:56:54 STEP 2322 H=2322:00 +CPU= 33.523
  04:57:15 STEP 2323 H=2323:00 +CPU= 20.741
  04:57:37 STEP 2324 H=2324:00 +CPU= 21.956
  04:58:08 STEP 2325 H=2325:00 +CPU= 31.430
  04:58:30 STEP 2326 H=2326:00 +CPU= 21.658
  04:58:52 STEP 2327 H=2327:00 +CPU= 21.654
  04:59:32 STEP 2328 H=2328:00 +CPU= 40.267
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_96.zip
Uploading the intermediate file: upload_file_96.zip
  04:59:54 STEP 2329 H=2329:00 +CPU= 21.989
  05:00:15 STEP 2330 H=2330:00 +CPU= 21.490
  05:00:51 STEP 2331 H=2331:00 +CPU= 35.504
  05:01:12 STEP 2332 H=2332:00 +CPU= 21.117
  05:01:33 STEP 2333 H=2333:00 +CPU= 20.744
  05:02:09 STEP 2334 H=2334:00 +CPU= 35.959
  05:02:31 STEP 2335 H=2335:00 +CPU= 21.657
  05:02:52 STEP 2336 H=2336:00 +CPU= 21.733
  05:03:24 STEP 2337 H=2337:00 +CPU= 31.461
  05:03:46 STEP 2338 H=2338:00 +CPU= 21.641
  05:04:09 STEP 2339 H=2339:00 +CPU= 22.986
  05:04:52 STEP 2340 H=2340:00 +CPU= 42.914
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002340
  05:05:13 STEP 2341 H=2341:00 +CPU= 20.879
  05:05:33 STEP 2342 H=2342:00 +CPU= 20.380
  05:06:05 STEP 2343 H=2343:00 +CPU= 31.740
  05:06:27 STEP 2344 H=2344:00 +CPU= 21.712
  05:06:47 STEP 2345 H=2345:00 +CPU= 20.580
  05:07:21 STEP 2346 H=2346:00 +CPU= 33.562
  05:07:43 STEP 2347 H=2347:00 +CPU= 21.576
  05:08:09 STEP 2348 H=2348:00 +CPU= 26.722
  05:08:42 STEP 2349 H=2349:00 +CPU= 32.512
  05:09:03 STEP 2350 H=2350:00 +CPU= 20.861
  05:09:24 STEP 2351 H=2351:00 +CPU= 20.788
  05:10:03 STEP 2352 H=2352:00 +CPU= 39.409
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_97.zip
Uploading the intermediate file: upload_file_97.zip
  05:10:24 STEP 2353 H=2353:00 +CPU= 20.576
  05:10:45 STEP 2354 H=2354:00 +CPU= 20.879
  05:11:17 STEP 2355 H=2355:00 +CPU= 32.188
  05:11:38 STEP 2356 H=2356:00 +CPU= 21.162
  05:11:59 STEP 2357 H=2357:00 +CPU= 21.254
  05:12:38 STEP 2358 H=2358:00 +CPU= 38.322
  05:12:58 STEP 2359 H=2359:00 +CPU= 20.584
  05:13:19 STEP 2360 H=2360:00 +CPU= 20.538
  05:13:51 STEP 2361 H=2361:00 +CPU= 31.980
  05:14:12 STEP 2362 H=2362:00 +CPU= 20.520
  05:14:33 STEP 2363 H=2363:00 +CPU= 20.905
  05:15:09 STEP 2364 H=2364:00 +CPU= 36.604
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002364
  05:15:30 STEP 2365 H=2365:00 +CPU= 20.668
  05:15:50 STEP 2366 H=2366:00 +CPU= 20.483
  05:16:22 STEP 2367 H=2367:00 +CPU= 31.393
  05:16:42 STEP 2368 H=2368:00 +CPU= 20.464
  05:17:03 STEP 2369 H=2369:00 +CPU= 20.887
  05:17:37 STEP 2370 H=2370:00 +CPU= 33.205
  05:17:58 STEP 2371 H=2371:00 +CPU= 21.211
  05:18:19 STEP 2372 H=2372:00 +CPU= 20.669
  05:18:49 STEP 2373 H=2373:00 +CPU= 30.518
  05:19:09 STEP 2374 H=2374:00 +CPU= 20.279
  05:19:30 STEP 2375 H=2375:00 +CPU= 20.364
  05:20:08 STEP 2376 H=2376:00 +CPU= 37.872
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_98.zip
Uploading the intermediate file: upload_file_98.zip
  05:20:29 STEP 2377 H=2377:00 +CPU= 21.223
  05:20:49 STEP 2378 H=2378:00 +CPU= 19.995
  05:21:20 STEP 2379 H=2379:00 +CPU= 31.341
  05:21:41 STEP 2380 H=2380:00 +CPU= 20.344
  05:22:01 STEP 2381 H=2381:00 +CPU= 19.953
  05:22:33 STEP 2382 H=2382:00 +CPU= 32.119
  05:22:54 STEP 2383 H=2383:00 +CPU= 20.601
  05:23:14 STEP 2384 H=2384:00 +CPU= 20.550
  05:23:45 STEP 2385 H=2385:00 +CPU= 31.102
  05:24:06 STEP 2386 H=2386:00 +CPU= 20.740
  05:24:27 STEP 2387 H=2387:00 +CPU= 20.361
  05:25:01 STEP 2388 H=2388:00 +CPU= 34.812
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002388
  05:25:22 STEP 2389 H=2389:00 +CPU= 20.237
  05:25:42 STEP 2390 H=2390:00 +CPU= 20.400
  05:26:14 STEP 2391 H=2391:00 +CPU= 31.629
  05:26:35 STEP 2392 H=2392:00 +CPU= 20.686
  05:26:55 STEP 2393 H=2393:00 +CPU= 20.179
  05:27:27 STEP 2394 H=2394:00 +CPU= 31.677
  05:27:47 STEP 2395 H=2395:00 +CPU= 19.932
  05:28:08 STEP 2396 H=2396:00 +CPU= 20.939
  05:28:41 STEP 2397 H=2397:00 +CPU= 32.984
  05:29:02 STEP 2398 H=2398:00 +CPU= 21.616
  05:29:24 STEP 2399 H=2399:00 +CPU= 21.823
  05:30:01 STEP 2400 H=2400:00 +CPU= 37.126
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_99.zip
Uploading the intermediate file: upload_file_99.zip
  05:30:22 STEP 2401 H=2401:00 +CPU= 20.368
  05:30:43 STEP 2402 H=2402:00 +CPU= 21.755
  05:31:16 STEP 2403 H=2403:00 +CPU= 31.996
  05:31:37 STEP 2404 H=2404:00 +CPU= 20.968
  05:31:57 STEP 2405 H=2405:00 +CPU= 20.522
  05:32:28 STEP 2406 H=2406:00 +CPU= 30.823
  05:32:48 STEP 2407 H=2407:00 +CPU= 20.407
  05:33:09 STEP 2408 H=2408:00 +CPU= 20.776
  05:33:41 STEP 2409 H=2409:00 +CPU= 31.560
  05:34:01 STEP 2410 H=2410:00 +CPU= 20.274
  05:34:21 STEP 2411 H=2411:00 +CPU= 19.663
  05:34:56 STEP 2412 H=2412:00 +CPU= 35.107
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002412
  05:35:15 STEP 2413 H=2413:00 +CPU= 19.177
  05:35:35 STEP 2414 H=2414:00 +CPU= 19.704
  05:36:06 STEP 2415 H=2415:00 +CPU= 30.881
  05:36:26 STEP 2416 H=2416:00 +CPU= 19.859
  05:36:45 STEP 2417 H=2417:00 +CPU= 19.311
  05:37:16 STEP 2418 H=2418:00 +CPU= 30.678
  05:37:35 STEP 2419 H=2419:00 +CPU= 19.513
  05:37:56 STEP 2420 H=2420:00 +CPU= 20.147
  05:38:26 STEP 2421 H=2421:00 +CPU= 30.298
  05:38:47 STEP 2422 H=2422:00 +CPU= 20.589
  05:39:07 STEP 2423 H=2423:00 +CPU= 20.258
  05:39:43 STEP 2424 H=2424:00 +CPU= 36.018
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_100.zip
Uploading the intermediate file: upload_file_100.zip
  05:40:03 STEP 2425 H=2425:00 +CPU= 19.516
  05:40:23 STEP 2426 H=2426:00 +CPU= 19.984
  05:40:53 STEP 2427 H=2427:00 +CPU= 30.513
  05:41:13 STEP 2428 H=2428:00 +CPU= 19.371
  05:41:32 STEP 2429 H=2429:00 +CPU= 19.576
  05:42:03 STEP 2430 H=2430:00 +CPU= 31.125
  05:42:23 STEP 2431 H=2431:00 +CPU= 19.424
  05:42:42 STEP 2432 H=2432:00 +CPU= 19.136
  05:43:13 STEP 2433 H=2433:00 +CPU= 30.524
  05:43:32 STEP 2434 H=2434:00 +CPU= 19.353
  05:43:51 STEP 2435 H=2435:00 +CPU= 18.798
  05:44:24 STEP 2436 H=2436:00 +CPU= 32.859
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002436
  05:44:43 STEP 2437 H=2437:00 +CPU= 19.489
  05:45:03 STEP 2438 H=2438:00 +CPU= 19.365
  05:45:32 STEP 2439 H=2439:00 +CPU= 29.632
  05:45:51 STEP 2440 H=2440:00 +CPU= 19.141
  05:46:11 STEP 2441 H=2441:00 +CPU= 19.227
  05:46:41 STEP 2442 H=2442:00 +CPU= 30.487
  05:47:00 STEP 2443 H=2443:00 +CPU= 18.758
  05:47:19 STEP 2444 H=2444:00 +CPU= 19.331
  05:47:49 STEP 2445 H=2445:00 +CPU= 30.001
  05:48:09 STEP 2446 H=2446:00 +CPU= 19.294
  05:48:28 STEP 2447 H=2447:00 +CPU= 19.091
  05:49:03 STEP 2448 H=2448:00 +CPU= 35.007
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_101.zip
Uploading the intermediate file: upload_file_101.zip
  05:49:22 STEP 2449 H=2449:00 +CPU= 18.767
  05:49:40 STEP 2450 H=2450:00 +CPU= 18.684
  05:50:10 STEP 2451 H=2451:00 +CPU= 29.915
  05:50:31 STEP 2452 H=2452:00 +CPU= 20.099
  05:50:50 STEP 2453 H=2453:00 +CPU= 19.662
  05:51:21 STEP 2454 H=2454:00 +CPU= 31.107
  05:51:41 STEP 2455 H=2455:00 +CPU= 19.609
  05:52:00 STEP 2456 H=2456:00 +CPU= 18.856
  05:52:31 STEP 2457 H=2457:00 +CPU= 31.311
  05:52:51 STEP 2458 H=2458:00 +CPU= 19.948
  05:53:11 STEP 2459 H=2459:00 +CPU= 19.544
  05:53:44 STEP 2460 H=2460:00 +CPU= 32.745
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002460
  05:54:03 STEP 2461 H=2461:00 +CPU= 19.296
  05:54:23 STEP 2462 H=2462:00 +CPU= 20.401
  05:54:54 STEP 2463 H=2463:00 +CPU= 30.434
  05:55:13 STEP 2464 H=2464:00 +CPU= 19.066
  05:55:33 STEP 2465 H=2465:00 +CPU= 19.599
  05:56:03 STEP 2466 H=2466:00 +CPU= 29.991
  05:56:21 STEP 2467 H=2467:00 +CPU= 18.716
  05:56:41 STEP 2468 H=2468:00 +CPU= 19.531
  05:57:13 STEP 2469 H=2469:00 +CPU= 31.487
  05:57:32 STEP 2470 H=2470:00 +CPU= 19.402
  05:57:52 STEP 2471 H=2471:00 +CPU= 19.935
  05:58:28 STEP 2472 H=2472:00 +CPU= 35.594
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_102.zip
Uploading the intermediate file: upload_file_102.zip
  05:58:46 STEP 2473 H=2473:00 +CPU= 18.045
Uploading trickle at timestep: 8899200
  05:59:05 STEP 2474 H=2474:00 +CPU= 19.375
  05:59:36 STEP 2475 H=2475:00 +CPU= 31.039
  05:59:57 STEP 2476 H=2476:00 +CPU= 20.493
  06:00:16 STEP 2477 H=2477:00 +CPU= 19.223
  06:00:48 STEP 2478 H=2478:00 +CPU= 32.155
  06:01:07 STEP 2479 H=2479:00 +CPU= 18.764
  06:01:27 STEP 2480 H=2480:00 +CPU= 19.624
  06:01:59 STEP 2481 H=2481:00 +CPU= 32.074
  06:02:18 STEP 2482 H=2482:00 +CPU= 19.379
  06:02:37 STEP 2483 H=2483:00 +CPU= 18.745
  06:03:11 STEP 2484 H=2484:00 +CPU= 33.549
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002484
  06:03:30 STEP 2485 H=2485:00 +CPU= 19.395
  06:03:49 STEP 2486 H=2486:00 +CPU= 19.387
  06:04:19 STEP 2487 H=2487:00 +CPU= 29.790
  06:04:39 STEP 2488 H=2488:00 +CPU= 19.578
  06:04:58 STEP 2489 H=2489:00 +CPU= 19.530
  06:05:30 STEP 2490 H=2490:00 +CPU= 31.083
  06:05:49 STEP 2491 H=2491:00 +CPU= 19.720
  06:06:09 STEP 2492 H=2492:00 +CPU= 20.102
  06:06:40 STEP 2493 H=2493:00 +CPU= 30.126
  06:06:59 STEP 2494 H=2494:00 +CPU= 19.174
  06:07:18 STEP 2495 H=2495:00 +CPU= 19.010
  06:07:53 STEP 2496 H=2496:00 +CPU= 34.868
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_103.zip
Uploading the intermediate file: upload_file_103.zip
  06:08:11 STEP 2497 H=2497:00 +CPU= 18.219
  06:08:30 STEP 2498 H=2498:00 +CPU= 19.339
  06:09:01 STEP 2499 H=2499:00 +CPU= 30.469
  06:09:21 STEP 2500 H=2500:00 +CPU= 19.557
  06:09:41 STEP 2501 H=2501:00 +CPU= 20.109
  06:10:11 STEP 2502 H=2502:00 +CPU= 29.959
  06:10:29 STEP 2503 H=2503:00 +CPU= 18.560
  06:10:48 STEP 2504 H=2504:00 +CPU= 19.067
  06:11:18 STEP 2505 H=2505:00 +CPU= 29.539
  06:11:37 STEP 2506 H=2506:00 +CPU= 19.368
  06:11:57 STEP 2507 H=2507:00 +CPU= 19.292
  06:12:30 STEP 2508 H=2508:00 +CPU= 33.176
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002508
  06:12:49 STEP 2509 H=2509:00 +CPU= 19.039
  06:13:08 STEP 2510 H=2510:00 +CPU= 19.231
  06:13:37 STEP 2511 H=2511:00 +CPU= 28.623
  06:13:56 STEP 2512 H=2512:00 +CPU= 19.029
  06:14:15 STEP 2513 H=2513:00 +CPU= 18.979
  06:14:45 STEP 2514 H=2514:00 +CPU= 30.157
  06:15:04 STEP 2515 H=2515:00 +CPU= 18.727
  06:15:24 STEP 2516 H=2516:00 +CPU= 19.534
  06:15:55 STEP 2517 H=2517:00 +CPU= 31.682
  06:16:14 STEP 2518 H=2518:00 +CPU= 19.101
  06:16:34 STEP 2519 H=2519:00 +CPU= 19.575
  06:17:10 STEP 2520 H=2520:00 +CPU= 35.800
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_104.zip
Uploading the intermediate file: upload_file_104.zip
  06:17:29 STEP 2521 H=2521:00 +CPU= 19.048
  06:17:48 STEP 2522 H=2522:00 +CPU= 18.786
  06:18:17 STEP 2523 H=2523:00 +CPU= 29.472
  06:18:36 STEP 2524 H=2524:00 +CPU= 18.870
  06:18:56 STEP 2525 H=2525:00 +CPU= 19.329
  06:19:26 STEP 2526 H=2526:00 +CPU= 30.007
  06:19:44 STEP 2527 H=2527:00 +CPU= 18.675
  06:20:03 STEP 2528 H=2528:00 +CPU= 19.024
  06:20:34 STEP 2529 H=2529:00 +CPU= 30.673
  06:20:53 STEP 2530 H=2530:00 +CPU= 19.116
  06:21:12 STEP 2531 H=2531:00 +CPU= 18.607
  06:21:46 STEP 2532 H=2532:00 +CPU= 33.882
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002532
  06:22:05 STEP 2533 H=2533:00 +CPU= 18.720
  06:22:24 STEP 2534 H=2534:00 +CPU= 19.033
  06:22:52 STEP 2535 H=2535:00 +CPU= 28.636
  06:23:11 STEP 2536 H=2536:00 +CPU= 18.801
  06:23:30 STEP 2537 H=2537:00 +CPU= 19.070
  06:24:02 STEP 2538 H=2538:00 +CPU= 31.164
  06:24:20 STEP 2539 H=2539:00 +CPU= 18.322
  06:24:40 STEP 2540 H=2540:00 +CPU= 20.468
  06:25:11 STEP 2541 H=2541:00 +CPU= 30.226
  06:25:29 STEP 2542 H=2542:00 +CPU= 18.803
  06:25:49 STEP 2543 H=2543:00 +CPU= 19.524
  06:26:25 STEP 2544 H=2544:00 +CPU= 35.791
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_105.zip
Uploading the intermediate file: upload_file_105.zip
  06:26:44 STEP 2545 H=2545:00 +CPU= 18.726
  06:27:03 STEP 2546 H=2546:00 +CPU= 19.650
  06:27:33 STEP 2547 H=2547:00 +CPU= 29.882
  06:27:52 STEP 2548 H=2548:00 +CPU= 18.206
  06:28:09 STEP 2549 H=2549:00 +CPU= 17.820
  06:28:39 STEP 2550 H=2550:00 +CPU= 29.873
  06:28:59 STEP 2551 H=2551:00 +CPU= 19.431
  06:29:19 STEP 2552 H=2552:00 +CPU= 20.003
  06:29:49 STEP 2553 H=2553:00 +CPU= 30.094
  06:30:07 STEP 2554 H=2554:00 +CPU= 17.942
  06:30:25 STEP 2555 H=2555:00 +CPU= 17.954
  06:30:58 STEP 2556 H=2556:00 +CPU= 33.483
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002556
  06:31:17 STEP 2557 H=2557:00 +CPU= 18.077
  06:31:35 STEP 2558 H=2558:00 +CPU= 18.480
  06:32:05 STEP 2559 H=2559:00 +CPU= 29.483
  06:32:23 STEP 2560 H=2560:00 +CPU= 18.586
  06:32:42 STEP 2561 H=2561:00 +CPU= 18.883
  06:33:11 STEP 2562 H=2562:00 +CPU= 28.742
  06:33:28 STEP 2563 H=2563:00 +CPU= 17.490
  06:33:47 STEP 2564 H=2564:00 +CPU= 18.045
  06:34:15 STEP 2565 H=2565:00 +CPU= 28.243
  06:34:33 STEP 2566 H=2566:00 +CPU= 18.370
  06:34:52 STEP 2567 H=2567:00 +CPU= 18.456
  06:35:26 STEP 2568 H=2568:00 +CPU= 33.833
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_106.zip
Uploading the intermediate file: upload_file_106.zip
  06:35:43 STEP 2569 H=2569:00 +CPU= 17.240
  06:36:02 STEP 2570 H=2570:00 +CPU= 18.784
  06:36:31 STEP 2571 H=2571:00 +CPU= 28.947
  06:36:50 STEP 2572 H=2572:00 +CPU= 18.927
  06:37:07 STEP 2573 H=2573:00 +CPU= 17.802
  06:37:40 STEP 2574 H=2574:00 +CPU= 32.732
  06:37:58 STEP 2575 H=2575:00 +CPU= 18.047
  06:38:17 STEP 2576 H=2576:00 +CPU= 18.730
  06:38:46 STEP 2577 H=2577:00 +CPU= 28.503
  06:39:04 STEP 2578 H=2578:00 +CPU= 18.607
  06:39:23 STEP 2579 H=2579:00 +CPU= 18.457
  06:39:55 STEP 2580 H=2580:00 +CPU= 32.371
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002580
  06:40:12 STEP 2581 H=2581:00 +CPU= 17.292
  06:40:31 STEP 2582 H=2582:00 +CPU= 18.111
  06:40:59 STEP 2583 H=2583:00 +CPU= 28.505
  06:41:17 STEP 2584 H=2584:00 +CPU= 18.120
  06:41:36 STEP 2585 H=2585:00 +CPU= 18.440
  06:42:06 STEP 2586 H=2586:00 +CPU= 29.805
  06:42:23 STEP 2587 H=2587:00 +CPU= 17.622
  06:42:42 STEP 2588 H=2588:00 +CPU= 18.474
  06:43:10 STEP 2589 H=2589:00 +CPU= 28.279
  06:43:28 STEP 2590 H=2590:00 +CPU= 18.081
  06:43:48 STEP 2591 H=2591:00 +CPU= 20.158
  06:44:23 STEP 2592 H=2592:00 +CPU= 34.931
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_107.zip
Uploading the intermediate file: upload_file_107.zip
  06:44:42 STEP 2593 H=2593:00 +CPU= 18.305
  06:45:00 STEP 2594 H=2594:00 +CPU= 18.430
  06:45:29 STEP 2595 H=2595:00 +CPU= 29.151
  06:45:48 STEP 2596 H=2596:00 +CPU= 18.305
  06:46:06 STEP 2597 H=2597:00 +CPU= 18.469
  06:46:36 STEP 2598 H=2598:00 +CPU= 29.846
  06:46:54 STEP 2599 H=2599:00 +CPU= 18.135
  06:47:13 STEP 2600 H=2600:00 +CPU= 18.811
  06:47:42 STEP 2601 H=2601:00 +CPU= 28.533
  06:48:00 STEP 2602 H=2602:00 +CPU= 18.316
  06:48:18 STEP 2603 H=2603:00 +CPU= 17.885
  06:48:50 STEP 2604 H=2604:00 +CPU= 31.651
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002604
  06:49:10 STEP 2605 H=2605:00 +CPU= 19.953
  06:49:28 STEP 2606 H=2606:00 +CPU= 18.448
  06:49:58 STEP 2607 H=2607:00 +CPU= 30.206
  06:50:17 STEP 2608 H=2608:00 +CPU= 18.253
  06:50:35 STEP 2609 H=2609:00 +CPU= 17.846
  06:51:03 STEP 2610 H=2610:00 +CPU= 28.462
  06:51:23 STEP 2611 H=2611:00 +CPU= 20.158
  06:51:42 STEP 2612 H=2612:00 +CPU= 18.544
  06:52:11 STEP 2613 H=2613:00 +CPU= 29.268
  06:52:29 STEP 2614 H=2614:00 +CPU= 18.242
  06:52:48 STEP 2615 H=2615:00 +CPU= 18.271
  06:53:21 STEP 2616 H=2616:00 +CPU= 33.291
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_108.zip
Uploading the intermediate file: upload_file_108.zip
  06:53:39 STEP 2617 H=2617:00 +CPU= 17.500
  06:53:57 STEP 2618 H=2618:00 +CPU= 18.533
  06:54:26 STEP 2619 H=2619:00 +CPU= 28.688
  06:54:45 STEP 2620 H=2620:00 +CPU= 19.446
  06:55:03 STEP 2621 H=2621:00 +CPU= 17.766
  06:55:33 STEP 2622 H=2622:00 +CPU= 29.436
  06:55:51 STEP 2623 H=2623:00 +CPU= 18.656
  06:56:10 STEP 2624 H=2624:00 +CPU= 18.539
  06:56:39 STEP 2625 H=2625:00 +CPU= 28.987
  06:56:58 STEP 2626 H=2626:00 +CPU= 18.564
  06:57:15 STEP 2627 H=2627:00 +CPU= 17.583
  06:57:47 STEP 2628 H=2628:00 +CPU= 31.308
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002628
  06:58:04 STEP 2629 H=2629:00 +CPU= 17.112
  06:58:22 STEP 2630 H=2630:00 +CPU= 18.462
  06:58:51 STEP 2631 H=2631:00 +CPU= 29.167
  06:59:10 STEP 2632 H=2632:00 +CPU= 18.134
  06:59:28 STEP 2633 H=2633:00 +CPU= 18.601
  06:59:58 STEP 2634 H=2634:00 +CPU= 29.571
  07:00:15 STEP 2635 H=2635:00 +CPU= 17.414
  07:00:36 STEP 2636 H=2636:00 +CPU= 20.843
  07:01:05 STEP 2637 H=2637:00 +CPU= 28.897
  07:01:23 STEP 2638 H=2638:00 +CPU= 18.268
  07:01:42 STEP 2639 H=2639:00 +CPU= 18.590
  07:02:16 STEP 2640 H=2640:00 +CPU= 34.166
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_109.zip
Uploading the intermediate file: upload_file_109.zip
  07:02:34 STEP 2641 H=2641:00 +CPU= 17.938
  07:02:53 STEP 2642 H=2642:00 +CPU= 19.138
  07:03:22 STEP 2643 H=2643:00 +CPU= 28.378
  07:03:40 STEP 2644 H=2644:00 +CPU= 18.239
  07:03:59 STEP 2645 H=2645:00 +CPU= 18.667
  07:04:29 STEP 2646 H=2646:00 +CPU= 29.899
  07:04:47 STEP 2647 H=2647:00 +CPU= 17.846
  07:05:05 STEP 2648 H=2648:00 +CPU= 18.451
  07:05:34 STEP 2649 H=2649:00 +CPU= 28.872
  07:05:53 STEP 2650 H=2650:00 +CPU= 18.774
  07:06:12 STEP 2651 H=2651:00 +CPU= 19.083
  07:06:44 STEP 2652 H=2652:00 +CPU= 32.290
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002652
  07:07:03 STEP 2653 H=2653:00 +CPU= 18.787
  07:07:22 STEP 2654 H=2654:00 +CPU= 18.795
  07:07:52 STEP 2655 H=2655:00 +CPU= 29.861
  07:08:10 STEP 2656 H=2656:00 +CPU= 18.392
  07:08:28 STEP 2657 H=2657:00 +CPU= 18.146
  07:08:58 STEP 2658 H=2658:00 +CPU= 29.755
  07:09:19 STEP 2659 H=2659:00 +CPU= 20.324
  07:09:37 STEP 2660 H=2660:00 +CPU= 18.744
  07:10:06 STEP 2661 H=2661:00 +CPU= 28.940
  07:10:25 STEP 2662 H=2662:00 +CPU= 18.386
  07:10:43 STEP 2663 H=2663:00 +CPU= 17.846
  07:11:19 STEP 2664 H=2664:00 +CPU= 35.843
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_110.zip
Uploading the intermediate file: upload_file_110.zip
  07:11:36 STEP 2665 H=2665:00 +CPU= 17.717
  07:11:54 STEP 2666 H=2666:00 +CPU= 17.652
  07:12:23 STEP 2667 H=2667:00 +CPU= 29.316
  07:12:41 STEP 2668 H=2668:00 +CPU= 18.105
  07:12:59 STEP 2669 H=2669:00 +CPU= 17.897
  07:13:29 STEP 2670 H=2670:00 +CPU= 29.869
  07:13:48 STEP 2671 H=2671:00 +CPU= 18.192
  07:14:06 STEP 2672 H=2672:00 +CPU= 17.955
  07:14:34 STEP 2673 H=2673:00 +CPU= 28.115
  07:14:53 STEP 2674 H=2674:00 +CPU= 18.844
  07:15:11 STEP 2675 H=2675:00 +CPU= 18.142
  07:15:43 STEP 2676 H=2676:00 +CPU= 31.719
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002676
  07:16:01 STEP 2677 H=2677:00 +CPU= 18.251
  07:16:19 STEP 2678 H=2678:00 +CPU= 18.397
  07:16:48 STEP 2679 H=2679:00 +CPU= 28.702
  07:17:06 STEP 2680 H=2680:00 +CPU= 18.022
  07:17:24 STEP 2681 H=2681:00 +CPU= 17.918
  07:17:53 STEP 2682 H=2682:00 +CPU= 28.910
  07:18:12 STEP 2683 H=2683:00 +CPU= 18.708
  07:18:30 STEP 2684 H=2684:00 +CPU= 18.716
  07:18:58 STEP 2685 H=2685:00 +CPU= 27.962
  07:19:17 STEP 2686 H=2686:00 +CPU= 18.815
  07:19:36 STEP 2687 H=2687:00 +CPU= 18.230
  07:20:09 STEP 2688 H=2688:00 +CPU= 33.202
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_111.zip
Uploading the intermediate file: upload_file_111.zip
  07:20:26 STEP 2689 H=2689:00 +CPU= 17.452
  07:20:44 STEP 2690 H=2690:00 +CPU= 18.112
  07:21:13 STEP 2691 H=2691:00 +CPU= 28.717
  07:21:31 STEP 2692 H=2692:00 +CPU= 17.660
  07:21:49 STEP 2693 H=2693:00 +CPU= 17.879
  07:22:18 STEP 2694 H=2694:00 +CPU= 28.818
  07:22:34 STEP 2695 H=2695:00 +CPU= 16.616
  07:22:53 STEP 2696 H=2696:00 +CPU= 18.699
  07:23:21 STEP 2697 H=2697:00 +CPU= 28.438
  07:23:40 STEP 2698 H=2698:00 +CPU= 18.201
  07:23:58 STEP 2699 H=2699:00 +CPU= 18.066
  07:24:30 STEP 2700 H=2700:00 +CPU= 31.901
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002700
  07:24:48 STEP 2701 H=2701:00 +CPU= 17.883
  07:25:06 STEP 2702 H=2702:00 +CPU= 18.524
  07:25:36 STEP 2703 H=2703:00 +CPU= 29.601
  07:25:54 STEP 2704 H=2704:00 +CPU= 18.219
  07:26:13 STEP 2705 H=2705:00 +CPU= 18.452
  07:26:43 STEP 2706 H=2706:00 +CPU= 29.927
  07:27:00 STEP 2707 H=2707:00 +CPU= 17.201
  07:27:18 STEP 2708 H=2708:00 +CPU= 17.947
  07:27:47 STEP 2709 H=2709:00 +CPU= 29.345
  07:28:06 STEP 2710 H=2710:00 +CPU= 18.379
  07:28:24 STEP 2711 H=2711:00 +CPU= 18.107
  07:28:58 STEP 2712 H=2712:00 +CPU= 34.027
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193941/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0297_2008050100_123_977_12193941_0_r2041478217_112.zip
Uploading the intermediate file: upload_file_112.zip
  07:29:16 STEP 2713 H=2713:00 +CPU= 18.374
Uploading trickle at timestep: 9763200
  07:29:35 STEP 2714 H=2714:00 +CPU= 18.666
  07:30:03 STEP 2715 H=2715:00 +CPU= 28.249
  07:30:22 STEP 2716 H=2716:00 +CPU= 18.375
  07:30:39 STEP 2717 H=2717:00 +CPU= 17.780
  07:31:08 STEP 2718 H=2718:00 +CPU= 28.238
  07:31:25 STEP 2719 H=2719:00 +CPU= 17.692
  07:31:43 STEP 2720 H=2720:00 +CPU= 17.689
  07:32:12 STEP 2721 H=2721:00 +CPU= 29.158
  07:32:31 STEP 2722 H=2722:00 +CPU= 18.379
  07:32:49 STEP 2723 H=2723:00 +CPU= 18.140
  07:33:20 STEP 2724 H=2724:00 +CPU= 31.242
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+002724
  07:33:38 STEP 2725 H=2725:00 +CPU= 17.531
  07:33:55 STEP 2726 H=2726:00 +CPU= 17.444
  07:34:23 STEP 2727 H=2727:00 +CPU= 27.652
  07:34:41 STEP 2728 H=2728:00 +CPU= 17.907
  07:34:58 STEP 2729 H=2729:00 +CPU= 17.114
  07:35:26 STEP 2730 H=2730:00 +CPU= 27.762
  07:35:43 STEP 2731 H=2731:00 +CPU= 17.246
  07:36:01 STEP 2732 H=2732:00 +CPU= 17.943
  07:36:28 STEP 2733 H=2733:00 +CPU= 26.785
  07:36:45 STEP 2734 H=2734:00 +CPU= 17.012
  07:37:02 STEP 2735 H=2735:00 +CPU= 17.139
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:02:38 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 9,763,200 64,191 0.0066
09 May 2023 16:02:38 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 9,763,200 64,191 0.0066
09 May 2023 16:02:36 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 8,899,200 58,776 0.0066
09 May 2023 16:02:10 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 5,184,000 31,921 0.0062
09 May 2023 16:02:06 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 4,320,000 26,533 0.0061
09 May 2023 16:02:06 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 4,320,000 26,533 0.0061
09 May 2023 16:01:59 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 3,456,000 21,346 0.0062
09 May 2023 16:01:56 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 2,592,000 16,178 0.0062
09 May 2023 16:01:45 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 1,728,000 10,732 0.0062
09 May 2023 16:01:45 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 1,728,000 10,732 0.0062
09 May 2023 16:01:41 1535374 22279760 oifs_43r3_ps_0297_2008050100_123_977_12193941_0 864,000 5,295 0.0061


©2024 cpdn.org