climateprediction.net home page
Task 22309579

Task 22309579

Name oifs_43r3_bl_a202_2016092300_15_991_12209381_0
Workunit 12209381
Created 13 Feb 2023, 16:47:16 UTC
Sent 14 Feb 2023, 6:42:29 UTC
Report deadline 15 Apr 2023, 6:42:29 UTC
Received 15 Feb 2023, 16:25:01 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1478188
Run time 13 hours 57 min 56 sec
CPU time 13 hours 53 min
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,912.06 MB
Peak swap size 5,930.79 MB
Peak disk usage 2,180.74 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.988685820517220E-07 0.000000000000000E+00 0.424249304738786E-03
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.681097468361632E-07 0.000000000000000E+00 0.750560901271060E-04
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.915994559606178E-01 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.106084003047410E-09 0.000000000000000E+00 0.135413824059249E-04
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.586416201026735E-07 0.000000000000000E+00 0.835412808143585E-04
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.382458782738977E-10 0.000000000000000E+00 0.200485246716036E-04
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.524570017803570E-09 0.000000000000000E+00 0.490628444549512E-04
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.295457414927073E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1008 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 2 lines from file: ifs.stat
 02:40:20 000000000 CNT3      -999     0.647    0.647    0.650      0:00      0:00 0.00000000000000E+00       1GB       0MB
 02:40:24 0AAA00AAA STEPO     1008     4.420    4.420    4.441      0:04      0:04 0.78126652196732E-06       1GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1008",
 CTIME   = "00101200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         996, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /data/boinc/boinc-client/slots/27/progress_file_12209381.xml

<running_values>
  <last_cpu_time>35571.900000</last_cpu_time>
  <upload_file_number>10</upload_file_number>
  <last_iter>1008</last_iter>
  <last_upload>864900</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a202
(argv4) batchid: 991
(argv5) wuid: 12209381
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/27
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/27/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/27/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d92ee22d4755e8efe16a5af01fa81053 to: /data/boinc/boinc-client/slots/27/oifs_43r3_bl_a202_2016092300_15_991_12209381.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/27/oifs_43r3_bl_a202_2016092300_15_991_12209381.zip
ic_ancil_file: ic_ancil_12209381
ifsdata_file: ifsdata_12209381
climate_data_file: clim_data_12209381
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/27/ic_ancil_12209381.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/27/ic_ancil_12209381.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_73a48e32d23903056aaa08f419a06554 to: /data/boinc/boinc-client/slots/27/ifsdata/ifsdata_12209381.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/27/ifsdata/ifsdata_12209381.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/27/159l_2/clim_data_12209381.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/27/159l_2/clim_data_12209381.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/27/progress_file_12209381.xml
Opened progress file ok : /data/boinc/boinc-client/slots/27/progress_file_12209381.xml
-- Model is restarting --
Adjusting last_iter, 1008, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/27/progress_file_12209381.xml
last_cpu_time: 35571
upload_file_number: 10
last_iter: 1009
last_upload: 864900
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398
The child process has been launched with process id: 164185
Executing the command: /data/boinc/boinc-client/slots/27/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:164185:164185] [20230215:024235:1676428955:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  02:43:17 STEP 1008 H= 252:00 +CPU= 30.754
  02:43:54 STEP 1009 H= 252:15 +CPU= 33.574
  02:44:28 STEP 1010 H= 252:30 +CPU= 33.463
  02:45:01 STEP 1011 H= 252:45 +CPU= 33.205
  02:45:37 STEP 1012 H= 253:00 +CPU= 34.890
  02:46:11 STEP 1013 H= 253:15 +CPU= 33.944
  02:46:45 STEP 1014 H= 253:30 +CPU= 34.240
  02:47:17 STEP 1015 H= 253:45 +CPU= 31.478
  02:47:49 STEP 1016 H= 254:00 +CPU= 31.938
  02:48:24 STEP 1017 H= 254:15 +CPU= 35.109
  02:48:59 STEP 1018 H= 254:30 +CPU= 34.422
  02:49:32 STEP 1019 H= 254:45 +CPU= 33.339
  02:50:14 STEP 1020 H= 255:00 +CPU= 40.673
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001020
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001020
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001020
  02:50:47 STEP 1021 H= 255:15 +CPU= 33.430
  02:51:20 STEP 1022 H= 255:30 +CPU= 32.903
  02:51:53 STEP 1023 H= 255:45 +CPU= 32.708
  02:52:29 STEP 1024 H= 256:00 +CPU= 35.186
  02:53:01 STEP 1025 H= 256:15 +CPU= 32.171
  02:53:34 STEP 1026 H= 256:30 +CPU= 32.728
  02:54:07 STEP 1027 H= 256:45 +CPU= 33.480
  02:54:42 STEP 1028 H= 257:00 +CPU= 34.542
  02:55:14 STEP 1029 H= 257:15 +CPU= 31.655
  02:55:42 STEP 1030 H= 257:30 +CPU= 28.574
  02:56:15 STEP 1031 H= 257:45 +CPU= 32.795
  02:56:51 STEP 1032 H= 258:00 +CPU= 34.869
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001032
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001032
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001032
  02:57:24 STEP 1033 H= 258:15 +CPU= 32.965
  02:57:57 STEP 1034 H= 258:30 +CPU= 32.681
  02:58:30 STEP 1035 H= 258:45 +CPU= 33.315
  02:59:05 STEP 1036 H= 259:00 +CPU= 35.049
  02:59:39 STEP 1037 H= 259:15 +CPU= 33.622
  03:00:13 STEP 1038 H= 259:30 +CPU= 33.766
  03:00:44 STEP 1039 H= 259:45 +CPU= 31.131
  03:01:20 STEP 1040 H= 260:00 +CPU= 35.113
  03:01:53 STEP 1041 H= 260:15 +CPU= 33.294
  03:02:26 STEP 1042 H= 260:30 +CPU= 33.131
  03:02:59 STEP 1043 H= 260:45 +CPU= 33.011
  03:03:39 STEP 1044 H= 261:00 +CPU= 39.750
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001044
  03:04:13 STEP 1045 H= 261:15 +CPU= 33.012
  03:04:47 STEP 1046 H= 261:30 +CPU= 34.733
  03:05:21 STEP 1047 H= 261:45 +CPU= 33.060
  03:05:55 STEP 1048 H= 262:00 +CPU= 34.100
  03:06:30 STEP 1049 H= 262:15 +CPU= 34.429
  03:07:04 STEP 1050 H= 262:30 +CPU= 34.234
  03:07:39 STEP 1051 H= 262:45 +CPU= 33.890
  03:08:14 STEP 1052 H= 263:00 +CPU= 35.075
  03:08:47 STEP 1053 H= 263:15 +CPU= 32.766
  03:09:22 STEP 1054 H= 263:30 +CPU= 34.766
  03:09:54 STEP 1055 H= 263:45 +CPU= 31.844
  03:10:41 STEP 1056 H= 264:00 +CPU= 45.369
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001056
  03:11:14 STEP 1057 H= 264:15 +CPU= 32.754
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001056
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398_10.zip
Uploading the intermediate file: upload_file_10.zip
  03:11:48 STEP 1058 H= 264:30 +CPU= 34.263
  03:12:21 STEP 1059 H= 264:45 +CPU= 32.351
  03:12:56 STEP 1060 H= 265:00 +CPU= 35.472
  03:13:30 STEP 1061 H= 265:15 +CPU= 33.423
  03:14:03 STEP 1062 H= 265:30 +CPU= 33.254
  03:14:36 STEP 1063 H= 265:45 +CPU= 32.378
  03:15:09 STEP 1064 H= 266:00 +CPU= 33.273
  03:15:43 STEP 1065 H= 266:15 +CPU= 33.751
  03:16:16 STEP 1066 H= 266:30 +CPU= 32.359
  03:16:51 STEP 1067 H= 266:45 +CPU= 35.549
  03:17:35 STEP 1068 H= 267:00 +CPU= 43.849
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001068
  03:18:09 STEP 1069 H= 267:15 +CPU= 33.901
  03:18:42 STEP 1070 H= 267:30 +CPU= 31.998
  03:19:15 STEP 1071 H= 267:45 +CPU= 33.423
  03:19:50 STEP 1072 H= 268:00 +CPU= 34.441
  03:20:24 STEP 1073 H= 268:15 +CPU= 34.486
  03:20:58 STEP 1074 H= 268:30 +CPU= 33.309
  03:21:30 STEP 1075 H= 268:45 +CPU= 32.265
  03:22:05 STEP 1076 H= 269:00 +CPU= 34.264
  03:22:37 STEP 1077 H= 269:15 +CPU= 32.410
  03:23:11 STEP 1078 H= 269:30 +CPU= 34.116
  03:23:45 STEP 1079 H= 269:45 +CPU= 33.790
  03:24:28 STEP 1080 H= 270:00 +CPU= 42.033
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001080
  03:25:01 STEP 1081 H= 270:15 +CPU= 33.624
  03:25:36 STEP 1082 H= 270:30 +CPU= 34.407
  03:26:10 STEP 1083 H= 270:45 +CPU= 33.524
  03:26:44 STEP 1084 H= 271:00 +CPU= 33.848
  03:27:17 STEP 1085 H= 271:15 +CPU= 32.841
  03:27:49 STEP 1086 H= 271:30 +CPU= 32.764
  03:28:22 STEP 1087 H= 271:45 +CPU= 32.756
  03:28:56 STEP 1088 H= 272:00 +CPU= 32.991
  03:29:27 STEP 1089 H= 272:15 +CPU= 31.335
  03:29:59 STEP 1090 H= 272:30 +CPU= 31.694
  03:30:33 STEP 1091 H= 272:45 +CPU= 34.355
  03:31:14 STEP 1092 H= 273:00 +CPU= 40.779
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001092
  03:31:46 STEP 1093 H= 273:15 +CPU= 32.038
  03:32:19 STEP 1094 H= 273:30 +CPU= 32.874
  03:32:52 STEP 1095 H= 273:45 +CPU= 32.473
  03:33:26 STEP 1096 H= 274:00 +CPU= 34.134
  03:34:01 STEP 1097 H= 274:15 +CPU= 34.266
  03:34:35 STEP 1098 H= 274:30 +CPU= 34.409
  03:35:09 STEP 1099 H= 274:45 +CPU= 33.497
  03:35:43 STEP 1100 H= 275:00 +CPU= 33.481
  03:36:16 STEP 1101 H= 275:15 +CPU= 33.245
  03:36:50 STEP 1102 H= 275:30 +CPU= 33.473
  03:37:23 STEP 1103 H= 275:45 +CPU= 33.256
  03:38:09 STEP 1104 H= 276:00 +CPU= 45.311
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001104
  03:38:43 STEP 1105 H= 276:15 +CPU= 34.631
  03:39:18 STEP 1106 H= 276:30 +CPU= 34.921
  03:39:52 STEP 1107 H= 276:45 +CPU= 33.664
  03:40:28 STEP 1108 H= 277:00 +CPU= 35.098
  03:41:02 STEP 1109 H= 277:15 +CPU= 34.356
  03:41:34 STEP 1110 H= 277:30 +CPU= 32.225
  03:42:08 STEP 1111 H= 277:45 +CPU= 33.495
  03:42:45 STEP 1112 H= 278:00 +CPU= 36.399
  03:43:18 STEP 1113 H= 278:15 +CPU= 33.283
  03:43:53 STEP 1114 H= 278:30 +CPU= 34.653
  03:44:27 STEP 1115 H= 278:45 +CPU= 33.756
  03:45:08 STEP 1116 H= 279:00 +CPU= 40.888
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001116
  03:45:40 STEP 1117 H= 279:15 +CPU= 31.850
  03:46:13 STEP 1118 H= 279:30 +CPU= 33.249
  03:46:45 STEP 1119 H= 279:45 +CPU= 32.075
  03:47:19 STEP 1120 H= 280:00 +CPU= 33.230
  03:47:52 STEP 1121 H= 280:15 +CPU= 32.978
  03:48:26 STEP 1122 H= 280:30 +CPU= 33.905
  03:48:59 STEP 1123 H= 280:45 +CPU= 32.883
  03:49:33 STEP 1124 H= 281:00 +CPU= 33.608
  03:50:08 STEP 1125 H= 281:15 +CPU= 34.989
  03:50:41 STEP 1126 H= 281:30 +CPU= 32.833
  03:51:14 STEP 1127 H= 281:45 +CPU= 32.695
  03:51:55 STEP 1128 H= 282:00 +CPU= 41.577
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001128
  03:52:26 STEP 1129 H= 282:15 +CPU= 30.411
  03:52:56 STEP 1130 H= 282:30 +CPU= 29.829
  03:53:29 STEP 1131 H= 282:45 +CPU= 32.346
  03:54:01 STEP 1132 H= 283:00 +CPU= 31.746
  03:54:34 STEP 1133 H= 283:15 +CPU= 32.735
  03:55:04 STEP 1134 H= 283:30 +CPU= 30.223
  03:55:35 STEP 1135 H= 283:45 +CPU= 30.756
  03:56:10 STEP 1136 H= 284:00 +CPU= 34.434
  03:56:42 STEP 1137 H= 284:15 +CPU= 32.163
  03:57:15 STEP 1138 H= 284:30 +CPU= 32.711
  03:57:46 STEP 1139 H= 284:45 +CPU= 30.999
  03:58:26 STEP 1140 H= 285:00 +CPU= 39.434
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001140
  03:59:00 STEP 1141 H= 285:15 +CPU= 33.711
  03:59:32 STEP 1142 H= 285:30 +CPU= 32.048
  04:00:06 STEP 1143 H= 285:45 +CPU= 33.501
  04:00:42 STEP 1144 H= 286:00 +CPU= 34.967
  04:01:16 STEP 1145 H= 286:15 +CPU= 32.874
  04:01:49 STEP 1146 H= 286:30 +CPU= 32.882
  04:02:24 STEP 1147 H= 286:45 +CPU= 34.719
  04:03:02 STEP 1148 H= 287:00 +CPU= 37.996
  04:03:37 STEP 1149 H= 287:15 +CPU= 34.612
  04:04:12 STEP 1150 H= 287:30 +CPU= 35.300
  04:04:49 STEP 1151 H= 287:45 +CPU= 36.430
  04:05:40 STEP 1152 H= 288:00 +CPU= 49.714
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001152
  04:06:15 STEP 1153 H= 288:15 +CPU= 35.512
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001152
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:06:51 STEP 1154 H= 288:30 +CPU= 35.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:01:10 STEP 1155 H= 288:45 +CPU= 40.958
  05:01:43 STEP 1156 H= 289:00 +CPU= 32.923
  05:02:17 STEP 1157 H= 289:15 +CPU= 33.445
  05:02:51 STEP 1158 H= 289:30 +CPU= 33.403
  05:03:25 STEP 1159 H= 289:45 +CPU= 33.682
  05:03:59 STEP 1160 H= 290:00 +CPU= 34.332
  05:04:32 STEP 1161 H= 290:15 +CPU= 32.753
  05:05:07 STEP 1162 H= 290:30 +CPU= 34.406
  05:05:39 STEP 1163 H= 290:45 +CPU= 31.891
  05:06:23 STEP 1164 H= 291:00 +CPU= 43.359
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001164
  05:06:54 STEP 1165 H= 291:15 +CPU= 31.475
  05:07:27 STEP 1166 H= 291:30 +CPU= 33.143
  05:08:01 STEP 1167 H= 291:45 +CPU= 33.681
  05:08:36 STEP 1168 H= 292:00 +CPU= 34.444
  05:09:09 STEP 1169 H= 292:15 +CPU= 33.066
  05:09:43 STEP 1170 H= 292:30 +CPU= 33.444
  05:10:21 STEP 1171 H= 292:45 +CPU= 34.843
  05:10:57 STEP 1172 H= 293:00 +CPU= 35.095
  05:11:32 STEP 1173 H= 293:15 +CPU= 34.619
  05:12:06 STEP 1174 H= 293:30 +CPU= 33.766
  05:12:41 STEP 1175 H= 293:45 +CPU= 35.026
  05:13:24 STEP 1176 H= 294:00 +CPU= 42.093
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001176
  05:13:59 STEP 1177 H= 294:15 +CPU= 34.675
  05:14:32 STEP 1178 H= 294:30 +CPU= 33.832
  05:15:08 STEP 1179 H= 294:45 +CPU= 34.979
  05:15:42 STEP 1180 H= 295:00 +CPU= 34.358
  05:16:15 STEP 1181 H= 295:15 +CPU= 32.535
  05:16:49 STEP 1182 H= 295:30 +CPU= 34.664
  05:17:25 STEP 1183 H= 295:45 +CPU= 35.678
  05:18:00 STEP 1184 H= 296:00 +CPU= 34.289
  05:18:34 STEP 1185 H= 296:15 +CPU= 34.672
  05:19:07 STEP 1186 H= 296:30 +CPU= 32.561
  05:19:40 STEP 1187 H= 296:45 +CPU= 32.978
  05:20:24 STEP 1188 H= 297:00 +CPU= 42.900
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001188
  05:20:58 STEP 1189 H= 297:15 +CPU= 33.737
  05:21:32 STEP 1190 H= 297:30 +CPU= 33.872
  05:22:05 STEP 1191 H= 297:45 +CPU= 33.531
  05:22:39 STEP 1192 H= 298:00 +CPU= 33.617
  05:23:13 STEP 1193 H= 298:15 +CPU= 34.070
  05:23:49 STEP 1194 H= 298:30 +CPU= 35.094
  05:24:23 STEP 1195 H= 298:45 +CPU= 34.709
  05:24:58 STEP 1196 H= 299:00 +CPU= 33.933
  05:25:30 STEP 1197 H= 299:15 +CPU= 32.461
  05:26:06 STEP 1198 H= 299:30 +CPU= 35.394
  05:26:41 STEP 1199 H= 299:45 +CPU= 34.694
  05:27:31 STEP 1200 H= 300:00 +CPU= 47.865
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001200
  05:28:06 STEP 1201 H= 300:15 +CPU= 34.764
  05:28:39 STEP 1202 H= 300:30 +CPU= 33.571
  05:29:12 STEP 1203 H= 300:45 +CPU= 32.384
  05:29:47 STEP 1204 H= 301:00 +CPU= 34.170
  05:30:21 STEP 1205 H= 301:15 +CPU= 33.175
  05:30:55 STEP 1206 H= 301:30 +CPU= 34.131
  05:31:29 STEP 1207 H= 301:45 +CPU= 33.571
  05:32:05 STEP 1208 H= 302:00 +CPU= 34.840
  05:32:39 STEP 1209 H= 302:15 +CPU= 34.348
  05:33:11 STEP 1210 H= 302:30 +CPU= 32.146
  05:33:47 STEP 1211 H= 302:45 +CPU= 34.908
  05:34:30 STEP 1212 H= 303:00 +CPU= 42.315
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001212
  05:35:05 STEP 1213 H= 303:15 +CPU= 34.955
  05:35:40 STEP 1214 H= 303:30 +CPU= 35.058
  05:36:14 STEP 1215 H= 303:45 +CPU= 34.174
  05:36:49 STEP 1216 H= 304:00 +CPU= 35.070
  05:37:22 STEP 1217 H= 304:15 +CPU= 32.915
  05:37:57 STEP 1218 H= 304:30 +CPU= 34.782
  05:38:33 STEP 1219 H= 304:45 +CPU= 35.352
  05:39:08 STEP 1220 H= 305:00 +CPU= 34.820
  05:39:41 STEP 1221 H= 305:15 +CPU= 33.231
  05:40:14 STEP 1222 H= 305:30 +CPU= 32.929
  05:40:48 STEP 1223 H= 305:45 +CPU= 33.623
  05:41:31 STEP 1224 H= 306:00 +CPU= 43.262
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001224
  05:42:06 STEP 1225 H= 306:15 +CPU= 34.889
  05:42:41 STEP 1226 H= 306:30 +CPU= 34.181
  05:43:14 STEP 1227 H= 306:45 +CPU= 33.329
  05:43:49 STEP 1228 H= 307:00 +CPU= 34.284
  05:44:23 STEP 1229 H= 307:15 +CPU= 33.945
  05:44:56 STEP 1230 H= 307:30 +CPU= 33.424
  05:45:30 STEP 1231 H= 307:45 +CPU= 33.568
  05:46:05 STEP 1232 H= 308:00 +CPU= 34.700
  05:46:40 STEP 1233 H= 308:15 +CPU= 34.690
  05:47:13 STEP 1234 H= 308:30 +CPU= 32.980
  05:47:46 STEP 1235 H= 308:45 +CPU= 32.724
  05:48:27 STEP 1236 H= 309:00 +CPU= 41.237
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001236
  05:49:00 STEP 1237 H= 309:15 +CPU= 33.183
  05:49:33 STEP 1238 H= 309:30 +CPU= 32.385
  05:50:06 STEP 1239 H= 309:45 +CPU= 33.361
  05:50:40 STEP 1240 H= 310:00 +CPU= 33.694
  05:51:11 STEP 1241 H= 310:15 +CPU= 30.843
  05:51:45 STEP 1242 H= 310:30 +CPU= 33.494
  05:52:17 STEP 1243 H= 310:45 +CPU= 32.028
  05:52:50 STEP 1244 H= 311:00 +CPU= 32.482
  05:53:21 STEP 1245 H= 311:15 +CPU= 30.933
  05:53:53 STEP 1246 H= 311:30 +CPU= 32.145
  05:54:25 STEP 1247 H= 311:45 +CPU= 31.741
  05:55:11 STEP 1248 H= 312:00 +CPU= 45.537
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001248
  05:55:45 STEP 1249 H= 312:15 +CPU= 34.284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001248
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:56:19 STEP 1250 H= 312:30 +CPU= 33.485
  05:56:52 STEP 1251 H= 312:45 +CPU= 32.739
  05:57:26 STEP 1252 H= 313:00 +CPU= 33.889
  05:57:57 STEP 1253 H= 313:15 +CPU= 31.483
  05:58:31 STEP 1254 H= 313:30 +CPU= 33.818
  05:59:06 STEP 1255 H= 313:45 +CPU= 34.520
  05:59:41 STEP 1256 H= 314:00 +CPU= 34.708
  06:00:15 STEP 1257 H= 314:15 +CPU= 33.722
  06:00:48 STEP 1258 H= 314:30 +CPU= 33.387
  06:01:22 STEP 1259 H= 314:45 +CPU= 33.791
  06:02:06 STEP 1260 H= 315:00 +CPU= 43.098
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001260
  06:02:41 STEP 1261 H= 315:15 +CPU= 35.040
  06:03:13 STEP 1262 H= 315:30 +CPU= 32.107
  06:03:46 STEP 1263 H= 315:45 +CPU= 32.932
  06:04:22 STEP 1264 H= 316:00 +CPU= 35.723
  06:04:54 STEP 1265 H= 316:15 +CPU= 32.304
  06:05:27 STEP 1266 H= 316:30 +CPU= 32.616
  06:06:01 STEP 1267 H= 316:45 +CPU= 33.866
  06:06:37 STEP 1268 H= 317:00 +CPU= 35.947
  06:07:10 STEP 1269 H= 317:15 +CPU= 32.958
  06:07:44 STEP 1270 H= 317:30 +CPU= 33.654
  06:08:18 STEP 1271 H= 317:45 +CPU= 33.338
  06:09:01 STEP 1272 H= 318:00 +CPU= 43.438
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001272
  06:09:37 STEP 1273 H= 318:15 +CPU= 35.426
  06:10:11 STEP 1274 H= 318:30 +CPU= 33.653
  06:10:45 STEP 1275 H= 318:45 +CPU= 34.281
  06:11:19 STEP 1276 H= 319:00 +CPU= 34.078
  06:11:52 STEP 1277 H= 319:15 +CPU= 32.780
  06:12:24 STEP 1278 H= 319:30 +CPU= 32.016
  06:12:57 STEP 1279 H= 319:45 +CPU= 32.032
  06:13:30 STEP 1280 H= 320:00 +CPU= 33.433
  06:14:02 STEP 1281 H= 320:15 +CPU= 31.521
  06:14:36 STEP 1282 H= 320:30 +CPU= 33.594
  06:15:09 STEP 1283 H= 320:45 +CPU= 33.063
  06:15:52 STEP 1284 H= 321:00 +CPU= 43.324
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001284
  06:16:25 STEP 1285 H= 321:15 +CPU= 32.513
  06:16:57 STEP 1286 H= 321:30 +CPU= 31.681
  06:17:29 STEP 1287 H= 321:45 +CPU= 31.715
  06:18:00 STEP 1288 H= 322:00 +CPU= 31.363
  06:18:34 STEP 1289 H= 322:15 +CPU= 33.329
  06:19:07 STEP 1290 H= 322:30 +CPU= 32.833
  06:19:40 STEP 1291 H= 322:45 +CPU= 33.546
  06:20:12 STEP 1292 H= 323:00 +CPU= 31.823
  06:20:46 STEP 1293 H= 323:15 +CPU= 33.468
  06:21:20 STEP 1294 H= 323:30 +CPU= 33.459
  06:21:54 STEP 1295 H= 323:45 +CPU= 34.645
  06:22:42 STEP 1296 H= 324:00 +CPU= 47.431
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001296
  06:23:14 STEP 1297 H= 324:15 +CPU= 31.530
  06:23:45 STEP 1298 H= 324:30 +CPU= 31.306
  06:24:20 STEP 1299 H= 324:45 +CPU= 35.109
  06:24:55 STEP 1300 H= 325:00 +CPU= 34.263
  06:25:29 STEP 1301 H= 325:15 +CPU= 34.459
  06:26:04 STEP 1302 H= 325:30 +CPU= 34.377
  06:26:39 STEP 1303 H= 325:45 +CPU= 34.836
  06:27:15 STEP 1304 H= 326:00 +CPU= 36.168
  06:27:50 STEP 1305 H= 326:15 +CPU= 34.257
  06:28:23 STEP 1306 H= 326:30 +CPU= 33.191
  06:28:55 STEP 1307 H= 326:45 +CPU= 32.187
  06:29:36 STEP 1308 H= 327:00 +CPU= 40.169
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001308
  06:30:08 STEP 1309 H= 327:15 +CPU= 32.607
  06:30:43 STEP 1310 H= 327:30 +CPU= 34.307
  06:31:16 STEP 1311 H= 327:45 +CPU= 33.013
  06:31:52 STEP 1312 H= 328:00 +CPU= 35.377
  06:32:26 STEP 1313 H= 328:15 +CPU= 34.195
  06:32:59 STEP 1314 H= 328:30 +CPU= 33.265
  06:33:34 STEP 1315 H= 328:45 +CPU= 34.413
  06:34:10 STEP 1316 H= 329:00 +CPU= 36.027
  06:34:43 STEP 1317 H= 329:15 +CPU= 32.886
  06:35:16 STEP 1318 H= 329:30 +CPU= 32.986
  06:35:50 STEP 1319 H= 329:45 +CPU= 33.879
  06:36:32 STEP 1320 H= 330:00 +CPU= 41.036
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001320
  06:37:06 STEP 1321 H= 330:15 +CPU= 34.717
  06:37:39 STEP 1322 H= 330:30 +CPU= 32.544
  06:38:12 STEP 1323 H= 330:45 +CPU= 32.361
  06:38:48 STEP 1324 H= 331:00 +CPU= 35.779
  06:39:22 STEP 1325 H= 331:15 +CPU= 33.893
  06:39:56 STEP 1326 H= 331:30 +CPU= 34.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:45:40 STEP 1327 H= 331:45 +CPU= 35.073
  08:46:18 STEP 1328 H= 332:00 +CPU= 35.772
  08:46:54 STEP 1329 H= 332:15 +CPU= 34.968
  08:47:31 STEP 1330 H= 332:30 +CPU= 35.551
  08:48:09 STEP 1331 H= 332:45 +CPU= 35.913
  08:48:55 STEP 1332 H= 333:00 +CPU= 44.207
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001332
  08:49:32 STEP 1333 H= 333:15 +CPU= 35.425
  08:50:09 STEP 1334 H= 333:30 +CPU= 34.891
  08:50:46 STEP 1335 H= 333:45 +CPU= 35.263
  08:51:23 STEP 1336 H= 334:00 +CPU= 36.337
  08:52:00 STEP 1337 H= 334:15 +CPU= 34.951
  08:52:36 STEP 1338 H= 334:30 +CPU= 35.306
  08:53:14 STEP 1339 H= 334:45 +CPU= 35.750
  08:53:51 STEP 1340 H= 335:00 +CPU= 35.988
  08:54:28 STEP 1341 H= 335:15 +CPU= 35.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:55:08 STEP 1342 H= 335:30 +CPU= 29.306
  08:55:38 STEP 1343 H= 335:45 +CPU= 27.876
  08:56:16 STEP 1344 H= 336:00 +CPU= 37.085
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001344
  08:56:44 STEP 1345 H= 336:15 +CPU= 26.546
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001344
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398_13.zip
Uploading the intermediate file: upload_file_13.zip
  08:57:12 STEP 1346 H= 336:30 +CPU= 26.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:05:32 STEP 1347 H= 336:45 +CPU= 25.568
  09:05:58 STEP 1348 H= 337:00 +CPU= 25.980
  09:06:24 STEP 1349 H= 337:15 +CPU= 25.080
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:59:06 STEP 1350 H= 337:30 +CPU= 25.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:34:33 STEP 1351 H= 337:45 +CPU= 26.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:42:17 STEP 1352 H= 338:00 +CPU= 27.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:51:32 STEP 1353 H= 338:15 +CPU= 27.294
  10:52:00 STEP 1354 H= 338:30 +CPU= 26.484
  10:52:28 STEP 1355 H= 338:45 +CPU= 26.329
  10:53:04 STEP 1356 H= 339:00 +CPU= 33.776
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:55:33 STEP 1357 H= 339:15 +CPU= 27.521
  10:56:01 STEP 1358 H= 339:30 +CPU= 27.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:10:51 STEP 1359 H= 339:45 +CPU= 27.260
  11:11:19 STEP 1360 H= 340:00 +CPU= 26.387
  11:11:46 STEP 1361 H= 340:15 +CPU= 26.681
  11:12:13 STEP 1362 H= 340:30 +CPU= 25.554
  11:12:41 STEP 1363 H= 340:45 +CPU= 27.086
  11:13:08 STEP 1364 H= 341:00 +CPU= 26.232
  11:13:35 STEP 1365 H= 341:15 +CPU= 25.767
  11:14:02 STEP 1366 H= 341:30 +CPU= 26.178
  11:14:30 STEP 1367 H= 341:45 +CPU= 26.475
  11:15:05 STEP 1368 H= 342:00 +CPU= 33.795
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001368
  11:15:32 STEP 1369 H= 342:15 +CPU= 26.466
  11:16:00 STEP 1370 H= 342:30 +CPU= 26.910
  11:16:28 STEP 1371 H= 342:45 +CPU= 26.983
  11:16:55 STEP 1372 H= 343:00 +CPU= 25.862
  11:17:22 STEP 1373 H= 343:15 +CPU= 25.993
  11:17:50 STEP 1374 H= 343:30 +CPU= 26.227
  11:18:15 STEP 1375 H= 343:45 +CPU= 24.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:23:16 STEP 1376 H= 344:00 +CPU= 25.871
  11:23:43 STEP 1377 H= 344:15 +CPU= 25.990
  11:24:17 STEP 1378 H= 344:30 +CPU= 31.349
  11:24:53 STEP 1379 H= 344:45 +CPU= 33.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:37:51 STEP 1380 H= 345:00 +CPU= 40.181
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:42:29 STEP 1381 H= 345:15 +CPU= 31.686
  11:43:04 STEP 1382 H= 345:30 +CPU= 33.575
  11:43:38 STEP 1383 H= 345:45 +CPU= 31.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:48:07 STEP 1384 H= 346:00 +CPU= 33.212
  11:48:41 STEP 1385 H= 346:15 +CPU= 32.343
  11:49:17 STEP 1386 H= 346:30 +CPU= 34.080
  11:49:51 STEP 1387 H= 346:45 +CPU= 31.383
  11:50:26 STEP 1388 H= 347:00 +CPU= 32.571
  11:51:00 STEP 1389 H= 347:15 +CPU= 32.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:54:05 STEP 1390 H= 347:30 +CPU= 31.936
  11:54:38 STEP 1391 H= 347:45 +CPU= 30.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:08:55 STEP 1392 H= 348:00 +CPU= 42.742
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001392
  12:09:25 STEP 1393 H= 348:15 +CPU= 29.047
  12:09:54 STEP 1394 H= 348:30 +CPU= 28.456
  12:10:26 STEP 1395 H= 348:45 +CPU= 31.435
  12:10:59 STEP 1396 H= 349:00 +CPU= 32.783
  12:11:28 STEP 1397 H= 349:15 +CPU= 28.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:18:25 STEP 1398 H= 349:30 +CPU= 32.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:18:47 STEP 1399 H= 349:45 +CPU= 40.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:00:10 STEP 1400 H= 350:00 +CPU= 38.439
  15:00:56 STEP 1401 H= 350:15 +CPU= 36.813
  15:01:27 STEP 1402 H= 350:30 +CPU= 30.231
  15:01:59 STEP 1403 H= 350:45 +CPU= 30.773
  15:02:37 STEP 1404 H= 351:00 +CPU= 36.491
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001404
  15:03:06 STEP 1405 H= 351:15 +CPU= 27.927
  15:03:33 STEP 1406 H= 351:30 +CPU= 25.971
  15:04:00 STEP 1407 H= 351:45 +CPU= 26.250
  15:04:26 STEP 1408 H= 352:00 +CPU= 25.971
  15:04:52 STEP 1409 H= 352:15 +CPU= 25.404
  15:05:19 STEP 1410 H= 352:30 +CPU= 26.209
  15:05:50 STEP 1411 H= 352:45 +CPU= 29.597
  15:06:21 STEP 1412 H= 353:00 +CPU= 29.587
  15:06:51 STEP 1413 H= 353:15 +CPU= 29.243
  15:07:21 STEP 1414 H= 353:30 +CPU= 28.479
  15:07:52 STEP 1415 H= 353:45 +CPU= 28.466
  15:08:29 STEP 1416 H= 354:00 +CPU= 35.334
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001416
  15:08:59 STEP 1417 H= 354:15 +CPU= 29.487
  15:09:25 STEP 1418 H= 354:30 +CPU= 25.138
  15:09:51 STEP 1419 H= 354:45 +CPU= 25.786
  15:10:21 STEP 1420 H= 355:00 +CPU= 29.115
  15:10:50 STEP 1421 H= 355:15 +CPU= 28.257
  15:11:19 STEP 1422 H= 355:30 +CPU= 28.266
  15:11:47 STEP 1423 H= 355:45 +CPU= 27.202
  15:12:15 STEP 1424 H= 356:00 +CPU= 26.825
  15:12:45 STEP 1425 H= 356:15 +CPU= 28.904
  15:13:13 STEP 1426 H= 356:30 +CPU= 28.135
  15:13:39 STEP 1427 H= 356:45 +CPU= 25.516
  15:14:13 STEP 1428 H= 357:00 +CPU= 32.765
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001428
  15:14:43 STEP 1429 H= 357:15 +CPU= 29.584
  15:15:14 STEP 1430 H= 357:30 +CPU= 30.319
  15:15:46 STEP 1431 H= 357:45 +CPU= 31.050
  15:16:19 STEP 1432 H= 358:00 +CPU= 32.583
  15:16:49 STEP 1433 H= 358:15 +CPU= 29.363
  15:17:18 STEP 1434 H= 358:30 +CPU= 28.001
  15:17:48 STEP 1435 H= 358:45 +CPU= 29.268
  15:18:22 STEP 1436 H= 359:00 +CPU= 32.163
  15:18:52 STEP 1437 H= 359:15 +CPU= 30.074
  15:19:25 STEP 1438 H= 359:30 +CPU= 31.801
  15:19:53 STEP 1439 H= 359:45 +CPU= 27.195
  15:20:36 STEP 1440 H= 360:00 +CPU= 38.789
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.2576047352E-22      I       0.1798686803E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2500974922E-01      I
I  Relat. Hum. I      0.1875437617E+00      I       0.2467156538E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3272854482E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    300225505 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS300225.5 Mbytes/s, TOTAL TIME=    0.0098(10.2%)
 15:20:36 STEP 1440 H= 360:00 +CPU= 38.789
 END CNT3
 NSTEP =  1440 CNT0   000000000  27.239  27.239  28.013   0.972               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        12762/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    228    0       34      1044068    12762 ************    33.0     2.0    31.1     3.2    68.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  469   38115.2   38115.2     39.30      0.00
   9 SPCM     - SPECTRAL COMP.                     432     898.2     898.2      0.85      0.00
  10 SCAN2M - PHYSICS                              433   45245.6   45245.6     43.08      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 36    1397.1    1397.1      0.11      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 19      53.0      53.0      0.00      0.00
  17 GRIDFPOS IN CNT4                               36      33.9      33.9      0.00      0.00
  27 RESTART FILES - WRITING                         9    5583.0    5583.0      0.11      0.00
  28 RESTART FILES - READING                         1    4066.3    4066.3      0.01      0.00
  29 SU4FPOS IN CNT4                                36       6.2       6.2      0.00      0.00
  30 DYNFPOS IN CNT4                                36   27849.1   27849.1      2.20      0.00
  31 POSDDH IN STEPO                                 2      39.7      39.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    433   10290.7   10290.7      9.80      0.00
  39 SU0YOMB                                         1     549.9     549.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    433      38.8      38.8      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              432     332.5     332.5      0.32      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              432      75.6      75.6      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 19       7.4       7.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      940     554.1     554.1      1.15      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       900     310.4     310.4      0.61      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        900     109.9     109.9      0.22      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       940     557.7     557.7      1.15      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      57.4      57.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            940      79.7      79.7      0.16      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            900      40.7      40.7      0.08      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            940     291.1     291.1      0.60      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            900      21.3      21.3      0.04      0.00
 400 GSTATS                                      50912       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 47318       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    45480.9 CPU TIME   14409.4 VECTOR TIME    14409.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       28.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/27/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/slots/27/NODE.001_01
Adding to the zip: /data/boinc/boinc-client/slots/27/ifs.stat
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+000864
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+000864
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMGGh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12209381/ICMSHh7zg+000864
Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a202_2016092300_15_991_12209381_0_r1166201398_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
15:24:10 (164158): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:42 1478188 22309579 oifs_43r3_bl_a202_2016092300_15_991_12209381_0 1,295,100 49,980 0.0386


©2024 cpdn.org