climateprediction.net home page
Task 22311493

Task 22311493

Name oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0
Workunit 12211256
Created 13 Feb 2023, 20:14:16 UTC
Sent 13 Feb 2023, 22:22:02 UTC
Report deadline 14 Apr 2023, 22:22:02 UTC
Received 15 Feb 2023, 8:00:23 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532429
Run time 10 hours 27 min 28 sec
CPU time 10 hours 15 min
Validate state Valid
Credit 1,813.14
Device peak FLOPS 3.27 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,076.27 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,378.54 MB
Stderr
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
cts directory: /home/nairb/slots/2/ICMGGh7zg+000780
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000780
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000780
  03:05:02 STEP  781 H= 195:15 +CPU= 25.820
  03:05:28 STEP  782 H= 195:30 +CPU= 25.913
  03:05:54 STEP  783 H= 195:45 +CPU= 25.924
  03:06:21 STEP  784 H= 196:00 +CPU= 26.552
  03:06:47 STEP  785 H= 196:15 +CPU= 26.013
  03:07:13 STEP  786 H= 196:30 +CPU= 25.914
  03:07:40 STEP  787 H= 196:45 +CPU= 26.006
  03:08:06 STEP  788 H= 197:00 +CPU= 26.442
  03:08:33 STEP  789 H= 197:15 +CPU= 26.099
  03:08:59 STEP  790 H= 197:30 +CPU= 25.921
  03:09:25 STEP  791 H= 197:45 +CPU= 26.030
  03:09:58 STEP  792 H= 198:00 +CPU= 32.296
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000792
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000792
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000792
  03:10:24 STEP  793 H= 198:15 +CPU= 26.165
  03:10:51 STEP  794 H= 198:30 +CPU= 26.042
  03:11:17 STEP  795 H= 198:45 +CPU= 25.943
  03:11:43 STEP  796 H= 199:00 +CPU= 25.495
  03:12:07 STEP  797 H= 199:15 +CPU= 24.001
  03:12:30 STEP  798 H= 199:30 +CPU= 23.073
  03:12:54 STEP  799 H= 199:45 +CPU= 23.076
  03:13:18 STEP  800 H= 200:00 +CPU= 23.664
  03:13:41 STEP  801 H= 200:15 +CPU= 23.042
  03:14:04 STEP  802 H= 200:30 +CPU= 22.942
  03:14:27 STEP  803 H= 200:45 +CPU= 23.115
  03:14:57 STEP  804 H= 201:00 +CPU= 28.963
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000804
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000804
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000804
  03:15:20 STEP  805 H= 201:15 +CPU= 23.087
  03:15:44 STEP  806 H= 201:30 +CPU= 23.308
  03:16:07 STEP  807 H= 201:45 +CPU= 22.973
  03:16:29 STEP  808 H= 202:00 +CPU= 22.474
  03:16:51 STEP  809 H= 202:15 +CPU= 21.470
  03:17:12 STEP  810 H= 202:30 +CPU= 20.944
  03:17:33 STEP  811 H= 202:45 +CPU= 20.921
  03:17:55 STEP  812 H= 203:00 +CPU= 21.445
  03:18:16 STEP  813 H= 203:15 +CPU= 20.854
  03:18:37 STEP  814 H= 203:30 +CPU= 20.953
  03:18:58 STEP  815 H= 203:45 +CPU= 20.695
  03:19:27 STEP  816 H= 204:00 +CPU= 28.591
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000816
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000816
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000816
  03:19:48 STEP  817 H= 204:15 +CPU= 21.053
  03:20:09 STEP  818 H= 204:30 +CPU= 20.798
  03:20:30 STEP  819 H= 204:45 +CPU= 20.791
  03:20:52 STEP  820 H= 205:00 +CPU= 21.600
  03:21:13 STEP  821 H= 205:15 +CPU= 21.009
  03:21:34 STEP  822 H= 205:30 +CPU= 21.025
  03:21:56 STEP  823 H= 205:45 +CPU= 20.953
  03:22:17 STEP  824 H= 206:00 +CPU= 21.427
  03:22:38 STEP  825 H= 206:15 +CPU= 20.971
  03:22:59 STEP  826 H= 206:30 +CPU= 20.904
  03:23:21 STEP  827 H= 206:45 +CPU= 21.023
  03:23:47 STEP  828 H= 207:00 +CPU= 26.170
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000828
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000828
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000828
  03:24:08 STEP  829 H= 207:15 +CPU= 21.060
  03:24:30 STEP  830 H= 207:30 +CPU= 21.113
  03:24:51 STEP  831 H= 207:45 +CPU= 21.077
  03:25:12 STEP  832 H= 208:00 +CPU= 21.287
  03:25:34 STEP  833 H= 208:15 +CPU= 21.008
  03:25:55 STEP  834 H= 208:30 +CPU= 20.947
  03:26:16 STEP  835 H= 208:45 +CPU= 21.013
  03:26:38 STEP  836 H= 209:00 +CPU= 21.497
  03:26:59 STEP  837 H= 209:15 +CPU= 20.868
  03:27:20 STEP  838 H= 209:30 +CPU= 20.912
  03:27:41 STEP  839 H= 209:45 +CPU= 20.885
  03:28:07 STEP  840 H= 210:00 +CPU= 25.599
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000840
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000840
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000840
  03:28:28 STEP  841 H= 210:15 +CPU= 21.004
  03:28:49 STEP  842 H= 210:30 +CPU= 21.051
  03:29:10 STEP  843 H= 210:45 +CPU= 20.945
  03:29:32 STEP  844 H= 211:00 +CPU= 21.454
  03:29:53 STEP  845 H= 211:15 +CPU= 21.023
  03:30:14 STEP  846 H= 211:30 +CPU= 20.912
  03:30:35 STEP  847 H= 211:45 +CPU= 20.727
  03:30:57 STEP  848 H= 212:00 +CPU= 21.532
  03:31:18 STEP  849 H= 212:15 +CPU= 20.904
  03:31:39 STEP  850 H= 212:30 +CPU= 21.009
  03:32:00 STEP  851 H= 212:45 +CPU= 20.994
  03:32:27 STEP  852 H= 213:00 +CPU= 26.022
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000852
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000852
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000852
  03:32:48 STEP  853 H= 213:15 +CPU= 20.950
  03:33:09 STEP  854 H= 213:30 +CPU= 21.061
  03:33:30 STEP  855 H= 213:45 +CPU= 21.160
  03:33:52 STEP  856 H= 214:00 +CPU= 21.552
  03:34:13 STEP  857 H= 214:15 +CPU= 20.950
  03:34:34 STEP  858 H= 214:30 +CPU= 20.981
  03:34:56 STEP  859 H= 214:45 +CPU= 20.933
  03:35:17 STEP  860 H= 215:00 +CPU= 21.448
  03:35:39 STEP  861 H= 215:15 +CPU= 21.041
  03:35:59 STEP  862 H= 215:30 +CPU= 20.793
  03:36:21 STEP  863 H= 215:45 +CPU= 20.865
  03:36:49 STEP  864 H= 216:00 +CPU= 28.637
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000864
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000864
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000852
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000852
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000852
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_8.zip
Uploading the intermediate file: upload_file_8.zip
  03:37:12 STEP  865 H= 216:15 +CPU= 22.006
  03:37:33 STEP  866 H= 216:30 +CPU= 21.091
  03:37:54 STEP  867 H= 216:45 +CPU= 21.085
  03:38:16 STEP  868 H= 217:00 +CPU= 21.421
  03:38:37 STEP  869 H= 217:15 +CPU= 21.019
  03:38:58 STEP  870 H= 217:30 +CPU= 20.998
  03:39:20 STEP  871 H= 217:45 +CPU= 21.390
  03:39:42 STEP  872 H= 218:00 +CPU= 21.545
  03:40:03 STEP  873 H= 218:15 +CPU= 21.055
  03:40:24 STEP  874 H= 218:30 +CPU= 20.747
  03:40:45 STEP  875 H= 218:45 +CPU= 20.779
  03:41:11 STEP  876 H= 219:00 +CPU= 26.118
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000876
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000876
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000876
  03:41:33 STEP  877 H= 219:15 +CPU= 21.063
  03:41:54 STEP  878 H= 219:30 +CPU= 20.948
  03:42:15 STEP  879 H= 219:45 +CPU= 21.234
  03:42:37 STEP  880 H= 220:00 +CPU= 21.591
  03:42:58 STEP  881 H= 220:15 +CPU= 21.013
  03:43:19 STEP  882 H= 220:30 +CPU= 20.974
  03:43:40 STEP  883 H= 220:45 +CPU= 21.003
  03:44:02 STEP  884 H= 221:00 +CPU= 21.330
  03:44:23 STEP  885 H= 221:15 +CPU= 20.974
  03:44:44 STEP  886 H= 221:30 +CPU= 20.965
  03:45:06 STEP  887 H= 221:45 +CPU= 20.982
  03:45:32 STEP  888 H= 222:00 +CPU= 26.228
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000888
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000888
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000888
  03:45:53 STEP  889 H= 222:15 +CPU= 21.012
  03:46:16 STEP  890 H= 222:30 +CPU= 22.182
  03:46:37 STEP  891 H= 222:45 +CPU= 21.010
  03:46:58 STEP  892 H= 223:00 +CPU= 21.344
  03:47:19 STEP  893 H= 223:15 +CPU= 20.940
  03:47:40 STEP  894 H= 223:30 +CPU= 20.824
  03:48:02 STEP  895 H= 223:45 +CPU= 20.905
  03:48:23 STEP  896 H= 224:00 +CPU= 21.347
  03:48:44 STEP  897 H= 224:15 +CPU= 20.856
  03:49:05 STEP  898 H= 224:30 +CPU= 20.887
  03:49:27 STEP  899 H= 224:45 +CPU= 21.048
  03:49:54 STEP  900 H= 225:00 +CPU= 26.724
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000900
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000900
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000900
  03:50:14 STEP  901 H= 225:15 +CPU= 20.682
  03:50:35 STEP  902 H= 225:30 +CPU= 20.671
  03:50:56 STEP  903 H= 225:45 +CPU= 20.577
  03:51:17 STEP  904 H= 226:00 +CPU= 21.127
  03:51:38 STEP  905 H= 226:15 +CPU= 20.633
  03:51:59 STEP  906 H= 226:30 +CPU= 20.593
  03:52:20 STEP  907 H= 226:45 +CPU= 20.565
  03:52:41 STEP  908 H= 227:00 +CPU= 21.098
  03:53:02 STEP  909 H= 227:15 +CPU= 20.571
  03:53:22 STEP  910 H= 227:30 +CPU= 20.694
  03:53:44 STEP  911 H= 227:45 +CPU= 21.101
  03:54:14 STEP  912 H= 228:00 +CPU= 29.925
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000912
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000912
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000912
  03:54:35 STEP  913 H= 228:15 +CPU= 20.810
  03:54:56 STEP  914 H= 228:30 +CPU= 20.652
  03:55:16 STEP  915 H= 228:45 +CPU= 20.551
  03:55:38 STEP  916 H= 229:00 +CPU= 21.087
  03:55:59 STEP  917 H= 229:15 +CPU= 20.570
  03:56:19 STEP  918 H= 229:30 +CPU= 20.601
  03:56:40 STEP  919 H= 229:45 +CPU= 20.492
  03:57:01 STEP  920 H= 230:00 +CPU= 20.997
  03:57:22 STEP  921 H= 230:15 +CPU= 20.666
  03:57:43 STEP  922 H= 230:30 +CPU= 20.561
  03:58:03 STEP  923 H= 230:45 +CPU= 20.566
  03:58:29 STEP  924 H= 231:00 +CPU= 25.603
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000924
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000924
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000924
  03:58:50 STEP  925 H= 231:15 +CPU= 20.593
  03:59:11 STEP  926 H= 231:30 +CPU= 20.536
  03:59:31 STEP  927 H= 231:45 +CPU= 20.580
  03:59:52 STEP  928 H= 232:00 +CPU= 20.932
  04:00:13 STEP  929 H= 232:15 +CPU= 20.473
  04:00:34 STEP  930 H= 232:30 +CPU= 20.660
  04:00:55 STEP  931 H= 232:45 +CPU= 20.593
  04:01:16 STEP  932 H= 233:00 +CPU= 20.916
  04:01:37 STEP  933 H= 233:15 +CPU= 20.648
  04:01:57 STEP  934 H= 233:30 +CPU= 20.475
  04:02:18 STEP  935 H= 233:45 +CPU= 20.651
  04:02:44 STEP  936 H= 234:00 +CPU= 25.649
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000936
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000936
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000936
  04:03:04 STEP  937 H= 234:15 +CPU= 20.421
  04:03:25 STEP  938 H= 234:30 +CPU= 20.437
  04:03:46 STEP  939 H= 234:45 +CPU= 20.478
  04:04:07 STEP  940 H= 235:00 +CPU= 20.982
  04:04:27 STEP  941 H= 235:15 +CPU= 20.534
  04:04:48 STEP  942 H= 235:30 +CPU= 20.503
  04:05:09 STEP  943 H= 235:45 +CPU= 20.649
  04:05:30 STEP  944 H= 236:00 +CPU= 20.901
  04:05:51 STEP  945 H= 236:15 +CPU= 20.549
  04:06:11 STEP  946 H= 236:30 +CPU= 20.522
  04:06:32 STEP  947 H= 236:45 +CPU= 20.543
  04:06:57 STEP  948 H= 237:00 +CPU= 25.188
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000948
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000948
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000948
  04:07:17 STEP  949 H= 237:15 +CPU= 19.842
  04:07:37 STEP  950 H= 237:30 +CPU= 19.627
  04:07:57 STEP  951 H= 237:45 +CPU= 19.568
  04:08:17 STEP  952 H= 238:00 +CPU= 20.054
  04:08:37 STEP  953 H= 238:15 +CPU= 19.599
  04:08:56 STEP  954 H= 238:30 +CPU= 19.573
  04:09:17 STEP  955 H= 238:45 +CPU= 20.010
  04:09:37 STEP  956 H= 239:00 +CPU= 19.975
  04:09:56 STEP  957 H= 239:15 +CPU= 19.405
  04:10:16 STEP  958 H= 239:30 +CPU= 19.399
  04:10:35 STEP  959 H= 239:45 +CPU= 19.415
  04:11:02 STEP  960 H= 240:00 +CPU= 26.671
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000960
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000960
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000948
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000948
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000948
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_9.zip
Uploading the intermediate file: upload_file_9.zip
  04:11:22 STEP  961 H= 240:15 +CPU= 19.864
Uploading trickle at timestep: 864000
  04:11:42 STEP  962 H= 240:30 +CPU= 19.472
  04:12:01 STEP  963 H= 240:45 +CPU= 19.381
  04:12:21 STEP  964 H= 241:00 +CPU= 19.886
  04:12:41 STEP  965 H= 241:15 +CPU= 19.430
  04:13:00 STEP  966 H= 241:30 +CPU= 19.454
  04:13:20 STEP  967 H= 241:45 +CPU= 19.421
  04:13:40 STEP  968 H= 242:00 +CPU= 19.924
  04:13:59 STEP  969 H= 242:15 +CPU= 19.456
  04:14:19 STEP  970 H= 242:30 +CPU= 19.402
  04:14:39 STEP  971 H= 242:45 +CPU= 19.501
  04:15:03 STEP  972 H= 243:00 +CPU= 24.205
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000972
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000972
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000972
  04:15:22 STEP  973 H= 243:15 +CPU= 19.402
  04:15:42 STEP  974 H= 243:30 +CPU= 19.484
  04:16:02 STEP  975 H= 243:45 +CPU= 19.426
  04:16:22 STEP  976 H= 244:00 +CPU= 19.858
  04:16:41 STEP  977 H= 244:15 +CPU= 19.451
  04:17:01 STEP  978 H= 244:30 +CPU= 19.394
  04:17:20 STEP  979 H= 244:45 +CPU= 19.387
  04:17:40 STEP  980 H= 245:00 +CPU= 19.912
  04:18:00 STEP  981 H= 245:15 +CPU= 19.386
  04:18:19 STEP  982 H= 245:30 +CPU= 19.420
  04:18:39 STEP  983 H= 245:45 +CPU= 19.461
  04:19:03 STEP  984 H= 246:00 +CPU= 24.293
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000984
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000984
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000984
  04:19:23 STEP  985 H= 246:15 +CPU= 19.438
  04:19:42 STEP  986 H= 246:30 +CPU= 19.478
  04:20:02 STEP  987 H= 246:45 +CPU= 19.429
  04:20:22 STEP  988 H= 247:00 +CPU= 19.925
  04:20:42 STEP  989 H= 247:15 +CPU= 19.478
  04:21:01 STEP  990 H= 247:30 +CPU= 19.490
  04:21:21 STEP  991 H= 247:45 +CPU= 19.451
  04:21:41 STEP  992 H= 248:00 +CPU= 19.990
  04:22:00 STEP  993 H= 248:15 +CPU= 19.437
  04:22:20 STEP  994 H= 248:30 +CPU= 19.411
  04:22:40 STEP  995 H= 248:45 +CPU= 19.466
  04:23:04 STEP  996 H= 249:00 +CPU= 24.226
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+000996
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+000996
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+000996
  04:23:23 STEP  997 H= 249:15 +CPU= 19.411
  04:23:43 STEP  998 H= 249:30 +CPU= 19.487
  04:24:03 STEP  999 H= 249:45 +CPU= 19.460
  04:24:23 STEP 1000 H= 250:00 +CPU= 19.912
  04:24:42 STEP 1001 H= 250:15 +CPU= 19.474
  04:25:02 STEP 1002 H= 250:30 +CPU= 19.462
  04:25:21 STEP 1003 H= 250:45 +CPU= 19.407
  04:25:41 STEP 1004 H= 251:00 +CPU= 19.992
  04:26:01 STEP 1005 H= 251:15 +CPU= 19.421
  04:26:21 STEP 1006 H= 251:30 +CPU= 19.417
  04:26:40 STEP 1007 H= 251:45 +CPU= 19.510
  04:27:07 STEP 1008 H= 252:00 +CPU= 26.868
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001008
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001008
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001008
  04:27:27 STEP 1009 H= 252:15 +CPU= 19.522
  04:27:46 STEP 1010 H= 252:30 +CPU= 19.462
  04:28:06 STEP 1011 H= 252:45 +CPU= 19.448
  04:28:26 STEP 1012 H= 253:00 +CPU= 19.942
  04:28:46 STEP 1013 H= 253:15 +CPU= 19.526
  04:29:05 STEP 1014 H= 253:30 +CPU= 19.513
  04:29:25 STEP 1015 H= 253:45 +CPU= 19.490
  04:29:45 STEP 1016 H= 254:00 +CPU= 20.033
  04:30:05 STEP 1017 H= 254:15 +CPU= 19.490
  04:30:24 STEP 1018 H= 254:30 +CPU= 19.436
  04:30:44 STEP 1019 H= 254:45 +CPU= 19.496
  04:31:08 STEP 1020 H= 255:00 +CPU= 24.227
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001020
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001020
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001020
  04:31:28 STEP 1021 H= 255:15 +CPU= 19.410
  04:31:47 STEP 1022 H= 255:30 +CPU= 19.473
  04:32:07 STEP 1023 H= 255:45 +CPU= 19.462
  04:32:27 STEP 1024 H= 256:00 +CPU= 19.922
  04:32:47 STEP 1025 H= 256:15 +CPU= 19.468
  04:33:06 STEP 1026 H= 256:30 +CPU= 19.610
  04:33:27 STEP 1027 H= 256:45 +CPU= 20.194
  04:33:48 STEP 1028 H= 257:00 +CPU= 20.941
  04:34:08 STEP 1029 H= 257:15 +CPU= 20.228
  04:34:28 STEP 1030 H= 257:30 +CPU= 20.275
  04:34:49 STEP 1031 H= 257:45 +CPU= 20.218
  04:35:14 STEP 1032 H= 258:00 +CPU= 25.002
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001032
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001032
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001032
  04:35:34 STEP 1033 H= 258:15 +CPU= 19.912
  04:35:54 STEP 1034 H= 258:30 +CPU= 19.486
  04:36:13 STEP 1035 H= 258:45 +CPU= 19.523
  04:36:33 STEP 1036 H= 259:00 +CPU= 19.975
  04:36:53 STEP 1037 H= 259:15 +CPU= 19.528
  04:37:13 STEP 1038 H= 259:30 +CPU= 19.507
  04:37:32 STEP 1039 H= 259:45 +CPU= 19.480
  04:37:52 STEP 1040 H= 260:00 +CPU= 20.061
  04:38:12 STEP 1041 H= 260:15 +CPU= 19.495
  04:38:32 STEP 1042 H= 260:30 +CPU= 19.492
  04:38:51 STEP 1043 H= 260:45 +CPU= 19.536
  04:39:16 STEP 1044 H= 261:00 +CPU= 24.331
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001044
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001044
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001044
  04:39:35 STEP 1045 H= 261:15 +CPU= 19.659
  04:39:55 STEP 1046 H= 261:30 +CPU= 19.809
  04:40:15 STEP 1047 H= 261:45 +CPU= 19.606
  04:40:37 STEP 1048 H= 262:00 +CPU= 21.810
  04:40:57 STEP 1049 H= 262:15 +CPU= 20.068
  04:41:18 STEP 1050 H= 262:30 +CPU= 20.212
  04:41:38 STEP 1051 H= 262:45 +CPU= 20.407
  04:41:59 STEP 1052 H= 263:00 +CPU= 20.674
  04:42:19 STEP 1053 H= 263:15 +CPU= 20.321
  04:42:40 STEP 1054 H= 263:30 +CPU= 20.327
  04:43:00 STEP 1055 H= 263:45 +CPU= 20.253
  04:43:28 STEP 1056 H= 264:00 +CPU= 27.774
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001056
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001056
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001044
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001044
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001044
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_10.zip
Uploading the intermediate file: upload_file_10.zip
  04:43:49 STEP 1057 H= 264:15 +CPU= 20.860
  04:44:10 STEP 1058 H= 264:30 +CPU= 20.305
  04:44:30 STEP 1059 H= 264:45 +CPU= 20.210
  04:44:51 STEP 1060 H= 265:00 +CPU= 20.995
  04:45:12 STEP 1061 H= 265:15 +CPU= 20.342
  04:45:32 STEP 1062 H= 265:30 +CPU= 20.356
  04:45:53 STEP 1063 H= 265:45 +CPU= 20.381
  04:46:14 STEP 1064 H= 266:00 +CPU= 20.861
  04:46:34 STEP 1065 H= 266:15 +CPU= 20.386
  04:46:55 STEP 1066 H= 266:30 +CPU= 20.368
  04:47:15 STEP 1067 H= 266:45 +CPU= 20.421
  04:47:41 STEP 1068 H= 267:00 +CPU= 25.342
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001068
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001068
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001068
  04:48:02 STEP 1069 H= 267:15 +CPU= 20.361
  04:48:22 STEP 1070 H= 267:30 +CPU= 20.353
  04:48:43 STEP 1071 H= 267:45 +CPU= 20.378
  04:49:04 STEP 1072 H= 268:00 +CPU= 20.921
  04:49:24 STEP 1073 H= 268:15 +CPU= 20.391
  04:49:45 STEP 1074 H= 268:30 +CPU= 20.411
  04:50:05 STEP 1075 H= 268:45 +CPU= 20.424
  04:50:27 STEP 1076 H= 269:00 +CPU= 20.953
  04:50:47 STEP 1077 H= 269:15 +CPU= 20.481
  04:51:08 STEP 1078 H= 269:30 +CPU= 20.434
  04:51:28 STEP 1079 H= 269:45 +CPU= 20.129
  04:51:53 STEP 1080 H= 270:00 +CPU= 25.058
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001080
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001080
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001080
  04:52:14 STEP 1081 H= 270:15 +CPU= 20.252
  04:52:34 STEP 1082 H= 270:30 +CPU= 20.497
  04:52:55 STEP 1083 H= 270:45 +CPU= 20.407
  04:53:16 STEP 1084 H= 271:00 +CPU= 20.912
  04:53:37 STEP 1085 H= 271:15 +CPU= 20.500
  04:53:57 STEP 1086 H= 271:30 +CPU= 20.426
  04:54:18 STEP 1087 H= 271:45 +CPU= 20.677
  04:54:39 STEP 1088 H= 272:00 +CPU= 21.207
  04:55:00 STEP 1089 H= 272:15 +CPU= 20.459
  04:55:21 STEP 1090 H= 272:30 +CPU= 20.453
  04:55:41 STEP 1091 H= 272:45 +CPU= 20.497
  04:56:07 STEP 1092 H= 273:00 +CPU= 25.360
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001092
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001092
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001092
  04:56:27 STEP 1093 H= 273:15 +CPU= 20.415
  04:56:48 STEP 1094 H= 273:30 +CPU= 20.407
  04:57:09 STEP 1095 H= 273:45 +CPU= 20.475
  04:57:30 STEP 1096 H= 274:00 +CPU= 20.913
  04:57:50 STEP 1097 H= 274:15 +CPU= 20.415
  04:58:11 STEP 1098 H= 274:30 +CPU= 20.447
  04:58:31 STEP 1099 H= 274:45 +CPU= 20.386
  04:58:52 STEP 1100 H= 275:00 +CPU= 20.861
  04:59:13 STEP 1101 H= 275:15 +CPU= 20.316
  04:59:33 STEP 1102 H= 275:30 +CPU= 20.333
  04:59:54 STEP 1103 H= 275:45 +CPU= 20.324
  05:00:22 STEP 1104 H= 276:00 +CPU= 27.776
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001104
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001104
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001104
  05:00:42 STEP 1105 H= 276:15 +CPU= 20.381
  05:01:03 STEP 1106 H= 276:30 +CPU= 20.538
  05:01:23 STEP 1107 H= 276:45 +CPU= 20.345
  05:01:44 STEP 1108 H= 277:00 +CPU= 20.894
  05:02:05 STEP 1109 H= 277:15 +CPU= 20.305
  05:02:25 STEP 1110 H= 277:30 +CPU= 20.414
  05:02:46 STEP 1111 H= 277:45 +CPU= 20.407
  05:03:07 STEP 1112 H= 278:00 +CPU= 20.671
  05:03:27 STEP 1113 H= 278:15 +CPU= 20.295
  05:03:48 STEP 1114 H= 278:30 +CPU= 20.366
  05:04:08 STEP 1115 H= 278:45 +CPU= 20.394
  05:04:34 STEP 1116 H= 279:00 +CPU= 25.311
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001116
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001116
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001116
  05:04:54 STEP 1117 H= 279:15 +CPU= 20.409
  05:05:15 STEP 1118 H= 279:30 +CPU= 20.362
  05:05:35 STEP 1119 H= 279:45 +CPU= 20.410
  05:05:56 STEP 1120 H= 280:00 +CPU= 20.856
  05:06:17 STEP 1121 H= 280:15 +CPU= 20.405
  05:06:37 STEP 1122 H= 280:30 +CPU= 20.372
  05:06:58 STEP 1123 H= 280:45 +CPU= 20.412
  05:07:19 STEP 1124 H= 281:00 +CPU= 20.867
  05:07:40 STEP 1125 H= 281:15 +CPU= 20.386
  05:08:00 STEP 1126 H= 281:30 +CPU= 20.279
  05:08:20 STEP 1127 H= 281:45 +CPU= 20.355
  05:08:46 STEP 1128 H= 282:00 +CPU= 25.293
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001128
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001128
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001128
  05:09:06 STEP 1129 H= 282:15 +CPU= 20.388
  05:09:27 STEP 1130 H= 282:30 +CPU= 20.340
  05:09:47 STEP 1131 H= 282:45 +CPU= 20.324
  05:10:08 STEP 1132 H= 283:00 +CPU= 20.857
  05:10:29 STEP 1133 H= 283:15 +CPU= 20.369
  05:10:49 STEP 1134 H= 283:30 +CPU= 20.404
  05:11:10 STEP 1135 H= 283:45 +CPU= 20.335
  05:11:31 STEP 1136 H= 284:00 +CPU= 20.916
  05:11:52 STEP 1137 H= 284:15 +CPU= 20.467
  05:12:12 STEP 1138 H= 284:30 +CPU= 20.378
  05:12:33 STEP 1139 H= 284:45 +CPU= 20.396
  05:12:58 STEP 1140 H= 285:00 +CPU= 25.297
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001140
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001140
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001140
  05:13:19 STEP 1141 H= 285:15 +CPU= 20.337
  05:13:39 STEP 1142 H= 285:30 +CPU= 20.364
  05:13:59 STEP 1143 H= 285:45 +CPU= 20.319
  05:14:20 STEP 1144 H= 286:00 +CPU= 20.802
  05:14:41 STEP 1145 H= 286:15 +CPU= 20.375
  05:15:01 STEP 1146 H= 286:30 +CPU= 20.242
  05:15:22 STEP 1147 H= 286:45 +CPU= 20.337
  05:15:43 STEP 1148 H= 287:00 +CPU= 20.879
  05:16:03 STEP 1149 H= 287:15 +CPU= 20.184
  05:16:24 STEP 1150 H= 287:30 +CPU= 20.371
  05:16:44 STEP 1151 H= 287:45 +CPU= 20.414
  05:17:12 STEP 1152 H= 288:00 +CPU= 27.969
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001152
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001152
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001140
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001140
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001140
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_11.zip
Uploading the intermediate file: upload_file_11.zip
  05:17:33 STEP 1153 H= 288:15 +CPU= 20.956
  05:17:54 STEP 1154 H= 288:30 +CPU= 20.540
  05:18:15 STEP 1155 H= 288:45 +CPU= 20.414
  05:18:36 STEP 1156 H= 289:00 +CPU= 20.820
  05:18:56 STEP 1157 H= 289:15 +CPU= 20.409
  05:19:17 STEP 1158 H= 289:30 +CPU= 20.480
  05:19:37 STEP 1159 H= 289:45 +CPU= 20.420
  05:19:59 STEP 1160 H= 290:00 +CPU= 20.960
  05:20:19 STEP 1161 H= 290:15 +CPU= 20.495
  05:20:40 STEP 1162 H= 290:30 +CPU= 20.487
  05:21:01 STEP 1163 H= 290:45 +CPU= 20.553
  05:21:26 STEP 1164 H= 291:00 +CPU= 25.417
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001164
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001164
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001164
  05:21:47 STEP 1165 H= 291:15 +CPU= 20.429
  05:22:07 STEP 1166 H= 291:30 +CPU= 20.473
  05:22:28 STEP 1167 H= 291:45 +CPU= 20.389
  05:22:49 STEP 1168 H= 292:00 +CPU= 21.003
  05:23:10 STEP 1169 H= 292:15 +CPU= 20.521
  05:23:30 STEP 1170 H= 292:30 +CPU= 20.528
  05:23:51 STEP 1171 H= 292:45 +CPU= 20.457
  05:24:12 STEP 1172 H= 293:00 +CPU= 20.888
  05:24:33 STEP 1173 H= 293:15 +CPU= 20.366
  05:24:53 STEP 1174 H= 293:30 +CPU= 20.408
  05:25:14 STEP 1175 H= 293:45 +CPU= 20.430
  05:25:39 STEP 1176 H= 294:00 +CPU= 25.455
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001176
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001176
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001176
  05:26:00 STEP 1177 H= 294:15 +CPU= 20.391
  05:26:21 STEP 1178 H= 294:30 +CPU= 20.596
  05:26:41 STEP 1179 H= 294:45 +CPU= 20.491
  05:27:02 STEP 1180 H= 295:00 +CPU= 21.046
  05:27:23 STEP 1181 H= 295:15 +CPU= 20.415
  05:27:44 STEP 1182 H= 295:30 +CPU= 20.458
  05:28:04 STEP 1183 H= 295:45 +CPU= 20.498
  05:28:25 STEP 1184 H= 296:00 +CPU= 20.943
  05:28:46 STEP 1185 H= 296:15 +CPU= 20.522
  05:29:07 STEP 1186 H= 296:30 +CPU= 20.492
  05:29:27 STEP 1187 H= 296:45 +CPU= 20.405
  05:29:53 STEP 1188 H= 297:00 +CPU= 25.449
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001188
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001188
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001188
  05:30:13 STEP 1189 H= 297:15 +CPU= 20.180
  05:30:34 STEP 1190 H= 297:30 +CPU= 20.382
  05:30:54 STEP 1191 H= 297:45 +CPU= 20.484
  05:31:16 STEP 1192 H= 298:00 +CPU= 20.977
  05:31:36 STEP 1193 H= 298:15 +CPU= 20.314
  05:31:57 STEP 1194 H= 298:30 +CPU= 20.426
  05:32:17 STEP 1195 H= 298:45 +CPU= 20.349
  05:32:38 STEP 1196 H= 299:00 +CPU= 20.841
  05:32:59 STEP 1197 H= 299:15 +CPU= 20.318
  05:33:19 STEP 1198 H= 299:30 +CPU= 20.302
  05:33:40 STEP 1199 H= 299:45 +CPU= 20.401
  05:34:08 STEP 1200 H= 300:00 +CPU= 28.107
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001200
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001200
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001200
  05:34:28 STEP 1201 H= 300:15 +CPU= 20.378
  05:34:49 STEP 1202 H= 300:30 +CPU= 20.362
  05:35:09 STEP 1203 H= 300:45 +CPU= 20.454
  05:35:30 STEP 1204 H= 301:00 +CPU= 20.888
  05:35:51 STEP 1205 H= 301:15 +CPU= 20.431
  05:36:12 STEP 1206 H= 301:30 +CPU= 20.345
  05:36:32 STEP 1207 H= 301:45 +CPU= 20.359
  05:36:53 STEP 1208 H= 302:00 +CPU= 20.868
  05:37:14 STEP 1209 H= 302:15 +CPU= 20.307
  05:37:34 STEP 1210 H= 302:30 +CPU= 20.380
  05:37:55 STEP 1211 H= 302:45 +CPU= 20.426
  05:38:20 STEP 1212 H= 303:00 +CPU= 25.376
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001212
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001212
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001212
  05:38:41 STEP 1213 H= 303:15 +CPU= 20.368
  05:39:01 STEP 1214 H= 303:30 +CPU= 20.374
  05:39:22 STEP 1215 H= 303:45 +CPU= 20.331
  05:39:43 STEP 1216 H= 304:00 +CPU= 20.821
  05:40:03 STEP 1217 H= 304:15 +CPU= 20.124
  05:40:23 STEP 1218 H= 304:30 +CPU= 20.108
  05:40:44 STEP 1219 H= 304:45 +CPU= 20.225
  05:41:04 STEP 1220 H= 305:00 +CPU= 20.794
  05:41:25 STEP 1221 H= 305:15 +CPU= 20.336
  05:41:46 STEP 1222 H= 305:30 +CPU= 20.462
  05:42:06 STEP 1223 H= 305:45 +CPU= 20.367
  05:42:32 STEP 1224 H= 306:00 +CPU= 25.316
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001224
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001224
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001224
  05:42:52 STEP 1225 H= 306:15 +CPU= 20.414
  05:43:13 STEP 1226 H= 306:30 +CPU= 20.370
  05:43:33 STEP 1227 H= 306:45 +CPU= 20.330
  05:43:54 STEP 1228 H= 307:00 +CPU= 20.811
  05:44:15 STEP 1229 H= 307:15 +CPU= 20.365
  05:44:35 STEP 1230 H= 307:30 +CPU= 20.289
  05:44:55 STEP 1231 H= 307:45 +CPU= 20.363
  05:45:17 STEP 1232 H= 308:00 +CPU= 20.930
  05:45:37 STEP 1233 H= 308:15 +CPU= 20.306
  05:45:58 STEP 1234 H= 308:30 +CPU= 20.420
  05:46:18 STEP 1235 H= 308:45 +CPU= 20.317
  05:46:43 STEP 1236 H= 309:00 +CPU= 25.263
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001236
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001236
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001236
  05:47:04 STEP 1237 H= 309:15 +CPU= 20.389
  05:47:24 STEP 1238 H= 309:30 +CPU= 20.358
  05:47:45 STEP 1239 H= 309:45 +CPU= 20.475
  05:48:06 STEP 1240 H= 310:00 +CPU= 20.967
  05:48:27 STEP 1241 H= 310:15 +CPU= 20.424
  05:48:47 STEP 1242 H= 310:30 +CPU= 20.495
  05:49:08 STEP 1243 H= 310:45 +CPU= 20.486
  05:49:29 STEP 1244 H= 311:00 +CPU= 20.949
  05:49:50 STEP 1245 H= 311:15 +CPU= 20.378
  05:50:10 STEP 1246 H= 311:30 +CPU= 20.400
  05:50:30 STEP 1247 H= 311:45 +CPU= 20.157
  05:50:59 STEP 1248 H= 312:00 +CPU= 28.157
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001248
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001248
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001236
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001236
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001236
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:51:20 STEP 1249 H= 312:15 +CPU= 20.983
  05:51:41 STEP 1250 H= 312:30 +CPU= 20.488
  05:52:01 STEP 1251 H= 312:45 +CPU= 20.437
  05:52:22 STEP 1252 H= 313:00 +CPU= 20.944
  05:52:43 STEP 1253 H= 313:15 +CPU= 20.448
  05:53:03 STEP 1254 H= 313:30 +CPU= 20.482
  05:53:24 STEP 1255 H= 313:45 +CPU= 20.439
  05:53:45 STEP 1256 H= 314:00 +CPU= 20.898
  05:54:06 STEP 1257 H= 314:15 +CPU= 20.511
  05:54:26 STEP 1258 H= 314:30 +CPU= 20.528
  05:54:47 STEP 1259 H= 314:45 +CPU= 20.526
  05:55:13 STEP 1260 H= 315:00 +CPU= 25.471
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001260
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001260
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001260
  05:55:33 STEP 1261 H= 315:15 +CPU= 20.464
  05:55:54 STEP 1262 H= 315:30 +CPU= 20.452
  05:56:15 STEP 1263 H= 315:45 +CPU= 20.526
  05:56:36 STEP 1264 H= 316:00 +CPU= 21.080
  05:56:57 STEP 1265 H= 316:15 +CPU= 20.537
  05:57:17 STEP 1266 H= 316:30 +CPU= 20.527
  05:57:38 STEP 1267 H= 316:45 +CPU= 20.553
  05:57:59 STEP 1268 H= 317:00 +CPU= 21.041
  05:58:20 STEP 1269 H= 317:15 +CPU= 20.531
  05:58:40 STEP 1270 H= 317:30 +CPU= 20.232
  05:59:01 STEP 1271 H= 317:45 +CPU= 20.374
  05:59:26 STEP 1272 H= 318:00 +CPU= 25.399
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001272
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001272
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001272
  05:59:47 STEP 1273 H= 318:15 +CPU= 20.447
  06:00:08 STEP 1274 H= 318:30 +CPU= 20.476
  06:00:28 STEP 1275 H= 318:45 +CPU= 20.453
  06:00:49 STEP 1276 H= 319:00 +CPU= 20.971
  06:01:10 STEP 1277 H= 319:15 +CPU= 20.460
  06:01:31 STEP 1278 H= 319:30 +CPU= 20.515
  06:01:51 STEP 1279 H= 319:45 +CPU= 20.418
  06:02:12 STEP 1280 H= 320:00 +CPU= 20.773
  06:02:32 STEP 1281 H= 320:15 +CPU= 20.251
  06:02:53 STEP 1282 H= 320:30 +CPU= 20.436
  06:03:14 STEP 1283 H= 320:45 +CPU= 20.431
  06:03:39 STEP 1284 H= 321:00 +CPU= 25.436
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001284
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001284
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001284
  06:04:00 STEP 1285 H= 321:15 +CPU= 20.452
  06:04:21 STEP 1286 H= 321:30 +CPU= 20.465
  06:04:41 STEP 1287 H= 321:45 +CPU= 20.394
  06:05:02 STEP 1288 H= 322:00 +CPU= 20.880
  06:05:23 STEP 1289 H= 322:15 +CPU= 20.549
  06:05:43 STEP 1290 H= 322:30 +CPU= 20.399
  06:06:04 STEP 1291 H= 322:45 +CPU= 20.379
  06:06:25 STEP 1292 H= 323:00 +CPU= 20.814
  06:06:45 STEP 1293 H= 323:15 +CPU= 20.368
  06:07:06 STEP 1294 H= 323:30 +CPU= 20.328
  06:07:26 STEP 1295 H= 323:45 +CPU= 20.325
  06:07:55 STEP 1296 H= 324:00 +CPU= 28.027
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001296
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001296
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001296
  06:08:15 STEP 1297 H= 324:15 +CPU= 20.348
  06:08:36 STEP 1298 H= 324:30 +CPU= 20.336
  06:08:56 STEP 1299 H= 324:45 +CPU= 20.281
  06:09:17 STEP 1300 H= 325:00 +CPU= 20.792
  06:09:37 STEP 1301 H= 325:15 +CPU= 20.311
  06:09:58 STEP 1302 H= 325:30 +CPU= 20.224
  06:10:18 STEP 1303 H= 325:45 +CPU= 20.252
  06:10:39 STEP 1304 H= 326:00 +CPU= 20.755
  06:11:00 STEP 1305 H= 326:15 +CPU= 20.582
  06:11:20 STEP 1306 H= 326:30 +CPU= 20.470
  06:11:41 STEP 1307 H= 326:45 +CPU= 20.409
  06:12:06 STEP 1308 H= 327:00 +CPU= 25.364
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001308
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001308
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001308
  06:12:27 STEP 1309 H= 327:15 +CPU= 20.255
  06:12:47 STEP 1310 H= 327:30 +CPU= 20.461
  06:13:08 STEP 1311 H= 327:45 +CPU= 20.450
  06:13:29 STEP 1312 H= 328:00 +CPU= 20.890
  06:13:50 STEP 1313 H= 328:15 +CPU= 20.395
  06:14:10 STEP 1314 H= 328:30 +CPU= 20.466
  06:14:31 STEP 1315 H= 328:45 +CPU= 20.395
  06:14:52 STEP 1316 H= 329:00 +CPU= 20.928
  06:15:12 STEP 1317 H= 329:15 +CPU= 20.448
  06:15:33 STEP 1318 H= 329:30 +CPU= 20.484
  06:15:54 STEP 1319 H= 329:45 +CPU= 20.414
  06:16:19 STEP 1320 H= 330:00 +CPU= 25.376
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001320
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001320
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001320
  06:16:40 STEP 1321 H= 330:15 +CPU= 20.368
  06:17:00 STEP 1322 H= 330:30 +CPU= 20.461
  06:17:21 STEP 1323 H= 330:45 +CPU= 20.437
  06:17:42 STEP 1324 H= 331:00 +CPU= 20.902
  06:18:02 STEP 1325 H= 331:15 +CPU= 20.445
  06:18:23 STEP 1326 H= 331:30 +CPU= 20.334
  06:18:43 STEP 1327 H= 331:45 +CPU= 20.353
  06:19:04 STEP 1328 H= 332:00 +CPU= 20.928
  06:19:25 STEP 1329 H= 332:15 +CPU= 20.310
  06:19:45 STEP 1330 H= 332:30 +CPU= 20.281
  06:20:06 STEP 1331 H= 332:45 +CPU= 20.398
  06:20:31 STEP 1332 H= 333:00 +CPU= 25.246
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001332
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001332
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001332
  06:20:52 STEP 1333 H= 333:15 +CPU= 20.282
  06:21:12 STEP 1334 H= 333:30 +CPU= 20.264
  06:21:33 STEP 1335 H= 333:45 +CPU= 20.397
  06:21:54 STEP 1336 H= 334:00 +CPU= 20.957
  06:22:14 STEP 1337 H= 334:15 +CPU= 20.367
  06:22:35 STEP 1338 H= 334:30 +CPU= 20.365
  06:22:55 STEP 1339 H= 334:45 +CPU= 20.361
  06:23:16 STEP 1340 H= 335:00 +CPU= 20.881
  06:23:37 STEP 1341 H= 335:15 +CPU= 20.373
  06:23:57 STEP 1342 H= 335:30 +CPU= 20.408
  06:24:18 STEP 1343 H= 335:45 +CPU= 20.341
  06:24:46 STEP 1344 H= 336:00 +CPU= 27.861
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001344
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001344
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001332
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001332
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001332
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:25:07 STEP 1345 H= 336:15 +CPU= 21.024
  06:25:28 STEP 1346 H= 336:30 +CPU= 20.500
  06:25:48 STEP 1347 H= 336:45 +CPU= 20.468
  06:26:10 STEP 1348 H= 337:00 +CPU= 21.041
  06:26:30 STEP 1349 H= 337:15 +CPU= 20.359
  06:26:51 STEP 1350 H= 337:30 +CPU= 20.366
  06:27:11 STEP 1351 H= 337:45 +CPU= 20.468
  06:27:32 STEP 1352 H= 338:00 +CPU= 20.919
  06:27:53 STEP 1353 H= 338:15 +CPU= 20.455
  06:28:14 STEP 1354 H= 338:30 +CPU= 20.448
  06:28:34 STEP 1355 H= 338:45 +CPU= 20.343
  06:29:00 STEP 1356 H= 339:00 +CPU= 25.424
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001356
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001356
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001356
  06:29:20 STEP 1357 H= 339:15 +CPU= 20.467
  06:29:41 STEP 1358 H= 339:30 +CPU= 20.526
  06:30:02 STEP 1359 H= 339:45 +CPU= 20.498
  06:30:23 STEP 1360 H= 340:00 +CPU= 20.966
  06:30:43 STEP 1361 H= 340:15 +CPU= 20.469
  06:31:04 STEP 1362 H= 340:30 +CPU= 20.523
  06:31:25 STEP 1363 H= 340:45 +CPU= 20.449
  06:31:46 STEP 1364 H= 341:00 +CPU= 20.964
  06:32:06 STEP 1365 H= 341:15 +CPU= 20.472
  06:32:27 STEP 1366 H= 341:30 +CPU= 20.450
  06:32:47 STEP 1367 H= 341:45 +CPU= 20.496
  06:33:13 STEP 1368 H= 342:00 +CPU= 25.469
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001368
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001368
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001368
  06:33:34 STEP 1369 H= 342:15 +CPU= 20.422
  06:33:54 STEP 1370 H= 342:30 +CPU= 20.427
  06:34:15 STEP 1371 H= 342:45 +CPU= 20.513
  06:34:36 STEP 1372 H= 343:00 +CPU= 21.051
  06:34:57 STEP 1373 H= 343:15 +CPU= 20.556
  06:35:18 STEP 1374 H= 343:30 +CPU= 20.516
  06:35:38 STEP 1375 H= 343:45 +CPU= 20.448
  06:35:59 STEP 1376 H= 344:00 +CPU= 20.932
  06:36:20 STEP 1377 H= 344:15 +CPU= 20.536
  06:36:41 STEP 1378 H= 344:30 +CPU= 20.455
  06:37:01 STEP 1379 H= 344:45 +CPU= 20.594
  06:37:27 STEP 1380 H= 345:00 +CPU= 25.495
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001380
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001380
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001380
  06:37:48 STEP 1381 H= 345:15 +CPU= 20.557
  06:38:08 STEP 1382 H= 345:30 +CPU= 20.567
  06:38:29 STEP 1383 H= 345:45 +CPU= 20.530
  06:38:50 STEP 1384 H= 346:00 +CPU= 20.985
  06:39:11 STEP 1385 H= 346:15 +CPU= 20.459
  06:39:31 STEP 1386 H= 346:30 +CPU= 20.440
  06:39:52 STEP 1387 H= 346:45 +CPU= 20.516
  06:40:13 STEP 1388 H= 347:00 +CPU= 20.993
  06:40:34 STEP 1389 H= 347:15 +CPU= 20.400
  06:40:54 STEP 1390 H= 347:30 +CPU= 20.411
  06:41:15 STEP 1391 H= 347:45 +CPU= 20.459
  06:41:43 STEP 1392 H= 348:00 +CPU= 28.153
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001392
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001392
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001392
  06:42:04 STEP 1393 H= 348:15 +CPU= 20.434
  06:42:24 STEP 1394 H= 348:30 +CPU= 20.317
  06:42:45 STEP 1395 H= 348:45 +CPU= 20.411
  06:43:06 STEP 1396 H= 349:00 +CPU= 20.989
  06:43:27 STEP 1397 H= 349:15 +CPU= 20.392
  06:43:47 STEP 1398 H= 349:30 +CPU= 20.498
  06:44:08 STEP 1399 H= 349:45 +CPU= 20.496
  06:44:29 STEP 1400 H= 350:00 +CPU= 20.890
  06:44:49 STEP 1401 H= 350:15 +CPU= 20.437
  06:45:10 STEP 1402 H= 350:30 +CPU= 20.515
  06:45:31 STEP 1403 H= 350:45 +CPU= 20.425
  06:45:56 STEP 1404 H= 351:00 +CPU= 25.274
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001404
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001404
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001404
  06:46:17 STEP 1405 H= 351:15 +CPU= 20.381
  06:46:37 STEP 1406 H= 351:30 +CPU= 20.227
  06:46:57 STEP 1407 H= 351:45 +CPU= 20.073
  06:47:17 STEP 1408 H= 352:00 +CPU= 20.049
  06:47:37 STEP 1409 H= 352:15 +CPU= 19.561
  06:47:57 STEP 1410 H= 352:30 +CPU= 19.583
  06:48:16 STEP 1411 H= 352:45 +CPU= 19.564
  06:48:37 STEP 1412 H= 353:00 +CPU= 20.026
  06:48:56 STEP 1413 H= 353:15 +CPU= 19.583
  06:49:16 STEP 1414 H= 353:30 +CPU= 19.577
  06:49:36 STEP 1415 H= 353:45 +CPU= 19.527
  06:50:00 STEP 1416 H= 354:00 +CPU= 24.411
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001416
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001416
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001416
  06:50:20 STEP 1417 H= 354:15 +CPU= 19.619
  06:50:40 STEP 1418 H= 354:30 +CPU= 19.570
  06:50:59 STEP 1419 H= 354:45 +CPU= 19.610
  06:51:20 STEP 1420 H= 355:00 +CPU= 20.076
  06:51:39 STEP 1421 H= 355:15 +CPU= 19.594
  06:51:59 STEP 1422 H= 355:30 +CPU= 19.628
  06:52:19 STEP 1423 H= 355:45 +CPU= 19.586
  06:52:39 STEP 1424 H= 356:00 +CPU= 20.073
  06:52:59 STEP 1425 H= 356:15 +CPU= 19.613
  06:53:18 STEP 1426 H= 356:30 +CPU= 19.641
  06:53:38 STEP 1427 H= 356:45 +CPU= 19.596
  06:54:03 STEP 1428 H= 357:00 +CPU= 24.427
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001428
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001428
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001428
  06:54:22 STEP 1429 H= 357:15 +CPU= 19.569
  06:54:42 STEP 1430 H= 357:30 +CPU= 19.532
  06:55:02 STEP 1431 H= 357:45 +CPU= 19.635
  06:55:22 STEP 1432 H= 358:00 +CPU= 20.039
  06:55:42 STEP 1433 H= 358:15 +CPU= 19.553
  06:56:01 STEP 1434 H= 358:30 +CPU= 19.621
  06:56:21 STEP 1435 H= 358:45 +CPU= 19.536
  06:56:41 STEP 1436 H= 359:00 +CPU= 20.018
  06:57:01 STEP 1437 H= 359:15 +CPU= 19.577
  06:57:21 STEP 1438 H= 359:30 +CPU= 19.582
  06:57:40 STEP 1439 H= 359:45 +CPU= 19.527
  06:58:06 STEP 1440 H= 360:00 +CPU= 25.517
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7661236063E-21      I       0.2582826996E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3350620998E-02      I
I  Relat. Hum. I      0.1928080786E+00      I       0.2309175560E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.6522177093E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    318537329 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0072( 4.2%)
 06:58:06 STEP 1440 H= 360:00 +CPU= 25.517
 END CNT3
 NSTEP =  1440 CNT0   000000000  18.844  18.844  18.982   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    64.1     0.0    64.0     0.0   127.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    3651.7    3651.7     15.24      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     741.6     741.6      2.85      0.00
  10 SCAN2M - PHYSICS                             1441   13541.0   13541.0     52.13      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     737.8     737.8      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      33.9      33.9      0.01      0.00
  14 SUINIF                                          1    4401.5    4401.5      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      25.2      25.2      0.01      0.00
  18 SUSPECG                                         1    2507.5    2507.5      0.01      0.00
  19 SUSPEC                                          1    2516.3    2516.3      0.01      0.00
  24 SUGRIDU                                         1    1382.3    1382.3      0.00      0.00
  25 SPECRT                                          1     346.4     346.4      0.00      0.00
  26 SUGRIDF                                         1     156.4     156.4      0.00      0.00
  27 RESTART FILES - WRITING                        30    2975.8    2975.8      0.24      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5315.3    5315.3      1.72      0.00
  31 POSDDH IN STEPO                                 7       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    4860.0    4860.0     18.71      0.00
  39 SU0YOMB                                         1     482.8     482.8      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      26.7      26.7      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     322.6     322.6      1.24      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      43.1      43.1      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     359.1     359.1      3.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     210.8     210.8      1.69      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      86.8      86.8      0.70      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     126.0     126.0      1.05      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      58.0      58.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      40.2      40.2      0.34      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      21.9      21.9      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      76.5      76.5      0.64      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      20.1      20.1      0.16      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    37431.4 CPU TIME   36899.9 VECTOR TIME    36899.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       34.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/nairb/slots/2/ICMGGh7zg+001440
Moving to projects directory: /home/nairb/slots/2/ICMSHh7zg+001440
Moving to projects directory: /home/nairb/slots/2/ICMUAh7zg+001440
Adding to the zip: /home/nairb/slots/2/NODE.001_01
Adding to the zip: /home/nairb/slots/2/ifs.stat
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001416
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001416
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMSHh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMUAh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211256/ICMGGh7zg+001416
Zipping up the final file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0_r895689108_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
07:01:33 (108644): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:34 1532429 22311493 oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0 1,295,100 36,900 0.0285
09 May 2023 16:51:32 1532429 22311493 oifs_43r3_bl_a3g5_2016092300_15_991_12211256_0 864,000 26,949 0.0312


©2024 cpdn.org