climateprediction.net home page
Task 22311866

Task 22311866

Name oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0
Workunit 12211620
Created 13 Feb 2023, 20:54:21 UTC
Sent 13 Feb 2023, 22:22:02 UTC
Report deadline 14 Apr 2023, 22:22:02 UTC
Received 15 Feb 2023, 20:18:52 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532429
Run time 11 hours 12 min 14 sec
CPU time 10 hours 58 min 51 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 3.27 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,076.45 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,582.65 MB
Stderr
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
cts directory: /home/nairb/slots/0/ICMGGh7zg+000780
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000780
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000780
  14:40:19 STEP  781 H= 195:15 +CPU= 25.789
  14:40:46 STEP  782 H= 195:30 +CPU= 26.192
  14:41:14 STEP  783 H= 195:45 +CPU= 28.199
  14:41:47 STEP  784 H= 196:00 +CPU= 31.568
  14:42:21 STEP  785 H= 196:15 +CPU= 33.794
  14:42:54 STEP  786 H= 196:30 +CPU= 32.061
  14:43:20 STEP  787 H= 196:45 +CPU= 25.856
  14:43:47 STEP  788 H= 197:00 +CPU= 26.516
  14:44:13 STEP  789 H= 197:15 +CPU= 25.883
  14:44:39 STEP  790 H= 197:30 +CPU= 25.871
  14:45:06 STEP  791 H= 197:45 +CPU= 25.864
  14:45:44 STEP  792 H= 198:00 +CPU= 37.423
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000792
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000792
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000792
  14:46:10 STEP  793 H= 198:15 +CPU= 25.917
  14:46:37 STEP  794 H= 198:30 +CPU= 26.273
  14:47:04 STEP  795 H= 198:45 +CPU= 26.237
  14:47:32 STEP  796 H= 199:00 +CPU= 27.627
  14:48:06 STEP  797 H= 199:15 +CPU= 33.559
  14:48:37 STEP  798 H= 199:30 +CPU= 31.035
  14:49:04 STEP  799 H= 199:45 +CPU= 25.755
  14:49:30 STEP  800 H= 200:00 +CPU= 26.344
  14:49:59 STEP  801 H= 200:15 +CPU= 27.963
  14:50:26 STEP  802 H= 200:30 +CPU= 27.034
  14:51:00 STEP  803 H= 200:45 +CPU= 33.679
  14:51:43 STEP  804 H= 201:00 +CPU= 42.318
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000804
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000804
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000804
  14:52:09 STEP  805 H= 201:15 +CPU= 25.857
  14:52:36 STEP  806 H= 201:30 +CPU= 25.763
  14:53:02 STEP  807 H= 201:45 +CPU= 25.804
  14:53:31 STEP  808 H= 202:00 +CPU= 28.560
  14:53:57 STEP  809 H= 202:15 +CPU= 25.783
  14:54:23 STEP  810 H= 202:30 +CPU= 25.771
  14:54:49 STEP  811 H= 202:45 +CPU= 25.831
  14:55:18 STEP  812 H= 203:00 +CPU= 28.878
  14:55:45 STEP  813 H= 203:15 +CPU= 25.759
  14:56:12 STEP  814 H= 203:30 +CPU= 26.738
  14:56:45 STEP  815 H= 203:45 +CPU= 32.668
  14:57:24 STEP  816 H= 204:00 +CPU= 38.851
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000816
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000816
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000816
  14:57:57 STEP  817 H= 204:15 +CPU= 32.251
  14:58:23 STEP  818 H= 204:30 +CPU= 25.655
  14:58:50 STEP  819 H= 204:45 +CPU= 26.700
  14:59:23 STEP  820 H= 205:00 +CPU= 32.069
  14:59:50 STEP  821 H= 205:15 +CPU= 27.265
  15:00:17 STEP  822 H= 205:30 +CPU= 25.758
  15:00:43 STEP  823 H= 205:45 +CPU= 25.737
  15:01:09 STEP  824 H= 206:00 +CPU= 26.334
  15:01:36 STEP  825 H= 206:15 +CPU= 26.103
  15:02:02 STEP  826 H= 206:30 +CPU= 25.713
  15:02:28 STEP  827 H= 206:45 +CPU= 25.710
  15:03:03 STEP  828 H= 207:00 +CPU= 34.871
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000828
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000828
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000828
  15:03:31 STEP  829 H= 207:15 +CPU= 27.855
  15:03:58 STEP  830 H= 207:30 +CPU= 25.801
  15:04:24 STEP  831 H= 207:45 +CPU= 25.819
  15:04:53 STEP  832 H= 208:00 +CPU= 28.418
  15:05:21 STEP  833 H= 208:15 +CPU= 27.741
  15:05:47 STEP  834 H= 208:30 +CPU= 25.747
  15:06:15 STEP  835 H= 208:45 +CPU= 27.612
  15:06:44 STEP  836 H= 209:00 +CPU= 29.165
  15:07:11 STEP  837 H= 209:15 +CPU= 25.814
  15:07:37 STEP  838 H= 209:30 +CPU= 25.728
  15:08:03 STEP  839 H= 209:45 +CPU= 25.724
  15:08:36 STEP  840 H= 210:00 +CPU= 32.312
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000840
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000840
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000840
  15:09:02 STEP  841 H= 210:15 +CPU= 25.808
  15:09:28 STEP  842 H= 210:30 +CPU= 25.725
  15:09:54 STEP  843 H= 210:45 +CPU= 25.785
  15:10:21 STEP  844 H= 211:00 +CPU= 26.417
  15:10:47 STEP  845 H= 211:15 +CPU= 25.786
  15:11:15 STEP  846 H= 211:30 +CPU= 27.883
  15:11:41 STEP  847 H= 211:45 +CPU= 25.744
  15:12:08 STEP  848 H= 212:00 +CPU= 26.383
  15:12:39 STEP  849 H= 212:15 +CPU= 30.930
  15:13:09 STEP  850 H= 212:30 +CPU= 29.704
  15:13:38 STEP  851 H= 212:45 +CPU= 28.551
  15:14:19 STEP  852 H= 213:00 +CPU= 39.938
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000852
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000852
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000852
  15:14:51 STEP  853 H= 213:15 +CPU= 31.494
  15:15:22 STEP  854 H= 213:30 +CPU= 31.047
  15:15:49 STEP  855 H= 213:45 +CPU= 25.784
  15:16:20 STEP  856 H= 214:00 +CPU= 30.738
  15:16:49 STEP  857 H= 214:15 +CPU= 28.435
  15:17:20 STEP  858 H= 214:30 +CPU= 30.835
  15:17:53 STEP  859 H= 214:45 +CPU= 32.793
  15:18:25 STEP  860 H= 215:00 +CPU= 31.220
  15:18:51 STEP  861 H= 215:15 +CPU= 25.751
  15:19:17 STEP  862 H= 215:30 +CPU= 25.949
  15:19:45 STEP  863 H= 215:45 +CPU= 27.838
  15:20:27 STEP  864 H= 216:00 +CPU= 41.009
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000864
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000864
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000768
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000780
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000792
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000804
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000816
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000828
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000840
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000852
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000852
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000852
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_8.zip
Uploading the intermediate file: upload_file_8.zip
  15:21:04 STEP  865 H= 216:15 +CPU= 36.484
  15:21:32 STEP  866 H= 216:30 +CPU= 27.069
  15:22:04 STEP  867 H= 216:45 +CPU= 31.196
  15:22:34 STEP  868 H= 217:00 +CPU= 29.909
  15:23:04 STEP  869 H= 217:15 +CPU= 28.786
  15:23:41 STEP  870 H= 217:30 +CPU= 36.444
  15:24:15 STEP  871 H= 217:45 +CPU= 33.728
  15:24:42 STEP  872 H= 218:00 +CPU= 26.684
  15:25:09 STEP  873 H= 218:15 +CPU= 26.076
  15:25:35 STEP  874 H= 218:30 +CPU= 25.890
  15:26:05 STEP  875 H= 218:45 +CPU= 29.116
  15:26:38 STEP  876 H= 219:00 +CPU= 32.679
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000876
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000876
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000876
  15:27:05 STEP  877 H= 219:15 +CPU= 27.144
  15:27:32 STEP  878 H= 219:30 +CPU= 25.931
  15:27:58 STEP  879 H= 219:45 +CPU= 25.910
  15:28:25 STEP  880 H= 220:00 +CPU= 26.523
  15:28:52 STEP  881 H= 220:15 +CPU= 25.893
  15:29:19 STEP  882 H= 220:30 +CPU= 27.214
  15:29:50 STEP  883 H= 220:45 +CPU= 30.228
  15:30:17 STEP  884 H= 221:00 +CPU= 26.792
  15:30:44 STEP  885 H= 221:15 +CPU= 25.878
  15:31:11 STEP  886 H= 221:30 +CPU= 26.690
  15:31:37 STEP  887 H= 221:45 +CPU= 25.845
  15:32:10 STEP  888 H= 222:00 +CPU= 32.404
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000888
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000888
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000888
  15:32:36 STEP  889 H= 222:15 +CPU= 25.871
  15:33:03 STEP  890 H= 222:30 +CPU= 26.582
  15:33:30 STEP  891 H= 222:45 +CPU= 25.880
  15:33:57 STEP  892 H= 223:00 +CPU= 26.525
  15:34:23 STEP  893 H= 223:15 +CPU= 25.917
  15:34:51 STEP  894 H= 223:30 +CPU= 27.058
  15:35:17 STEP  895 H= 223:45 +CPU= 25.940
  15:35:44 STEP  896 H= 224:00 +CPU= 27.194
  15:36:11 STEP  897 H= 224:15 +CPU= 25.854
  15:36:37 STEP  898 H= 224:30 +CPU= 25.835
  15:37:03 STEP  899 H= 224:45 +CPU= 25.861
  15:37:38 STEP  900 H= 225:00 +CPU= 34.261
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000900
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000900
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000900
  15:38:04 STEP  901 H= 225:15 +CPU= 25.931
  15:38:30 STEP  902 H= 225:30 +CPU= 25.789
  15:39:01 STEP  903 H= 225:45 +CPU= 30.597
  15:39:28 STEP  904 H= 226:00 +CPU= 26.465
  15:39:55 STEP  905 H= 226:15 +CPU= 26.347
  15:40:21 STEP  906 H= 226:30 +CPU= 25.835
  15:40:47 STEP  907 H= 226:45 +CPU= 25.835
  15:41:15 STEP  908 H= 227:00 +CPU= 27.555
  15:41:41 STEP  909 H= 227:15 +CPU= 25.827
  15:42:08 STEP  910 H= 227:30 +CPU= 25.888
  15:42:34 STEP  911 H= 227:45 +CPU= 25.816
  15:43:21 STEP  912 H= 228:00 +CPU= 46.079
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000912
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000912
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000912
  15:43:48 STEP  913 H= 228:15 +CPU= 26.318
  15:44:14 STEP  914 H= 228:30 +CPU= 25.845
  15:44:40 STEP  915 H= 228:45 +CPU= 25.845
  15:45:07 STEP  916 H= 229:00 +CPU= 26.714
  15:45:37 STEP  917 H= 229:15 +CPU= 29.431
  15:46:03 STEP  918 H= 229:30 +CPU= 25.949
  15:46:30 STEP  919 H= 229:45 +CPU= 25.860
  15:46:56 STEP  920 H= 230:00 +CPU= 26.454
  15:47:23 STEP  921 H= 230:15 +CPU= 25.864
  15:47:49 STEP  922 H= 230:30 +CPU= 25.889
  15:48:15 STEP  923 H= 230:45 +CPU= 25.901
  15:48:48 STEP  924 H= 231:00 +CPU= 32.049
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000924
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000924
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000924
  15:49:14 STEP  925 H= 231:15 +CPU= 25.876
  15:49:40 STEP  926 H= 231:30 +CPU= 25.832
  15:50:07 STEP  927 H= 231:45 +CPU= 26.861
  15:50:35 STEP  928 H= 232:00 +CPU= 27.571
  15:51:02 STEP  929 H= 232:15 +CPU= 26.004
  15:51:28 STEP  930 H= 232:30 +CPU= 25.942
  15:51:54 STEP  931 H= 232:45 +CPU= 25.832
  15:52:21 STEP  932 H= 233:00 +CPU= 26.461
  15:52:49 STEP  933 H= 233:15 +CPU= 27.198
  15:53:23 STEP  934 H= 233:30 +CPU= 33.520
  15:53:57 STEP  935 H= 233:45 +CPU= 34.090
  15:54:34 STEP  936 H= 234:00 +CPU= 36.201
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000936
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000936
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000936
  15:55:02 STEP  937 H= 234:15 +CPU= 27.521
  15:55:33 STEP  938 H= 234:30 +CPU= 30.732
  15:56:09 STEP  939 H= 234:45 +CPU= 35.010
  15:56:43 STEP  940 H= 235:00 +CPU= 33.945
  15:57:09 STEP  941 H= 235:15 +CPU= 25.857
  15:57:37 STEP  942 H= 235:30 +CPU= 26.965
  15:58:03 STEP  943 H= 235:45 +CPU= 25.860
  15:58:30 STEP  944 H= 236:00 +CPU= 26.489
  15:58:56 STEP  945 H= 236:15 +CPU= 25.840
  15:59:22 STEP  946 H= 236:30 +CPU= 25.872
  15:59:48 STEP  947 H= 236:45 +CPU= 25.829
  16:00:21 STEP  948 H= 237:00 +CPU= 32.171
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000948
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000948
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000948
  16:00:48 STEP  949 H= 237:15 +CPU= 26.226
  16:01:20 STEP  950 H= 237:30 +CPU= 31.654
  16:01:46 STEP  951 H= 237:45 +CPU= 25.959
  16:02:13 STEP  952 H= 238:00 +CPU= 26.522
  16:02:39 STEP  953 H= 238:15 +CPU= 26.054
  16:03:06 STEP  954 H= 238:30 +CPU= 25.951
  16:03:32 STEP  955 H= 238:45 +CPU= 25.867
  16:04:01 STEP  956 H= 239:00 +CPU= 28.918
  16:04:33 STEP  957 H= 239:15 +CPU= 30.847
  16:05:00 STEP  958 H= 239:30 +CPU= 26.608
  16:05:30 STEP  959 H= 239:45 +CPU= 30.451
  16:06:11 STEP  960 H= 240:00 +CPU= 39.653
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000960
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000960
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000864
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000876
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000888
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000900
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000912
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000924
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000936
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000948
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000948
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000948
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_9.zip
Uploading the intermediate file: upload_file_9.zip
  16:06:48 STEP  961 H= 240:15 +CPU= 36.545
Uploading trickle at timestep: 864000
  16:07:15 STEP  962 H= 240:30 +CPU= 26.901
  16:07:42 STEP  963 H= 240:45 +CPU= 25.943
  16:08:09 STEP  964 H= 241:00 +CPU= 26.605
  16:08:35 STEP  965 H= 241:15 +CPU= 25.940
  16:09:02 STEP  966 H= 241:30 +CPU= 26.013
  16:09:30 STEP  967 H= 241:45 +CPU= 27.961
  16:09:58 STEP  968 H= 242:00 +CPU= 27.533
  16:10:25 STEP  969 H= 242:15 +CPU= 26.018
  16:10:51 STEP  970 H= 242:30 +CPU= 26.254
  16:11:18 STEP  971 H= 242:45 +CPU= 26.070
  16:11:51 STEP  972 H= 243:00 +CPU= 32.272
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000972
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000972
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000972
  16:12:17 STEP  973 H= 243:15 +CPU= 26.011
  16:12:44 STEP  974 H= 243:30 +CPU= 25.984
  16:13:10 STEP  975 H= 243:45 +CPU= 26.031
  16:13:37 STEP  976 H= 244:00 +CPU= 26.586
  16:14:03 STEP  977 H= 244:15 +CPU= 25.953
  16:14:30 STEP  978 H= 244:30 +CPU= 25.952
  16:15:03 STEP  979 H= 244:45 +CPU= 32.163
  16:15:42 STEP  980 H= 245:00 +CPU= 38.422
  16:16:15 STEP  981 H= 245:15 +CPU= 32.826
  16:16:42 STEP  982 H= 245:30 +CPU= 25.957
  16:17:08 STEP  983 H= 245:45 +CPU= 26.058
  16:17:49 STEP  984 H= 246:00 +CPU= 39.951
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000984
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000984
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000984
  16:18:15 STEP  985 H= 246:15 +CPU= 25.997
  16:18:42 STEP  986 H= 246:30 +CPU= 25.955
  16:19:08 STEP  987 H= 246:45 +CPU= 26.001
  16:19:35 STEP  988 H= 247:00 +CPU= 26.563
  16:20:10 STEP  989 H= 247:15 +CPU= 34.665
  16:20:48 STEP  990 H= 247:30 +CPU= 37.296
  16:21:25 STEP  991 H= 247:45 +CPU= 36.386
  16:21:54 STEP  992 H= 248:00 +CPU= 27.889
  16:22:20 STEP  993 H= 248:15 +CPU= 26.330
  16:22:51 STEP  994 H= 248:30 +CPU= 29.975
  16:23:19 STEP  995 H= 248:45 +CPU= 27.787
  16:23:56 STEP  996 H= 249:00 +CPU= 37.091
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+000996
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+000996
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+000996
  16:24:31 STEP  997 H= 249:15 +CPU= 34.153
  16:25:08 STEP  998 H= 249:30 +CPU= 36.631
  16:25:38 STEP  999 H= 249:45 +CPU= 29.255
  16:26:15 STEP 1000 H= 250:00 +CPU= 36.733
  16:26:49 STEP 1001 H= 250:15 +CPU= 33.493
  16:27:26 STEP 1002 H= 250:30 +CPU= 36.509
  16:27:58 STEP 1003 H= 250:45 +CPU= 31.108
  16:28:25 STEP 1004 H= 251:00 +CPU= 26.565
  16:28:59 STEP 1005 H= 251:15 +CPU= 33.245
  16:29:34 STEP 1006 H= 251:30 +CPU= 35.280
  16:30:05 STEP 1007 H= 251:45 +CPU= 30.163
  16:30:48 STEP 1008 H= 252:00 +CPU= 41.889
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001008
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001008
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001008
  16:31:15 STEP 1009 H= 252:15 +CPU= 27.247
  16:31:42 STEP 1010 H= 252:30 +CPU= 25.912
  16:32:08 STEP 1011 H= 252:45 +CPU= 25.953
  16:32:35 STEP 1012 H= 253:00 +CPU= 26.610
  16:33:03 STEP 1013 H= 253:15 +CPU= 27.621
  16:33:30 STEP 1014 H= 253:30 +CPU= 27.283
  16:33:57 STEP 1015 H= 253:45 +CPU= 26.380
  16:34:24 STEP 1016 H= 254:00 +CPU= 26.588
  16:34:52 STEP 1017 H= 254:15 +CPU= 27.867
  16:35:19 STEP 1018 H= 254:30 +CPU= 25.936
  16:35:45 STEP 1019 H= 254:45 +CPU= 25.881
  16:36:20 STEP 1020 H= 255:00 +CPU= 34.364
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001020
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001020
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001020
  16:36:53 STEP 1021 H= 255:15 +CPU= 31.749
  16:37:25 STEP 1022 H= 255:30 +CPU= 32.044
  16:38:01 STEP 1023 H= 255:45 +CPU= 35.276
  16:38:38 STEP 1024 H= 256:00 +CPU= 36.130
  16:39:15 STEP 1025 H= 256:15 +CPU= 36.561
  16:39:50 STEP 1026 H= 256:30 +CPU= 34.232
  16:40:24 STEP 1027 H= 256:45 +CPU= 33.895
  16:40:51 STEP 1028 H= 257:00 +CPU= 26.546
  16:41:19 STEP 1029 H= 257:15 +CPU= 27.415
  16:41:45 STEP 1030 H= 257:30 +CPU= 25.880
  16:42:11 STEP 1031 H= 257:45 +CPU= 25.968
  16:42:44 STEP 1032 H= 258:00 +CPU= 32.215
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001032
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001032
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001032
  16:43:12 STEP 1033 H= 258:15 +CPU= 27.441
  16:43:40 STEP 1034 H= 258:30 +CPU= 27.321
  16:44:10 STEP 1035 H= 258:45 +CPU= 29.937
  16:44:37 STEP 1036 H= 259:00 +CPU= 26.578
  16:45:03 STEP 1037 H= 259:15 +CPU= 25.967
  16:45:30 STEP 1038 H= 259:30 +CPU= 25.929
  16:45:56 STEP 1039 H= 259:45 +CPU= 25.959
  16:46:23 STEP 1040 H= 260:00 +CPU= 26.583
  16:46:49 STEP 1041 H= 260:15 +CPU= 25.903
  16:47:15 STEP 1042 H= 260:30 +CPU= 25.990
  16:47:42 STEP 1043 H= 260:45 +CPU= 25.892
  16:48:14 STEP 1044 H= 261:00 +CPU= 32.205
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001044
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001044
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001044
  16:48:42 STEP 1045 H= 261:15 +CPU= 26.921
  16:49:20 STEP 1046 H= 261:30 +CPU= 37.266
  16:49:56 STEP 1047 H= 261:45 +CPU= 36.205
  16:50:31 STEP 1048 H= 262:00 +CPU= 34.540
  16:51:01 STEP 1049 H= 262:15 +CPU= 29.418
  16:51:27 STEP 1050 H= 262:30 +CPU= 25.917
  16:51:54 STEP 1051 H= 262:45 +CPU= 25.913
  16:52:21 STEP 1052 H= 263:00 +CPU= 26.578
  16:52:47 STEP 1053 H= 263:15 +CPU= 25.928
  16:53:13 STEP 1054 H= 263:30 +CPU= 25.949
  16:53:41 STEP 1055 H= 263:45 +CPU= 27.714
  16:54:25 STEP 1056 H= 264:00 +CPU= 42.691
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001056
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001056
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000960
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000972
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000984
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+000996
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001008
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001020
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001032
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001044
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001044
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001044
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_10.zip
Uploading the intermediate file: upload_file_10.zip
  16:55:02 STEP 1057 H= 264:15 +CPU= 36.318
  16:55:38 STEP 1058 H= 264:30 +CPU= 35.556
  16:56:14 STEP 1059 H= 264:45 +CPU= 35.769
  16:56:50 STEP 1060 H= 265:00 +CPU= 34.790
  16:57:18 STEP 1061 H= 265:15 +CPU= 27.216
  16:57:45 STEP 1062 H= 265:30 +CPU= 27.052
  16:58:13 STEP 1063 H= 265:45 +CPU= 27.741
  16:58:41 STEP 1064 H= 266:00 +CPU= 26.780
  16:59:07 STEP 1065 H= 266:15 +CPU= 26.287
  16:59:34 STEP 1066 H= 266:30 +CPU= 26.093
  17:00:00 STEP 1067 H= 266:45 +CPU= 26.084
  17:00:33 STEP 1068 H= 267:00 +CPU= 32.377
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001068
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001068
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001068
  17:01:00 STEP 1069 H= 267:15 +CPU= 26.089
  17:01:26 STEP 1070 H= 267:30 +CPU= 26.102
  17:01:53 STEP 1071 H= 267:45 +CPU= 26.112
  17:02:24 STEP 1072 H= 268:00 +CPU= 30.386
  17:02:50 STEP 1073 H= 268:15 +CPU= 26.049
  17:03:22 STEP 1074 H= 268:30 +CPU= 31.270
  17:03:50 STEP 1075 H= 268:45 +CPU= 27.427
  17:04:23 STEP 1076 H= 269:00 +CPU= 32.197
  17:04:49 STEP 1077 H= 269:15 +CPU= 26.050
  17:05:16 STEP 1078 H= 269:30 +CPU= 26.101
  17:05:46 STEP 1079 H= 269:45 +CPU= 29.565
  17:06:21 STEP 1080 H= 270:00 +CPU= 34.466
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001080
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001080
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001080
  17:06:48 STEP 1081 H= 270:15 +CPU= 26.021
  17:07:15 STEP 1082 H= 270:30 +CPU= 27.393
  17:07:42 STEP 1083 H= 270:45 +CPU= 26.064
  17:08:15 STEP 1084 H= 271:00 +CPU= 32.437
  17:08:41 STEP 1085 H= 271:15 +CPU= 26.053
  17:09:08 STEP 1086 H= 271:30 +CPU= 26.037
  17:09:34 STEP 1087 H= 271:45 +CPU= 26.107
  17:10:02 STEP 1088 H= 272:00 +CPU= 26.698
  17:10:28 STEP 1089 H= 272:15 +CPU= 26.051
  17:11:01 STEP 1090 H= 272:30 +CPU= 32.848
  17:11:28 STEP 1091 H= 272:45 +CPU= 26.439
  17:12:01 STEP 1092 H= 273:00 +CPU= 32.169
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001092
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001092
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001092
  17:12:31 STEP 1093 H= 273:15 +CPU= 29.504
  17:13:06 STEP 1094 H= 273:30 +CPU= 34.364
  17:13:36 STEP 1095 H= 273:45 +CPU= 29.593
  17:14:03 STEP 1096 H= 274:00 +CPU= 27.064
  17:14:29 STEP 1097 H= 274:15 +CPU= 25.996
  17:14:56 STEP 1098 H= 274:30 +CPU= 26.001
  17:15:22 STEP 1099 H= 274:45 +CPU= 25.999
  17:15:49 STEP 1100 H= 275:00 +CPU= 26.637
  17:16:18 STEP 1101 H= 275:15 +CPU= 27.965
  17:16:46 STEP 1102 H= 275:30 +CPU= 27.891
  17:17:16 STEP 1103 H= 275:45 +CPU= 29.315
  17:17:53 STEP 1104 H= 276:00 +CPU= 36.869
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001104
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001104
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001104
  17:18:21 STEP 1105 H= 276:15 +CPU= 27.428
  17:18:49 STEP 1106 H= 276:30 +CPU= 27.738
  17:19:18 STEP 1107 H= 276:45 +CPU= 28.295
  17:19:48 STEP 1108 H= 277:00 +CPU= 29.372
  17:20:15 STEP 1109 H= 277:15 +CPU= 27.354
  17:20:42 STEP 1110 H= 277:30 +CPU= 26.726
  17:21:10 STEP 1111 H= 277:45 +CPU= 27.404
  17:21:40 STEP 1112 H= 278:00 +CPU= 29.186
  17:22:08 STEP 1113 H= 278:15 +CPU= 27.403
  17:22:37 STEP 1114 H= 278:30 +CPU= 28.303
  17:23:04 STEP 1115 H= 278:45 +CPU= 26.888
  17:23:34 STEP 1116 H= 279:00 +CPU= 29.355
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001116
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001116
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001116
  17:23:58 STEP 1117 H= 279:15 +CPU= 24.081
  17:24:22 STEP 1118 H= 279:30 +CPU= 23.825
  17:24:48 STEP 1119 H= 279:45 +CPU= 25.319
  17:25:15 STEP 1120 H= 280:00 +CPU= 26.602
  17:25:40 STEP 1121 H= 280:15 +CPU= 24.181
  17:26:03 STEP 1122 H= 280:30 +CPU= 23.391
  17:26:27 STEP 1123 H= 280:45 +CPU= 23.830
  17:26:51 STEP 1124 H= 281:00 +CPU= 23.645
  17:27:15 STEP 1125 H= 281:15 +CPU= 23.196
  17:27:38 STEP 1126 H= 281:30 +CPU= 23.280
  17:28:02 STEP 1127 H= 281:45 +CPU= 23.304
  17:28:31 STEP 1128 H= 282:00 +CPU= 28.997
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001128
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001128
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001128
  17:28:54 STEP 1129 H= 282:15 +CPU= 23.192
  17:29:18 STEP 1130 H= 282:30 +CPU= 23.344
  17:29:41 STEP 1131 H= 282:45 +CPU= 23.122
  17:30:05 STEP 1132 H= 283:00 +CPU= 23.777
  17:30:29 STEP 1133 H= 283:15 +CPU= 23.204
  17:30:52 STEP 1134 H= 283:30 +CPU= 23.199
  17:31:15 STEP 1135 H= 283:45 +CPU= 23.072
  17:31:39 STEP 1136 H= 284:00 +CPU= 23.726
  17:32:03 STEP 1137 H= 284:15 +CPU= 23.163
  17:32:26 STEP 1138 H= 284:30 +CPU= 23.214
  17:32:49 STEP 1139 H= 284:45 +CPU= 23.197
  17:33:19 STEP 1140 H= 285:00 +CPU= 28.894
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001140
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001140
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001140
  17:33:42 STEP 1141 H= 285:15 +CPU= 23.266
  17:34:05 STEP 1142 H= 285:30 +CPU= 23.122
  17:34:29 STEP 1143 H= 285:45 +CPU= 23.068
  17:34:53 STEP 1144 H= 286:00 +CPU= 23.682
  17:35:16 STEP 1145 H= 286:15 +CPU= 23.302
  17:35:40 STEP 1146 H= 286:30 +CPU= 23.234
  17:36:03 STEP 1147 H= 286:45 +CPU= 23.253
  17:36:27 STEP 1148 H= 287:00 +CPU= 23.706
  17:36:50 STEP 1149 H= 287:15 +CPU= 23.159
  17:37:14 STEP 1150 H= 287:30 +CPU= 23.351
  17:37:37 STEP 1151 H= 287:45 +CPU= 23.258
  17:38:09 STEP 1152 H= 288:00 +CPU= 31.685
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001152
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001152
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001056
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001068
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001080
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001092
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001104
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001116
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001128
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001140
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001140
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001140
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_11.zip
Uploading the intermediate file: upload_file_11.zip
  17:38:34 STEP 1153 H= 288:15 +CPU= 24.148
  17:38:57 STEP 1154 H= 288:30 +CPU= 23.337
  17:39:21 STEP 1155 H= 288:45 +CPU= 23.367
  17:39:45 STEP 1156 H= 289:00 +CPU= 23.654
  17:40:08 STEP 1157 H= 289:15 +CPU= 23.150
  17:40:32 STEP 1158 H= 289:30 +CPU= 23.221
  17:40:55 STEP 1159 H= 289:45 +CPU= 23.237
  17:41:19 STEP 1160 H= 290:00 +CPU= 23.722
  17:41:42 STEP 1161 H= 290:15 +CPU= 23.255
  17:42:06 STEP 1162 H= 290:30 +CPU= 23.271
  17:42:29 STEP 1163 H= 290:45 +CPU= 23.302
  17:42:59 STEP 1164 H= 291:00 +CPU= 29.021
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001164
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001164
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001164
  17:43:22 STEP 1165 H= 291:15 +CPU= 22.705
  17:43:44 STEP 1166 H= 291:30 +CPU= 22.301
  17:44:06 STEP 1167 H= 291:45 +CPU= 21.433
  17:44:28 STEP 1168 H= 292:00 +CPU= 21.823
  17:44:49 STEP 1169 H= 292:15 +CPU= 21.110
  17:45:10 STEP 1170 H= 292:30 +CPU= 21.121
  17:45:32 STEP 1171 H= 292:45 +CPU= 21.233
  17:45:54 STEP 1172 H= 293:00 +CPU= 21.718
  17:46:15 STEP 1173 H= 293:15 +CPU= 21.233
  17:46:36 STEP 1174 H= 293:30 +CPU= 21.250
  17:46:58 STEP 1175 H= 293:45 +CPU= 21.107
  17:47:24 STEP 1176 H= 294:00 +CPU= 26.275
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001176
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001176
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001176
  17:47:45 STEP 1177 H= 294:15 +CPU= 21.048
  17:48:07 STEP 1178 H= 294:30 +CPU= 21.063
  17:48:28 STEP 1179 H= 294:45 +CPU= 21.166
  17:48:50 STEP 1180 H= 295:00 +CPU= 21.538
  17:49:11 STEP 1181 H= 295:15 +CPU= 21.042
  17:49:32 STEP 1182 H= 295:30 +CPU= 21.107
  17:49:53 STEP 1183 H= 295:45 +CPU= 21.092
  17:50:15 STEP 1184 H= 296:00 +CPU= 21.685
  17:50:37 STEP 1185 H= 296:15 +CPU= 21.214
  17:50:58 STEP 1186 H= 296:30 +CPU= 21.106
  17:51:19 STEP 1187 H= 296:45 +CPU= 21.112
  17:51:46 STEP 1188 H= 297:00 +CPU= 26.225
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001188
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001188
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001188
  17:52:07 STEP 1189 H= 297:15 +CPU= 20.943
  17:52:28 STEP 1190 H= 297:30 +CPU= 20.925
  17:52:49 STEP 1191 H= 297:45 +CPU= 20.878
  17:53:11 STEP 1192 H= 298:00 +CPU= 21.683
  17:53:32 STEP 1193 H= 298:15 +CPU= 21.193
  17:53:53 STEP 1194 H= 298:30 +CPU= 20.969
  17:54:15 STEP 1195 H= 298:45 +CPU= 21.129
  17:54:37 STEP 1196 H= 299:00 +CPU= 21.715
  17:54:58 STEP 1197 H= 299:15 +CPU= 21.163
  17:55:19 STEP 1198 H= 299:30 +CPU= 21.224
  17:55:41 STEP 1199 H= 299:45 +CPU= 21.207
  17:56:10 STEP 1200 H= 300:00 +CPU= 28.847
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001200
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001200
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001200
  17:56:31 STEP 1201 H= 300:15 +CPU= 21.345
  17:56:53 STEP 1202 H= 300:30 +CPU= 21.222
  17:57:14 STEP 1203 H= 300:45 +CPU= 21.133
  17:57:36 STEP 1204 H= 301:00 +CPU= 21.671
  17:57:57 STEP 1205 H= 301:15 +CPU= 21.180
  17:58:18 STEP 1206 H= 301:30 +CPU= 21.076
  17:58:40 STEP 1207 H= 301:45 +CPU= 21.159
  17:59:02 STEP 1208 H= 302:00 +CPU= 21.664
  17:59:23 STEP 1209 H= 302:15 +CPU= 21.281
  17:59:44 STEP 1210 H= 302:30 +CPU= 21.032
  18:00:06 STEP 1211 H= 302:45 +CPU= 21.070
  18:00:32 STEP 1212 H= 303:00 +CPU= 26.353
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001212
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001212
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001212
  18:00:53 STEP 1213 H= 303:15 +CPU= 21.088
  18:01:15 STEP 1214 H= 303:30 +CPU= 21.290
  18:01:36 STEP 1215 H= 303:45 +CPU= 21.241
  18:01:58 STEP 1216 H= 304:00 +CPU= 21.616
  18:02:19 STEP 1217 H= 304:15 +CPU= 21.119
  18:02:41 STEP 1218 H= 304:30 +CPU= 21.116
  18:03:02 STEP 1219 H= 304:45 +CPU= 21.156
  18:03:24 STEP 1220 H= 305:00 +CPU= 21.665
  18:03:45 STEP 1221 H= 305:15 +CPU= 21.048
  18:04:06 STEP 1222 H= 305:30 +CPU= 21.015
  18:04:27 STEP 1223 H= 305:45 +CPU= 21.085
  18:04:54 STEP 1224 H= 306:00 +CPU= 25.988
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001224
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001224
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001224
  18:05:15 STEP 1225 H= 306:15 +CPU= 21.211
  18:05:37 STEP 1226 H= 306:30 +CPU= 21.375
  18:05:58 STEP 1227 H= 306:45 +CPU= 21.203
  18:06:20 STEP 1228 H= 307:00 +CPU= 21.656
  18:06:41 STEP 1229 H= 307:15 +CPU= 21.141
  18:07:02 STEP 1230 H= 307:30 +CPU= 21.143
  18:07:24 STEP 1231 H= 307:45 +CPU= 21.212
  18:07:46 STEP 1232 H= 308:00 +CPU= 21.616
  18:08:07 STEP 1233 H= 308:15 +CPU= 21.094
  18:08:28 STEP 1234 H= 308:30 +CPU= 21.241
  18:08:50 STEP 1235 H= 308:45 +CPU= 21.098
  18:09:16 STEP 1236 H= 309:00 +CPU= 26.046
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001236
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001236
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001236
  18:09:37 STEP 1237 H= 309:15 +CPU= 21.001
  18:09:58 STEP 1238 H= 309:30 +CPU= 21.107
  18:10:20 STEP 1239 H= 309:45 +CPU= 21.170
  18:10:41 STEP 1240 H= 310:00 +CPU= 21.696
  18:11:03 STEP 1241 H= 310:15 +CPU= 21.192
  18:11:24 STEP 1242 H= 310:30 +CPU= 21.233
  18:11:46 STEP 1243 H= 310:45 +CPU= 21.132
  18:12:07 STEP 1244 H= 311:00 +CPU= 21.627
  18:12:29 STEP 1245 H= 311:15 +CPU= 21.143
  18:12:50 STEP 1246 H= 311:30 +CPU= 21.190
  18:13:11 STEP 1247 H= 311:45 +CPU= 21.211
  18:13:41 STEP 1248 H= 312:00 +CPU= 28.859
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001248
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001248
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001152
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001164
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001176
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001188
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001200
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001212
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001224
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001236
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001236
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001236
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_12.zip
Uploading the intermediate file: upload_file_12.zip
  18:14:03 STEP 1249 H= 312:15 +CPU= 22.170
  18:14:24 STEP 1250 H= 312:30 +CPU= 21.353
  18:14:46 STEP 1251 H= 312:45 +CPU= 20.932
  18:15:07 STEP 1252 H= 313:00 +CPU= 21.615
  18:15:29 STEP 1253 H= 313:15 +CPU= 21.180
  18:15:50 STEP 1254 H= 313:30 +CPU= 21.120
  18:16:11 STEP 1255 H= 313:45 +CPU= 21.097
  18:16:33 STEP 1256 H= 314:00 +CPU= 21.760
  18:16:54 STEP 1257 H= 314:15 +CPU= 21.098
  18:17:16 STEP 1258 H= 314:30 +CPU= 21.112
  18:17:36 STEP 1259 H= 314:45 +CPU= 20.490
  18:18:02 STEP 1260 H= 315:00 +CPU= 25.797
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001260
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001260
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001260
  18:18:23 STEP 1261 H= 315:15 +CPU= 20.146
  18:18:43 STEP 1262 H= 315:30 +CPU= 20.056
  18:19:03 STEP 1263 H= 315:45 +CPU= 20.096
  18:19:24 STEP 1264 H= 316:00 +CPU= 20.641
  18:19:44 STEP 1265 H= 316:15 +CPU= 20.088
  18:20:04 STEP 1266 H= 316:30 +CPU= 20.122
  18:20:25 STEP 1267 H= 316:45 +CPU= 20.174
  18:20:45 STEP 1268 H= 317:00 +CPU= 20.539
  18:21:06 STEP 1269 H= 317:15 +CPU= 20.181
  18:21:26 STEP 1270 H= 317:30 +CPU= 20.154
  18:21:46 STEP 1271 H= 317:45 +CPU= 20.099
  18:22:11 STEP 1272 H= 318:00 +CPU= 24.990
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001272
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001272
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001272
  18:22:32 STEP 1273 H= 318:15 +CPU= 20.148
  18:22:52 STEP 1274 H= 318:30 +CPU= 20.056
  18:23:12 STEP 1275 H= 318:45 +CPU= 20.077
  18:23:33 STEP 1276 H= 319:00 +CPU= 20.672
  18:23:53 STEP 1277 H= 319:15 +CPU= 20.034
  18:24:13 STEP 1278 H= 319:30 +CPU= 20.097
  18:24:34 STEP 1279 H= 319:45 +CPU= 20.487
  18:24:55 STEP 1280 H= 320:00 +CPU= 20.584
  18:25:15 STEP 1281 H= 320:15 +CPU= 20.086
  18:25:35 STEP 1282 H= 320:30 +CPU= 20.116
  18:25:55 STEP 1283 H= 320:45 +CPU= 20.057
  18:26:21 STEP 1284 H= 321:00 +CPU= 24.915
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001284
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001284
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001284
  18:26:41 STEP 1285 H= 321:15 +CPU= 20.101
  18:27:01 STEP 1286 H= 321:30 +CPU= 20.025
  18:27:21 STEP 1287 H= 321:45 +CPU= 20.130
  18:27:42 STEP 1288 H= 322:00 +CPU= 20.566
  18:28:02 STEP 1289 H= 322:15 +CPU= 20.074
  18:28:22 STEP 1290 H= 322:30 +CPU= 20.155
  18:28:43 STEP 1291 H= 322:45 +CPU= 20.084
  18:29:03 STEP 1292 H= 323:00 +CPU= 20.586
  18:29:24 STEP 1293 H= 323:15 +CPU= 20.109
  18:29:44 STEP 1294 H= 323:30 +CPU= 20.095
  18:30:04 STEP 1295 H= 323:45 +CPU= 20.141
  18:30:32 STEP 1296 H= 324:00 +CPU= 27.461
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001296
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001296
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001296
  18:30:52 STEP 1297 H= 324:15 +CPU= 20.173
  18:31:13 STEP 1298 H= 324:30 +CPU= 20.230
  18:31:33 STEP 1299 H= 324:45 +CPU= 20.153
  18:31:54 STEP 1300 H= 325:00 +CPU= 20.541
  18:32:14 STEP 1301 H= 325:15 +CPU= 20.116
  18:32:34 STEP 1302 H= 325:30 +CPU= 20.249
  18:32:54 STEP 1303 H= 325:45 +CPU= 20.094
  18:33:15 STEP 1304 H= 326:00 +CPU= 20.592
  18:33:36 STEP 1305 H= 326:15 +CPU= 20.180
  18:33:56 STEP 1306 H= 326:30 +CPU= 20.092
  18:34:16 STEP 1307 H= 326:45 +CPU= 20.099
  18:34:41 STEP 1308 H= 327:00 +CPU= 25.080
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001308
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001308
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001308
  18:35:01 STEP 1309 H= 327:15 +CPU= 20.125
  18:35:22 STEP 1310 H= 327:30 +CPU= 20.166
  18:35:42 STEP 1311 H= 327:45 +CPU= 20.115
  18:36:03 STEP 1312 H= 328:00 +CPU= 20.560
  18:36:23 STEP 1313 H= 328:15 +CPU= 20.202
  18:36:43 STEP 1314 H= 328:30 +CPU= 20.093
  18:37:04 STEP 1315 H= 328:45 +CPU= 20.074
  18:37:24 STEP 1316 H= 329:00 +CPU= 20.650
  18:37:45 STEP 1317 H= 329:15 +CPU= 20.063
  18:38:05 STEP 1318 H= 329:30 +CPU= 20.098
  18:38:25 STEP 1319 H= 329:45 +CPU= 20.151
  18:38:50 STEP 1320 H= 330:00 +CPU= 24.966
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001320
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001320
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001320
  18:39:11 STEP 1321 H= 330:15 +CPU= 20.105
  18:39:31 STEP 1322 H= 330:30 +CPU= 20.214
  18:39:51 STEP 1323 H= 330:45 +CPU= 20.064
  18:40:12 STEP 1324 H= 331:00 +CPU= 20.574
  18:40:32 STEP 1325 H= 331:15 +CPU= 20.145
  18:40:52 STEP 1326 H= 331:30 +CPU= 20.111
  18:41:13 STEP 1327 H= 331:45 +CPU= 20.084
  18:41:33 STEP 1328 H= 332:00 +CPU= 20.636
  18:41:54 STEP 1329 H= 332:15 +CPU= 20.055
  18:42:14 STEP 1330 H= 332:30 +CPU= 20.087
  18:42:34 STEP 1331 H= 332:45 +CPU= 20.172
  18:42:59 STEP 1332 H= 333:00 +CPU= 24.951
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001332
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001332
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001332
  18:43:19 STEP 1333 H= 333:15 +CPU= 20.110
  18:43:40 STEP 1334 H= 333:30 +CPU= 20.215
  18:44:00 STEP 1335 H= 333:45 +CPU= 20.098
  18:44:21 STEP 1336 H= 334:00 +CPU= 20.609
  18:44:41 STEP 1337 H= 334:15 +CPU= 20.250
  18:45:01 STEP 1338 H= 334:30 +CPU= 20.069
  18:45:22 STEP 1339 H= 334:45 +CPU= 20.107
  18:45:42 STEP 1340 H= 335:00 +CPU= 20.689
  18:46:03 STEP 1341 H= 335:15 +CPU= 20.152
  18:46:23 STEP 1342 H= 335:30 +CPU= 20.131
  18:46:43 STEP 1343 H= 335:45 +CPU= 20.146
  18:47:11 STEP 1344 H= 336:00 +CPU= 27.414
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001344
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001344
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001248
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001260
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001272
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001284
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001296
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001308
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001320
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001332
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001332
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001332
Zipping up the intermediate file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_13.zip
Uploading the intermediate file: upload_file_13.zip
  18:47:32 STEP 1345 H= 336:15 +CPU= 20.841
  18:47:52 STEP 1346 H= 336:30 +CPU= 20.184
  18:48:13 STEP 1347 H= 336:45 +CPU= 20.142
  18:48:33 STEP 1348 H= 337:00 +CPU= 20.714
  18:48:54 STEP 1349 H= 337:15 +CPU= 20.100
  18:49:14 STEP 1350 H= 337:30 +CPU= 20.170
  18:49:34 STEP 1351 H= 337:45 +CPU= 20.214
  18:49:55 STEP 1352 H= 338:00 +CPU= 20.631
  18:50:15 STEP 1353 H= 338:15 +CPU= 20.153
  18:50:36 STEP 1354 H= 338:30 +CPU= 20.250
  18:50:56 STEP 1355 H= 338:45 +CPU= 20.150
  18:51:21 STEP 1356 H= 339:00 +CPU= 25.048
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001356
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001356
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001356
  18:51:42 STEP 1357 H= 339:15 +CPU= 20.423
  18:52:02 STEP 1358 H= 339:30 +CPU= 20.142
  18:52:23 STEP 1359 H= 339:45 +CPU= 20.158
  18:52:43 STEP 1360 H= 340:00 +CPU= 20.750
  18:53:04 STEP 1361 H= 340:15 +CPU= 20.145
  18:53:24 STEP 1362 H= 340:30 +CPU= 20.226
  18:53:44 STEP 1363 H= 340:45 +CPU= 20.209
  18:54:05 STEP 1364 H= 341:00 +CPU= 20.653
  18:54:26 STEP 1365 H= 341:15 +CPU= 20.218
  18:54:46 STEP 1366 H= 341:30 +CPU= 20.148
  18:55:06 STEP 1367 H= 341:45 +CPU= 20.175
  18:55:32 STEP 1368 H= 342:00 +CPU= 25.112
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001368
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001368
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001368
  18:55:52 STEP 1369 H= 342:15 +CPU= 20.158
  18:56:12 STEP 1370 H= 342:30 +CPU= 20.173
  18:56:32 STEP 1371 H= 342:45 +CPU= 20.219
  18:56:53 STEP 1372 H= 343:00 +CPU= 20.656
  18:57:14 STEP 1373 H= 343:15 +CPU= 20.202
  18:57:34 STEP 1374 H= 343:30 +CPU= 20.238
  18:57:54 STEP 1375 H= 343:45 +CPU= 20.161
  18:58:15 STEP 1376 H= 344:00 +CPU= 20.651
  18:58:36 STEP 1377 H= 344:15 +CPU= 20.260
  18:58:56 STEP 1378 H= 344:30 +CPU= 20.158
  18:59:16 STEP 1379 H= 344:45 +CPU= 20.176
  18:59:41 STEP 1380 H= 345:00 +CPU= 25.127
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001380
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001380
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001380
  19:00:02 STEP 1381 H= 345:15 +CPU= 20.188
  19:00:22 STEP 1382 H= 345:30 +CPU= 20.203
  19:00:43 STEP 1383 H= 345:45 +CPU= 20.308
  19:01:03 STEP 1384 H= 346:00 +CPU= 20.657
  19:01:24 STEP 1385 H= 346:15 +CPU= 20.142
  19:01:44 STEP 1386 H= 346:30 +CPU= 20.244
  19:02:04 STEP 1387 H= 346:45 +CPU= 20.186
  19:02:25 STEP 1388 H= 347:00 +CPU= 20.712
  19:02:46 STEP 1389 H= 347:15 +CPU= 20.172
  19:03:06 STEP 1390 H= 347:30 +CPU= 20.153
  19:03:26 STEP 1391 H= 347:45 +CPU= 20.506
  19:03:54 STEP 1392 H= 348:00 +CPU= 27.743
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001392
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001392
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001392
  19:04:15 STEP 1393 H= 348:15 +CPU= 20.207
  19:04:35 STEP 1394 H= 348:30 +CPU= 20.343
  19:04:56 STEP 1395 H= 348:45 +CPU= 20.165
  19:05:16 STEP 1396 H= 349:00 +CPU= 20.631
  19:05:37 STEP 1397 H= 349:15 +CPU= 20.250
  19:05:57 STEP 1398 H= 349:30 +CPU= 20.189
  19:06:17 STEP 1399 H= 349:45 +CPU= 20.196
  19:06:38 STEP 1400 H= 350:00 +CPU= 20.777
  19:06:59 STEP 1401 H= 350:15 +CPU= 20.205
  19:07:19 STEP 1402 H= 350:30 +CPU= 20.237
  19:07:39 STEP 1403 H= 350:45 +CPU= 20.262
  19:08:05 STEP 1404 H= 351:00 +CPU= 25.056
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001404
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001404
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001404
  19:08:25 STEP 1405 H= 351:15 +CPU= 20.294
  19:08:46 STEP 1406 H= 351:30 +CPU= 20.236
  19:09:06 STEP 1407 H= 351:45 +CPU= 20.224
  19:09:27 STEP 1408 H= 352:00 +CPU= 20.835
  19:09:47 STEP 1409 H= 352:15 +CPU= 20.198
  19:10:08 STEP 1410 H= 352:30 +CPU= 20.256
  19:10:28 STEP 1411 H= 352:45 +CPU= 20.349
  19:10:49 STEP 1412 H= 353:00 +CPU= 20.695
  19:11:09 STEP 1413 H= 353:15 +CPU= 20.219
  19:11:30 STEP 1414 H= 353:30 +CPU= 20.264
  19:11:50 STEP 1415 H= 353:45 +CPU= 20.148
  19:12:15 STEP 1416 H= 354:00 +CPU= 25.097
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001416
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001416
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001416
  19:12:36 STEP 1417 H= 354:15 +CPU= 20.247
  19:12:56 STEP 1418 H= 354:30 +CPU= 20.154
  19:13:16 STEP 1419 H= 354:45 +CPU= 20.171
  19:13:37 STEP 1420 H= 355:00 +CPU= 20.768
  19:13:57 STEP 1421 H= 355:15 +CPU= 20.184
  19:14:18 STEP 1422 H= 355:30 +CPU= 20.173
  19:14:38 STEP 1423 H= 355:45 +CPU= 20.240
  19:14:59 STEP 1424 H= 356:00 +CPU= 20.658
  19:15:19 STEP 1425 H= 356:15 +CPU= 20.224
  19:15:40 STEP 1426 H= 356:30 +CPU= 20.372
  19:16:00 STEP 1427 H= 356:45 +CPU= 20.179
  19:16:25 STEP 1428 H= 357:00 +CPU= 25.132
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001428
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001428
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001428
  19:16:46 STEP 1429 H= 357:15 +CPU= 20.300
  19:17:06 STEP 1430 H= 357:30 +CPU= 20.239
  19:17:27 STEP 1431 H= 357:45 +CPU= 20.219
  19:17:48 STEP 1432 H= 358:00 +CPU= 20.732
  19:18:08 STEP 1433 H= 358:15 +CPU= 20.236
  19:18:28 STEP 1434 H= 358:30 +CPU= 20.328
  19:18:49 STEP 1435 H= 358:45 +CPU= 20.243
  19:19:10 STEP 1436 H= 359:00 +CPU= 20.732
  19:19:30 STEP 1437 H= 359:15 +CPU= 20.341
  19:19:50 STEP 1438 H= 359:30 +CPU= 20.220
  19:20:11 STEP 1439 H= 359:45 +CPU= 20.281
  19:20:37 STEP 1440 H= 360:00 +CPU= 26.060
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2196472252E-20      I       0.4507589993E-05      I
ICloud fractionI      0.0000000000E+00      I       0.5030941177E-01      I
I  Relat. Hum. I      0.1082526183E-01      I       0.1741242638E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5296645141E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    322068081 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0079( 3.8%)
 19:20:37 STEP 1440 H= 360:00 +CPU= 26.060
 END CNT3
 NSTEP =  1440 CNT0   000000000  19.352  19.352  19.472   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    69.6     0.0    69.5     0.0   141.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    3861.3    3861.3     15.03      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     781.1     781.1      2.80      0.00
  10 SCAN2M - PHYSICS                             1441   14628.2   14628.2     52.54      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     798.4     798.4      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      36.6      36.6      0.01      0.00
  14 SUINIF                                          1    2690.7    2690.7      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      28.6      28.6      0.01      0.00
  18 SUSPECG                                         1    1266.1    1266.1      0.00      0.00
  19 SUSPEC                                          1    1270.3    1270.3      0.00      0.00
  24 SUGRIDU                                         1     824.4     824.4      0.00      0.00
  25 SPECRT                                          1     193.4     193.4      0.00      0.00
  26 SUGRIDF                                         1     402.5     402.5      0.00      0.00
  27 RESTART FILES - WRITING                        30    3220.1    3220.1      0.24      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5845.4    5845.4      1.76      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    5179.7    5179.7     18.60      0.00
  39 SU0YOMB                                         1     270.9     270.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      28.0      28.0      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     331.6     331.6      1.19      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      45.3      45.3      0.16      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     385.3     385.3      3.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     226.8     226.8      1.70      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      92.6      92.6      0.69      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     134.2     134.2      1.05      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      31.4      31.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      42.5      42.5      0.33      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      22.8      22.8      0.17      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      80.8      80.8      0.63      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      21.3      21.3      0.16      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    40119.0 CPU TIME   39531.8 VECTOR TIME    39531.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       32.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/nairb/slots/0/ICMGGh7zg+001440
Moving to projects directory: /home/nairb/slots/0/ICMSHh7zg+001440
Moving to projects directory: /home/nairb/slots/0/ICMUAh7zg+001440
Adding to the zip: /home/nairb/slots/0/NODE.001_01
Adding to the zip: /home/nairb/slots/0/ifs.stat
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001416
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001368
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001416
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001404
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001344
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001440
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001428
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMSHh7zg+001392
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMUAh7zg+001380
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001356
Adding to the zip: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_12211620/ICMGGh7zg+001416
Zipping up the final file: /home/nairb/projects/climateprediction.net/oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0_r397517230_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
19:24:07 (119717): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:45 1532429 22311866 oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0 1,295,100 39,531 0.0305
09 May 2023 16:51:42 1532429 22311866 oifs_43r3_bl_a3q9_2016092300_15_991_12211620_0 864,000 27,997 0.0324


©2024 climateprediction.net