climateprediction.net home page
Task 22435750

Task 22435750

Name oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0
Workunit 12284170
Created 7 Jun 2024, 14:14:05 UTC
Sent 8 Jun 2024, 10:00:49 UTC
Report deadline 7 Aug 2024, 10:00:49 UTC
Received 9 Jun 2024, 0:31:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538875
Run time 13 hours 37 min 58 sec
CPU time 13 hours 31 min 42 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.39 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.32 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,269.66 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 32.859
  18:24:16 STEP  835 H= 208:45 +CPU= 32.901
  18:24:50 STEP  836 H= 209:00 +CPU= 33.489
  18:25:23 STEP  837 H= 209:15 +CPU= 32.835
  18:25:55 STEP  838 H= 209:30 +CPU= 32.785
  18:26:28 STEP  839 H= 209:45 +CPU= 32.633
  18:27:08 STEP  840 H= 210:00 +CPU= 40.029
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000840
  18:27:40 STEP  841 H= 210:15 +CPU= 32.445
  18:28:13 STEP  842 H= 210:30 +CPU= 32.433
  18:28:45 STEP  843 H= 210:45 +CPU= 32.341
  18:29:19 STEP  844 H= 211:00 +CPU= 33.189
  18:29:52 STEP  845 H= 211:15 +CPU= 33.776
  18:30:25 STEP  846 H= 211:30 +CPU= 32.925
  18:31:01 STEP  847 H= 211:45 +CPU= 35.400
  18:31:35 STEP  848 H= 212:00 +CPU= 33.282
  18:32:09 STEP  849 H= 212:15 +CPU= 34.418
  18:32:42 STEP  850 H= 212:30 +CPU= 32.586
  18:33:15 STEP  851 H= 212:45 +CPU= 33.279
  18:33:55 STEP  852 H= 213:00 +CPU= 39.836
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000852
  18:34:27 STEP  853 H= 213:15 +CPU= 32.153
  18:34:59 STEP  854 H= 213:30 +CPU= 32.212
  18:35:32 STEP  855 H= 213:45 +CPU= 32.157
  18:36:05 STEP  856 H= 214:00 +CPU= 32.705
  18:36:37 STEP  857 H= 214:15 +CPU= 31.887
  18:37:09 STEP  858 H= 214:30 +CPU= 32.744
  18:37:43 STEP  859 H= 214:45 +CPU= 33.251
  18:38:20 STEP  860 H= 215:00 +CPU= 35.794
  18:38:53 STEP  861 H= 215:15 +CPU= 32.743
  18:39:26 STEP  862 H= 215:30 +CPU= 32.983
  18:39:59 STEP  863 H= 215:45 +CPU= 32.456
  18:40:43 STEP  864 H= 216:00 +CPU= 43.997
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_8.zip
Uploading the intermediate file: upload_file_8.zip
  18:41:15 STEP  865 H= 216:15 +CPU= 31.922
  18:41:48 STEP  866 H= 216:30 +CPU= 33.073
  18:42:23 STEP  867 H= 216:45 +CPU= 34.342
  18:42:56 STEP  868 H= 217:00 +CPU= 32.976
  18:43:27 STEP  869 H= 217:15 +CPU= 31.810
  18:43:59 STEP  870 H= 217:30 +CPU= 31.885
  18:44:31 STEP  871 H= 217:45 +CPU= 31.760
  18:45:05 STEP  872 H= 218:00 +CPU= 32.583
  18:45:38 STEP  873 H= 218:15 +CPU= 32.387
  18:46:10 STEP  874 H= 218:30 +CPU= 31.706
  18:46:41 STEP  875 H= 218:45 +CPU= 31.647
  18:47:21 STEP  876 H= 219:00 +CPU= 39.769
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000876
  18:47:53 STEP  877 H= 219:15 +CPU= 31.545
  18:48:24 STEP  878 H= 219:30 +CPU= 31.495
  18:48:56 STEP  879 H= 219:45 +CPU= 31.546
  18:49:28 STEP  880 H= 220:00 +CPU= 31.863
  18:49:59 STEP  881 H= 220:15 +CPU= 31.123
  18:50:31 STEP  882 H= 220:30 +CPU= 31.368
  18:51:02 STEP  883 H= 220:45 +CPU= 31.323
  18:51:34 STEP  884 H= 221:00 +CPU= 31.719
  18:52:05 STEP  885 H= 221:15 +CPU= 31.117
  18:52:36 STEP  886 H= 221:30 +CPU= 31.326
  18:53:08 STEP  887 H= 221:45 +CPU= 31.889
  18:53:48 STEP  888 H= 222:00 +CPU= 39.291
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000888
  18:54:22 STEP  889 H= 222:15 +CPU= 33.461
  18:54:55 STEP  890 H= 222:30 +CPU= 32.687
  18:55:26 STEP  891 H= 222:45 +CPU= 31.010
  18:55:58 STEP  892 H= 223:00 +CPU= 32.407
  18:56:30 STEP  893 H= 223:15 +CPU= 32.232
  18:57:03 STEP  894 H= 223:30 +CPU= 32.726
  18:57:36 STEP  895 H= 223:45 +CPU= 32.517
  18:58:09 STEP  896 H= 224:00 +CPU= 32.682
  18:58:41 STEP  897 H= 224:15 +CPU= 31.733
  18:59:12 STEP  898 H= 224:30 +CPU= 31.799
  18:59:46 STEP  899 H= 224:45 +CPU= 33.261
  19:00:25 STEP  900 H= 225:00 +CPU= 39.118
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000900
  19:00:56 STEP  901 H= 225:15 +CPU= 31.212
  19:01:30 STEP  902 H= 225:30 +CPU= 33.116
  19:02:03 STEP  903 H= 225:45 +CPU= 32.788
  19:02:37 STEP  904 H= 226:00 +CPU= 33.470
  19:03:10 STEP  905 H= 226:15 +CPU= 32.686
  19:03:42 STEP  906 H= 226:30 +CPU= 32.004
  19:04:14 STEP  907 H= 226:45 +CPU= 31.853
  19:04:46 STEP  908 H= 227:00 +CPU= 32.517
  19:05:19 STEP  909 H= 227:15 +CPU= 32.294
  19:05:51 STEP  910 H= 227:30 +CPU= 31.960
  19:06:23 STEP  911 H= 227:45 +CPU= 32.117
  19:07:06 STEP  912 H= 228:00 +CPU= 42.794
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000912
  19:07:38 STEP  913 H= 228:15 +CPU= 31.792
  19:08:09 STEP  914 H= 228:30 +CPU= 31.024
  19:08:40 STEP  915 H= 228:45 +CPU= 31.155
  19:09:12 STEP  916 H= 229:00 +CPU= 31.919
  19:09:43 STEP  917 H= 229:15 +CPU= 31.256
  19:10:15 STEP  918 H= 229:30 +CPU= 31.202
  19:10:46 STEP  919 H= 229:45 +CPU= 31.169
  19:11:17 STEP  920 H= 230:00 +CPU= 31.654
  19:11:49 STEP  921 H= 230:15 +CPU= 31.078
  19:12:20 STEP  922 H= 230:30 +CPU= 31.172
  19:12:51 STEP  923 H= 230:45 +CPU= 31.350
  19:13:30 STEP  924 H= 231:00 +CPU= 38.977
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000924
  19:14:04 STEP  925 H= 231:15 +CPU= 33.779
  19:14:35 STEP  926 H= 231:30 +CPU= 31.122
  19:15:07 STEP  927 H= 231:45 +CPU= 31.515
  19:15:39 STEP  928 H= 232:00 +CPU= 32.587
  19:16:11 STEP  929 H= 232:15 +CPU= 31.978
  19:16:43 STEP  930 H= 232:30 +CPU= 31.408
  19:17:15 STEP  931 H= 232:45 +CPU= 31.804
  19:17:47 STEP  932 H= 233:00 +CPU= 32.261
  19:18:19 STEP  933 H= 233:15 +CPU= 31.252
  19:18:50 STEP  934 H= 233:30 +CPU= 30.986
  19:19:21 STEP  935 H= 233:45 +CPU= 31.326
  19:20:01 STEP  936 H= 234:00 +CPU= 39.758
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000936
  19:20:34 STEP  937 H= 234:15 +CPU= 33.478
  19:21:08 STEP  938 H= 234:30 +CPU= 33.356
  19:21:41 STEP  939 H= 234:45 +CPU= 33.060
  19:22:15 STEP  940 H= 235:00 +CPU= 33.906
  19:22:50 STEP  941 H= 235:15 +CPU= 34.342
  19:23:22 STEP  942 H= 235:30 +CPU= 32.347
  19:23:55 STEP  943 H= 235:45 +CPU= 32.784
  19:24:29 STEP  944 H= 236:00 +CPU= 33.471
  19:25:01 STEP  945 H= 236:15 +CPU= 32.821
  19:25:34 STEP  946 H= 236:30 +CPU= 32.574
  19:26:07 STEP  947 H= 236:45 +CPU= 32.390
  19:26:48 STEP  948 H= 237:00 +CPU= 40.427
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000948
  19:27:22 STEP  949 H= 237:15 +CPU= 34.472
  19:27:55 STEP  950 H= 237:30 +CPU= 33.087
  19:28:27 STEP  951 H= 237:45 +CPU= 32.114
  19:29:02 STEP  952 H= 238:00 +CPU= 34.822
  19:29:35 STEP  953 H= 238:15 +CPU= 32.213
  19:30:07 STEP  954 H= 238:30 +CPU= 32.207
  19:30:39 STEP  955 H= 238:45 +CPU= 32.166
  19:31:12 STEP  956 H= 239:00 +CPU= 32.919
  19:31:44 STEP  957 H= 239:15 +CPU= 31.975
  19:32:16 STEP  958 H= 239:30 +CPU= 32.053
  19:32:48 STEP  959 H= 239:45 +CPU= 32.175
  19:33:34 STEP  960 H= 240:00 +CPU= 46.293
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_9.zip
Uploading the intermediate file: upload_file_9.zip
  19:34:07 STEP  961 H= 240:15 +CPU= 32.852
Uploading trickle at timestep: 864000
  19:34:39 STEP  962 H= 240:30 +CPU= 31.203
  19:35:10 STEP  963 H= 240:45 +CPU= 31.690
  19:35:43 STEP  964 H= 241:00 +CPU= 32.461
  19:36:15 STEP  965 H= 241:15 +CPU= 31.924
  19:36:45 STEP  966 H= 241:30 +CPU= 30.090
  19:37:16 STEP  967 H= 241:45 +CPU= 31.145
  19:37:48 STEP  968 H= 242:00 +CPU= 31.916
  19:38:19 STEP  969 H= 242:15 +CPU= 30.474
  19:38:49 STEP  970 H= 242:30 +CPU= 30.674
  19:39:19 STEP  971 H= 242:45 +CPU= 30.216
  19:39:56 STEP  972 H= 243:00 +CPU= 37.029
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000972
  19:40:27 STEP  973 H= 243:15 +CPU= 30.521
  19:40:57 STEP  974 H= 243:30 +CPU= 29.761
  19:41:26 STEP  975 H= 243:45 +CPU= 28.837
  19:41:55 STEP  976 H= 244:00 +CPU= 29.759
  19:42:26 STEP  977 H= 244:15 +CPU= 30.454
  19:42:57 STEP  978 H= 244:30 +CPU= 30.536
  19:43:28 STEP  979 H= 244:45 +CPU= 30.452
  19:43:59 STEP  980 H= 245:00 +CPU= 31.177
  19:44:32 STEP  981 H= 245:15 +CPU= 32.485
  19:45:03 STEP  982 H= 245:30 +CPU= 31.147
  19:45:33 STEP  983 H= 245:45 +CPU= 30.335
  19:46:11 STEP  984 H= 246:00 +CPU= 37.694
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000984
  19:46:42 STEP  985 H= 246:15 +CPU= 30.079
  19:47:13 STEP  986 H= 246:30 +CPU= 31.122
  19:47:44 STEP  987 H= 246:45 +CPU= 30.489
  19:48:17 STEP  988 H= 247:00 +CPU= 32.248
  19:48:47 STEP  989 H= 247:15 +CPU= 30.177
  19:49:17 STEP  990 H= 247:30 +CPU= 30.187
  19:49:47 STEP  991 H= 247:45 +CPU= 29.756
  19:50:18 STEP  992 H= 248:00 +CPU= 30.581
  19:50:48 STEP  993 H= 248:15 +CPU= 30.073
  19:51:19 STEP  994 H= 248:30 +CPU= 30.905
  19:51:51 STEP  995 H= 248:45 +CPU= 31.787
  19:52:28 STEP  996 H= 249:00 +CPU= 37.014
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000996
  19:52:58 STEP  997 H= 249:15 +CPU= 29.602
  19:53:27 STEP  998 H= 249:30 +CPU= 29.648
  19:53:57 STEP  999 H= 249:45 +CPU= 29.632
  19:54:28 STEP 1000 H= 250:00 +CPU= 31.175
  19:54:58 STEP 1001 H= 250:15 +CPU= 29.872
  19:55:29 STEP 1002 H= 250:30 +CPU= 30.431
  19:56:01 STEP 1003 H= 250:45 +CPU= 32.354
  19:56:32 STEP 1004 H= 251:00 +CPU= 30.694
  19:57:02 STEP 1005 H= 251:15 +CPU= 30.301
  19:57:32 STEP 1006 H= 251:30 +CPU= 30.075
  19:58:03 STEP 1007 H= 251:45 +CPU= 30.430
  19:58:46 STEP 1008 H= 252:00 +CPU= 42.015
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001008
  19:59:16 STEP 1009 H= 252:15 +CPU= 30.176
  19:59:46 STEP 1010 H= 252:30 +CPU= 30.229
  20:00:16 STEP 1011 H= 252:45 +CPU= 29.795
  20:00:47 STEP 1012 H= 253:00 +CPU= 30.709
  20:01:17 STEP 1013 H= 253:15 +CPU= 30.477
  20:01:48 STEP 1014 H= 253:30 +CPU= 30.471
  20:02:18 STEP 1015 H= 253:45 +CPU= 30.159
  20:02:49 STEP 1016 H= 254:00 +CPU= 30.777
  20:03:20 STEP 1017 H= 254:15 +CPU= 30.342
  20:03:50 STEP 1018 H= 254:30 +CPU= 30.419
  20:04:20 STEP 1019 H= 254:45 +CPU= 30.152
  20:04:58 STEP 1020 H= 255:00 +CPU= 37.578
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001020
  20:05:29 STEP 1021 H= 255:15 +CPU= 30.104
  20:06:00 STEP 1022 H= 255:30 +CPU= 31.444
  20:06:30 STEP 1023 H= 255:45 +CPU= 29.805
  20:07:01 STEP 1024 H= 256:00 +CPU= 30.483
  20:07:31 STEP 1025 H= 256:15 +CPU= 29.950
  20:08:00 STEP 1026 H= 256:30 +CPU= 29.754
  20:08:30 STEP 1027 H= 256:45 +CPU= 29.898
  20:09:02 STEP 1028 H= 257:00 +CPU= 31.424
  20:09:32 STEP 1029 H= 257:15 +CPU= 30.373
  20:10:03 STEP 1030 H= 257:30 +CPU= 30.421
  20:10:33 STEP 1031 H= 257:45 +CPU= 30.305
  20:11:11 STEP 1032 H= 258:00 +CPU= 37.889
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001032
  20:11:41 STEP 1033 H= 258:15 +CPU= 30.119
  20:12:11 STEP 1034 H= 258:30 +CPU= 29.959
  20:12:41 STEP 1035 H= 258:45 +CPU= 30.049
  20:13:12 STEP 1036 H= 259:00 +CPU= 30.561
  20:13:42 STEP 1037 H= 259:15 +CPU= 29.912
  20:14:10 STEP 1038 H= 259:30 +CPU= 28.272
  20:14:40 STEP 1039 H= 259:45 +CPU= 29.573
  20:15:11 STEP 1040 H= 260:00 +CPU= 31.173
  20:15:41 STEP 1041 H= 260:15 +CPU= 30.435
  20:16:11 STEP 1042 H= 260:30 +CPU= 29.617
  20:16:42 STEP 1043 H= 260:45 +CPU= 30.658
  20:17:19 STEP 1044 H= 261:00 +CPU= 37.332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001044
  20:17:49 STEP 1045 H= 261:15 +CPU= 29.898
  20:18:19 STEP 1046 H= 261:30 +CPU= 29.893
  20:18:49 STEP 1047 H= 261:45 +CPU= 30.176
  20:19:19 STEP 1048 H= 262:00 +CPU= 30.003
  20:19:49 STEP 1049 H= 262:15 +CPU= 29.849
  20:20:19 STEP 1050 H= 262:30 +CPU= 29.909
  20:20:49 STEP 1051 H= 262:45 +CPU= 30.370
  20:21:21 STEP 1052 H= 263:00 +CPU= 32.096
  20:21:52 STEP 1053 H= 263:15 +CPU= 30.355
  20:22:22 STEP 1054 H= 263:30 +CPU= 29.945
  20:22:52 STEP 1055 H= 263:45 +CPU= 30.556
  20:23:35 STEP 1056 H= 264:00 +CPU= 42.827
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_10.zip
Uploading the intermediate file: upload_file_10.zip
  20:24:06 STEP 1057 H= 264:15 +CPU= 30.882
  20:24:38 STEP 1058 H= 264:30 +CPU= 31.695
  20:25:09 STEP 1059 H= 264:45 +CPU= 31.230
  20:25:43 STEP 1060 H= 265:00 +CPU= 33.064
  20:26:14 STEP 1061 H= 265:15 +CPU= 31.036
  20:26:45 STEP 1062 H= 265:30 +CPU= 31.458
  20:27:17 STEP 1063 H= 265:45 +CPU= 31.474
  20:27:49 STEP 1064 H= 266:00 +CPU= 32.329
  20:28:21 STEP 1065 H= 266:15 +CPU= 31.553
  20:28:53 STEP 1066 H= 266:30 +CPU= 32.069
  20:29:24 STEP 1067 H= 266:45 +CPU= 31.267
  20:30:03 STEP 1068 H= 267:00 +CPU= 38.627
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001068
  20:30:34 STEP 1069 H= 267:15 +CPU= 31.262
  20:31:05 STEP 1070 H= 267:30 +CPU= 31.068
  20:31:37 STEP 1071 H= 267:45 +CPU= 31.136
  20:32:09 STEP 1072 H= 268:00 +CPU= 31.834
  20:32:39 STEP 1073 H= 268:15 +CPU= 30.743
  20:33:10 STEP 1074 H= 268:30 +CPU= 30.988
  20:33:41 STEP 1075 H= 268:45 +CPU= 31.017
  20:34:15 STEP 1076 H= 269:00 +CPU= 33.956
  20:34:47 STEP 1077 H= 269:15 +CPU= 31.359
  20:35:19 STEP 1078 H= 269:30 +CPU= 31.871
  20:35:50 STEP 1079 H= 269:45 +CPU= 31.321
  20:36:30 STEP 1080 H= 270:00 +CPU= 39.547
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001080
  20:37:03 STEP 1081 H= 270:15 +CPU= 32.578
  20:37:34 STEP 1082 H= 270:30 +CPU= 31.091
  20:38:06 STEP 1083 H= 270:45 +CPU= 32.237
  20:38:38 STEP 1084 H= 271:00 +CPU= 31.987
  20:39:10 STEP 1085 H= 271:15 +CPU= 31.608
  20:39:43 STEP 1086 H= 271:30 +CPU= 32.696
  20:40:14 STEP 1087 H= 271:45 +CPU= 30.996
  20:40:47 STEP 1088 H= 272:00 +CPU= 32.586
  20:41:18 STEP 1089 H= 272:15 +CPU= 30.971
  20:41:49 STEP 1090 H= 272:30 +CPU= 30.927
  20:42:20 STEP 1091 H= 272:45 +CPU= 31.041
  20:42:59 STEP 1092 H= 273:00 +CPU= 39.162
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001092
  20:43:33 STEP 1093 H= 273:15 +CPU= 33.446
  20:44:04 STEP 1094 H= 273:30 +CPU= 31.250
  20:44:36 STEP 1095 H= 273:45 +CPU= 31.569
  20:45:08 STEP 1096 H= 274:00 +CPU= 32.531
  20:45:40 STEP 1097 H= 274:15 +CPU= 31.557
  20:46:12 STEP 1098 H= 274:30 +CPU= 31.684
  20:46:43 STEP 1099 H= 274:45 +CPU= 31.381
  20:47:15 STEP 1100 H= 275:00 +CPU= 31.633
  20:47:46 STEP 1101 H= 275:15 +CPU= 31.119
  20:48:17 STEP 1102 H= 275:30 +CPU= 31.099
  20:48:51 STEP 1103 H= 275:45 +CPU= 33.440
  20:49:36 STEP 1104 H= 276:00 +CPU= 44.964
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001104
  20:50:07 STEP 1105 H= 276:15 +CPU= 31.021
  20:50:39 STEP 1106 H= 276:30 +CPU= 31.957
  20:51:10 STEP 1107 H= 276:45 +CPU= 31.072
  20:51:42 STEP 1108 H= 277:00 +CPU= 32.404
  20:52:14 STEP 1109 H= 277:15 +CPU= 31.434
  20:52:46 STEP 1110 H= 277:30 +CPU= 31.697
  20:53:18 STEP 1111 H= 277:45 +CPU= 32.533
  20:53:51 STEP 1112 H= 278:00 +CPU= 32.661
  20:54:22 STEP 1113 H= 278:15 +CPU= 30.793
  20:54:53 STEP 1114 H= 278:30 +CPU= 30.647
  20:55:23 STEP 1115 H= 278:45 +CPU= 29.855
  20:56:01 STEP 1116 H= 279:00 +CPU= 37.648
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001116
  20:56:31 STEP 1117 H= 279:15 +CPU= 30.028
  20:57:01 STEP 1118 H= 279:30 +CPU= 29.821
  20:57:30 STEP 1119 H= 279:45 +CPU= 29.397
  20:58:01 STEP 1120 H= 280:00 +CPU= 30.976
  20:58:32 STEP 1121 H= 280:15 +CPU= 30.246
  20:59:02 STEP 1122 H= 280:30 +CPU= 30.196
  20:59:32 STEP 1123 H= 280:45 +CPU= 30.047
  21:00:03 STEP 1124 H= 281:00 +CPU= 30.951
  21:00:34 STEP 1125 H= 281:15 +CPU= 30.792
  21:01:05 STEP 1126 H= 281:30 +CPU= 30.634
  21:01:36 STEP 1127 H= 281:45 +CPU= 30.784
  21:02:14 STEP 1128 H= 282:00 +CPU= 38.128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001128
  21:02:44 STEP 1129 H= 282:15 +CPU= 30.530
  21:03:15 STEP 1130 H= 282:30 +CPU= 30.404
  21:03:45 STEP 1131 H= 282:45 +CPU= 30.366
  21:04:16 STEP 1132 H= 283:00 +CPU= 30.924
  21:04:46 STEP 1133 H= 283:15 +CPU= 30.260
  21:05:17 STEP 1134 H= 283:30 +CPU= 30.429
  21:05:48 STEP 1135 H= 283:45 +CPU= 30.847
  21:06:19 STEP 1136 H= 284:00 +CPU= 31.228
  21:06:49 STEP 1137 H= 284:15 +CPU= 30.332
  21:07:20 STEP 1138 H= 284:30 +CPU= 30.379
  21:07:51 STEP 1139 H= 284:45 +CPU= 30.598
  21:08:29 STEP 1140 H= 285:00 +CPU= 38.345
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001140
  21:09:00 STEP 1141 H= 285:15 +CPU= 30.884
  21:09:32 STEP 1142 H= 285:30 +CPU= 31.861
  21:10:02 STEP 1143 H= 285:45 +CPU= 30.610
  21:10:34 STEP 1144 H= 286:00 +CPU= 31.462
  21:11:05 STEP 1145 H= 286:15 +CPU= 31.110
  21:11:35 STEP 1146 H= 286:30 +CPU= 29.930
  21:12:06 STEP 1147 H= 286:45 +CPU= 30.613
  21:12:37 STEP 1148 H= 287:00 +CPU= 31.125
  21:13:07 STEP 1149 H= 287:15 +CPU= 29.877
  21:13:37 STEP 1150 H= 287:30 +CPU= 29.898
  21:14:07 STEP 1151 H= 287:45 +CPU= 30.008
  21:14:50 STEP 1152 H= 288:00 +CPU= 42.853
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_11.zip
Uploading the intermediate file: upload_file_11.zip
  21:15:22 STEP 1153 H= 288:15 +CPU= 32.425
  21:15:53 STEP 1154 H= 288:30 +CPU= 30.469
  21:16:23 STEP 1155 H= 288:45 +CPU= 30.232
  21:16:54 STEP 1156 H= 289:00 +CPU= 30.787
  21:17:25 STEP 1157 H= 289:15 +CPU= 30.438
  21:17:56 STEP 1158 H= 289:30 +CPU= 30.685
  21:18:28 STEP 1159 H= 289:45 +CPU= 32.503
  21:19:00 STEP 1160 H= 290:00 +CPU= 31.283
  21:19:30 STEP 1161 H= 290:15 +CPU= 30.342
  21:20:02 STEP 1162 H= 290:30 +CPU= 31.296
  21:20:33 STEP 1163 H= 290:45 +CPU= 31.179
  21:21:12 STEP 1164 H= 291:00 +CPU= 38.601
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001164
  21:21:43 STEP 1165 H= 291:15 +CPU= 30.923
  21:22:13 STEP 1166 H= 291:30 +CPU= 30.333
  21:22:44 STEP 1167 H= 291:45 +CPU= 30.394
  21:23:15 STEP 1168 H= 292:00 +CPU= 31.065
  21:23:45 STEP 1169 H= 292:15 +CPU= 30.184
  21:24:15 STEP 1170 H= 292:30 +CPU= 30.432
  21:24:46 STEP 1171 H= 292:45 +CPU= 30.245
  21:25:17 STEP 1172 H= 293:00 +CPU= 30.702
  21:25:47 STEP 1173 H= 293:15 +CPU= 30.034
  21:26:17 STEP 1174 H= 293:30 +CPU= 30.104
  21:26:47 STEP 1175 H= 293:45 +CPU= 30.210
  21:27:25 STEP 1176 H= 294:00 +CPU= 37.903
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001176
  21:27:55 STEP 1177 H= 294:15 +CPU= 30.137
  21:28:26 STEP 1178 H= 294:30 +CPU= 30.480
  21:28:56 STEP 1179 H= 294:45 +CPU= 30.510
  21:29:27 STEP 1180 H= 295:00 +CPU= 30.793
  21:29:57 STEP 1181 H= 295:15 +CPU= 29.972
  21:30:27 STEP 1182 H= 295:30 +CPU= 30.253
  21:30:58 STEP 1183 H= 295:45 +CPU= 30.371
  21:31:29 STEP 1184 H= 296:00 +CPU= 31.708
  21:32:00 STEP 1185 H= 296:15 +CPU= 30.083
  21:32:31 STEP 1186 H= 296:30 +CPU= 31.549
  21:33:01 STEP 1187 H= 296:45 +CPU= 29.863
  21:33:39 STEP 1188 H= 297:00 +CPU= 37.486
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001188
  21:34:08 STEP 1189 H= 297:15 +CPU= 29.628
  21:34:37 STEP 1190 H= 297:30 +CPU= 28.973
  21:35:07 STEP 1191 H= 297:45 +CPU= 29.942
  21:35:38 STEP 1192 H= 298:00 +CPU= 31.024
  21:36:09 STEP 1193 H= 298:15 +CPU= 30.726
  21:36:39 STEP 1194 H= 298:30 +CPU= 30.065
  21:37:09 STEP 1195 H= 298:45 +CPU= 30.098
  21:37:40 STEP 1196 H= 299:00 +CPU= 30.543
  21:38:10 STEP 1197 H= 299:15 +CPU= 29.847
  21:38:40 STEP 1198 H= 299:30 +CPU= 29.643
  21:39:10 STEP 1199 H= 299:45 +CPU= 29.881
  21:39:53 STEP 1200 H= 300:00 +CPU= 42.717
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001200
  21:40:23 STEP 1201 H= 300:15 +CPU= 30.600
  21:40:55 STEP 1202 H= 300:30 +CPU= 30.968
  21:41:27 STEP 1203 H= 300:45 +CPU= 32.020
  21:41:58 STEP 1204 H= 301:00 +CPU= 31.449
  21:42:29 STEP 1205 H= 301:15 +CPU= 30.544
  21:42:59 STEP 1206 H= 301:30 +CPU= 30.581
  21:43:30 STEP 1207 H= 301:45 +CPU= 30.904
  21:44:02 STEP 1208 H= 302:00 +CPU= 31.341
  21:44:32 STEP 1209 H= 302:15 +CPU= 29.883
  21:45:02 STEP 1210 H= 302:30 +CPU= 30.071
  21:45:32 STEP 1211 H= 302:45 +CPU= 29.978
  21:46:09 STEP 1212 H= 303:00 +CPU= 37.076
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001212
  21:46:38 STEP 1213 H= 303:15 +CPU= 29.180
  21:47:07 STEP 1214 H= 303:30 +CPU= 28.882
  21:47:36 STEP 1215 H= 303:45 +CPU= 28.828
  21:48:06 STEP 1216 H= 304:00 +CPU= 29.768
  21:48:36 STEP 1217 H= 304:15 +CPU= 29.691
  21:49:06 STEP 1218 H= 304:30 +CPU= 30.022
  21:49:36 STEP 1219 H= 304:45 +CPU= 29.409
  21:50:06 STEP 1220 H= 305:00 +CPU= 30.352
  21:50:36 STEP 1221 H= 305:15 +CPU= 29.670
  21:51:07 STEP 1222 H= 305:30 +CPU= 30.421
  21:51:36 STEP 1223 H= 305:45 +CPU= 29.272
  21:52:12 STEP 1224 H= 306:00 +CPU= 36.298
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001224
  21:52:42 STEP 1225 H= 306:15 +CPU= 29.748
  21:53:11 STEP 1226 H= 306:30 +CPU= 29.398
  21:53:40 STEP 1227 H= 306:45 +CPU= 28.817
  21:54:10 STEP 1228 H= 307:00 +CPU= 29.466
  21:54:39 STEP 1229 H= 307:15 +CPU= 29.043
  21:55:08 STEP 1230 H= 307:30 +CPU= 29.352
  21:55:38 STEP 1231 H= 307:45 +CPU= 29.475
  21:56:08 STEP 1232 H= 308:00 +CPU= 29.998
  21:56:37 STEP 1233 H= 308:15 +CPU= 29.390
  21:57:07 STEP 1234 H= 308:30 +CPU= 29.213
  21:57:36 STEP 1235 H= 308:45 +CPU= 28.880
  21:58:12 STEP 1236 H= 309:00 +CPU= 36.169
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001236
  21:58:41 STEP 1237 H= 309:15 +CPU= 28.988
  21:59:10 STEP 1238 H= 309:30 +CPU= 28.796
  21:59:39 STEP 1239 H= 309:45 +CPU= 28.911
  22:00:09 STEP 1240 H= 310:00 +CPU= 29.667
  22:00:38 STEP 1241 H= 310:15 +CPU= 29.021
  22:01:07 STEP 1242 H= 310:30 +CPU= 28.941
  22:01:36 STEP 1243 H= 310:45 +CPU= 29.002
  22:02:06 STEP 1244 H= 311:00 +CPU= 29.774
  22:02:36 STEP 1245 H= 311:15 +CPU= 29.944
  22:03:05 STEP 1246 H= 311:30 +CPU= 29.093
  22:03:34 STEP 1247 H= 311:45 +CPU= 28.885
  22:04:15 STEP 1248 H= 312:00 +CPU= 40.890
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_12.zip
Uploading the intermediate file: upload_file_12.zip
  22:04:44 STEP 1249 H= 312:15 +CPU= 29.222
  22:05:13 STEP 1250 H= 312:30 +CPU= 29.025
  22:05:43 STEP 1251 H= 312:45 +CPU= 29.975
  22:06:13 STEP 1252 H= 313:00 +CPU= 29.792
  22:06:42 STEP 1253 H= 313:15 +CPU= 29.093
  22:07:11 STEP 1254 H= 313:30 +CPU= 29.182
  22:07:41 STEP 1255 H= 313:45 +CPU= 29.251
  22:08:10 STEP 1256 H= 314:00 +CPU= 29.617
  22:08:39 STEP 1257 H= 314:15 +CPU= 28.853
  22:09:08 STEP 1258 H= 314:30 +CPU= 28.930
  22:09:37 STEP 1259 H= 314:45 +CPU= 29.026
  22:10:13 STEP 1260 H= 315:00 +CPU= 36.155
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001260
  22:10:42 STEP 1261 H= 315:15 +CPU= 28.786
  22:11:11 STEP 1262 H= 315:30 +CPU= 28.988
  22:11:40 STEP 1263 H= 315:45 +CPU= 28.910
  22:12:10 STEP 1264 H= 316:00 +CPU= 29.579
  22:12:39 STEP 1265 H= 316:15 +CPU= 28.816
  22:13:08 STEP 1266 H= 316:30 +CPU= 28.871
  22:13:37 STEP 1267 H= 316:45 +CPU= 28.879
  22:14:07 STEP 1268 H= 317:00 +CPU= 30.198
  22:14:37 STEP 1269 H= 317:15 +CPU= 29.691
  22:15:06 STEP 1270 H= 317:30 +CPU= 29.494
  22:15:37 STEP 1271 H= 317:45 +CPU= 30.599
  22:16:14 STEP 1272 H= 318:00 +CPU= 36.958
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001272
  22:16:44 STEP 1273 H= 318:15 +CPU= 29.789
  22:17:14 STEP 1274 H= 318:30 +CPU= 29.798
  22:17:43 STEP 1275 H= 318:45 +CPU= 29.417
  22:18:14 STEP 1276 H= 319:00 +CPU= 30.495
  22:18:43 STEP 1277 H= 319:15 +CPU= 29.148
  22:19:12 STEP 1278 H= 319:30 +CPU= 29.101
  22:19:42 STEP 1279 H= 319:45 +CPU= 29.321
  22:20:12 STEP 1280 H= 320:00 +CPU= 29.819
  22:20:41 STEP 1281 H= 320:15 +CPU= 28.864
  22:21:10 STEP 1282 H= 320:30 +CPU= 29.292
  22:21:37 STEP 1283 H= 320:45 +CPU= 27.482
  22:22:13 STEP 1284 H= 321:00 +CPU= 35.947
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001284
  22:22:42 STEP 1285 H= 321:15 +CPU= 28.219
  22:23:10 STEP 1286 H= 321:30 +CPU= 28.497
  22:23:38 STEP 1287 H= 321:45 +CPU= 28.232
  22:24:08 STEP 1288 H= 322:00 +CPU= 29.552
  22:24:36 STEP 1289 H= 322:15 +CPU= 27.815
  22:25:05 STEP 1290 H= 322:30 +CPU= 28.997
  22:25:34 STEP 1291 H= 322:45 +CPU= 28.860
  22:26:03 STEP 1292 H= 323:00 +CPU= 29.331
  22:26:32 STEP 1293 H= 323:15 +CPU= 28.678
  22:27:01 STEP 1294 H= 323:30 +CPU= 29.179
  22:27:30 STEP 1295 H= 323:45 +CPU= 28.930
  22:28:10 STEP 1296 H= 324:00 +CPU= 40.356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001296
  22:28:38 STEP 1297 H= 324:15 +CPU= 27.677
  22:29:07 STEP 1298 H= 324:30 +CPU= 29.137
  22:29:37 STEP 1299 H= 324:45 +CPU= 29.536
  22:30:09 STEP 1300 H= 325:00 +CPU= 32.102
  22:30:39 STEP 1301 H= 325:15 +CPU= 29.580
  22:31:08 STEP 1302 H= 325:30 +CPU= 29.378
  22:31:38 STEP 1303 H= 325:45 +CPU= 29.575
  22:32:08 STEP 1304 H= 326:00 +CPU= 30.054
  22:32:37 STEP 1305 H= 326:15 +CPU= 29.099
  22:33:06 STEP 1306 H= 326:30 +CPU= 29.629
  22:33:36 STEP 1307 H= 326:45 +CPU= 29.062
  22:34:12 STEP 1308 H= 327:00 +CPU= 36.450
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001308
  22:34:42 STEP 1309 H= 327:15 +CPU= 29.260
  22:35:11 STEP 1310 H= 327:30 +CPU= 29.315
  22:35:40 STEP 1311 H= 327:45 +CPU= 29.207
  22:36:10 STEP 1312 H= 328:00 +CPU= 29.879
  22:36:40 STEP 1313 H= 328:15 +CPU= 29.675
  22:37:10 STEP 1314 H= 328:30 +CPU= 29.522
  22:37:39 STEP 1315 H= 328:45 +CPU= 29.743
  22:38:10 STEP 1316 H= 329:00 +CPU= 30.304
  22:38:40 STEP 1317 H= 329:15 +CPU= 29.896
  22:39:10 STEP 1318 H= 329:30 +CPU= 29.915
  22:39:39 STEP 1319 H= 329:45 +CPU= 29.426
  22:40:16 STEP 1320 H= 330:00 +CPU= 36.753
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001320
  22:40:46 STEP 1321 H= 330:15 +CPU= 29.578
  22:41:15 STEP 1322 H= 330:30 +CPU= 28.888
  22:41:43 STEP 1323 H= 330:45 +CPU= 28.384
  22:42:12 STEP 1324 H= 331:00 +CPU= 28.789
  22:42:40 STEP 1325 H= 331:15 +CPU= 28.572
  22:43:08 STEP 1326 H= 331:30 +CPU= 27.648
  22:43:34 STEP 1327 H= 331:45 +CPU= 26.481
  22:44:03 STEP 1328 H= 332:00 +CPU= 28.519
  22:44:30 STEP 1329 H= 332:15 +CPU= 27.100
  22:44:57 STEP 1330 H= 332:30 +CPU= 27.298
  22:45:25 STEP 1331 H= 332:45 +CPU= 27.818
  22:46:01 STEP 1332 H= 333:00 +CPU= 35.390
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001332
  22:46:29 STEP 1333 H= 333:15 +CPU= 28.312
  22:46:58 STEP 1334 H= 333:30 +CPU= 28.204
  22:47:26 STEP 1335 H= 333:45 +CPU= 28.326
  22:47:55 STEP 1336 H= 334:00 +CPU= 28.777
  22:48:23 STEP 1337 H= 334:15 +CPU= 28.205
  22:48:51 STEP 1338 H= 334:30 +CPU= 28.266
  22:49:19 STEP 1339 H= 334:45 +CPU= 28.183
  22:49:49 STEP 1340 H= 335:00 +CPU= 29.679
  22:50:18 STEP 1341 H= 335:15 +CPU= 28.919
  22:50:47 STEP 1342 H= 335:30 +CPU= 28.808
  22:51:16 STEP 1343 H= 335:45 +CPU= 28.644
  22:51:55 STEP 1344 H= 336:00 +CPU= 39.739
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_13.zip
Uploading the intermediate file: upload_file_13.zip
  22:52:25 STEP 1345 H= 336:15 +CPU= 28.786
  22:52:53 STEP 1346 H= 336:30 +CPU= 28.504
  22:53:22 STEP 1347 H= 336:45 +CPU= 28.661
  22:53:52 STEP 1348 H= 337:00 +CPU= 29.678
  22:54:21 STEP 1349 H= 337:15 +CPU= 29.061
  22:54:50 STEP 1350 H= 337:30 +CPU= 29.079
  22:55:19 STEP 1351 H= 337:45 +CPU= 29.090
  22:55:49 STEP 1352 H= 338:00 +CPU= 29.357
  22:56:17 STEP 1353 H= 338:15 +CPU= 28.557
  22:56:46 STEP 1354 H= 338:30 +CPU= 28.784
  22:57:15 STEP 1355 H= 338:45 +CPU= 28.450
  22:57:50 STEP 1356 H= 339:00 +CPU= 35.434
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001356
  22:58:19 STEP 1357 H= 339:15 +CPU= 28.428
  22:58:47 STEP 1358 H= 339:30 +CPU= 28.489
  22:59:15 STEP 1359 H= 339:45 +CPU= 28.210
  22:59:45 STEP 1360 H= 340:00 +CPU= 29.077
  23:00:14 STEP 1361 H= 340:15 +CPU= 28.987
  23:00:43 STEP 1362 H= 340:30 +CPU= 28.902
  23:01:11 STEP 1363 H= 340:45 +CPU= 28.822
  23:01:41 STEP 1364 H= 341:00 +CPU= 29.429
  23:02:10 STEP 1365 H= 341:15 +CPU= 28.649
  23:02:38 STEP 1366 H= 341:30 +CPU= 28.501
  23:03:07 STEP 1367 H= 341:45 +CPU= 28.634
  23:03:43 STEP 1368 H= 342:00 +CPU= 35.627
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001368
  23:04:11 STEP 1369 H= 342:15 +CPU= 28.581
  23:04:40 STEP 1370 H= 342:30 +CPU= 28.454
  23:05:08 STEP 1371 H= 342:45 +CPU= 28.295
  23:05:37 STEP 1372 H= 343:00 +CPU= 28.797
  23:06:06 STEP 1373 H= 343:15 +CPU= 28.481
  23:06:34 STEP 1374 H= 343:30 +CPU= 28.799
  23:07:03 STEP 1375 H= 343:45 +CPU= 28.877
  23:07:33 STEP 1376 H= 344:00 +CPU= 29.514
  23:08:02 STEP 1377 H= 344:15 +CPU= 28.834
  23:08:31 STEP 1378 H= 344:30 +CPU= 28.746
  23:08:59 STEP 1379 H= 344:45 +CPU= 28.513
  23:09:35 STEP 1380 H= 345:00 +CPU= 35.800
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001380
  23:10:04 STEP 1381 H= 345:15 +CPU= 28.529
  23:10:32 STEP 1382 H= 345:30 +CPU= 28.627
  23:11:01 STEP 1383 H= 345:45 +CPU= 28.608
  23:11:30 STEP 1384 H= 346:00 +CPU= 29.227
  23:11:59 STEP 1385 H= 346:15 +CPU= 28.628
  23:12:27 STEP 1386 H= 346:30 +CPU= 28.556
  23:12:56 STEP 1387 H= 346:45 +CPU= 28.528
  23:13:25 STEP 1388 H= 347:00 +CPU= 29.144
  23:13:53 STEP 1389 H= 347:15 +CPU= 28.286
  23:14:22 STEP 1390 H= 347:30 +CPU= 28.495
  23:14:50 STEP 1391 H= 347:45 +CPU= 28.341
  23:15:31 STEP 1392 H= 348:00 +CPU= 40.298
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001392
  23:16:00 STEP 1393 H= 348:15 +CPU= 28.824
  23:16:29 STEP 1394 H= 348:30 +CPU= 28.800
  23:16:57 STEP 1395 H= 348:45 +CPU= 28.798
  23:17:27 STEP 1396 H= 349:00 +CPU= 29.435
  23:17:56 STEP 1397 H= 349:15 +CPU= 28.681
  23:18:24 STEP 1398 H= 349:30 +CPU= 28.594
  23:18:53 STEP 1399 H= 349:45 +CPU= 28.417
  23:19:22 STEP 1400 H= 350:00 +CPU= 28.932
  23:19:50 STEP 1401 H= 350:15 +CPU= 28.551
  23:20:19 STEP 1402 H= 350:30 +CPU= 28.417
  23:20:47 STEP 1403 H= 350:45 +CPU= 28.371
  23:21:23 STEP 1404 H= 351:00 +CPU= 36.259
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001404
  23:21:52 STEP 1405 H= 351:15 +CPU= 28.433
  23:22:20 STEP 1406 H= 351:30 +CPU= 28.347
  23:22:49 STEP 1407 H= 351:45 +CPU= 28.566
  23:23:18 STEP 1408 H= 352:00 +CPU= 29.169
  23:23:47 STEP 1409 H= 352:15 +CPU= 28.599
  23:24:15 STEP 1410 H= 352:30 +CPU= 28.400
  23:24:43 STEP 1411 H= 352:45 +CPU= 28.351
  23:25:13 STEP 1412 H= 353:00 +CPU= 29.088
  23:25:41 STEP 1413 H= 353:15 +CPU= 28.581
  23:26:09 STEP 1414 H= 353:30 +CPU= 28.230
  23:26:38 STEP 1415 H= 353:45 +CPU= 28.151
  23:27:13 STEP 1416 H= 354:00 +CPU= 35.390
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001416
  23:27:42 STEP 1417 H= 354:15 +CPU= 28.459
  23:28:11 STEP 1418 H= 354:30 +CPU= 29.769
  23:28:41 STEP 1419 H= 354:45 +CPU= 29.061
  23:29:09 STEP 1420 H= 355:00 +CPU= 28.619
  23:29:37 STEP 1421 H= 355:15 +CPU= 28.012
  23:30:05 STEP 1422 H= 355:30 +CPU= 27.794
  23:30:33 STEP 1423 H= 355:45 +CPU= 27.518
  23:31:01 STEP 1424 H= 356:00 +CPU= 28.156
  23:31:28 STEP 1425 H= 356:15 +CPU= 27.082
  23:31:56 STEP 1426 H= 356:30 +CPU= 27.593
  23:32:23 STEP 1427 H= 356:45 +CPU= 27.765
  23:32:58 STEP 1428 H= 357:00 +CPU= 34.859
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001428
  23:33:26 STEP 1429 H= 357:15 +CPU= 27.828
  23:33:54 STEP 1430 H= 357:30 +CPU= 27.772
  23:34:22 STEP 1431 H= 357:45 +CPU= 27.662
  23:34:51 STEP 1432 H= 358:00 +CPU= 28.843
  23:35:19 STEP 1433 H= 358:15 +CPU= 28.070
  23:35:47 STEP 1434 H= 358:30 +CPU= 28.010
  23:36:15 STEP 1435 H= 358:45 +CPU= 27.994
  23:36:44 STEP 1436 H= 359:00 +CPU= 28.350
  23:37:12 STEP 1437 H= 359:15 +CPU= 28.524
  23:37:41 STEP 1438 H= 359:30 +CPU= 28.397
  23:38:09 STEP 1439 H= 359:45 +CPU= 28.399
  23:38:46 STEP 1440 H= 360:00 +CPU= 37.112
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.3916553398E-21      I      -0.4706375078E-04      I
ICloud fractionI      0.0000000000E+00      I       0.1043674226E+00      I
I  Relat. Hum. I      0.5904259431E+00      I       0.5214573012E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1670521911E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313451652 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS522419.4 Mbytes/s, TOTAL TIME=    0.0130( 4.6%)
 23:38:46 STEP 1440 H= 360:00 +CPU= 37.112
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.619  26.619  26.630   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    89.9     0.0    89.8     0.0   193.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5170.7    5170.7     16.53      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     946.8     946.8      2.79      0.00
  10 SCAN2M - PHYSICS                             1441   16180.0   16180.0     47.72      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1022.0    1022.0      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      44.5      44.5      0.01      0.00
  14 SUINIF                                          1    7835.3    7835.3      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      33.6      33.6      0.01      0.00
  18 SUSPECG                                         1    4116.0    4116.0      0.01      0.00
  19 SUSPEC                                          1    4123.9    4123.9      0.01      0.00
  24 SUGRIDU                                         1    3251.7    3251.7      0.01      0.00
  25 SPECRT                                          1     320.7     320.7      0.00      0.00
  26 SUGRIDF                                         1     139.0     139.0      0.00      0.00
  27 RESTART FILES - WRITING                        30    4121.9    4121.9      0.25      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    7065.3    7065.3      1.75      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6734.3    6734.3     19.86      0.00
  39 SU0YOMB                                         1     454.3     454.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      29.9      29.9      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     399.8     399.8      1.18      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      84.2      84.2      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     627.6     627.6      4.01      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     348.0     348.0      2.14      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     126.0     126.0      0.78      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     173.0     173.0      1.11      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      46.0      46.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      70.0      70.0      0.45      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      35.2      35.2      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     112.7     112.7      0.72      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      61.9      61.9      0.38      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    48855.7 CPU TIME   48702.5 VECTOR TIME    48702.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       26.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/9/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/9/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284170/ICMUAh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
23:42:24 (1777719): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0_r1886104304_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 00:32:51 1538875 22435750 oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0 1,295,100 48,702 0.0376
08 Jun 2024 20:51:22 1538875 22435750 oifs_43r3_bl_a1t3_2016092300_20_1017_12284170_0 864,000 34,028 0.0394


©2024 cpdn.org