climateprediction.net home page
Task 22313087

Task 22313087

Name oifs_43r3_bl_a4na_2016092300_15_991_12212809_0
Workunit 12212809
Created 13 Feb 2023, 23:05:29 UTC
Sent 13 Feb 2023, 23:11:18 UTC
Report deadline 14 Apr 2023, 23:11:18 UTC
Received 18 Feb 2023, 10:51:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1522997
Run time 10 hours 43 min 27 sec
CPU time 10 hours 34 min 34 sec
Validate state Invalid
Credit 1,813.14
Device peak FLOPS 3.95 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,611.91 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,384.06 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
6:12:37 STEP  835 H= 208:45 +CPU= 25.810
  06:13:03 STEP  836 H= 209:00 +CPU= 26.343
  06:13:29 STEP  837 H= 209:15 +CPU= 25.845
  06:13:55 STEP  838 H= 209:30 +CPU= 25.824
  06:14:21 STEP  839 H= 209:45 +CPU= 25.971
  06:14:53 STEP  840 H= 210:00 +CPU= 31.993
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000840
  06:15:19 STEP  841 H= 210:15 +CPU= 25.853
  06:15:45 STEP  842 H= 210:30 +CPU= 26.093
  06:16:11 STEP  843 H= 210:45 +CPU= 26.016
  06:16:37 STEP  844 H= 211:00 +CPU= 26.510
  06:17:03 STEP  845 H= 211:15 +CPU= 25.973
  06:17:29 STEP  846 H= 211:30 +CPU= 26.088
  06:17:55 STEP  847 H= 211:45 +CPU= 25.968
  06:18:22 STEP  848 H= 212:00 +CPU= 26.557
  06:18:48 STEP  849 H= 212:15 +CPU= 25.626
  06:19:14 STEP  850 H= 212:30 +CPU= 25.956
  06:19:40 STEP  851 H= 212:45 +CPU= 26.149
  06:20:12 STEP  852 H= 213:00 +CPU= 32.142
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000852
  06:20:38 STEP  853 H= 213:15 +CPU= 25.959
  06:21:04 STEP  854 H= 213:30 +CPU= 25.939
  06:21:30 STEP  855 H= 213:45 +CPU= 25.930
  06:21:56 STEP  856 H= 214:00 +CPU= 26.767
  06:22:22 STEP  857 H= 214:15 +CPU= 26.064
  06:22:49 STEP  858 H= 214:30 +CPU= 26.086
  06:23:15 STEP  859 H= 214:45 +CPU= 25.973
  06:23:41 STEP  860 H= 215:00 +CPU= 26.603
  06:24:07 STEP  861 H= 215:15 +CPU= 26.020
  06:24:33 STEP  862 H= 215:30 +CPU= 25.980
  06:24:59 STEP  863 H= 215:45 +CPU= 26.048
  06:25:34 STEP  864 H= 216:00 +CPU= 34.972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_8.zip
Uploading the intermediate file: upload_file_8.zip
  06:26:00 STEP  865 H= 216:15 +CPU= 26.205
  06:26:26 STEP  866 H= 216:30 +CPU= 25.939
  06:26:53 STEP  867 H= 216:45 +CPU= 26.370
  06:27:20 STEP  868 H= 217:00 +CPU= 27.024
  06:27:46 STEP  869 H= 217:15 +CPU= 26.008
  06:28:12 STEP  870 H= 217:30 +CPU= 26.027
  06:28:38 STEP  871 H= 217:45 +CPU= 25.928
  06:29:04 STEP  872 H= 218:00 +CPU= 26.556
  06:29:30 STEP  873 H= 218:15 +CPU= 25.869
  06:29:56 STEP  874 H= 218:30 +CPU= 25.843
  06:30:22 STEP  875 H= 218:45 +CPU= 25.890
  06:30:54 STEP  876 H= 219:00 +CPU= 32.115
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000876
  06:31:20 STEP  877 H= 219:15 +CPU= 25.887
  06:31:46 STEP  878 H= 219:30 +CPU= 26.205
  06:32:12 STEP  879 H= 219:45 +CPU= 26.129
  06:32:39 STEP  880 H= 220:00 +CPU= 26.654
  06:33:05 STEP  881 H= 220:15 +CPU= 26.456
  06:33:32 STEP  882 H= 220:30 +CPU= 26.606
  06:33:58 STEP  883 H= 220:45 +CPU= 26.044
  06:34:25 STEP  884 H= 221:00 +CPU= 26.622
  06:34:51 STEP  885 H= 221:15 +CPU= 26.040
  06:35:17 STEP  886 H= 221:30 +CPU= 25.925
  06:35:43 STEP  887 H= 221:45 +CPU= 26.012
  06:36:15 STEP  888 H= 222:00 +CPU= 32.401
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000888
  06:36:41 STEP  889 H= 222:15 +CPU= 26.038
  06:37:07 STEP  890 H= 222:30 +CPU= 25.974
  06:37:33 STEP  891 H= 222:45 +CPU= 26.475
  06:38:00 STEP  892 H= 223:00 +CPU= 26.749
  06:38:26 STEP  893 H= 223:15 +CPU= 25.982
  06:38:52 STEP  894 H= 223:30 +CPU= 26.192
  06:39:18 STEP  895 H= 223:45 +CPU= 25.928
  06:39:45 STEP  896 H= 224:00 +CPU= 26.704
  06:40:11 STEP  897 H= 224:15 +CPU= 26.009
  06:40:37 STEP  898 H= 224:30 +CPU= 25.953
  06:41:03 STEP  899 H= 224:45 +CPU= 25.944
  06:41:35 STEP  900 H= 225:00 +CPU= 32.085
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000900
  06:42:01 STEP  901 H= 225:15 +CPU= 26.052
  06:42:27 STEP  902 H= 225:30 +CPU= 25.945
  06:42:53 STEP  903 H= 225:45 +CPU= 25.841
  06:43:19 STEP  904 H= 226:00 +CPU= 26.478
  06:43:45 STEP  905 H= 226:15 +CPU= 25.972
  06:44:11 STEP  906 H= 226:30 +CPU= 26.000
  06:44:37 STEP  907 H= 226:45 +CPU= 26.007
  06:45:04 STEP  908 H= 227:00 +CPU= 26.472
  06:45:30 STEP  909 H= 227:15 +CPU= 26.000
  06:45:56 STEP  910 H= 227:30 +CPU= 26.088
  06:46:22 STEP  911 H= 227:45 +CPU= 26.092
  06:46:57 STEP  912 H= 228:00 +CPU= 34.913
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000912
  06:47:23 STEP  913 H= 228:15 +CPU= 26.248
  06:47:50 STEP  914 H= 228:30 +CPU= 26.618
  06:48:16 STEP  915 H= 228:45 +CPU= 26.336
  06:48:43 STEP  916 H= 229:00 +CPU= 26.826
  06:49:09 STEP  917 H= 229:15 +CPU= 26.437
  06:49:35 STEP  918 H= 229:30 +CPU= 26.112
  06:50:02 STEP  919 H= 229:45 +CPU= 26.164
  06:50:28 STEP  920 H= 230:00 +CPU= 26.766
  06:50:54 STEP  921 H= 230:15 +CPU= 26.127
  06:51:21 STEP  922 H= 230:30 +CPU= 26.644
  06:51:48 STEP  923 H= 230:45 +CPU= 26.463
  06:52:20 STEP  924 H= 231:00 +CPU= 32.254
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000924
  06:52:46 STEP  925 H= 231:15 +CPU= 26.600
  06:53:13 STEP  926 H= 231:30 +CPU= 26.748
  06:53:39 STEP  927 H= 231:45 +CPU= 26.059
  06:54:06 STEP  928 H= 232:00 +CPU= 26.644
  06:54:32 STEP  929 H= 232:15 +CPU= 26.057
  06:54:58 STEP  930 H= 232:30 +CPU= 26.191
  06:55:24 STEP  931 H= 232:45 +CPU= 26.026
  06:55:51 STEP  932 H= 233:00 +CPU= 26.698
  06:56:17 STEP  933 H= 233:15 +CPU= 26.155
  06:56:43 STEP  934 H= 233:30 +CPU= 26.107
  06:57:09 STEP  935 H= 233:45 +CPU= 25.946
  06:57:41 STEP  936 H= 234:00 +CPU= 32.216
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000936
  06:58:08 STEP  937 H= 234:15 +CPU= 26.249
  06:58:34 STEP  938 H= 234:30 +CPU= 26.116
  06:59:00 STEP  939 H= 234:45 +CPU= 26.257
  06:59:26 STEP  940 H= 235:00 +CPU= 26.546
  06:59:53 STEP  941 H= 235:15 +CPU= 26.071
  07:00:18 STEP  942 H= 235:30 +CPU= 25.897
  07:00:44 STEP  943 H= 235:45 +CPU= 26.015
  07:01:11 STEP  944 H= 236:00 +CPU= 26.608
  07:01:37 STEP  945 H= 236:15 +CPU= 26.047
  07:02:03 STEP  946 H= 236:30 +CPU= 26.082
  07:02:29 STEP  947 H= 236:45 +CPU= 26.088
  07:03:01 STEP  948 H= 237:00 +CPU= 32.083
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000948
  07:03:28 STEP  949 H= 237:15 +CPU= 26.318
  07:03:54 STEP  950 H= 237:30 +CPU= 25.952
  07:04:20 STEP  951 H= 237:45 +CPU= 26.068
  07:04:46 STEP  952 H= 238:00 +CPU= 26.529
  07:05:12 STEP  953 H= 238:15 +CPU= 26.052
  07:05:38 STEP  954 H= 238:30 +CPU= 26.232
  07:06:05 STEP  955 H= 238:45 +CPU= 26.074
  07:06:31 STEP  956 H= 239:00 +CPU= 26.618
  07:06:57 STEP  957 H= 239:15 +CPU= 26.200
  07:07:24 STEP  958 H= 239:30 +CPU= 26.544
  07:07:50 STEP  959 H= 239:45 +CPU= 26.062
  07:08:25 STEP  960 H= 240:00 +CPU= 34.964
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_9.zip
Uploading the intermediate file: upload_file_9.zip
  07:08:51 STEP  961 H= 240:15 +CPU= 26.410
Uploading trickle at timestep: 864000
  07:09:17 STEP  962 H= 240:30 +CPU= 26.119
  07:09:44 STEP  963 H= 240:45 +CPU= 26.428
  07:10:11 STEP  964 H= 241:00 +CPU= 26.968
  07:10:37 STEP  965 H= 241:15 +CPU= 26.278
  07:11:03 STEP  966 H= 241:30 +CPU= 26.271
  07:11:29 STEP  967 H= 241:45 +CPU= 25.915
  07:11:56 STEP  968 H= 242:00 +CPU= 26.817
  07:12:22 STEP  969 H= 242:15 +CPU= 26.315
  07:12:49 STEP  970 H= 242:30 +CPU= 26.378
  07:13:15 STEP  971 H= 242:45 +CPU= 26.253
  07:13:47 STEP  972 H= 243:00 +CPU= 32.141
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000972
  07:14:14 STEP  973 H= 243:15 +CPU= 26.256
  07:14:40 STEP  974 H= 243:30 +CPU= 26.435
  07:15:07 STEP  975 H= 243:45 +CPU= 26.870
  07:15:34 STEP  976 H= 244:00 +CPU= 27.131
  07:16:00 STEP  977 H= 244:15 +CPU= 26.039
  07:16:26 STEP  978 H= 244:30 +CPU= 26.052
  07:16:52 STEP  979 H= 244:45 +CPU= 26.108
  07:17:19 STEP  980 H= 245:00 +CPU= 26.765
  07:17:45 STEP  981 H= 245:15 +CPU= 26.002
  07:18:11 STEP  982 H= 245:30 +CPU= 26.231
  07:18:37 STEP  983 H= 245:45 +CPU= 26.222
  07:19:10 STEP  984 H= 246:00 +CPU= 32.381
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000984
  07:19:36 STEP  985 H= 246:15 +CPU= 26.117
  07:20:02 STEP  986 H= 246:30 +CPU= 26.177
  07:20:28 STEP  987 H= 246:45 +CPU= 26.224
  07:20:55 STEP  988 H= 247:00 +CPU= 26.702
  07:21:21 STEP  989 H= 247:15 +CPU= 26.223
  07:21:47 STEP  990 H= 247:30 +CPU= 26.128
  07:22:13 STEP  991 H= 247:45 +CPU= 26.098
  07:22:40 STEP  992 H= 248:00 +CPU= 26.469
  07:23:06 STEP  993 H= 248:15 +CPU= 26.016
  07:23:32 STEP  994 H= 248:30 +CPU= 26.293
  07:23:58 STEP  995 H= 248:45 +CPU= 26.017
  07:24:30 STEP  996 H= 249:00 +CPU= 32.125
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000996
  07:24:56 STEP  997 H= 249:15 +CPU= 26.101
  07:25:23 STEP  998 H= 249:30 +CPU= 26.128
  07:25:49 STEP  999 H= 249:45 +CPU= 26.115
  07:26:15 STEP 1000 H= 250:00 +CPU= 26.501
  07:26:41 STEP 1001 H= 250:15 +CPU= 26.001
  07:27:07 STEP 1002 H= 250:30 +CPU= 25.920
  07:27:33 STEP 1003 H= 250:45 +CPU= 26.061
  07:28:00 STEP 1004 H= 251:00 +CPU= 26.551
  07:28:26 STEP 1005 H= 251:15 +CPU= 26.063
  07:28:52 STEP 1006 H= 251:30 +CPU= 26.054
  07:29:18 STEP 1007 H= 251:45 +CPU= 26.036
  07:29:53 STEP 1008 H= 252:00 +CPU= 34.800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001008
  07:30:19 STEP 1009 H= 252:15 +CPU= 26.351
  07:30:45 STEP 1010 H= 252:30 +CPU= 26.174
  07:31:11 STEP 1011 H= 252:45 +CPU= 26.206
  07:31:38 STEP 1012 H= 253:00 +CPU= 26.609
  07:32:04 STEP 1013 H= 253:15 +CPU= 26.269
  07:32:31 STEP 1014 H= 253:30 +CPU= 26.542
  07:32:57 STEP 1015 H= 253:45 +CPU= 26.158
  07:33:24 STEP 1016 H= 254:00 +CPU= 27.236
  07:33:50 STEP 1017 H= 254:15 +CPU= 26.220
  07:34:17 STEP 1018 H= 254:30 +CPU= 26.487
  07:34:43 STEP 1019 H= 254:45 +CPU= 26.123
  07:35:16 STEP 1020 H= 255:00 +CPU= 32.615
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001020
  07:35:42 STEP 1021 H= 255:15 +CPU= 26.705
  07:36:09 STEP 1022 H= 255:30 +CPU= 26.781
  07:36:36 STEP 1023 H= 255:45 +CPU= 26.745
  07:37:03 STEP 1024 H= 256:00 +CPU= 27.038
  07:37:29 STEP 1025 H= 256:15 +CPU= 26.030
  07:37:55 STEP 1026 H= 256:30 +CPU= 26.257
  07:38:22 STEP 1027 H= 256:45 +CPU= 26.307
  07:38:48 STEP 1028 H= 257:00 +CPU= 26.729
  07:39:14 STEP 1029 H= 257:15 +CPU= 26.180
  07:39:41 STEP 1030 H= 257:30 +CPU= 26.249
  07:40:07 STEP 1031 H= 257:45 +CPU= 26.240
  07:40:39 STEP 1032 H= 258:00 +CPU= 32.192
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001032
  07:41:05 STEP 1033 H= 258:15 +CPU= 26.211
  07:41:31 STEP 1034 H= 258:30 +CPU= 26.081
  07:41:57 STEP 1035 H= 258:45 +CPU= 25.970
  07:42:24 STEP 1036 H= 259:00 +CPU= 26.662
  07:42:50 STEP 1037 H= 259:15 +CPU= 26.170
  07:43:16 STEP 1038 H= 259:30 +CPU= 26.025
  07:43:43 STEP 1039 H= 259:45 +CPU= 26.356
  07:44:09 STEP 1040 H= 260:00 +CPU= 26.611
  07:44:35 STEP 1041 H= 260:15 +CPU= 26.062
  07:45:01 STEP 1042 H= 260:30 +CPU= 26.114
  07:45:27 STEP 1043 H= 260:45 +CPU= 26.034
  07:46:00 STEP 1044 H= 261:00 +CPU= 32.172
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001044
  07:46:26 STEP 1045 H= 261:15 +CPU= 26.284
  07:46:52 STEP 1046 H= 261:30 +CPU= 26.244
  07:47:19 STEP 1047 H= 261:45 +CPU= 26.341
  07:47:46 STEP 1048 H= 262:00 +CPU= 27.033
  07:48:12 STEP 1049 H= 262:15 +CPU= 26.316
  07:48:38 STEP 1050 H= 262:30 +CPU= 26.127
  07:49:04 STEP 1051 H= 262:45 +CPU= 26.273
  07:49:31 STEP 1052 H= 263:00 +CPU= 26.779
  07:49:57 STEP 1053 H= 263:15 +CPU= 26.305
  07:50:23 STEP 1054 H= 263:30 +CPU= 25.988
  07:50:50 STEP 1055 H= 263:45 +CPU= 26.180
  07:51:24 STEP 1056 H= 264:00 +CPU= 34.935
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_10.zip
Uploading the intermediate file: upload_file_10.zip
  07:51:51 STEP 1057 H= 264:15 +CPU= 26.269
  07:52:17 STEP 1058 H= 264:30 +CPU= 26.272
  07:52:43 STEP 1059 H= 264:45 +CPU= 26.110
  07:53:10 STEP 1060 H= 265:00 +CPU= 27.080
  07:53:36 STEP 1061 H= 265:15 +CPU= 26.261
  07:54:02 STEP 1062 H= 265:30 +CPU= 26.004
  07:54:29 STEP 1063 H= 265:45 +CPU= 26.189
  07:54:56 STEP 1064 H= 266:00 +CPU= 26.893
  07:55:22 STEP 1065 H= 266:15 +CPU= 26.015
  07:55:48 STEP 1066 H= 266:30 +CPU= 26.186
  07:56:14 STEP 1067 H= 266:45 +CPU= 26.275
  07:56:46 STEP 1068 H= 267:00 +CPU= 32.473
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001068
  07:57:13 STEP 1069 H= 267:15 +CPU= 26.955
  07:57:40 STEP 1070 H= 267:30 +CPU= 26.202
  07:58:06 STEP 1071 H= 267:45 +CPU= 26.272
  07:58:33 STEP 1072 H= 268:00 +CPU= 26.788
  07:58:59 STEP 1073 H= 268:15 +CPU= 26.044
  07:59:25 STEP 1074 H= 268:30 +CPU= 26.379
  07:59:51 STEP 1075 H= 268:45 +CPU= 26.206
  08:00:18 STEP 1076 H= 269:00 +CPU= 26.843
  08:00:44 STEP 1077 H= 269:15 +CPU= 26.301
  08:01:11 STEP 1078 H= 269:30 +CPU= 26.245
  08:01:37 STEP 1079 H= 269:45 +CPU= 26.459
  08:02:10 STEP 1080 H= 270:00 +CPU= 32.474
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001080
  08:02:36 STEP 1081 H= 270:15 +CPU= 26.203
  08:03:02 STEP 1082 H= 270:30 +CPU= 26.373
  08:03:29 STEP 1083 H= 270:45 +CPU= 26.297
  08:03:55 STEP 1084 H= 271:00 +CPU= 26.764
  08:04:22 STEP 1085 H= 271:15 +CPU= 26.246
  08:04:48 STEP 1086 H= 271:30 +CPU= 26.158
  08:05:14 STEP 1087 H= 271:45 +CPU= 26.318
  08:05:41 STEP 1088 H= 272:00 +CPU= 26.719
  08:06:07 STEP 1089 H= 272:15 +CPU= 26.003
  08:06:33 STEP 1090 H= 272:30 +CPU= 26.220
  08:06:59 STEP 1091 H= 272:45 +CPU= 26.132
  08:07:31 STEP 1092 H= 273:00 +CPU= 32.269
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001092
  08:07:57 STEP 1093 H= 273:15 +CPU= 26.118
  08:08:24 STEP 1094 H= 273:30 +CPU= 26.295
  08:08:50 STEP 1095 H= 273:45 +CPU= 26.377
  08:09:17 STEP 1096 H= 274:00 +CPU= 26.702
  08:09:43 STEP 1097 H= 274:15 +CPU= 26.079
  08:10:09 STEP 1098 H= 274:30 +CPU= 26.224
  08:10:36 STEP 1099 H= 274:45 +CPU= 26.336
  08:11:02 STEP 1100 H= 275:00 +CPU= 26.813
  08:11:29 STEP 1101 H= 275:15 +CPU= 26.539
  08:11:55 STEP 1102 H= 275:30 +CPU= 26.483
  08:12:22 STEP 1103 H= 275:45 +CPU= 26.348
  08:12:57 STEP 1104 H= 276:00 +CPU= 35.377
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001104
  08:13:23 STEP 1105 H= 276:15 +CPU= 26.161
  08:13:50 STEP 1106 H= 276:30 +CPU= 26.421
  08:14:16 STEP 1107 H= 276:45 +CPU= 26.156
  08:14:43 STEP 1108 H= 277:00 +CPU= 26.912
  08:15:09 STEP 1109 H= 277:15 +CPU= 26.084
  08:15:35 STEP 1110 H= 277:30 +CPU= 26.324
  08:16:01 STEP 1111 H= 277:45 +CPU= 26.300
  08:16:28 STEP 1112 H= 278:00 +CPU= 26.077
  08:16:54 STEP 1113 H= 278:15 +CPU= 25.999
  08:17:18 STEP 1114 H= 278:30 +CPU= 24.828
  08:17:44 STEP 1115 H= 278:45 +CPU= 25.626
  08:18:16 STEP 1116 H= 279:00 +CPU= 31.743
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001116
  08:18:41 STEP 1117 H= 279:15 +CPU= 25.138
  08:19:07 STEP 1118 H= 279:30 +CPU= 25.799
  08:19:32 STEP 1119 H= 279:45 +CPU= 25.279
  08:19:58 STEP 1120 H= 280:00 +CPU= 26.278
  08:20:24 STEP 1121 H= 280:15 +CPU= 26.051
  08:20:50 STEP 1122 H= 280:30 +CPU= 26.216
  08:21:17 STEP 1123 H= 280:45 +CPU= 26.261
  08:21:43 STEP 1124 H= 281:00 +CPU= 25.998
  08:22:08 STEP 1125 H= 281:15 +CPU= 25.036
  08:22:34 STEP 1126 H= 281:30 +CPU= 26.118
  08:23:00 STEP 1127 H= 281:45 +CPU= 25.730
  08:23:30 STEP 1128 H= 282:00 +CPU= 29.914
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001128
  08:23:55 STEP 1129 H= 282:15 +CPU= 25.122
  08:24:20 STEP 1130 H= 282:30 +CPU= 25.312
  08:24:45 STEP 1131 H= 282:45 +CPU= 24.866
  08:25:09 STEP 1132 H= 283:00 +CPU= 24.607
  08:25:34 STEP 1133 H= 283:15 +CPU= 24.866
  08:26:00 STEP 1134 H= 283:30 +CPU= 26.102
  08:26:25 STEP 1135 H= 283:45 +CPU= 24.381
  08:26:51 STEP 1136 H= 284:00 +CPU= 26.358
  08:27:16 STEP 1137 H= 284:15 +CPU= 24.561
  08:27:40 STEP 1138 H= 284:30 +CPU= 24.147
  08:28:04 STEP 1139 H= 284:45 +CPU= 24.098
  08:28:35 STEP 1140 H= 285:00 +CPU= 30.595
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001140
  08:29:01 STEP 1141 H= 285:15 +CPU= 26.020
  08:29:27 STEP 1142 H= 285:30 +CPU= 26.052
  08:29:53 STEP 1143 H= 285:45 +CPU= 25.938
  08:30:19 STEP 1144 H= 286:00 +CPU= 26.552
  08:30:45 STEP 1145 H= 286:15 +CPU= 26.092
  08:31:11 STEP 1146 H= 286:30 +CPU= 25.889
  08:31:37 STEP 1147 H= 286:45 +CPU= 25.779
  08:32:03 STEP 1148 H= 287:00 +CPU= 26.513
  08:32:29 STEP 1149 H= 287:15 +CPU= 25.673
  08:32:54 STEP 1150 H= 287:30 +CPU= 24.763
  08:33:18 STEP 1151 H= 287:45 +CPU= 24.349
  08:33:53 STEP 1152 H= 288:00 +CPU= 34.754
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_11.zip
Uploading the intermediate file: upload_file_11.zip
  08:34:18 STEP 1153 H= 288:15 +CPU= 25.432
  08:34:44 STEP 1154 H= 288:30 +CPU= 25.378
  08:35:09 STEP 1155 H= 288:45 +CPU= 24.810
  08:35:35 STEP 1156 H= 289:00 +CPU= 26.749
  08:36:01 STEP 1157 H= 289:15 +CPU= 26.033
  08:36:27 STEP 1158 H= 289:30 +CPU= 25.719
  08:36:52 STEP 1159 H= 289:45 +CPU= 25.417
  08:37:18 STEP 1160 H= 290:00 +CPU= 26.020
  08:37:44 STEP 1161 H= 290:15 +CPU= 25.434
  08:38:09 STEP 1162 H= 290:30 +CPU= 24.824
  08:38:34 STEP 1163 H= 290:45 +CPU= 24.869
  08:39:04 STEP 1164 H= 291:00 +CPU= 30.758
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001164
  08:39:30 STEP 1165 H= 291:15 +CPU= 25.859
  08:39:56 STEP 1166 H= 291:30 +CPU= 25.972
  08:40:22 STEP 1167 H= 291:45 +CPU= 25.764
  08:40:48 STEP 1168 H= 292:00 +CPU= 26.128
  08:41:14 STEP 1169 H= 292:15 +CPU= 26.001
  08:41:39 STEP 1170 H= 292:30 +CPU= 24.610
  08:42:03 STEP 1171 H= 292:45 +CPU= 24.153
  08:42:28 STEP 1172 H= 293:00 +CPU= 25.611
  08:42:54 STEP 1173 H= 293:15 +CPU= 25.623
  08:43:20 STEP 1174 H= 293:30 +CPU= 26.174
  08:43:46 STEP 1175 H= 293:45 +CPU= 26.018
  08:44:18 STEP 1176 H= 294:00 +CPU= 31.420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001176
  08:44:44 STEP 1177 H= 294:15 +CPU= 26.118
  08:45:10 STEP 1178 H= 294:30 +CPU= 25.840
  08:45:36 STEP 1179 H= 294:45 +CPU= 25.947
  08:46:02 STEP 1180 H= 295:00 +CPU= 26.210
  08:46:28 STEP 1181 H= 295:15 +CPU= 25.855
  08:46:53 STEP 1182 H= 295:30 +CPU= 25.731
  08:47:19 STEP 1183 H= 295:45 +CPU= 26.030
  08:47:46 STEP 1184 H= 296:00 +CPU= 26.694
  08:48:12 STEP 1185 H= 296:15 +CPU= 26.153
  08:48:38 STEP 1186 H= 296:30 +CPU= 25.881
  08:49:03 STEP 1187 H= 296:45 +CPU= 24.727
  08:49:35 STEP 1188 H= 297:00 +CPU= 31.722
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001188
  08:50:00 STEP 1189 H= 297:15 +CPU= 25.386
  08:50:25 STEP 1190 H= 297:30 +CPU= 25.311
  08:50:50 STEP 1191 H= 297:45 +CPU= 25.051
  08:51:15 STEP 1192 H= 298:00 +CPU= 24.913
  08:51:39 STEP 1193 H= 298:15 +CPU= 24.146
  08:52:04 STEP 1194 H= 298:30 +CPU= 24.219
  08:52:29 STEP 1195 H= 298:45 +CPU= 24.954
  08:52:55 STEP 1196 H= 299:00 +CPU= 26.396
  08:53:20 STEP 1197 H= 299:15 +CPU= 24.702
  08:53:45 STEP 1198 H= 299:30 +CPU= 25.448
  08:54:11 STEP 1199 H= 299:45 +CPU= 25.358
  08:54:45 STEP 1200 H= 300:00 +CPU= 34.078
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001200
  08:55:10 STEP 1201 H= 300:15 +CPU= 25.118
  08:55:36 STEP 1202 H= 300:30 +CPU= 26.102
  08:56:02 STEP 1203 H= 300:45 +CPU= 25.977
  08:56:28 STEP 1204 H= 301:00 +CPU= 26.014
  08:56:52 STEP 1205 H= 301:15 +CPU= 24.334
  08:57:16 STEP 1206 H= 301:30 +CPU= 24.268
  08:57:41 STEP 1207 H= 301:45 +CPU= 24.396
  08:58:06 STEP 1208 H= 302:00 +CPU= 25.154
  08:58:31 STEP 1209 H= 302:15 +CPU= 24.650
  08:58:56 STEP 1210 H= 302:30 +CPU= 24.857
  08:59:20 STEP 1211 H= 302:45 +CPU= 24.399
  08:59:51 STEP 1212 H= 303:00 +CPU= 30.630
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001212
  09:00:15 STEP 1213 H= 303:15 +CPU= 24.493
  09:00:40 STEP 1214 H= 303:30 +CPU= 25.184
  09:01:06 STEP 1215 H= 303:45 +CPU= 25.624
  09:01:32 STEP 1216 H= 304:00 +CPU= 26.053
  09:01:56 STEP 1217 H= 304:15 +CPU= 24.371
  09:02:22 STEP 1218 H= 304:30 +CPU= 26.165
  09:02:49 STEP 1219 H= 304:45 +CPU= 26.089
  09:03:15 STEP 1220 H= 305:00 +CPU= 26.476
  09:03:40 STEP 1221 H= 305:15 +CPU= 25.361
  09:04:06 STEP 1222 H= 305:30 +CPU= 25.700
  09:04:32 STEP 1223 H= 305:45 +CPU= 26.004
  09:05:04 STEP 1224 H= 306:00 +CPU= 31.457
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001224
  09:05:30 STEP 1225 H= 306:15 +CPU= 26.160
  09:05:54 STEP 1226 H= 306:30 +CPU= 24.487
  09:06:19 STEP 1227 H= 306:45 +CPU= 24.347
  09:06:43 STEP 1228 H= 307:00 +CPU= 24.931
  09:07:08 STEP 1229 H= 307:15 +CPU= 24.470
  09:07:32 STEP 1230 H= 307:30 +CPU= 24.289
  09:07:58 STEP 1231 H= 307:45 +CPU= 25.756
  09:08:24 STEP 1232 H= 308:00 +CPU= 26.035
  09:08:50 STEP 1233 H= 308:15 +CPU= 26.176
  09:09:16 STEP 1234 H= 308:30 +CPU= 25.880
  09:09:42 STEP 1235 H= 308:45 +CPU= 25.984
  09:10:13 STEP 1236 H= 309:00 +CPU= 30.962
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001236
  09:10:37 STEP 1237 H= 309:15 +CPU= 24.136
  09:11:02 STEP 1238 H= 309:30 +CPU= 24.925
  09:11:28 STEP 1239 H= 309:45 +CPU= 25.971
  09:11:54 STEP 1240 H= 310:00 +CPU= 26.447
  09:12:20 STEP 1241 H= 310:15 +CPU= 25.563
  09:12:46 STEP 1242 H= 310:30 +CPU= 26.172
  09:13:12 STEP 1243 H= 310:45 +CPU= 26.173
  09:13:39 STEP 1244 H= 311:00 +CPU= 26.791
  09:14:05 STEP 1245 H= 311:15 +CPU= 26.190
  09:14:31 STEP 1246 H= 311:30 +CPU= 26.052
  09:14:57 STEP 1247 H= 311:45 +CPU= 25.934
  09:15:32 STEP 1248 H= 312:00 +CPU= 34.879
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_12.zip
Uploading the intermediate file: upload_file_12.zip
  09:15:57 STEP 1249 H= 312:15 +CPU= 25.073
  09:16:23 STEP 1250 H= 312:30 +CPU= 25.614
  09:16:48 STEP 1251 H= 312:45 +CPU= 25.540
  09:17:15 STEP 1252 H= 313:00 +CPU= 26.427
  09:17:40 STEP 1253 H= 313:15 +CPU= 24.691
  09:18:05 STEP 1254 H= 313:30 +CPU= 24.926
  09:18:30 STEP 1255 H= 313:45 +CPU= 25.424
  09:18:57 STEP 1256 H= 314:00 +CPU= 26.826
  09:19:23 STEP 1257 H= 314:15 +CPU= 25.865
  09:19:49 STEP 1258 H= 314:30 +CPU= 25.950
  09:20:15 STEP 1259 H= 314:45 +CPU= 25.938
  09:20:47 STEP 1260 H= 315:00 +CPU= 32.165
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001260
  09:21:11 STEP 1261 H= 315:15 +CPU= 24.750
  09:21:36 STEP 1262 H= 315:30 +CPU= 24.209
  09:22:00 STEP 1263 H= 315:45 +CPU= 24.602
  09:22:25 STEP 1264 H= 316:00 +CPU= 25.078
  09:22:50 STEP 1265 H= 316:15 +CPU= 25.152
  09:23:16 STEP 1266 H= 316:30 +CPU= 25.960
  09:23:43 STEP 1267 H= 316:45 +CPU= 26.113
  09:24:09 STEP 1268 H= 317:00 +CPU= 26.427
  09:24:35 STEP 1269 H= 317:15 +CPU= 25.808
  09:25:01 STEP 1270 H= 317:30 +CPU= 26.127
  09:25:27 STEP 1271 H= 317:45 +CPU= 26.166
  09:25:59 STEP 1272 H= 318:00 +CPU= 32.005
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001272
  09:26:25 STEP 1273 H= 318:15 +CPU= 25.813
  09:26:51 STEP 1274 H= 318:30 +CPU= 25.868
  09:27:16 STEP 1275 H= 318:45 +CPU= 24.949
  09:27:41 STEP 1276 H= 319:00 +CPU= 25.013
  09:28:05 STEP 1277 H= 319:15 +CPU= 24.366
  09:28:30 STEP 1278 H= 319:30 +CPU= 24.733
  09:28:54 STEP 1279 H= 319:45 +CPU= 24.228
  09:29:19 STEP 1280 H= 320:00 +CPU= 24.874
  09:29:44 STEP 1281 H= 320:15 +CPU= 24.876
  09:30:10 STEP 1282 H= 320:30 +CPU= 26.064
  09:30:36 STEP 1283 H= 320:45 +CPU= 25.782
  09:31:07 STEP 1284 H= 321:00 +CPU= 31.694
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001284
  09:31:33 STEP 1285 H= 321:15 +CPU= 25.858
  09:31:59 STEP 1286 H= 321:30 +CPU= 26.112
  09:32:24 STEP 1287 H= 321:45 +CPU= 25.051
  09:32:50 STEP 1288 H= 322:00 +CPU= 25.258
  09:33:15 STEP 1289 H= 322:15 +CPU= 25.379
  09:33:41 STEP 1290 H= 322:30 +CPU= 25.891
  09:34:05 STEP 1291 H= 322:45 +CPU= 24.184
  09:34:30 STEP 1292 H= 323:00 +CPU= 24.987
  09:34:55 STEP 1293 H= 323:15 +CPU= 24.646
  09:35:19 STEP 1294 H= 323:30 +CPU= 24.439
  09:35:44 STEP 1295 H= 323:45 +CPU= 24.720
  09:36:17 STEP 1296 H= 324:00 +CPU= 33.414
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001296
  09:36:41 STEP 1297 H= 324:15 +CPU= 24.062
  09:37:05 STEP 1298 H= 324:30 +CPU= 23.904
  09:37:30 STEP 1299 H= 324:45 +CPU= 25.057
  09:37:57 STEP 1300 H= 325:00 +CPU= 26.418
  09:38:23 STEP 1301 H= 325:15 +CPU= 25.911
  09:38:49 STEP 1302 H= 325:30 +CPU= 26.171
  09:39:15 STEP 1303 H= 325:45 +CPU= 26.082
  09:39:42 STEP 1304 H= 326:00 +CPU= 26.754
  09:40:08 STEP 1305 H= 326:15 +CPU= 26.251
  09:40:32 STEP 1306 H= 326:30 +CPU= 24.532
  09:40:58 STEP 1307 H= 326:45 +CPU= 25.294
  09:41:30 STEP 1308 H= 327:00 +CPU= 32.159
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001308
  09:41:56 STEP 1309 H= 327:15 +CPU= 26.154
  09:42:22 STEP 1310 H= 327:30 +CPU= 25.742
  09:42:46 STEP 1311 H= 327:45 +CPU= 24.193
  09:43:11 STEP 1312 H= 328:00 +CPU= 24.808
  09:43:35 STEP 1313 H= 328:15 +CPU= 24.246
  09:44:00 STEP 1314 H= 328:30 +CPU= 24.546
  09:44:24 STEP 1315 H= 328:45 +CPU= 24.396
  09:44:49 STEP 1316 H= 329:00 +CPU= 25.218
  09:45:15 STEP 1317 H= 329:15 +CPU= 26.270
  09:45:42 STEP 1318 H= 329:30 +CPU= 26.025
  09:46:08 STEP 1319 H= 329:45 +CPU= 26.087
  09:46:40 STEP 1320 H= 330:00 +CPU= 32.026
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001320
  09:47:06 STEP 1321 H= 330:15 +CPU= 26.121
  09:47:32 STEP 1322 H= 330:30 +CPU= 26.263
  09:47:58 STEP 1323 H= 330:45 +CPU= 26.119
  09:48:24 STEP 1324 H= 331:00 +CPU= 25.629
  09:48:50 STEP 1325 H= 331:15 +CPU= 26.198
  09:49:16 STEP 1326 H= 331:30 +CPU= 25.884
  09:49:42 STEP 1327 H= 331:45 +CPU= 26.279
  09:50:09 STEP 1328 H= 332:00 +CPU= 26.668
  09:50:34 STEP 1329 H= 332:15 +CPU= 25.634
  09:51:01 STEP 1330 H= 332:30 +CPU= 26.146
  09:51:27 STEP 1331 H= 332:45 +CPU= 26.079
  09:51:58 STEP 1332 H= 333:00 +CPU= 31.683
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001332
  09:52:24 STEP 1333 H= 333:15 +CPU= 25.868
  09:52:50 STEP 1334 H= 333:30 +CPU= 25.947
  09:53:16 STEP 1335 H= 333:45 +CPU= 25.551
  09:53:42 STEP 1336 H= 334:00 +CPU= 26.035
  09:54:08 STEP 1337 H= 334:15 +CPU= 25.765
  09:54:34 STEP 1338 H= 334:30 +CPU= 26.032
  09:55:00 STEP 1339 H= 334:45 +CPU= 26.278
  09:55:27 STEP 1340 H= 335:00 +CPU= 26.850
  09:55:53 STEP 1341 H= 335:15 +CPU= 26.145
  09:56:18 STEP 1342 H= 335:30 +CPU= 25.549
  09:56:45 STEP 1343 H= 335:45 +CPU= 26.144
  09:57:18 STEP 1344 H= 336:00 +CPU= 33.886
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_13.zip
Uploading the intermediate file: upload_file_13.zip
  09:57:44 STEP 1345 H= 336:15 +CPU= 25.793
  09:58:10 STEP 1346 H= 336:30 +CPU= 25.599
  09:58:36 STEP 1347 H= 336:45 +CPU= 25.992
  09:59:02 STEP 1348 H= 337:00 +CPU= 26.206
  09:59:27 STEP 1349 H= 337:15 +CPU= 25.373
  09:59:53 STEP 1350 H= 337:30 +CPU= 25.269
  10:00:19 STEP 1351 H= 337:45 +CPU= 25.948
  10:00:45 STEP 1352 H= 338:00 +CPU= 26.755
  10:01:11 STEP 1353 H= 338:15 +CPU= 26.086
  10:01:36 STEP 1354 H= 338:30 +CPU= 24.553
  10:02:00 STEP 1355 H= 338:45 +CPU= 24.430
  10:02:32 STEP 1356 H= 339:00 +CPU= 31.528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001356
  10:02:58 STEP 1357 H= 339:15 +CPU= 26.011
  10:03:23 STEP 1358 H= 339:30 +CPU= 25.434
  10:03:49 STEP 1359 H= 339:45 +CPU= 25.853
  10:04:16 STEP 1360 H= 340:00 +CPU= 26.272
  10:04:41 STEP 1361 H= 340:15 +CPU= 24.926
  10:05:06 STEP 1362 H= 340:30 +CPU= 25.583
  10:05:32 STEP 1363 H= 340:45 +CPU= 25.686
  10:05:57 STEP 1364 H= 341:00 +CPU= 24.878
  10:06:21 STEP 1365 H= 341:15 +CPU= 24.292
  10:06:46 STEP 1366 H= 341:30 +CPU= 25.240
  10:07:11 STEP 1367 H= 341:45 +CPU= 24.733
  10:07:42 STEP 1368 H= 342:00 +CPU= 31.149
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001368
  10:08:08 STEP 1369 H= 342:15 +CPU= 26.229
  10:08:34 STEP 1370 H= 342:30 +CPU= 25.817
  10:09:00 STEP 1371 H= 342:45 +CPU= 26.023
  10:09:27 STEP 1372 H= 343:00 +CPU= 26.683
  10:09:53 STEP 1373 H= 343:15 +CPU= 25.992
  10:10:18 STEP 1374 H= 343:30 +CPU= 25.476
  10:10:43 STEP 1375 H= 343:45 +CPU= 24.231
  10:11:08 STEP 1376 H= 344:00 +CPU= 25.070
  10:11:32 STEP 1377 H= 344:15 +CPU= 24.465
  10:11:56 STEP 1378 H= 344:30 +CPU= 24.425
  10:12:21 STEP 1379 H= 344:45 +CPU= 24.872
  10:12:53 STEP 1380 H= 345:00 +CPU= 31.226
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001380
  10:13:17 STEP 1381 H= 345:15 +CPU= 24.048
  10:13:42 STEP 1382 H= 345:30 +CPU= 24.967
  10:14:06 STEP 1383 H= 345:45 +CPU= 24.697
  10:14:32 STEP 1384 H= 346:00 +CPU= 25.790
  10:14:58 STEP 1385 H= 346:15 +CPU= 25.517
  10:15:22 STEP 1386 H= 346:30 +CPU= 24.758
  10:15:48 STEP 1387 H= 346:45 +CPU= 25.533
  10:16:14 STEP 1388 H= 347:00 +CPU= 25.930
  10:16:40 STEP 1389 H= 347:15 +CPU= 26.064
  10:17:06 STEP 1390 H= 347:30 +CPU= 26.184
  10:17:32 STEP 1391 H= 347:45 +CPU= 25.953
  10:18:07 STEP 1392 H= 348:00 +CPU= 34.645
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001392
  10:18:32 STEP 1393 H= 348:15 +CPU= 25.237
  10:18:58 STEP 1394 H= 348:30 +CPU= 25.782
  10:19:24 STEP 1395 H= 348:45 +CPU= 26.123
  10:19:51 STEP 1396 H= 349:00 +CPU= 26.893
  10:20:15 STEP 1397 H= 349:15 +CPU= 24.249
  10:20:40 STEP 1398 H= 349:30 +CPU= 24.983
  10:21:04 STEP 1399 H= 349:45 +CPU= 24.371
  10:21:30 STEP 1400 H= 350:00 +CPU= 26.049
  10:21:57 STEP 1401 H= 350:15 +CPU= 26.190
  10:22:22 STEP 1402 H= 350:30 +CPU= 25.508
  10:22:47 STEP 1403 H= 350:45 +CPU= 24.704
  10:23:19 STEP 1404 H= 351:00 +CPU= 32.226
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001404
  10:23:45 STEP 1405 H= 351:15 +CPU= 26.083
  10:24:11 STEP 1406 H= 351:30 +CPU= 26.099
  10:24:37 STEP 1407 H= 351:45 +CPU= 26.121
  10:25:04 STEP 1408 H= 352:00 +CPU= 26.453
  10:25:30 STEP 1409 H= 352:15 +CPU= 26.050
  10:25:55 STEP 1410 H= 352:30 +CPU= 25.260
  10:26:19 STEP 1411 H= 352:45 +CPU= 24.343
  10:26:44 STEP 1412 H= 353:00 +CPU= 24.917
  10:27:09 STEP 1413 H= 353:15 +CPU= 24.225
  10:27:34 STEP 1414 H= 353:30 +CPU= 25.117
  10:28:00 STEP 1415 H= 353:45 +CPU= 26.349
  10:28:31 STEP 1416 H= 354:00 +CPU= 31.405
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001416
  10:28:57 STEP 1417 H= 354:15 +CPU= 25.835
  10:29:22 STEP 1418 H= 354:30 +CPU= 25.148
  10:29:49 STEP 1419 H= 354:45 +CPU= 26.407
  10:30:16 STEP 1420 H= 355:00 +CPU= 26.841
  10:30:42 STEP 1421 H= 355:15 +CPU= 26.212
  10:31:08 STEP 1422 H= 355:30 +CPU= 25.679
  10:31:34 STEP 1423 H= 355:45 +CPU= 26.195
  10:32:00 STEP 1424 H= 356:00 +CPU= 26.674
  10:32:27 STEP 1425 H= 356:15 +CPU= 26.307
  10:32:53 STEP 1426 H= 356:30 +CPU= 25.937
  10:33:19 STEP 1427 H= 356:45 +CPU= 25.856
  10:33:50 STEP 1428 H= 357:00 +CPU= 31.245
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001428
  10:34:15 STEP 1429 H= 357:15 +CPU= 24.796
  10:34:39 STEP 1430 H= 357:30 +CPU= 24.210
  10:35:04 STEP 1431 H= 357:45 +CPU= 24.866
  10:35:30 STEP 1432 H= 358:00 +CPU= 26.731
  10:35:57 STEP 1433 H= 358:15 +CPU= 26.181
  10:36:21 STEP 1434 H= 358:30 +CPU= 24.691
  10:36:46 STEP 1435 H= 358:45 +CPU= 24.467
  10:37:10 STEP 1436 H= 359:00 +CPU= 24.761
  10:37:35 STEP 1437 H= 359:15 +CPU= 24.252
  10:38:00 STEP 1438 H= 359:30 +CPU= 25.723
  10:38:26 STEP 1439 H= 359:45 +CPU= 25.640
  10:38:58 STEP 1440 H= 360:00 +CPU= 32.335
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9283035684E-21      I       0.1487315888E-04      I
ICloud fractionI      0.0000000000E+00      I       0.1545909095E+00      I
I  Relat. Hum. I      0.5727244489E+00      I       0.5602404615E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1769408099E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    317925665 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS635851.3 Mbytes/s, TOTAL TIME=    0.0100( 5.0%)
 10:38:58 STEP 1440 H= 360:00 +CPU= 32.335
 END CNT3
 NSTEP =  1440 CNT0   000000000  24.306  24.306  24.307   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    60.3     0.0    60.3     0.0   125.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    3507.9    3507.9     14.39      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     852.3     852.3      3.22      0.00
  10 SCAN2M - PHYSICS                             1441   14067.3   14067.3     53.24      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     692.1     692.1      0.22      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      37.0      37.0      0.01      0.00
  14 SUINIF                                          1    2867.4    2867.4      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      24.5      24.5      0.01      0.00
  18 SUSPECG                                         1    1605.2    1605.2      0.00      0.00
  19 SUSPEC                                          1    1610.7    1610.7      0.00      0.00
  24 SUGRIDU                                         1     915.3     915.3      0.00      0.00
  25 SPECRT                                          1     240.0     240.0      0.00      0.00
  26 SUGRIDF                                         1     101.4     101.4      0.00      0.00
  27 RESTART FILES - WRITING                        30    2791.4    2791.4      0.22      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5196.9    5196.9      1.65      0.00
  31 POSDDH IN STEPO                                 7       0.8       0.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    4553.3    4553.3     17.23      0.00
  39 SU0YOMB                                         1     280.5     280.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      23.2      23.2      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     423.5     423.5      1.60      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      67.3      67.3      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     404.7     404.7      3.32      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     229.4     229.4      1.81      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      74.8      74.8      0.59      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     126.4     126.4      1.04      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.2      38.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      36.5      36.5      0.30      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      20.2      20.2      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      85.6      85.6      0.70      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      47.2      47.2      0.37      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    38075.3 CPU TIME   38074.4 VECTOR TIME    38074.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       34.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212809/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4na_2016092300_15_991_12212809_0_r1964336706_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
double free or corruption (!prev)
10:42:30 (6597): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:11 1522997 22313087 oifs_43r3_bl_a4na_2016092300_15_991_12212809_0 1,295,100 38,074 0.0294
09 May 2023 16:52:10 1522997 22313087 oifs_43r3_bl_a4na_2016092300_15_991_12212809_0 864,000 25,448 0.0295


©2024 climateprediction.net