climateprediction.net home page
Task 22433421

Task 22433421

Name oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0
Workunit 12281854
Created 7 Jun 2024, 10:53:20 UTC
Sent 7 Jun 2024, 10:55:05 UTC
Report deadline 6 Aug 2024, 10:55:05 UTC
Received 4 Jul 2024, 0:00:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1512622
Run time 12 hours 24 min 26 sec
CPU time 11 hours 48 min 58 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 4.88 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,021.20 MB
Peak swap size 5,980.79 MB
Peak disk usage 1,366.33 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
.515
  17:42:07 STEP  837 H= 209:15 +CPU= 29.031
  17:42:38 STEP  838 H= 209:30 +CPU= 29.035
  17:43:09 STEP  839 H= 209:45 +CPU= 29.064
  17:43:47 STEP  840 H= 210:00 +CPU= 35.976
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000840
  17:44:17 STEP  841 H= 210:15 +CPU= 29.117
  17:44:48 STEP  842 H= 210:30 +CPU= 28.886
  17:45:18 STEP  843 H= 210:45 +CPU= 28.746
  17:45:49 STEP  844 H= 211:00 +CPU= 29.652
  17:46:21 STEP  845 H= 211:15 +CPU= 29.221
  17:46:51 STEP  846 H= 211:30 +CPU= 28.872
  17:47:21 STEP  847 H= 211:45 +CPU= 28.890
  17:47:53 STEP  848 H= 212:00 +CPU= 29.885
  17:48:23 STEP  849 H= 212:15 +CPU= 29.027
  17:48:53 STEP  850 H= 212:30 +CPU= 28.865
  17:49:24 STEP  851 H= 212:45 +CPU= 28.874
  17:50:02 STEP  852 H= 213:00 +CPU= 36.185
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000852
  17:50:33 STEP  853 H= 213:15 +CPU= 28.957
  17:51:04 STEP  854 H= 213:30 +CPU= 29.053
  17:51:33 STEP  855 H= 213:45 +CPU= 29.074
  17:52:05 STEP  856 H= 214:00 +CPU= 29.532
  17:52:35 STEP  857 H= 214:15 +CPU= 29.090
  17:53:06 STEP  858 H= 214:30 +CPU= 29.102
  17:53:37 STEP  859 H= 214:45 +CPU= 28.949
  17:54:08 STEP  860 H= 215:00 +CPU= 29.545
  17:54:38 STEP  861 H= 215:15 +CPU= 28.930
  17:55:08 STEP  862 H= 215:30 +CPU= 29.110
  17:55:38 STEP  863 H= 215:45 +CPU= 29.021
  17:56:19 STEP  864 H= 216:00 +CPU= 38.806
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_8.zip
Uploading the intermediate file: upload_file_8.zip
  17:56:50 STEP  865 H= 216:15 +CPU= 28.911
  17:57:21 STEP  866 H= 216:30 +CPU= 29.096
  17:57:51 STEP  867 H= 216:45 +CPU= 28.954
  17:58:22 STEP  868 H= 217:00 +CPU= 28.182
  17:58:52 STEP  869 H= 217:15 +CPU= 28.488
  17:59:22 STEP  870 H= 217:30 +CPU= 29.077
  17:59:53 STEP  871 H= 217:45 +CPU= 28.873
  18:00:24 STEP  872 H= 218:00 +CPU= 29.758
  18:00:54 STEP  873 H= 218:15 +CPU= 29.087
  18:01:24 STEP  874 H= 218:30 +CPU= 29.141
  18:01:55 STEP  875 H= 218:45 +CPU= 29.182
  18:02:32 STEP  876 H= 219:00 +CPU= 35.912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000876
  18:03:03 STEP  877 H= 219:15 +CPU= 28.928
  18:03:33 STEP  878 H= 219:30 +CPU= 28.754
  18:04:04 STEP  879 H= 219:45 +CPU= 28.898
  18:04:35 STEP  880 H= 220:00 +CPU= 29.745
  18:05:05 STEP  881 H= 220:15 +CPU= 29.099
  18:05:36 STEP  882 H= 220:30 +CPU= 28.989
  18:06:06 STEP  883 H= 220:45 +CPU= 28.856
  18:06:38 STEP  884 H= 221:00 +CPU= 29.593
  18:07:08 STEP  885 H= 221:15 +CPU= 29.098
  18:07:38 STEP  886 H= 221:30 +CPU= 28.940
  18:08:09 STEP  887 H= 221:45 +CPU= 28.955
  18:08:48 STEP  888 H= 222:00 +CPU= 36.389
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000888
  18:09:18 STEP  889 H= 222:15 +CPU= 29.015
  18:09:47 STEP  890 H= 222:30 +CPU= 28.882
  18:10:18 STEP  891 H= 222:45 +CPU= 28.899
  18:10:50 STEP  892 H= 223:00 +CPU= 29.612
  18:11:20 STEP  893 H= 223:15 +CPU= 29.235
  18:11:50 STEP  894 H= 223:30 +CPU= 29.050
  18:12:21 STEP  895 H= 223:45 +CPU= 28.983
  18:12:52 STEP  896 H= 224:00 +CPU= 29.608
  18:13:23 STEP  897 H= 224:15 +CPU= 28.960
  18:13:54 STEP  898 H= 224:30 +CPU= 28.918
  18:14:23 STEP  899 H= 224:45 +CPU= 29.020
  18:15:01 STEP  900 H= 225:00 +CPU= 36.060
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000900
  18:15:31 STEP  901 H= 225:15 +CPU= 28.764
  18:16:02 STEP  902 H= 225:30 +CPU= 28.836
  18:16:33 STEP  903 H= 225:45 +CPU= 28.832
  18:17:04 STEP  904 H= 226:00 +CPU= 29.536
  18:17:34 STEP  905 H= 226:15 +CPU= 28.949
  18:18:04 STEP  906 H= 226:30 +CPU= 28.774
  18:18:35 STEP  907 H= 226:45 +CPU= 29.086
  18:19:06 STEP  908 H= 227:00 +CPU= 29.829
  18:19:37 STEP  909 H= 227:15 +CPU= 29.124
  18:20:08 STEP  910 H= 227:30 +CPU= 29.107
  18:20:38 STEP  911 H= 227:45 +CPU= 29.066
  18:21:19 STEP  912 H= 228:00 +CPU= 38.725
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000912
  18:21:49 STEP  913 H= 228:15 +CPU= 28.820
  18:22:19 STEP  914 H= 228:30 +CPU= 28.882
  18:22:50 STEP  915 H= 228:45 +CPU= 28.974
  18:23:22 STEP  916 H= 229:00 +CPU= 29.653
  18:23:52 STEP  917 H= 229:15 +CPU= 29.015
  18:24:23 STEP  918 H= 229:30 +CPU= 29.255
  18:24:53 STEP  919 H= 229:45 +CPU= 29.082
  18:25:25 STEP  920 H= 230:00 +CPU= 29.682
  18:25:56 STEP  921 H= 230:15 +CPU= 29.146
  18:26:27 STEP  922 H= 230:30 +CPU= 29.181
  18:26:58 STEP  923 H= 230:45 +CPU= 28.988
  18:27:36 STEP  924 H= 231:00 +CPU= 36.324
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000924
  18:28:06 STEP  925 H= 231:15 +CPU= 29.010
  18:28:36 STEP  926 H= 231:30 +CPU= 28.941
  18:29:07 STEP  927 H= 231:45 +CPU= 29.071
  18:29:38 STEP  928 H= 232:00 +CPU= 29.749
  18:30:09 STEP  929 H= 232:15 +CPU= 29.109
  18:30:39 STEP  930 H= 232:30 +CPU= 29.197
  18:31:10 STEP  931 H= 232:45 +CPU= 29.198
  18:31:42 STEP  932 H= 233:00 +CPU= 29.697
  18:32:12 STEP  933 H= 233:15 +CPU= 28.970
  18:32:43 STEP  934 H= 233:30 +CPU= 29.026
  18:33:14 STEP  935 H= 233:45 +CPU= 29.029
  18:33:51 STEP  936 H= 234:00 +CPU= 35.862
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000936
  18:34:22 STEP  937 H= 234:15 +CPU= 28.888
  18:34:53 STEP  938 H= 234:30 +CPU= 28.972
  18:35:23 STEP  939 H= 234:45 +CPU= 28.997
  18:35:55 STEP  940 H= 235:00 +CPU= 29.761
  18:36:25 STEP  941 H= 235:15 +CPU= 29.087
  18:36:56 STEP  942 H= 235:30 +CPU= 28.970
  18:37:27 STEP  943 H= 235:45 +CPU= 29.303
  18:37:58 STEP  944 H= 236:00 +CPU= 29.855
  18:38:29 STEP  945 H= 236:15 +CPU= 29.111
  18:38:59 STEP  946 H= 236:30 +CPU= 29.210
  18:39:30 STEP  947 H= 236:45 +CPU= 29.097
  18:40:08 STEP  948 H= 237:00 +CPU= 35.744
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000948
  18:40:38 STEP  949 H= 237:15 +CPU= 28.912
  18:41:09 STEP  950 H= 237:30 +CPU= 28.962
  18:41:39 STEP  951 H= 237:45 +CPU= 29.098
  18:42:10 STEP  952 H= 238:00 +CPU= 29.652
  18:42:41 STEP  953 H= 238:15 +CPU= 29.101
  18:43:12 STEP  954 H= 238:30 +CPU= 29.046
  18:43:43 STEP  955 H= 238:45 +CPU= 28.977
  18:44:14 STEP  956 H= 239:00 +CPU= 29.896
  18:44:44 STEP  957 H= 239:15 +CPU= 29.074
  18:45:15 STEP  958 H= 239:30 +CPU= 29.070
  18:45:45 STEP  959 H= 239:45 +CPU= 29.075
  18:46:27 STEP  960 H= 240:00 +CPU= 39.007
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_9.zip
Uploading the intermediate file: upload_file_9.zip
  18:46:58 STEP  961 H= 240:15 +CPU= 28.982
Uploading trickle at timestep: 864000
  18:47:29 STEP  962 H= 240:30 +CPU= 29.418
  18:48:00 STEP  963 H= 240:45 +CPU= 29.053
  18:48:31 STEP  964 H= 241:00 +CPU= 29.610
  18:49:01 STEP  965 H= 241:15 +CPU= 28.847
  18:49:31 STEP  966 H= 241:30 +CPU= 28.878
  18:50:02 STEP  967 H= 241:45 +CPU= 28.944
  18:50:33 STEP  968 H= 242:00 +CPU= 29.652
  18:51:04 STEP  969 H= 242:15 +CPU= 29.248
  18:51:34 STEP  970 H= 242:30 +CPU= 28.893
  18:52:04 STEP  971 H= 242:45 +CPU= 28.823
  18:52:41 STEP  972 H= 243:00 +CPU= 35.717
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000972
  18:53:12 STEP  973 H= 243:15 +CPU= 28.948
  18:53:43 STEP  974 H= 243:30 +CPU= 29.066
  18:54:13 STEP  975 H= 243:45 +CPU= 28.874
  18:54:44 STEP  976 H= 244:00 +CPU= 29.544
  18:55:15 STEP  977 H= 244:15 +CPU= 29.117
  18:55:44 STEP  978 H= 244:30 +CPU= 28.940
  18:56:15 STEP  979 H= 244:45 +CPU= 28.915
  18:56:46 STEP  980 H= 245:00 +CPU= 29.613
  18:57:17 STEP  981 H= 245:15 +CPU= 28.978
  18:57:47 STEP  982 H= 245:30 +CPU= 29.023
  18:58:18 STEP  983 H= 245:45 +CPU= 28.993
  18:58:56 STEP  984 H= 246:00 +CPU= 35.696
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000984
  18:59:26 STEP  985 H= 246:15 +CPU= 28.996
  18:59:57 STEP  986 H= 246:30 +CPU= 29.052
  19:00:27 STEP  987 H= 246:45 +CPU= 28.941
  19:00:59 STEP  988 H= 247:00 +CPU= 29.681
  19:01:29 STEP  989 H= 247:15 +CPU= 29.029
  19:01:59 STEP  990 H= 247:30 +CPU= 29.142
  19:02:30 STEP  991 H= 247:45 +CPU= 28.817
  19:03:02 STEP  992 H= 248:00 +CPU= 29.786
  19:03:32 STEP  993 H= 248:15 +CPU= 29.116
  19:04:03 STEP  994 H= 248:30 +CPU= 29.080
  19:04:34 STEP  995 H= 248:45 +CPU= 29.163
  19:05:11 STEP  996 H= 249:00 +CPU= 35.763
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000996
  19:05:42 STEP  997 H= 249:15 +CPU= 29.032
  19:06:13 STEP  998 H= 249:30 +CPU= 29.157
  19:06:43 STEP  999 H= 249:45 +CPU= 29.026
  19:07:14 STEP 1000 H= 250:00 +CPU= 29.781
  19:07:45 STEP 1001 H= 250:15 +CPU= 29.034
  19:08:15 STEP 1002 H= 250:30 +CPU= 29.155
  19:08:46 STEP 1003 H= 250:45 +CPU= 28.994
  19:09:17 STEP 1004 H= 251:00 +CPU= 29.649
  19:09:48 STEP 1005 H= 251:15 +CPU= 28.919
  19:10:19 STEP 1006 H= 251:30 +CPU= 28.959
  19:10:49 STEP 1007 H= 251:45 +CPU= 28.880
  19:11:31 STEP 1008 H= 252:00 +CPU= 38.735
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001008
  19:12:01 STEP 1009 H= 252:15 +CPU= 29.005
  19:12:32 STEP 1010 H= 252:30 +CPU= 28.984
  19:13:03 STEP 1011 H= 252:45 +CPU= 28.878
  19:13:34 STEP 1012 H= 253:00 +CPU= 29.505
  19:14:05 STEP 1013 H= 253:15 +CPU= 29.009
  19:14:34 STEP 1014 H= 253:30 +CPU= 28.858
  19:15:05 STEP 1015 H= 253:45 +CPU= 28.991
  19:15:35 STEP 1016 H= 254:00 +CPU= 29.452
  19:16:06 STEP 1017 H= 254:15 +CPU= 29.054
  19:16:36 STEP 1018 H= 254:30 +CPU= 29.150
  19:17:07 STEP 1019 H= 254:45 +CPU= 29.117
  19:17:44 STEP 1020 H= 255:00 +CPU= 36.053
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001020
  19:18:15 STEP 1021 H= 255:15 +CPU= 29.118
  19:18:46 STEP 1022 H= 255:30 +CPU= 29.121
  19:19:18 STEP 1023 H= 255:45 +CPU= 29.104
  19:19:48 STEP 1024 H= 256:00 +CPU= 29.412
  19:20:19 STEP 1025 H= 256:15 +CPU= 28.901
  19:20:49 STEP 1026 H= 256:30 +CPU= 28.925
  19:21:19 STEP 1027 H= 256:45 +CPU= 28.777
  19:21:51 STEP 1028 H= 257:00 +CPU= 29.951
  19:22:23 STEP 1029 H= 257:15 +CPU= 29.635
  19:22:55 STEP 1030 H= 257:30 +CPU= 29.449
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:39:48 STEP 1031 H= 257:45 +CPU= 28.040
  21:40:28 STEP 1032 H= 258:00 +CPU= 36.833
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001032
  21:40:59 STEP 1033 H= 258:15 +CPU= 29.915
  21:41:30 STEP 1034 H= 258:30 +CPU= 29.913
  21:42:01 STEP 1035 H= 258:45 +CPU= 29.445
  21:42:34 STEP 1036 H= 259:00 +CPU= 30.783
  21:43:06 STEP 1037 H= 259:15 +CPU= 30.245
  21:43:37 STEP 1038 H= 259:30 +CPU= 29.631
  21:44:07 STEP 1039 H= 259:45 +CPU= 29.480
  21:44:39 STEP 1040 H= 260:00 +CPU= 30.266
  21:45:12 STEP 1041 H= 260:15 +CPU= 30.202
  21:45:45 STEP 1042 H= 260:30 +CPU= 29.913
  21:46:18 STEP 1043 H= 260:45 +CPU= 29.954
  21:47:00 STEP 1044 H= 261:00 +CPU= 37.175
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001044
  21:47:29 STEP 1045 H= 261:15 +CPU= 29.050
  21:48:04 STEP 1046 H= 261:30 +CPU= 29.826
  21:48:37 STEP 1047 H= 261:45 +CPU= 29.900
  21:49:11 STEP 1048 H= 262:00 +CPU= 30.257
  21:49:41 STEP 1049 H= 262:15 +CPU= 29.137
  21:50:11 STEP 1050 H= 262:30 +CPU= 29.276
  21:50:41 STEP 1051 H= 262:45 +CPU= 29.170
  21:51:11 STEP 1052 H= 263:00 +CPU= 29.855
  21:51:42 STEP 1053 H= 263:15 +CPU= 29.186
  21:52:11 STEP 1054 H= 263:30 +CPU= 29.004
  21:52:41 STEP 1055 H= 263:45 +CPU= 29.169
  21:53:21 STEP 1056 H= 264:00 +CPU= 38.879
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_10.zip
Uploading the intermediate file: upload_file_10.zip
  21:53:52 STEP 1057 H= 264:15 +CPU= 29.265
  21:54:22 STEP 1058 H= 264:30 +CPU= 29.689
  21:54:52 STEP 1059 H= 264:45 +CPU= 28.992
  21:55:23 STEP 1060 H= 265:00 +CPU= 29.746
  21:55:53 STEP 1061 H= 265:15 +CPU= 29.096
  21:56:22 STEP 1062 H= 265:30 +CPU= 28.911
  21:56:52 STEP 1063 H= 265:45 +CPU= 29.120
  21:57:23 STEP 1064 H= 266:00 +CPU= 29.828
  21:57:54 STEP 1065 H= 266:15 +CPU= 29.438
  21:58:25 STEP 1066 H= 266:30 +CPU= 29.330
  21:58:56 STEP 1067 H= 266:45 +CPU= 29.345
  21:59:33 STEP 1068 H= 267:00 +CPU= 36.028
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001068
  22:00:05 STEP 1069 H= 267:15 +CPU= 29.881
  22:00:35 STEP 1070 H= 267:30 +CPU= 29.333
  22:01:06 STEP 1071 H= 267:45 +CPU= 29.642
  22:01:37 STEP 1072 H= 268:00 +CPU= 29.800
  22:02:08 STEP 1073 H= 268:15 +CPU= 29.202
  22:02:38 STEP 1074 H= 268:30 +CPU= 29.451
  22:03:09 STEP 1075 H= 268:45 +CPU= 29.238
  22:03:40 STEP 1076 H= 269:00 +CPU= 29.775
  22:04:13 STEP 1077 H= 269:15 +CPU= 29.875
  22:04:44 STEP 1078 H= 269:30 +CPU= 29.491
  22:05:15 STEP 1079 H= 269:45 +CPU= 29.693
  22:05:56 STEP 1080 H= 270:00 +CPU= 36.483
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001080
  22:06:26 STEP 1081 H= 270:15 +CPU= 29.604
  22:06:58 STEP 1082 H= 270:30 +CPU= 29.627
  22:07:29 STEP 1083 H= 270:45 +CPU= 29.530
  22:07:59 STEP 1084 H= 271:00 +CPU= 29.740
  22:08:29 STEP 1085 H= 271:15 +CPU= 29.119
  22:08:58 STEP 1086 H= 271:30 +CPU= 29.032
  22:09:28 STEP 1087 H= 271:45 +CPU= 28.956
  22:09:58 STEP 1088 H= 272:00 +CPU= 29.691
  22:10:28 STEP 1089 H= 272:15 +CPU= 28.944
  22:10:57 STEP 1090 H= 272:30 +CPU= 28.931
  22:11:27 STEP 1091 H= 272:45 +CPU= 29.088
  22:12:04 STEP 1092 H= 273:00 +CPU= 36.139
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001092
  22:12:33 STEP 1093 H= 273:15 +CPU= 29.106
  22:13:03 STEP 1094 H= 273:30 +CPU= 29.259
  22:13:33 STEP 1095 H= 273:45 +CPU= 29.197
  22:14:03 STEP 1096 H= 274:00 +CPU= 29.717
  22:14:33 STEP 1097 H= 274:15 +CPU= 29.188
  22:15:02 STEP 1098 H= 274:30 +CPU= 29.041
  22:15:32 STEP 1099 H= 274:45 +CPU= 29.104
  22:16:02 STEP 1100 H= 275:00 +CPU= 29.724
  22:16:32 STEP 1101 H= 275:15 +CPU= 29.081
  22:17:01 STEP 1102 H= 275:30 +CPU= 28.895
  22:17:31 STEP 1103 H= 275:45 +CPU= 29.141
  22:18:11 STEP 1104 H= 276:00 +CPU= 38.808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001104
  22:18:41 STEP 1105 H= 276:15 +CPU= 29.228
  22:19:10 STEP 1106 H= 276:30 +CPU= 28.773
  22:19:38 STEP 1107 H= 276:45 +CPU= 27.107
  22:20:06 STEP 1108 H= 277:00 +CPU= 27.244
  22:20:34 STEP 1109 H= 277:15 +CPU= 28.483
  22:21:04 STEP 1110 H= 277:30 +CPU= 28.897
  22:21:33 STEP 1111 H= 277:45 +CPU= 28.723
  22:22:03 STEP 1112 H= 278:00 +CPU= 29.340
  22:22:32 STEP 1113 H= 278:15 +CPU= 28.580
  22:23:01 STEP 1114 H= 278:30 +CPU= 28.692
  22:23:30 STEP 1115 H= 278:45 +CPU= 28.475
  22:24:06 STEP 1116 H= 279:00 +CPU= 35.424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001116
  22:24:35 STEP 1117 H= 279:15 +CPU= 28.737
  22:25:05 STEP 1118 H= 279:30 +CPU= 28.817
  22:25:34 STEP 1119 H= 279:45 +CPU= 28.848
  22:26:04 STEP 1120 H= 280:00 +CPU= 29.623
  22:26:34 STEP 1121 H= 280:15 +CPU= 29.055
  22:27:03 STEP 1122 H= 280:30 +CPU= 29.113
  22:27:33 STEP 1123 H= 280:45 +CPU= 29.295
  22:28:04 STEP 1124 H= 281:00 +CPU= 29.717
  22:28:34 STEP 1125 H= 281:15 +CPU= 29.272
  22:29:04 STEP 1126 H= 281:30 +CPU= 29.188
  22:29:33 STEP 1127 H= 281:45 +CPU= 29.041
  22:30:10 STEP 1128 H= 282:00 +CPU= 35.996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001128
  22:30:40 STEP 1129 H= 282:15 +CPU= 29.264
  22:31:10 STEP 1130 H= 282:30 +CPU= 29.481
  22:31:40 STEP 1131 H= 282:45 +CPU= 29.051
  22:32:09 STEP 1132 H= 283:00 +CPU= 27.490
  22:32:38 STEP 1133 H= 283:15 +CPU= 28.795
  22:33:08 STEP 1134 H= 283:30 +CPU= 29.226
  22:33:38 STEP 1135 H= 283:45 +CPU= 29.124
  22:34:08 STEP 1136 H= 284:00 +CPU= 29.819
  22:34:38 STEP 1137 H= 284:15 +CPU= 29.168
  22:35:07 STEP 1138 H= 284:30 +CPU= 29.071
  22:35:37 STEP 1139 H= 284:45 +CPU= 28.903
  22:36:13 STEP 1140 H= 285:00 +CPU= 35.387
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001140
  22:36:42 STEP 1141 H= 285:15 +CPU= 28.860
  22:37:12 STEP 1142 H= 285:30 +CPU= 28.869
  22:37:41 STEP 1143 H= 285:45 +CPU= 28.742
  22:38:10 STEP 1144 H= 286:00 +CPU= 29.107
  22:38:39 STEP 1145 H= 286:15 +CPU= 28.604
  22:39:09 STEP 1146 H= 286:30 +CPU= 28.729
  22:39:38 STEP 1147 H= 286:45 +CPU= 28.670
  22:40:08 STEP 1148 H= 287:00 +CPU= 29.264
  22:40:37 STEP 1149 H= 287:15 +CPU= 28.480
  22:41:06 STEP 1150 H= 287:30 +CPU= 28.689
  22:41:35 STEP 1151 H= 287:45 +CPU= 28.808
  22:42:15 STEP 1152 H= 288:00 +CPU= 38.430
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_11.zip
Uploading the intermediate file: upload_file_11.zip
  22:42:44 STEP 1153 H= 288:15 +CPU= 28.757
  22:43:14 STEP 1154 H= 288:30 +CPU= 29.234
  22:43:43 STEP 1155 H= 288:45 +CPU= 28.730
  22:44:13 STEP 1156 H= 289:00 +CPU= 29.497
  22:44:42 STEP 1157 H= 289:15 +CPU= 28.869
  22:45:12 STEP 1158 H= 289:30 +CPU= 28.837
  22:45:41 STEP 1159 H= 289:45 +CPU= 28.820
  22:46:11 STEP 1160 H= 290:00 +CPU= 29.387
  22:46:40 STEP 1161 H= 290:15 +CPU= 28.870
  22:47:10 STEP 1162 H= 290:30 +CPU= 28.769
  22:47:39 STEP 1163 H= 290:45 +CPU= 28.769
  22:48:15 STEP 1164 H= 291:00 +CPU= 35.764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001164
  22:48:45 STEP 1165 H= 291:15 +CPU= 28.917
  22:49:14 STEP 1166 H= 291:30 +CPU= 28.819
  22:49:43 STEP 1167 H= 291:45 +CPU= 28.634
  22:50:13 STEP 1168 H= 292:00 +CPU= 29.434
  22:50:42 STEP 1169 H= 292:15 +CPU= 28.899
  22:51:12 STEP 1170 H= 292:30 +CPU= 28.907
  22:51:42 STEP 1171 H= 292:45 +CPU= 28.863
  22:52:11 STEP 1172 H= 293:00 +CPU= 29.418
  22:52:41 STEP 1173 H= 293:15 +CPU= 28.914
  22:53:11 STEP 1174 H= 293:30 +CPU= 29.167
  22:53:40 STEP 1175 H= 293:45 +CPU= 28.694
  22:54:16 STEP 1176 H= 294:00 +CPU= 35.591
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001176
  22:54:45 STEP 1177 H= 294:15 +CPU= 28.774
  22:55:15 STEP 1178 H= 294:30 +CPU= 28.905
  22:55:44 STEP 1179 H= 294:45 +CPU= 28.617
  22:56:14 STEP 1180 H= 295:00 +CPU= 29.438
  22:56:43 STEP 1181 H= 295:15 +CPU= 28.848
  22:57:13 STEP 1182 H= 295:30 +CPU= 28.877
  22:57:42 STEP 1183 H= 295:45 +CPU= 28.934
  22:58:12 STEP 1184 H= 296:00 +CPU= 29.215
  22:58:39 STEP 1185 H= 296:15 +CPU= 26.426
  22:59:07 STEP 1186 H= 296:30 +CPU= 28.286
  22:59:37 STEP 1187 H= 296:45 +CPU= 28.950
  23:00:13 STEP 1188 H= 297:00 +CPU= 35.427
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001188
  23:00:42 STEP 1189 H= 297:15 +CPU= 28.799
  23:01:12 STEP 1190 H= 297:30 +CPU= 28.952
  23:01:41 STEP 1191 H= 297:45 +CPU= 28.668
  23:02:11 STEP 1192 H= 298:00 +CPU= 29.393
  23:02:40 STEP 1193 H= 298:15 +CPU= 28.787
  23:03:10 STEP 1194 H= 298:30 +CPU= 28.908
  23:03:38 STEP 1195 H= 298:45 +CPU= 28.711
  23:04:09 STEP 1196 H= 299:00 +CPU= 29.500
  23:04:38 STEP 1197 H= 299:15 +CPU= 29.010
  23:05:07 STEP 1198 H= 299:30 +CPU= 29.026
  23:05:37 STEP 1199 H= 299:45 +CPU= 28.930
  23:06:17 STEP 1200 H= 300:00 +CPU= 38.906
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001200
  23:06:46 STEP 1201 H= 300:15 +CPU= 28.668
  23:07:15 STEP 1202 H= 300:30 +CPU= 28.674
  23:07:44 STEP 1203 H= 300:45 +CPU= 28.816
  23:08:14 STEP 1204 H= 301:00 +CPU= 29.331
  23:08:41 STEP 1205 H= 301:15 +CPU= 26.325
  23:09:07 STEP 1206 H= 301:30 +CPU= 26.162
  23:09:36 STEP 1207 H= 301:45 +CPU= 28.637
  23:10:06 STEP 1208 H= 302:00 +CPU= 29.353
  23:10:36 STEP 1209 H= 302:15 +CPU= 28.863
  23:11:05 STEP 1210 H= 302:30 +CPU= 28.758
  23:11:34 STEP 1211 H= 302:45 +CPU= 28.706
  23:12:11 STEP 1212 H= 303:00 +CPU= 36.133
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001212
  23:12:40 STEP 1213 H= 303:15 +CPU= 28.681
  23:13:10 STEP 1214 H= 303:30 +CPU= 28.910
  23:13:40 STEP 1215 H= 303:45 +CPU= 28.899
  23:14:10 STEP 1216 H= 304:00 +CPU= 29.518
  23:14:39 STEP 1217 H= 304:15 +CPU= 28.902
  23:15:08 STEP 1218 H= 304:30 +CPU= 28.661
  23:15:37 STEP 1219 H= 304:45 +CPU= 28.824
  23:16:07 STEP 1220 H= 305:00 +CPU= 29.498
  23:16:37 STEP 1221 H= 305:15 +CPU= 28.847
  23:17:06 STEP 1222 H= 305:30 +CPU= 28.644
  23:17:35 STEP 1223 H= 305:45 +CPU= 28.845
  23:18:11 STEP 1224 H= 306:00 +CPU= 35.560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001224
  23:18:40 STEP 1225 H= 306:15 +CPU= 28.587
  23:19:10 STEP 1226 H= 306:30 +CPU= 28.944
  23:19:41 STEP 1227 H= 306:45 +CPU= 28.777
  23:20:12 STEP 1228 H= 307:00 +CPU= 29.691
  23:20:41 STEP 1229 H= 307:15 +CPU= 29.220
  23:21:11 STEP 1230 H= 307:30 +CPU= 28.877
  23:21:40 STEP 1231 H= 307:45 +CPU= 28.736
  23:22:10 STEP 1232 H= 308:00 +CPU= 29.521
  23:22:39 STEP 1233 H= 308:15 +CPU= 28.739
  23:23:08 STEP 1234 H= 308:30 +CPU= 28.754
  23:23:37 STEP 1235 H= 308:45 +CPU= 28.582
  23:24:13 STEP 1236 H= 309:00 +CPU= 35.687
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001236
  23:24:42 STEP 1237 H= 309:15 +CPU= 28.640
  23:25:12 STEP 1238 H= 309:30 +CPU= 28.834
  23:25:41 STEP 1239 H= 309:45 +CPU= 28.818
  23:26:11 STEP 1240 H= 310:00 +CPU= 29.489
  23:26:40 STEP 1241 H= 310:15 +CPU= 28.801
  23:27:10 STEP 1242 H= 310:30 +CPU= 28.864
  23:27:39 STEP 1243 H= 310:45 +CPU= 28.821
  23:28:09 STEP 1244 H= 311:00 +CPU= 29.448
  23:28:38 STEP 1245 H= 311:15 +CPU= 28.709
  23:29:07 STEP 1246 H= 311:30 +CPU= 28.609
  23:29:36 STEP 1247 H= 311:45 +CPU= 28.779
  23:30:15 STEP 1248 H= 312:00 +CPU= 38.180
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_12.zip
Uploading the intermediate file: upload_file_12.zip
  23:30:46 STEP 1249 H= 312:15 +CPU= 28.878
  23:31:15 STEP 1250 H= 312:30 +CPU= 29.081
  23:31:44 STEP 1251 H= 312:45 +CPU= 28.656
  23:32:14 STEP 1252 H= 313:00 +CPU= 29.225
  23:32:43 STEP 1253 H= 313:15 +CPU= 28.705
  23:33:13 STEP 1254 H= 313:30 +CPU= 28.834
  23:33:42 STEP 1255 H= 313:45 +CPU= 28.882
  23:34:12 STEP 1256 H= 314:00 +CPU= 29.432
  23:34:42 STEP 1257 H= 314:15 +CPU= 28.754
  23:35:11 STEP 1258 H= 314:30 +CPU= 28.660
  23:35:40 STEP 1259 H= 314:45 +CPU= 28.691
  23:36:16 STEP 1260 H= 315:00 +CPU= 35.427
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001260
  23:36:45 STEP 1261 H= 315:15 +CPU= 28.899
  23:37:15 STEP 1262 H= 315:30 +CPU= 28.676
  23:37:44 STEP 1263 H= 315:45 +CPU= 28.779
  23:38:11 STEP 1264 H= 316:00 +CPU= 27.094
  23:38:38 STEP 1265 H= 316:15 +CPU= 26.100
  23:39:06 STEP 1266 H= 316:30 +CPU= 28.023
  23:39:36 STEP 1267 H= 316:45 +CPU= 28.802
  23:40:05 STEP 1268 H= 317:00 +CPU= 29.494
  23:40:35 STEP 1269 H= 317:15 +CPU= 28.780
  23:41:04 STEP 1270 H= 317:30 +CPU= 28.695
  23:41:33 STEP 1271 H= 317:45 +CPU= 28.776
  23:42:09 STEP 1272 H= 318:00 +CPU= 35.448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001272
  23:42:38 STEP 1273 H= 318:15 +CPU= 28.999
  23:43:08 STEP 1274 H= 318:30 +CPU= 28.725
  23:43:36 STEP 1275 H= 318:45 +CPU= 28.577
  23:44:06 STEP 1276 H= 319:00 +CPU= 29.414
  23:44:36 STEP 1277 H= 319:15 +CPU= 28.821
  23:45:05 STEP 1278 H= 319:30 +CPU= 28.625
  23:45:34 STEP 1279 H= 319:45 +CPU= 28.737
  23:46:03 STEP 1280 H= 320:00 +CPU= 29.528
  23:46:33 STEP 1281 H= 320:15 +CPU= 28.835
  23:47:02 STEP 1282 H= 320:30 +CPU= 28.766
  23:47:30 STEP 1283 H= 320:45 +CPU= 27.242
  23:48:03 STEP 1284 H= 321:00 +CPU= 32.419
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001284
  23:48:32 STEP 1285 H= 321:15 +CPU= 28.896
  23:49:01 STEP 1286 H= 321:30 +CPU= 28.704
  23:49:30 STEP 1287 H= 321:45 +CPU= 28.647
  23:50:00 STEP 1288 H= 322:00 +CPU= 29.412
  23:50:30 STEP 1289 H= 322:15 +CPU= 28.837
  23:50:58 STEP 1290 H= 322:30 +CPU= 28.436
  23:51:27 STEP 1291 H= 322:45 +CPU= 28.633
  23:51:57 STEP 1292 H= 323:00 +CPU= 29.459
  23:52:27 STEP 1293 H= 323:15 +CPU= 28.842
  23:52:56 STEP 1294 H= 323:30 +CPU= 28.789
  23:53:25 STEP 1295 H= 323:45 +CPU= 28.744
  23:54:05 STEP 1296 H= 324:00 +CPU= 38.311
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001296
  23:54:34 STEP 1297 H= 324:15 +CPU= 28.834
  23:55:03 STEP 1298 H= 324:30 +CPU= 28.875
  23:55:33 STEP 1299 H= 324:45 +CPU= 28.837
  23:56:02 STEP 1300 H= 325:00 +CPU= 29.319
  23:56:31 STEP 1301 H= 325:15 +CPU= 28.745
  23:57:00 STEP 1302 H= 325:30 +CPU= 28.543
  23:57:30 STEP 1303 H= 325:45 +CPU= 28.762
  23:58:00 STEP 1304 H= 326:00 +CPU= 29.296
  23:58:29 STEP 1305 H= 326:15 +CPU= 28.713
  23:58:59 STEP 1306 H= 326:30 +CPU= 28.738
  23:59:28 STEP 1307 H= 326:45 +CPU= 28.794
  00:00:04 STEP 1308 H= 327:00 +CPU= 35.513
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001308
  00:00:33 STEP 1309 H= 327:15 +CPU= 28.815
  00:01:02 STEP 1310 H= 327:30 +CPU= 27.990
  00:01:30 STEP 1311 H= 327:45 +CPU= 26.582
  00:01:58 STEP 1312 H= 328:00 +CPU= 27.093
  00:02:25 STEP 1313 H= 328:15 +CPU= 26.626
  00:02:54 STEP 1314 H= 328:30 +CPU= 28.845
  00:03:24 STEP 1315 H= 328:45 +CPU= 29.288
  00:03:56 STEP 1316 H= 329:00 +CPU= 30.515
  00:04:25 STEP 1317 H= 329:15 +CPU= 28.602
  00:04:54 STEP 1318 H= 329:30 +CPU= 27.224
  00:05:24 STEP 1319 H= 329:45 +CPU= 28.549
  00:06:00 STEP 1320 H= 330:00 +CPU= 35.852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001320
  00:06:30 STEP 1321 H= 330:15 +CPU= 28.982
  00:06:59 STEP 1322 H= 330:30 +CPU= 28.842
  00:07:29 STEP 1323 H= 330:45 +CPU= 28.974
  00:07:59 STEP 1324 H= 331:00 +CPU= 29.679
  00:08:28 STEP 1325 H= 331:15 +CPU= 28.904
  00:08:58 STEP 1326 H= 331:30 +CPU= 28.895
  00:09:28 STEP 1327 H= 331:45 +CPU= 28.977
  00:09:58 STEP 1328 H= 332:00 +CPU= 29.508
  00:10:28 STEP 1329 H= 332:15 +CPU= 29.145
  00:10:56 STEP 1330 H= 332:30 +CPU= 28.585
  00:11:27 STEP 1331 H= 332:45 +CPU= 27.071
  00:12:03 STEP 1332 H= 333:00 +CPU= 35.431
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001332
  00:12:33 STEP 1333 H= 333:15 +CPU= 28.854
  00:13:02 STEP 1334 H= 333:30 +CPU= 28.856
  00:13:31 STEP 1335 H= 333:45 +CPU= 28.846
  00:14:01 STEP 1336 H= 334:00 +CPU= 29.498
  00:14:31 STEP 1337 H= 334:15 +CPU= 28.857
  00:15:00 STEP 1338 H= 334:30 +CPU= 28.986
  00:15:30 STEP 1339 H= 334:45 +CPU= 29.001
  00:16:00 STEP 1340 H= 335:00 +CPU= 29.564
  00:16:29 STEP 1341 H= 335:15 +CPU= 28.948
  00:16:59 STEP 1342 H= 335:30 +CPU= 28.922
  00:17:28 STEP 1343 H= 335:45 +CPU= 28.865
  00:18:08 STEP 1344 H= 336:00 +CPU= 38.786
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_13.zip
Uploading the intermediate file: upload_file_13.zip
  00:18:38 STEP 1345 H= 336:15 +CPU= 28.670
  00:19:07 STEP 1346 H= 336:30 +CPU= 28.556
  00:19:36 STEP 1347 H= 336:45 +CPU= 27.345
  00:20:06 STEP 1348 H= 337:00 +CPU= 29.444
  00:20:35 STEP 1349 H= 337:15 +CPU= 28.728
  00:21:04 STEP 1350 H= 337:30 +CPU= 28.744
  00:21:34 STEP 1351 H= 337:45 +CPU= 28.827
  00:22:04 STEP 1352 H= 338:00 +CPU= 29.498
  00:22:33 STEP 1353 H= 338:15 +CPU= 28.753
  00:23:02 STEP 1354 H= 338:30 +CPU= 28.959
  00:23:31 STEP 1355 H= 338:45 +CPU= 28.877
  00:24:08 STEP 1356 H= 339:00 +CPU= 35.691
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001356
  00:24:37 STEP 1357 H= 339:15 +CPU= 28.748
  00:25:07 STEP 1358 H= 339:30 +CPU= 28.918
  00:25:36 STEP 1359 H= 339:45 +CPU= 28.855
  00:26:06 STEP 1360 H= 340:00 +CPU= 29.452
  00:26:35 STEP 1361 H= 340:15 +CPU= 28.904
  00:27:05 STEP 1362 H= 340:30 +CPU= 28.788
  00:27:34 STEP 1363 H= 340:45 +CPU= 28.910
  00:28:03 STEP 1364 H= 341:00 +CPU= 28.106
  00:28:30 STEP 1365 H= 341:15 +CPU= 26.327
  00:28:59 STEP 1366 H= 341:30 +CPU= 28.674
  00:29:29 STEP 1367 H= 341:45 +CPU= 28.935
  00:30:05 STEP 1368 H= 342:00 +CPU= 35.813
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001368
  00:30:35 STEP 1369 H= 342:15 +CPU= 28.848
  00:31:04 STEP 1370 H= 342:30 +CPU= 28.915
  00:31:34 STEP 1371 H= 342:45 +CPU= 28.751
  00:32:04 STEP 1372 H= 343:00 +CPU= 29.596
  00:32:33 STEP 1373 H= 343:15 +CPU= 28.790
  00:33:03 STEP 1374 H= 343:30 +CPU= 28.914
  00:33:32 STEP 1375 H= 343:45 +CPU= 28.905
  00:34:02 STEP 1376 H= 344:00 +CPU= 29.589
  00:34:31 STEP 1377 H= 344:15 +CPU= 28.572
  00:35:01 STEP 1378 H= 344:30 +CPU= 29.040
  00:35:32 STEP 1379 H= 344:45 +CPU= 29.092
  00:36:08 STEP 1380 H= 345:00 +CPU= 35.699
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001380
  00:36:38 STEP 1381 H= 345:15 +CPU= 28.963
  00:37:07 STEP 1382 H= 345:30 +CPU= 29.003
  00:37:37 STEP 1383 H= 345:45 +CPU= 28.950
  00:38:07 STEP 1384 H= 346:00 +CPU= 29.476
  00:38:36 STEP 1385 H= 346:15 +CPU= 28.857
  00:39:05 STEP 1386 H= 346:30 +CPU= 28.794
  00:39:35 STEP 1387 H= 346:45 +CPU= 28.854
  00:40:05 STEP 1388 H= 347:00 +CPU= 29.537
  00:40:35 STEP 1389 H= 347:15 +CPU= 28.739
  00:41:05 STEP 1390 H= 347:30 +CPU= 28.649
  00:41:35 STEP 1391 H= 347:45 +CPU= 27.332
  00:42:11 STEP 1392 H= 348:00 +CPU= 35.447
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001392
  00:42:38 STEP 1393 H= 348:15 +CPU= 26.190
  00:43:06 STEP 1394 H= 348:30 +CPU= 27.649
  00:43:35 STEP 1395 H= 348:45 +CPU= 28.622
  00:44:05 STEP 1396 H= 349:00 +CPU= 29.400
  00:44:34 STEP 1397 H= 349:15 +CPU= 28.878
  00:45:04 STEP 1398 H= 349:30 +CPU= 28.838
  00:45:33 STEP 1399 H= 349:45 +CPU= 28.683
  00:46:03 STEP 1400 H= 350:00 +CPU= 29.379
  00:46:32 STEP 1401 H= 350:15 +CPU= 28.806
  00:47:01 STEP 1402 H= 350:30 +CPU= 28.739
  00:47:31 STEP 1403 H= 350:45 +CPU= 28.808
  00:48:07 STEP 1404 H= 351:00 +CPU= 35.459
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001404
  00:48:36 STEP 1405 H= 351:15 +CPU= 28.725
  00:49:05 STEP 1406 H= 351:30 +CPU= 28.720
  00:49:34 STEP 1407 H= 351:45 +CPU= 28.709
  00:50:04 STEP 1408 H= 352:00 +CPU= 29.347
  00:50:34 STEP 1409 H= 352:15 +CPU= 28.761
  00:51:03 STEP 1410 H= 352:30 +CPU= 28.816
  00:51:32 STEP 1411 H= 352:45 +CPU= 28.732
  00:52:02 STEP 1412 H= 353:00 +CPU= 29.385
  00:52:32 STEP 1413 H= 353:15 +CPU= 28.847
  00:53:01 STEP 1414 H= 353:30 +CPU= 28.788
  00:53:31 STEP 1415 H= 353:45 +CPU= 28.776
  00:54:07 STEP 1416 H= 354:00 +CPU= 35.715
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001416
  00:54:35 STEP 1417 H= 354:15 +CPU= 27.357
  00:54:58 STEP 1418 H= 354:30 +CPU= 23.283
  00:55:22 STEP 1419 H= 354:45 +CPU= 23.339
  00:55:46 STEP 1420 H= 355:00 +CPU= 23.791
  00:56:10 STEP 1421 H= 355:15 +CPU= 23.483
  00:56:34 STEP 1422 H= 355:30 +CPU= 23.526
  00:56:58 STEP 1423 H= 355:45 +CPU= 23.249
  00:57:21 STEP 1424 H= 356:00 +CPU= 23.661
  00:57:45 STEP 1425 H= 356:15 +CPU= 23.399
  00:58:09 STEP 1426 H= 356:30 +CPU= 23.737
  00:58:36 STEP 1427 H= 356:45 +CPU= 26.050
  00:59:12 STEP 1428 H= 357:00 +CPU= 35.148
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001428
  00:59:41 STEP 1429 H= 357:15 +CPU= 28.954
  01:00:11 STEP 1430 H= 357:30 +CPU= 29.002
  01:00:40 STEP 1431 H= 357:45 +CPU= 28.971
  01:01:11 STEP 1432 H= 358:00 +CPU= 29.967
  01:01:41 STEP 1433 H= 358:15 +CPU= 28.811
  01:02:10 STEP 1434 H= 358:30 +CPU= 27.244
  01:02:37 STEP 1435 H= 358:45 +CPU= 26.742
  01:03:06 STEP 1436 H= 359:00 +CPU= 28.585
  01:03:35 STEP 1437 H= 359:15 +CPU= 28.670
  01:04:04 STEP 1438 H= 359:30 +CPU= 28.815
  01:04:34 STEP 1439 H= 359:45 +CPU= 29.160
  01:05:11 STEP 1440 H= 360:00 +CPU= 36.425
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.7336927977E-21      I       0.3499540526E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2918857728E-01      I
I  Relat. Hum. I      0.3847358978E+00      I       0.4221783787E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5576421634E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    323190180 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS807975.5 Mbytes/s, TOTAL TIME=    0.0108( 3.7%)
 01:05:11 STEP 1440 H= 360:00 +CPU= 36.425
 END CNT3
 NSTEP =  1440 CNT0   000000000  27.486  27.486  28.257   0.973               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    65.2     0.0    65.2     0.0   147.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    4436.8    4436.8     13.17      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     870.8     870.8      2.38      0.00
  10 SCAN2M - PHYSICS                             1441   15738.9   15738.9     43.09      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     754.0     754.0      0.17      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      36.6      36.6      0.00      0.00
  14 SUINIF                                          1    6506.6    6506.6      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      28.1      28.1      0.01      0.00
  18 SUSPECG                                         1    3299.3    3299.3      0.01      0.00
  19 SUSPEC                                          1    3305.1    3305.1      0.01      0.00
  24 SUGRIDU                                         1    2798.9    2798.9      0.01      0.00
  25 SPECRT                                          1     266.0     266.0      0.00      0.00
  26 SUGRIDF                                         1     136.6     136.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    3041.3    3041.3      0.17      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6444.6    6444.6      1.48      0.00
  31 POSDDH IN STEPO                                 7      35.1      35.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441   11642.4   11642.4     31.87      0.00
  39 SU0YOMB                                         1     343.6     343.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      31.3      31.3      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     478.6     478.6      1.31      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      87.2      87.2      0.24      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     415.2     415.2      2.47      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     239.5     239.5      1.37      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      95.4      95.4      0.54      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     142.9     142.9      0.85      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      44.9      44.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      50.3      50.3      0.30      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      28.2      28.2      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      84.9      84.9      0.50      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      24.7      24.7      0.14      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    52633.7 CPU TIME   42538.5 VECTOR TIME    42538.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       24.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281854/ICMGGh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
01:08:40 (1768234): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0_r1215173794_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Jul 2024 00:00:32 1512622 22433421 oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0 1,295,100 42,538 0.0328
03 Jul 2024 19:39:50 1512622 22433421 oifs_43r3_bl_a00r_2016092300_20_1017_12281854_0 864,000 28,411 0.0329


©2024 cpdn.org