climateprediction.net home page
Task 22433520

Task 22433520

Name oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0
Workunit 12281953
Created 7 Jun 2024, 11:01:52 UTC
Sent 7 Jun 2024, 11:14:04 UTC
Report deadline 6 Aug 2024, 11:14:04 UTC
Received 8 Jun 2024, 1:29:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1550999
Run time 12 hours 25 min 16 sec
CPU time 12 hours 25 min 16 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,010.02 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,369.58 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
U= 27.430
  22:04:50 STEP  834 H= 208:30 +CPU= 27.228
  22:05:18 STEP  835 H= 208:45 +CPU= 27.218
  22:05:49 STEP  836 H= 209:00 +CPU= 29.534
  22:06:17 STEP  837 H= 209:15 +CPU= 27.264
  22:06:46 STEP  838 H= 209:30 +CPU= 27.585
  22:07:15 STEP  839 H= 209:45 +CPU= 28.600
  22:07:52 STEP  840 H= 210:00 +CPU= 35.949
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000840
  22:08:20 STEP  841 H= 210:15 +CPU= 27.950
  22:08:49 STEP  842 H= 210:30 +CPU= 28.057
  22:09:19 STEP  843 H= 210:45 +CPU= 28.570
  22:09:47 STEP  844 H= 211:00 +CPU= 28.022
  22:10:15 STEP  845 H= 211:15 +CPU= 26.788
  22:10:44 STEP  846 H= 211:30 +CPU= 28.611
  22:11:13 STEP  847 H= 211:45 +CPU= 28.015
  22:11:42 STEP  848 H= 212:00 +CPU= 28.904
  22:12:10 STEP  849 H= 212:15 +CPU= 27.412
  22:12:40 STEP  850 H= 212:30 +CPU= 28.862
  22:13:09 STEP  851 H= 212:45 +CPU= 28.222
  22:13:44 STEP  852 H= 213:00 +CPU= 35.279
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000852
  22:14:12 STEP  853 H= 213:15 +CPU= 26.821
  22:14:40 STEP  854 H= 213:30 +CPU= 27.694
  22:15:09 STEP  855 H= 213:45 +CPU= 28.018
  22:15:39 STEP  856 H= 214:00 +CPU= 29.274
  22:16:07 STEP  857 H= 214:15 +CPU= 27.284
  22:16:35 STEP  858 H= 214:30 +CPU= 27.448
  22:17:03 STEP  859 H= 214:45 +CPU= 26.831
  22:17:31 STEP  860 H= 215:00 +CPU= 27.998
  22:18:00 STEP  861 H= 215:15 +CPU= 28.729
  22:18:29 STEP  862 H= 215:30 +CPU= 27.624
  22:18:57 STEP  863 H= 215:45 +CPU= 27.754
  22:19:37 STEP  864 H= 216:00 +CPU= 38.350
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000864
  22:20:06 STEP  865 H= 216:15 +CPU= 28.767
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000864
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_8.zip
Uploading the intermediate file: upload_file_8.zip
  22:20:36 STEP  866 H= 216:30 +CPU= 28.054
  22:21:04 STEP  867 H= 216:45 +CPU= 27.519
  22:21:33 STEP  868 H= 217:00 +CPU= 29.165
  22:22:03 STEP  869 H= 217:15 +CPU= 28.944
  22:22:32 STEP  870 H= 217:30 +CPU= 28.082
  22:23:00 STEP  871 H= 217:45 +CPU= 27.699
  22:23:29 STEP  872 H= 218:00 +CPU= 27.903
  22:23:57 STEP  873 H= 218:15 +CPU= 27.800
  22:24:26 STEP  874 H= 218:30 +CPU= 27.877
  22:24:56 STEP  875 H= 218:45 +CPU= 28.926
  22:25:31 STEP  876 H= 219:00 +CPU= 34.532
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000876
  22:26:00 STEP  877 H= 219:15 +CPU= 28.244
  22:26:30 STEP  878 H= 219:30 +CPU= 29.345
  22:26:59 STEP  879 H= 219:45 +CPU= 28.592
  22:27:29 STEP  880 H= 220:00 +CPU= 28.807
  22:27:57 STEP  881 H= 220:15 +CPU= 27.209
  22:28:26 STEP  882 H= 220:30 +CPU= 27.972
  22:28:55 STEP  883 H= 220:45 +CPU= 27.412
  22:29:23 STEP  884 H= 221:00 +CPU= 27.546
  22:29:54 STEP  885 H= 221:15 +CPU= 29.710
  22:30:22 STEP  886 H= 221:30 +CPU= 27.527
  22:30:51 STEP  887 H= 221:45 +CPU= 27.682
  22:31:28 STEP  888 H= 222:00 +CPU= 36.087
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000888
  22:31:55 STEP  889 H= 222:15 +CPU= 26.683
  22:32:23 STEP  890 H= 222:30 +CPU= 27.358
  22:32:51 STEP  891 H= 222:45 +CPU= 27.178
  22:33:21 STEP  892 H= 223:00 +CPU= 30.074
  22:33:49 STEP  893 H= 223:15 +CPU= 27.205
  22:34:17 STEP  894 H= 223:30 +CPU= 27.866
  22:34:45 STEP  895 H= 223:45 +CPU= 27.389
  22:35:15 STEP  896 H= 224:00 +CPU= 29.191
  22:35:43 STEP  897 H= 224:15 +CPU= 27.252
  22:36:11 STEP  898 H= 224:30 +CPU= 26.940
  22:36:38 STEP  899 H= 224:45 +CPU= 27.215
  22:37:13 STEP  900 H= 225:00 +CPU= 34.059
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000900
  22:37:41 STEP  901 H= 225:15 +CPU= 27.475
  22:38:09 STEP  902 H= 225:30 +CPU= 27.369
  22:38:37 STEP  903 H= 225:45 +CPU= 27.769
  22:39:06 STEP  904 H= 226:00 +CPU= 27.834
  22:39:35 STEP  905 H= 226:15 +CPU= 28.290
  22:40:04 STEP  906 H= 226:30 +CPU= 28.423
  22:40:33 STEP  907 H= 226:45 +CPU= 27.728
  22:41:03 STEP  908 H= 227:00 +CPU= 29.686
  22:41:32 STEP  909 H= 227:15 +CPU= 28.027
  22:42:01 STEP  910 H= 227:30 +CPU= 28.433
  22:42:29 STEP  911 H= 227:45 +CPU= 27.224
  22:43:09 STEP  912 H= 228:00 +CPU= 39.428
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000912
  22:43:39 STEP  913 H= 228:15 +CPU= 29.040
  22:44:07 STEP  914 H= 228:30 +CPU= 26.909
  22:44:37 STEP  915 H= 228:45 +CPU= 28.820
  22:45:06 STEP  916 H= 229:00 +CPU= 28.843
  22:45:37 STEP  917 H= 229:15 +CPU= 30.441
  22:46:07 STEP  918 H= 229:30 +CPU= 29.002
  22:46:35 STEP  919 H= 229:45 +CPU= 27.073
  22:47:04 STEP  920 H= 230:00 +CPU= 28.588
  22:47:33 STEP  921 H= 230:15 +CPU= 28.009
  22:48:02 STEP  922 H= 230:30 +CPU= 28.332
  22:48:30 STEP  923 H= 230:45 +CPU= 27.324
  22:49:05 STEP  924 H= 231:00 +CPU= 34.808
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000924
  22:49:33 STEP  925 H= 231:15 +CPU= 27.639
  22:50:02 STEP  926 H= 231:30 +CPU= 27.645
  22:50:33 STEP  927 H= 231:45 +CPU= 29.852
  22:51:01 STEP  928 H= 232:00 +CPU= 27.951
  22:51:29 STEP  929 H= 232:15 +CPU= 27.606
  22:51:57 STEP  930 H= 232:30 +CPU= 26.566
  22:52:25 STEP  931 H= 232:45 +CPU= 27.759
  22:52:54 STEP  932 H= 233:00 +CPU= 28.247
  22:53:23 STEP  933 H= 233:15 +CPU= 27.676
  22:53:52 STEP  934 H= 233:30 +CPU= 28.500
  22:54:20 STEP  935 H= 233:45 +CPU= 27.770
  22:54:57 STEP  936 H= 234:00 +CPU= 35.138
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000936
  22:55:25 STEP  937 H= 234:15 +CPU= 28.062
  22:55:54 STEP  938 H= 234:30 +CPU= 27.544
  22:56:21 STEP  939 H= 234:45 +CPU= 27.280
  22:56:52 STEP  940 H= 235:00 +CPU= 30.108
  22:57:20 STEP  941 H= 235:15 +CPU= 27.507
  22:57:49 STEP  942 H= 235:30 +CPU= 27.702
  22:58:18 STEP  943 H= 235:45 +CPU= 28.813
  22:58:48 STEP  944 H= 236:00 +CPU= 28.898
  22:59:15 STEP  945 H= 236:15 +CPU= 26.947
  22:59:43 STEP  946 H= 236:30 +CPU= 27.366
  23:00:12 STEP  947 H= 236:45 +CPU= 28.950
  23:00:49 STEP  948 H= 237:00 +CPU= 35.644
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000948
  23:01:18 STEP  949 H= 237:15 +CPU= 28.001
  23:01:46 STEP  950 H= 237:30 +CPU= 27.538
  23:02:15 STEP  951 H= 237:45 +CPU= 28.478
  23:02:44 STEP  952 H= 238:00 +CPU= 28.968
  23:03:13 STEP  953 H= 238:15 +CPU= 27.486
  23:03:41 STEP  954 H= 238:30 +CPU= 28.202
  23:04:11 STEP  955 H= 238:45 +CPU= 28.686
  23:04:41 STEP  956 H= 239:00 +CPU= 29.437
  23:05:09 STEP  957 H= 239:15 +CPU= 27.983
  23:05:38 STEP  958 H= 239:30 +CPU= 28.217
  23:06:06 STEP  959 H= 239:45 +CPU= 27.390
  23:06:46 STEP  960 H= 240:00 +CPU= 39.105
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000960
  23:07:13 STEP  961 H= 240:15 +CPU= 26.504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000960
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_9.zip
Uploading the intermediate file: upload_file_9.zip
  23:07:41 STEP  962 H= 240:30 +CPU= 26.766
  23:08:08 STEP  963 H= 240:45 +CPU= 26.743
  23:08:37 STEP  964 H= 241:00 +CPU= 28.036
  23:09:05 STEP  965 H= 241:15 +CPU= 27.739
  23:09:33 STEP  966 H= 241:30 +CPU= 27.057
  23:10:01 STEP  967 H= 241:45 +CPU= 27.736
  23:10:29 STEP  968 H= 242:00 +CPU= 27.653
  23:10:57 STEP  969 H= 242:15 +CPU= 26.698
  23:11:24 STEP  970 H= 242:30 +CPU= 26.852
  23:11:52 STEP  971 H= 242:45 +CPU= 26.743
  23:12:26 STEP  972 H= 243:00 +CPU= 33.821
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000972
  23:12:54 STEP  973 H= 243:15 +CPU= 26.934
  23:13:21 STEP  974 H= 243:30 +CPU= 26.803
  23:13:49 STEP  975 H= 243:45 +CPU= 27.362
  23:14:18 STEP  976 H= 244:00 +CPU= 28.225
  23:14:47 STEP  977 H= 244:15 +CPU= 27.503
  23:15:15 STEP  978 H= 244:30 +CPU= 27.808
  23:15:44 STEP  979 H= 244:45 +CPU= 28.288
  23:16:14 STEP  980 H= 245:00 +CPU= 28.522
  23:16:43 STEP  981 H= 245:15 +CPU= 28.054
  23:17:12 STEP  982 H= 245:30 +CPU= 28.050
  23:17:40 STEP  983 H= 245:45 +CPU= 27.387
  23:18:16 STEP  984 H= 246:00 +CPU= 35.243
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000984
  23:18:45 STEP  985 H= 246:15 +CPU= 28.723
  23:19:13 STEP  986 H= 246:30 +CPU= 27.726
  23:19:42 STEP  987 H= 246:45 +CPU= 28.718
  23:20:13 STEP  988 H= 247:00 +CPU= 30.021
  23:20:41 STEP  989 H= 247:15 +CPU= 27.674
  23:21:09 STEP  990 H= 247:30 +CPU= 27.933
  23:21:37 STEP  991 H= 247:45 +CPU= 27.307
  23:22:06 STEP  992 H= 248:00 +CPU= 28.233
  23:22:34 STEP  993 H= 248:15 +CPU= 27.963
  23:23:03 STEP  994 H= 248:30 +CPU= 28.178
  23:23:31 STEP  995 H= 248:45 +CPU= 27.572
  23:24:06 STEP  996 H= 249:00 +CPU= 34.494
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+000996
  23:24:36 STEP  997 H= 249:15 +CPU= 28.320
  23:25:04 STEP  998 H= 249:30 +CPU= 27.276
  23:25:34 STEP  999 H= 249:45 +CPU= 29.452
  23:26:03 STEP 1000 H= 250:00 +CPU= 28.694
  23:26:33 STEP 1001 H= 250:15 +CPU= 28.646
  23:27:02 STEP 1002 H= 250:30 +CPU= 28.273
  23:27:31 STEP 1003 H= 250:45 +CPU= 28.736
  23:28:01 STEP 1004 H= 251:00 +CPU= 29.701
  23:28:30 STEP 1005 H= 251:15 +CPU= 27.883
  23:28:59 STEP 1006 H= 251:30 +CPU= 28.387
  23:29:29 STEP 1007 H= 251:45 +CPU= 28.551
  23:30:09 STEP 1008 H= 252:00 +CPU= 39.575
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001008
  23:30:38 STEP 1009 H= 252:15 +CPU= 28.021
  23:31:05 STEP 1010 H= 252:30 +CPU= 27.153
  23:31:35 STEP 1011 H= 252:45 +CPU= 28.830
  23:32:06 STEP 1012 H= 253:00 +CPU= 30.211
  23:32:35 STEP 1013 H= 253:15 +CPU= 27.947
  23:33:03 STEP 1014 H= 253:30 +CPU= 28.027
  23:33:32 STEP 1015 H= 253:45 +CPU= 28.342
  23:34:02 STEP 1016 H= 254:00 +CPU= 29.699
  23:34:31 STEP 1017 H= 254:15 +CPU= 28.063
  23:35:00 STEP 1018 H= 254:30 +CPU= 28.565
  23:35:29 STEP 1019 H= 254:45 +CPU= 28.183
  23:36:05 STEP 1020 H= 255:00 +CPU= 34.911
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001020
  23:36:35 STEP 1021 H= 255:15 +CPU= 28.798
  23:37:05 STEP 1022 H= 255:30 +CPU= 29.341
  23:37:34 STEP 1023 H= 255:45 +CPU= 28.956
  23:38:04 STEP 1024 H= 256:00 +CPU= 28.809
  23:38:33 STEP 1025 H= 256:15 +CPU= 28.160
  23:39:01 STEP 1026 H= 256:30 +CPU= 27.370
  23:39:31 STEP 1027 H= 256:45 +CPU= 29.012
  23:40:02 STEP 1028 H= 257:00 +CPU= 29.815
  23:40:30 STEP 1029 H= 257:15 +CPU= 27.797
  23:40:58 STEP 1030 H= 257:30 +CPU= 27.273
  23:41:27 STEP 1031 H= 257:45 +CPU= 27.748
  23:42:04 STEP 1032 H= 258:00 +CPU= 36.318
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001032
  23:42:33 STEP 1033 H= 258:15 +CPU= 27.787
  23:43:01 STEP 1034 H= 258:30 +CPU= 27.587
  23:43:30 STEP 1035 H= 258:45 +CPU= 28.660
  23:43:59 STEP 1036 H= 259:00 +CPU= 27.928
  23:44:27 STEP 1037 H= 259:15 +CPU= 27.326
  23:44:55 STEP 1038 H= 259:30 +CPU= 27.443
  23:45:23 STEP 1039 H= 259:45 +CPU= 27.187
  23:45:53 STEP 1040 H= 260:00 +CPU= 29.315
  23:46:21 STEP 1041 H= 260:15 +CPU= 27.269
  23:46:50 STEP 1042 H= 260:30 +CPU= 28.140
  23:47:18 STEP 1043 H= 260:45 +CPU= 27.767
  23:47:55 STEP 1044 H= 261:00 +CPU= 35.378
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001044
  23:48:22 STEP 1045 H= 261:15 +CPU= 27.046
  23:48:49 STEP 1046 H= 261:30 +CPU= 26.863
  23:49:18 STEP 1047 H= 261:45 +CPU= 27.990
  23:49:47 STEP 1048 H= 262:00 +CPU= 28.324
  23:50:16 STEP 1049 H= 262:15 +CPU= 28.579
  23:50:45 STEP 1050 H= 262:30 +CPU= 28.677
  23:51:14 STEP 1051 H= 262:45 +CPU= 28.076
  23:51:45 STEP 1052 H= 263:00 +CPU= 29.948
  23:52:14 STEP 1053 H= 263:15 +CPU= 28.463
  23:52:42 STEP 1054 H= 263:30 +CPU= 27.030
  23:53:12 STEP 1055 H= 263:45 +CPU= 29.864
  23:53:53 STEP 1056 H= 264:00 +CPU= 39.588
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001056
  23:54:22 STEP 1057 H= 264:15 +CPU= 28.180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001056
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_10.zip
Uploading the intermediate file: upload_file_10.zip
  23:54:51 STEP 1058 H= 264:30 +CPU= 28.183
  23:55:19 STEP 1059 H= 264:45 +CPU= 27.803
  23:55:49 STEP 1060 H= 265:00 +CPU= 28.900
  23:56:17 STEP 1061 H= 265:15 +CPU= 27.722
  23:56:47 STEP 1062 H= 265:30 +CPU= 28.454
  23:57:15 STEP 1063 H= 265:45 +CPU= 27.774
  23:57:44 STEP 1064 H= 266:00 +CPU= 28.174
  23:58:12 STEP 1065 H= 266:15 +CPU= 28.094
  23:58:41 STEP 1066 H= 266:30 +CPU= 27.836
  23:59:10 STEP 1067 H= 266:45 +CPU= 28.204
  23:59:45 STEP 1068 H= 267:00 +CPU= 34.743
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001068
  00:00:14 STEP 1069 H= 267:15 +CPU= 27.874
  00:00:44 STEP 1070 H= 267:30 +CPU= 29.268
  00:01:12 STEP 1071 H= 267:45 +CPU= 26.982
  00:01:40 STEP 1072 H= 268:00 +CPU= 27.895
  00:02:09 STEP 1073 H= 268:15 +CPU= 27.357
  00:02:38 STEP 1074 H= 268:30 +CPU= 27.779
  00:03:06 STEP 1075 H= 268:45 +CPU= 27.060
  00:03:35 STEP 1076 H= 269:00 +CPU= 28.552
  00:04:03 STEP 1077 H= 269:15 +CPU= 27.397
  00:04:32 STEP 1078 H= 269:30 +CPU= 28.362
  00:05:00 STEP 1079 H= 269:45 +CPU= 27.290
  00:05:35 STEP 1080 H= 270:00 +CPU= 34.229
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001080
  00:06:03 STEP 1081 H= 270:15 +CPU= 27.104
  00:06:31 STEP 1082 H= 270:30 +CPU= 27.245
  00:06:58 STEP 1083 H= 270:45 +CPU= 26.987
  00:07:26 STEP 1084 H= 271:00 +CPU= 27.977
  00:07:54 STEP 1085 H= 271:15 +CPU= 26.621
  00:08:22 STEP 1086 H= 271:30 +CPU= 28.253
  00:08:50 STEP 1087 H= 271:45 +CPU= 27.264
  00:09:20 STEP 1088 H= 272:00 +CPU= 28.369
  00:09:48 STEP 1089 H= 272:15 +CPU= 27.904
  00:10:16 STEP 1090 H= 272:30 +CPU= 27.433
  00:10:44 STEP 1091 H= 272:45 +CPU= 26.834
  00:11:18 STEP 1092 H= 273:00 +CPU= 33.600
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001092
  00:11:46 STEP 1093 H= 273:15 +CPU= 27.296
  00:12:14 STEP 1094 H= 273:30 +CPU= 27.072
  00:12:41 STEP 1095 H= 273:45 +CPU= 26.790
  00:13:09 STEP 1096 H= 274:00 +CPU= 27.483
  00:13:37 STEP 1097 H= 274:15 +CPU= 27.473
  00:14:04 STEP 1098 H= 274:30 +CPU= 27.136
  00:14:32 STEP 1099 H= 274:45 +CPU= 26.994
  00:15:01 STEP 1100 H= 275:00 +CPU= 28.555
  00:15:31 STEP 1101 H= 275:15 +CPU= 28.428
  00:16:00 STEP 1102 H= 275:30 +CPU= 27.847
  00:16:28 STEP 1103 H= 275:45 +CPU= 28.322
  00:17:08 STEP 1104 H= 276:00 +CPU= 38.872
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001104
  00:17:36 STEP 1105 H= 276:15 +CPU= 27.693
  00:18:06 STEP 1106 H= 276:30 +CPU= 29.006
  00:18:36 STEP 1107 H= 276:45 +CPU= 28.546
  00:19:05 STEP 1108 H= 277:00 +CPU= 28.360
  00:19:35 STEP 1109 H= 277:15 +CPU= 29.292
  00:20:04 STEP 1110 H= 277:30 +CPU= 28.139
  00:20:33 STEP 1111 H= 277:45 +CPU= 27.877
  00:21:01 STEP 1112 H= 278:00 +CPU= 27.971
  00:21:30 STEP 1113 H= 278:15 +CPU= 27.775
  00:21:58 STEP 1114 H= 278:30 +CPU= 27.657
  00:22:27 STEP 1115 H= 278:45 +CPU= 27.862
  00:23:04 STEP 1116 H= 279:00 +CPU= 36.338
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001116
  00:23:34 STEP 1117 H= 279:15 +CPU= 29.077
  00:24:03 STEP 1118 H= 279:30 +CPU= 28.648
  00:24:33 STEP 1119 H= 279:45 +CPU= 28.579
  00:25:01 STEP 1120 H= 280:00 +CPU= 27.502
  00:25:29 STEP 1121 H= 280:15 +CPU= 26.850
  00:25:56 STEP 1122 H= 280:30 +CPU= 26.245
  00:26:23 STEP 1123 H= 280:45 +CPU= 26.830
  00:26:52 STEP 1124 H= 281:00 +CPU= 28.276
  00:27:18 STEP 1125 H= 281:15 +CPU= 26.209
  00:27:45 STEP 1126 H= 281:30 +CPU= 26.630
  00:28:13 STEP 1127 H= 281:45 +CPU= 27.001
  00:28:48 STEP 1128 H= 282:00 +CPU= 34.489
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001128
  00:29:16 STEP 1129 H= 282:15 +CPU= 26.974
  00:29:45 STEP 1130 H= 282:30 +CPU= 27.878
  00:30:13 STEP 1131 H= 282:45 +CPU= 28.482
  00:30:41 STEP 1132 H= 283:00 +CPU= 26.968
  00:31:10 STEP 1133 H= 283:15 +CPU= 28.209
  00:31:38 STEP 1134 H= 283:30 +CPU= 27.343
  00:32:08 STEP 1135 H= 283:45 +CPU= 29.004
  00:32:37 STEP 1136 H= 284:00 +CPU= 27.665
  00:33:07 STEP 1137 H= 284:15 +CPU= 29.312
  00:33:36 STEP 1138 H= 284:30 +CPU= 28.202
  00:34:05 STEP 1139 H= 284:45 +CPU= 27.989
  00:34:40 STEP 1140 H= 285:00 +CPU= 34.251
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001140
  00:35:09 STEP 1141 H= 285:15 +CPU= 28.711
  00:35:37 STEP 1142 H= 285:30 +CPU= 27.642
  00:36:05 STEP 1143 H= 285:45 +CPU= 26.855
  00:36:34 STEP 1144 H= 286:00 +CPU= 27.995
  00:37:02 STEP 1145 H= 286:15 +CPU= 27.619
  00:37:31 STEP 1146 H= 286:30 +CPU= 27.969
  00:37:59 STEP 1147 H= 286:45 +CPU= 27.380
  00:38:29 STEP 1148 H= 287:00 +CPU= 29.463
  00:38:58 STEP 1149 H= 287:15 +CPU= 28.260
  00:39:27 STEP 1150 H= 287:30 +CPU= 28.965
  00:39:56 STEP 1151 H= 287:45 +CPU= 28.476
  00:40:35 STEP 1152 H= 288:00 +CPU= 37.854
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001152
  00:41:04 STEP 1153 H= 288:15 +CPU= 27.984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001152
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:41:33 STEP 1154 H= 288:30 +CPU= 28.075
  00:42:02 STEP 1155 H= 288:45 +CPU= 27.625
  00:42:31 STEP 1156 H= 289:00 +CPU= 28.062
  00:42:59 STEP 1157 H= 289:15 +CPU= 28.250
  00:43:28 STEP 1158 H= 289:30 +CPU= 27.727
  00:43:56 STEP 1159 H= 289:45 +CPU= 27.382
  00:44:25 STEP 1160 H= 290:00 +CPU= 28.095
  00:44:53 STEP 1161 H= 290:15 +CPU= 27.863
  00:45:21 STEP 1162 H= 290:30 +CPU= 27.837
  00:45:49 STEP 1163 H= 290:45 +CPU= 26.964
  00:46:26 STEP 1164 H= 291:00 +CPU= 35.493
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001164
  00:46:54 STEP 1165 H= 291:15 +CPU= 27.522
  00:47:22 STEP 1166 H= 291:30 +CPU= 27.935
  00:47:52 STEP 1167 H= 291:45 +CPU= 28.790
  00:48:21 STEP 1168 H= 292:00 +CPU= 27.937
  00:48:49 STEP 1169 H= 292:15 +CPU= 26.969
  00:49:18 STEP 1170 H= 292:30 +CPU= 27.772
  00:49:46 STEP 1171 H= 292:45 +CPU= 27.519
  00:50:15 STEP 1172 H= 293:00 +CPU= 28.660
  00:50:43 STEP 1173 H= 293:15 +CPU= 27.291
  00:51:12 STEP 1174 H= 293:30 +CPU= 27.998
  00:51:41 STEP 1175 H= 293:45 +CPU= 28.931
  00:52:16 STEP 1176 H= 294:00 +CPU= 34.089
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001176
  00:52:45 STEP 1177 H= 294:15 +CPU= 27.513
  00:53:13 STEP 1178 H= 294:30 +CPU= 27.413
  00:53:40 STEP 1179 H= 294:45 +CPU= 27.107
  00:54:11 STEP 1180 H= 295:00 +CPU= 29.480
  00:54:39 STEP 1181 H= 295:15 +CPU= 27.921
  00:55:09 STEP 1182 H= 295:30 +CPU= 28.473
  00:55:37 STEP 1183 H= 295:45 +CPU= 27.429
  00:56:06 STEP 1184 H= 296:00 +CPU= 28.161
  00:56:34 STEP 1185 H= 296:15 +CPU= 27.786
  00:57:02 STEP 1186 H= 296:30 +CPU= 27.541
  00:57:31 STEP 1187 H= 296:45 +CPU= 27.771
  00:58:08 STEP 1188 H= 297:00 +CPU= 35.972
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001188
  00:58:36 STEP 1189 H= 297:15 +CPU= 27.277
  00:59:03 STEP 1190 H= 297:30 +CPU= 26.800
  00:59:31 STEP 1191 H= 297:45 +CPU= 27.462
  01:00:00 STEP 1192 H= 298:00 +CPU= 28.692
  01:00:31 STEP 1193 H= 298:15 +CPU= 29.388
  01:01:00 STEP 1194 H= 298:30 +CPU= 28.325
  01:01:27 STEP 1195 H= 298:45 +CPU= 26.771
  01:01:58 STEP 1196 H= 299:00 +CPU= 29.462
  01:02:27 STEP 1197 H= 299:15 +CPU= 28.388
  01:02:57 STEP 1198 H= 299:30 +CPU= 28.849
  01:03:26 STEP 1199 H= 299:45 +CPU= 28.733
  01:04:06 STEP 1200 H= 300:00 +CPU= 39.078
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001200
  01:04:35 STEP 1201 H= 300:15 +CPU= 28.124
  01:05:04 STEP 1202 H= 300:30 +CPU= 28.331
  01:05:33 STEP 1203 H= 300:45 +CPU= 28.093
  01:06:03 STEP 1204 H= 301:00 +CPU= 29.303
  01:06:32 STEP 1205 H= 301:15 +CPU= 27.463
  01:07:01 STEP 1206 H= 301:30 +CPU= 28.440
  01:07:30 STEP 1207 H= 301:45 +CPU= 27.713
  01:07:58 STEP 1208 H= 302:00 +CPU= 27.658
  01:08:26 STEP 1209 H= 302:15 +CPU= 27.425
  01:08:55 STEP 1210 H= 302:30 +CPU= 27.886
  01:09:24 STEP 1211 H= 302:45 +CPU= 27.737
  01:10:00 STEP 1212 H= 303:00 +CPU= 35.878
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001212
  01:10:31 STEP 1213 H= 303:15 +CPU= 30.221
  01:11:01 STEP 1214 H= 303:30 +CPU= 28.711
  01:11:29 STEP 1215 H= 303:45 +CPU= 27.730
  01:11:58 STEP 1216 H= 304:00 +CPU= 27.980
  01:12:26 STEP 1217 H= 304:15 +CPU= 27.503
  01:12:54 STEP 1218 H= 304:30 +CPU= 27.447
  01:13:22 STEP 1219 H= 304:45 +CPU= 27.511
  01:13:53 STEP 1220 H= 305:00 +CPU= 30.082
  01:14:21 STEP 1221 H= 305:15 +CPU= 27.808
  01:14:50 STEP 1222 H= 305:30 +CPU= 27.828
  01:15:18 STEP 1223 H= 305:45 +CPU= 27.672
  01:15:55 STEP 1224 H= 306:00 +CPU= 35.682
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001224
  01:16:23 STEP 1225 H= 306:15 +CPU= 27.909
  01:16:52 STEP 1226 H= 306:30 +CPU= 28.651
  01:17:20 STEP 1227 H= 306:45 +CPU= 27.060
  01:17:49 STEP 1228 H= 307:00 +CPU= 28.456
  01:18:18 STEP 1229 H= 307:15 +CPU= 27.611
  01:18:46 STEP 1230 H= 307:30 +CPU= 26.915
  01:19:14 STEP 1231 H= 307:45 +CPU= 27.462
  01:19:44 STEP 1232 H= 308:00 +CPU= 30.066
  01:20:13 STEP 1233 H= 308:15 +CPU= 27.517
  01:20:40 STEP 1234 H= 308:30 +CPU= 26.851
  01:21:09 STEP 1235 H= 308:45 +CPU= 27.241
  01:21:44 STEP 1236 H= 309:00 +CPU= 34.822
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001236
  01:22:14 STEP 1237 H= 309:15 +CPU= 28.886
  01:22:42 STEP 1238 H= 309:30 +CPU= 27.416
  01:23:10 STEP 1239 H= 309:45 +CPU= 27.512
  01:23:39 STEP 1240 H= 310:00 +CPU= 28.254
  01:24:07 STEP 1241 H= 310:15 +CPU= 26.888
  01:24:35 STEP 1242 H= 310:30 +CPU= 27.378
  01:25:03 STEP 1243 H= 310:45 +CPU= 27.258
  01:25:32 STEP 1244 H= 311:00 +CPU= 27.956
  01:26:00 STEP 1245 H= 311:15 +CPU= 28.086
  01:26:27 STEP 1246 H= 311:30 +CPU= 27.073
  01:26:56 STEP 1247 H= 311:45 +CPU= 27.601
  01:27:36 STEP 1248 H= 312:00 +CPU= 39.641
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001248
  01:28:06 STEP 1249 H= 312:15 +CPU= 29.014
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001248
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:28:35 STEP 1250 H= 312:30 +CPU= 27.639
Uploading trickle at timestep: 1124100
  01:29:04 STEP 1251 H= 312:45 +CPU= 28.798
  01:29:33 STEP 1252 H= 313:00 +CPU= 28.297
  01:30:04 STEP 1253 H= 313:15 +CPU= 29.970
  01:30:33 STEP 1254 H= 313:30 +CPU= 28.732
  01:31:01 STEP 1255 H= 313:45 +CPU= 27.861
  01:31:30 STEP 1256 H= 314:00 +CPU= 27.911
  01:31:59 STEP 1257 H= 314:15 +CPU= 28.356
  01:32:29 STEP 1258 H= 314:30 +CPU= 29.113
  01:32:59 STEP 1259 H= 314:45 +CPU= 29.635
  01:33:36 STEP 1260 H= 315:00 +CPU= 36.063
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001260
  01:34:04 STEP 1261 H= 315:15 +CPU= 27.291
  01:34:35 STEP 1262 H= 315:30 +CPU= 29.342
  01:35:03 STEP 1263 H= 315:45 +CPU= 27.620
  01:35:35 STEP 1264 H= 316:00 +CPU= 30.237
  01:36:05 STEP 1265 H= 316:15 +CPU= 28.522
  01:36:34 STEP 1266 H= 316:30 +CPU= 27.783
  01:37:03 STEP 1267 H= 316:45 +CPU= 28.545
  01:37:33 STEP 1268 H= 317:00 +CPU= 29.152
  01:38:02 STEP 1269 H= 317:15 +CPU= 28.499
  01:38:32 STEP 1270 H= 317:30 +CPU= 28.970
  01:39:00 STEP 1271 H= 317:45 +CPU= 27.556
  01:39:36 STEP 1272 H= 318:00 +CPU= 35.017
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001272
  01:40:05 STEP 1273 H= 318:15 +CPU= 28.901
  01:40:35 STEP 1274 H= 318:30 +CPU= 28.918
  01:41:04 STEP 1275 H= 318:45 +CPU= 28.015
  01:41:33 STEP 1276 H= 319:00 +CPU= 28.625
  01:42:01 STEP 1277 H= 319:15 +CPU= 27.762
  01:42:30 STEP 1278 H= 319:30 +CPU= 28.144
  01:42:59 STEP 1279 H= 319:45 +CPU= 28.628
  01:43:27 STEP 1280 H= 320:00 +CPU= 27.845
  01:43:56 STEP 1281 H= 320:15 +CPU= 27.801
  01:44:24 STEP 1282 H= 320:30 +CPU= 28.006
  01:44:54 STEP 1283 H= 320:45 +CPU= 28.309
  01:45:30 STEP 1284 H= 321:00 +CPU= 35.302
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001284
  01:45:59 STEP 1285 H= 321:15 +CPU= 28.632
  01:46:29 STEP 1286 H= 321:30 +CPU= 29.268
  01:46:57 STEP 1287 H= 321:45 +CPU= 27.199
  01:47:26 STEP 1288 H= 322:00 +CPU= 28.730
  01:47:55 STEP 1289 H= 322:15 +CPU= 28.017
  01:48:24 STEP 1290 H= 322:30 +CPU= 27.900
  01:48:53 STEP 1291 H= 322:45 +CPU= 28.185
  01:49:23 STEP 1292 H= 323:00 +CPU= 29.091
  01:49:52 STEP 1293 H= 323:15 +CPU= 28.628
  01:50:23 STEP 1294 H= 323:30 +CPU= 30.122
  01:50:52 STEP 1295 H= 323:45 +CPU= 28.839
  01:51:32 STEP 1296 H= 324:00 +CPU= 38.750
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001296
  01:52:02 STEP 1297 H= 324:15 +CPU= 30.030
  01:52:31 STEP 1298 H= 324:30 +CPU= 27.816
  01:52:59 STEP 1299 H= 324:45 +CPU= 28.136
  01:53:28 STEP 1300 H= 325:00 +CPU= 28.188
  01:53:56 STEP 1301 H= 325:15 +CPU= 27.435
  01:54:24 STEP 1302 H= 325:30 +CPU= 26.932
  01:54:53 STEP 1303 H= 325:45 +CPU= 28.236
  01:55:22 STEP 1304 H= 326:00 +CPU= 28.419
  01:55:49 STEP 1305 H= 326:15 +CPU= 26.653
  01:56:17 STEP 1306 H= 326:30 +CPU= 27.004
  01:56:45 STEP 1307 H= 326:45 +CPU= 27.834
  01:57:20 STEP 1308 H= 327:00 +CPU= 34.968
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001308
  01:57:49 STEP 1309 H= 327:15 +CPU= 27.361
  01:58:17 STEP 1310 H= 327:30 +CPU= 28.006
  01:58:45 STEP 1311 H= 327:45 +CPU= 26.856
  01:59:13 STEP 1312 H= 328:00 +CPU= 27.929
  01:59:41 STEP 1313 H= 328:15 +CPU= 27.698
  02:00:10 STEP 1314 H= 328:30 +CPU= 27.808
  02:00:39 STEP 1315 H= 328:45 +CPU= 28.600
  02:01:08 STEP 1316 H= 329:00 +CPU= 28.378
  02:01:36 STEP 1317 H= 329:15 +CPU= 27.767
  02:02:04 STEP 1318 H= 329:30 +CPU= 26.845
  02:02:33 STEP 1319 H= 329:45 +CPU= 27.751
  02:03:08 STEP 1320 H= 330:00 +CPU= 35.000
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001320
  02:03:37 STEP 1321 H= 330:15 +CPU= 27.805
  02:04:06 STEP 1322 H= 330:30 +CPU= 28.651
  02:04:34 STEP 1323 H= 330:45 +CPU= 27.768
  02:05:03 STEP 1324 H= 331:00 +CPU= 27.665
  02:05:31 STEP 1325 H= 331:15 +CPU= 27.714
  02:06:00 STEP 1326 H= 331:30 +CPU= 27.726
  02:06:28 STEP 1327 H= 331:45 +CPU= 27.376
  02:06:58 STEP 1328 H= 332:00 +CPU= 29.311
  02:07:28 STEP 1329 H= 332:15 +CPU= 29.094
  02:07:56 STEP 1330 H= 332:30 +CPU= 27.080
  02:08:24 STEP 1331 H= 332:45 +CPU= 27.488
  02:09:01 STEP 1332 H= 333:00 +CPU= 35.829
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001332
  02:09:28 STEP 1333 H= 333:15 +CPU= 27.328
  02:09:58 STEP 1334 H= 333:30 +CPU= 28.802
  02:10:28 STEP 1335 H= 333:45 +CPU= 28.686
  02:10:57 STEP 1336 H= 334:00 +CPU= 28.706
  02:11:27 STEP 1337 H= 334:15 +CPU= 29.401
  02:11:56 STEP 1338 H= 334:30 +CPU= 27.764
  02:12:25 STEP 1339 H= 334:45 +CPU= 28.757
  02:12:55 STEP 1340 H= 335:00 +CPU= 29.441
  02:13:24 STEP 1341 H= 335:15 +CPU= 28.106
  02:13:53 STEP 1342 H= 335:30 +CPU= 28.749
  02:14:24 STEP 1343 H= 335:45 +CPU= 29.439
  02:15:03 STEP 1344 H= 336:00 +CPU= 39.040
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001344
  02:15:32 STEP 1345 H= 336:15 +CPU= 28.403
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:16:02 STEP 1346 H= 336:30 +CPU= 28.050
  02:16:31 STEP 1347 H= 336:45 +CPU= 28.213
  02:17:00 STEP 1348 H= 337:00 +CPU= 28.995
  02:17:30 STEP 1349 H= 337:15 +CPU= 29.139
  02:17:59 STEP 1350 H= 337:30 +CPU= 27.990
  02:18:28 STEP 1351 H= 337:45 +CPU= 28.591
  02:18:59 STEP 1352 H= 338:00 +CPU= 30.320
  02:19:27 STEP 1353 H= 338:15 +CPU= 27.519
  02:19:58 STEP 1354 H= 338:30 +CPU= 30.213
  02:20:26 STEP 1355 H= 338:45 +CPU= 28.225
  02:21:05 STEP 1356 H= 339:00 +CPU= 37.544
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001356
  02:21:35 STEP 1357 H= 339:15 +CPU= 28.881
  02:22:03 STEP 1358 H= 339:30 +CPU= 27.483
  02:22:32 STEP 1359 H= 339:45 +CPU= 28.392
  02:23:01 STEP 1360 H= 340:00 +CPU= 28.128
  02:23:30 STEP 1361 H= 340:15 +CPU= 28.245
  02:23:59 STEP 1362 H= 340:30 +CPU= 28.281
  02:24:28 STEP 1363 H= 340:45 +CPU= 28.349
  02:24:59 STEP 1364 H= 341:00 +CPU= 30.116
  02:25:28 STEP 1365 H= 341:15 +CPU= 28.137
  02:25:58 STEP 1366 H= 341:30 +CPU= 29.198
  02:26:28 STEP 1367 H= 341:45 +CPU= 29.404
  02:27:05 STEP 1368 H= 342:00 +CPU= 35.597
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001368
  02:27:34 STEP 1369 H= 342:15 +CPU= 28.386
  02:28:03 STEP 1370 H= 342:30 +CPU= 28.549
  02:28:32 STEP 1371 H= 342:45 +CPU= 28.738
  02:29:01 STEP 1372 H= 343:00 +CPU= 28.359
  02:29:29 STEP 1373 H= 343:15 +CPU= 27.364
  02:29:59 STEP 1374 H= 343:30 +CPU= 28.540
  02:30:28 STEP 1375 H= 343:45 +CPU= 29.132
  02:30:57 STEP 1376 H= 344:00 +CPU= 28.045
  02:31:26 STEP 1377 H= 344:15 +CPU= 28.646
  02:31:54 STEP 1378 H= 344:30 +CPU= 27.069
  02:32:23 STEP 1379 H= 344:45 +CPU= 28.210
  02:32:58 STEP 1380 H= 345:00 +CPU= 34.611
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001380
  02:33:27 STEP 1381 H= 345:15 +CPU= 27.833
  02:33:55 STEP 1382 H= 345:30 +CPU= 27.205
  02:34:24 STEP 1383 H= 345:45 +CPU= 28.575
  02:34:54 STEP 1384 H= 346:00 +CPU= 28.831
  02:35:23 STEP 1385 H= 346:15 +CPU= 28.149
  02:35:51 STEP 1386 H= 346:30 +CPU= 27.820
  02:36:19 STEP 1387 H= 346:45 +CPU= 26.917
  02:36:47 STEP 1388 H= 347:00 +CPU= 27.475
  02:37:16 STEP 1389 H= 347:15 +CPU= 28.990
  02:37:44 STEP 1390 H= 347:30 +CPU= 27.205
  02:38:14 STEP 1391 H= 347:45 +CPU= 29.320
  02:38:56 STEP 1392 H= 348:00 +CPU= 41.035
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001392
  02:39:24 STEP 1393 H= 348:15 +CPU= 27.426
  02:39:54 STEP 1394 H= 348:30 +CPU= 28.532
  02:40:23 STEP 1395 H= 348:45 +CPU= 28.774
  02:40:53 STEP 1396 H= 349:00 +CPU= 29.418
  02:41:21 STEP 1397 H= 349:15 +CPU= 28.248
  02:41:50 STEP 1398 H= 349:30 +CPU= 27.800
  02:42:18 STEP 1399 H= 349:45 +CPU= 27.519
  02:42:48 STEP 1400 H= 350:00 +CPU= 29.575
  02:43:18 STEP 1401 H= 350:15 +CPU= 29.760
  02:43:48 STEP 1402 H= 350:30 +CPU= 28.808
  02:44:16 STEP 1403 H= 350:45 +CPU= 28.513
  02:44:55 STEP 1404 H= 351:00 +CPU= 37.566
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001404
  02:45:25 STEP 1405 H= 351:15 +CPU= 28.911
  02:45:54 STEP 1406 H= 351:30 +CPU= 29.212
  02:46:23 STEP 1407 H= 351:45 +CPU= 27.769
  02:46:54 STEP 1408 H= 352:00 +CPU= 29.931
  02:47:25 STEP 1409 H= 352:15 +CPU= 30.121
  02:47:55 STEP 1410 H= 352:30 +CPU= 29.699
  02:48:26 STEP 1411 H= 352:45 +CPU= 29.573
  02:48:55 STEP 1412 H= 353:00 +CPU= 28.626
  02:49:25 STEP 1413 H= 353:15 +CPU= 29.301
  02:49:56 STEP 1414 H= 353:30 +CPU= 30.351
  02:50:26 STEP 1415 H= 353:45 +CPU= 28.835
  02:51:01 STEP 1416 H= 354:00 +CPU= 34.810
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001416
  02:51:33 STEP 1417 H= 354:15 +CPU= 30.969
  02:52:02 STEP 1418 H= 354:30 +CPU= 27.992
  02:52:34 STEP 1419 H= 354:45 +CPU= 30.442
  02:53:04 STEP 1420 H= 355:00 +CPU= 29.410
  02:53:34 STEP 1421 H= 355:15 +CPU= 29.865
  02:54:04 STEP 1422 H= 355:30 +CPU= 29.319
  02:54:35 STEP 1423 H= 355:45 +CPU= 30.027
  02:55:07 STEP 1424 H= 356:00 +CPU= 30.694
  02:55:36 STEP 1425 H= 356:15 +CPU= 28.725
  02:56:05 STEP 1426 H= 356:30 +CPU= 28.107
  02:56:35 STEP 1427 H= 356:45 +CPU= 29.297
  02:57:12 STEP 1428 H= 357:00 +CPU= 37.350
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001428
  02:57:44 STEP 1429 H= 357:15 +CPU= 30.245
  02:58:12 STEP 1430 H= 357:30 +CPU= 28.035
  02:58:41 STEP 1431 H= 357:45 +CPU= 28.419
  02:59:13 STEP 1432 H= 358:00 +CPU= 31.174
  02:59:42 STEP 1433 H= 358:15 +CPU= 28.732
  03:00:09 STEP 1434 H= 358:30 +CPU= 26.314
  03:00:37 STEP 1435 H= 358:45 +CPU= 27.190
  03:01:04 STEP 1436 H= 359:00 +CPU= 27.153
  03:01:32 STEP 1437 H= 359:15 +CPU= 27.399
  03:02:00 STEP 1438 H= 359:30 +CPU= 26.898
  03:02:26 STEP 1439 H= 359:45 +CPU= 26.293
  03:03:02 STEP 1440 H= 360:00 +CPU= 35.317
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9551617268E-21      I       0.2628558939E-05      I
ICloud fractionI      0.0000000000E+00      I       0.6029233017E-01      I
I  Relat. Hum. I      0.7390244145E-01      I       0.2645680868E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5468126083E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    302648948 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS302648.9 Mbytes/s, TOTAL TIME=    0.0130( 7.7%)
 03:03:02 STEP 1440 H= 360:00 +CPU= 35.317
 END CNT3
 NSTEP =  1440 CNT0   000000000  25.279  25.279  25.588   0.988               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        31460/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    553    0       46      1044068    31460 ************    76.7     2.1    74.6     3.1   142.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1145    5095.0    5095.0     18.55      0.00
   9 SPCM     - SPECTRAL COMP.                    1056     853.8     853.8      2.87      0.00
  10 SCAN2M - PHYSICS                             1057   13126.3   13126.3     44.13      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 88    1105.8    1105.8      0.31      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 45      56.2      56.2      0.01      0.00
  17 GRIDFPOS IN CNT4                               88      32.9      32.9      0.01      0.00
  27 RESTART FILES - WRITING                        22    4423.2    4423.2      0.31      0.00
  28 RESTART FILES - READING                         1    4146.0    4146.0      0.01      0.00
  29 SU4FPOS IN CNT4                                88       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                88    6466.5    6466.5      1.81      0.00
  31 POSDDH IN STEPO                                 5       3.7       3.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1057    6733.3    6733.3     22.64      0.00
  39 SU0YOMB                                         1     462.5     462.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1057      18.8      18.8      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1056     451.3     451.3      1.52      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1056      64.5      64.5      0.22      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 45       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2292     427.8     427.8      3.12      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2200     259.0     259.0      1.81      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2200      86.1      86.1      0.60      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2292     116.8     116.8      0.85      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.5      38.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2292      77.0      77.0      0.56      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2200      37.5      37.5      0.26      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2292      80.5      80.5      0.59      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2200      36.9      36.9      0.26      0.00
 400 GSTATS                                     123195       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                114571       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    31441.4 CPU TIME   30068.1 VECTOR TIME    30068.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       41.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/18/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/18/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281953/ICMGGh7zg+000384
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
03:06:34 (778524): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0_r1446391362_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 01:30:50 1550999 22433520 oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0 1,295,100 44,716 0.0345
07 Jun 2024 23:28:51 1550999 22433520 oifs_43r3_bl_a03i_2016092300_20_1017_12281953_0 1,124,100 39,152 0.0348


©2024 cpdn.org