climateprediction.net home page
Task 22438192

Task 22438192

Name oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0
Workunit 12286571
Created 7 Jun 2024, 17:42:16 UTC
Sent 7 Jun 2024, 17:48:48 UTC
Report deadline 6 Aug 2024, 17:48:48 UTC
Received 12 Jun 2024, 13:38:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1524679
Run time 19 hours 41 min 26 sec
CPU time 19 hours 25 min 10 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 2.66 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,022.88 MB
Peak swap size 5,980.80 MB
Peak disk usage 2,288.67 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 44.658
  23:41:58 STEP  835 H= 208:45 +CPU= 46.074
  23:42:44 STEP  836 H= 209:00 +CPU= 45.418
  23:43:28 STEP  837 H= 209:15 +CPU= 44.523
  23:44:16 STEP  838 H= 209:30 +CPU= 47.349
  23:45:03 STEP  839 H= 209:45 +CPU= 46.619
  23:45:59 STEP  840 H= 210:00 +CPU= 55.635
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000840
  23:46:44 STEP  841 H= 210:15 +CPU= 44.833
  23:47:29 STEP  842 H= 210:30 +CPU= 44.620
  23:48:14 STEP  843 H= 210:45 +CPU= 45.294
  23:48:59 STEP  844 H= 211:00 +CPU= 44.769
  23:49:44 STEP  845 H= 211:15 +CPU= 44.369
  23:50:30 STEP  846 H= 211:30 +CPU= 45.842
  23:51:21 STEP  847 H= 211:45 +CPU= 50.932
  23:52:08 STEP  848 H= 212:00 +CPU= 46.167
  23:52:52 STEP  849 H= 212:15 +CPU= 44.047
  23:53:38 STEP  850 H= 212:30 +CPU= 45.683
  23:54:24 STEP  851 H= 212:45 +CPU= 45.754
  23:55:20 STEP  852 H= 213:00 +CPU= 55.164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000852
  23:56:05 STEP  853 H= 213:15 +CPU= 45.348
  23:56:51 STEP  854 H= 213:30 +CPU= 45.439
  23:57:38 STEP  855 H= 213:45 +CPU= 46.721
  23:58:28 STEP  856 H= 214:00 +CPU= 49.363
  23:59:15 STEP  857 H= 214:15 +CPU= 46.768
  00:00:00 STEP  858 H= 214:30 +CPU= 45.288
  00:00:51 STEP  859 H= 214:45 +CPU= 49.901
  00:01:42 STEP  860 H= 215:00 +CPU= 51.272
  00:02:29 STEP  861 H= 215:15 +CPU= 46.515
  00:03:18 STEP  862 H= 215:30 +CPU= 48.662
  00:04:05 STEP  863 H= 215:45 +CPU= 46.250
  00:05:07 STEP  864 H= 216:00 +CPU= 61.942
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_8.zip
Uploading the intermediate file: upload_file_8.zip
  00:06:00 STEP  865 H= 216:15 +CPU= 52.916
  00:06:52 STEP  866 H= 216:30 +CPU= 51.067
  00:07:37 STEP  867 H= 216:45 +CPU= 44.657
  00:08:25 STEP  868 H= 217:00 +CPU= 48.022
  00:09:11 STEP  869 H= 217:15 +CPU= 45.863
  00:09:59 STEP  870 H= 217:30 +CPU= 47.812
  00:10:44 STEP  871 H= 217:45 +CPU= 44.352
  00:11:29 STEP  872 H= 218:00 +CPU= 45.380
  00:12:14 STEP  873 H= 218:15 +CPU= 44.537
  00:13:00 STEP  874 H= 218:30 +CPU= 45.460
  00:13:44 STEP  875 H= 218:45 +CPU= 43.508
  00:14:40 STEP  876 H= 219:00 +CPU= 55.536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000876
  00:15:25 STEP  877 H= 219:15 +CPU= 45.260
  00:16:10 STEP  878 H= 219:30 +CPU= 44.898
  00:16:55 STEP  879 H= 219:45 +CPU= 45.006
  00:17:42 STEP  880 H= 220:00 +CPU= 46.519
  00:18:27 STEP  881 H= 220:15 +CPU= 43.917
  00:19:11 STEP  882 H= 220:30 +CPU= 43.834
  00:19:57 STEP  883 H= 220:45 +CPU= 46.664
  00:20:48 STEP  884 H= 221:00 +CPU= 49.926
  00:21:37 STEP  885 H= 221:15 +CPU= 48.767
  00:22:22 STEP  886 H= 221:30 +CPU= 45.167
  00:23:09 STEP  887 H= 221:45 +CPU= 46.054
  00:24:09 STEP  888 H= 222:00 +CPU= 60.410
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000888
  00:24:55 STEP  889 H= 222:15 +CPU= 45.036
  00:25:40 STEP  890 H= 222:30 +CPU= 45.465
  00:26:27 STEP  891 H= 222:45 +CPU= 46.211
  00:27:14 STEP  892 H= 223:00 +CPU= 46.668
  00:28:01 STEP  893 H= 223:15 +CPU= 47.397
  00:28:49 STEP  894 H= 223:30 +CPU= 46.797
  00:29:35 STEP  895 H= 223:45 +CPU= 46.298
  00:30:21 STEP  896 H= 224:00 +CPU= 46.230
  00:31:07 STEP  897 H= 224:15 +CPU= 45.307
  00:31:52 STEP  898 H= 224:30 +CPU= 44.685
  00:32:39 STEP  899 H= 224:45 +CPU= 46.915
  00:33:37 STEP  900 H= 225:00 +CPU= 57.301
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000900
  00:34:22 STEP  901 H= 225:15 +CPU= 45.324
  00:35:08 STEP  902 H= 225:30 +CPU= 45.251
  00:35:52 STEP  903 H= 225:45 +CPU= 44.264
  00:36:39 STEP  904 H= 226:00 +CPU= 46.026
  00:37:25 STEP  905 H= 226:15 +CPU= 46.212
  00:38:11 STEP  906 H= 226:30 +CPU= 45.695
  00:38:55 STEP  907 H= 226:45 +CPU= 43.944
  00:39:43 STEP  908 H= 227:00 +CPU= 47.533
  00:40:31 STEP  909 H= 227:15 +CPU= 48.045
  00:41:17 STEP  910 H= 227:30 +CPU= 45.453
  00:42:04 STEP  911 H= 227:45 +CPU= 46.584
  00:43:12 STEP  912 H= 228:00 +CPU= 67.555
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000912
  00:43:59 STEP  913 H= 228:15 +CPU= 46.871
  00:44:44 STEP  914 H= 228:30 +CPU= 44.627
  00:45:30 STEP  915 H= 228:45 +CPU= 46.163
  00:46:20 STEP  916 H= 229:00 +CPU= 49.328
  00:47:07 STEP  917 H= 229:15 +CPU= 46.687
  00:47:56 STEP  918 H= 229:30 +CPU= 49.001
  00:48:43 STEP  919 H= 229:45 +CPU= 46.792
  00:49:33 STEP  920 H= 230:00 +CPU= 49.875
  00:50:19 STEP  921 H= 230:15 +CPU= 45.056
  00:51:05 STEP  922 H= 230:30 +CPU= 46.035
  00:51:51 STEP  923 H= 230:45 +CPU= 45.011
  00:52:44 STEP  924 H= 231:00 +CPU= 53.611
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000924
  00:53:29 STEP  925 H= 231:15 +CPU= 44.077
  00:54:12 STEP  926 H= 231:30 +CPU= 43.325
  00:54:56 STEP  927 H= 231:45 +CPU= 43.200
  00:55:42 STEP  928 H= 232:00 +CPU= 46.431
  00:56:27 STEP  929 H= 232:15 +CPU= 44.191
  00:57:14 STEP  930 H= 232:30 +CPU= 46.528
  00:57:58 STEP  931 H= 232:45 +CPU= 44.717
  00:58:46 STEP  932 H= 233:00 +CPU= 47.309
  00:59:33 STEP  933 H= 233:15 +CPU= 46.788
  01:00:20 STEP  934 H= 233:30 +CPU= 46.257
  01:01:06 STEP  935 H= 233:45 +CPU= 46.276
  01:02:03 STEP  936 H= 234:00 +CPU= 56.533
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000936
  01:02:51 STEP  937 H= 234:15 +CPU= 47.775
  01:03:41 STEP  938 H= 234:30 +CPU= 49.993
  01:04:30 STEP  939 H= 234:45 +CPU= 48.635
  01:05:18 STEP  940 H= 235:00 +CPU= 46.939
  01:06:04 STEP  941 H= 235:15 +CPU= 46.123
  01:06:51 STEP  942 H= 235:30 +CPU= 46.610
  01:07:37 STEP  943 H= 235:45 +CPU= 45.666
  01:08:25 STEP  944 H= 236:00 +CPU= 48.580
  01:09:11 STEP  945 H= 236:15 +CPU= 45.565
  01:09:56 STEP  946 H= 236:30 +CPU= 44.526
  01:10:40 STEP  947 H= 236:45 +CPU= 44.315
  01:11:35 STEP  948 H= 237:00 +CPU= 54.739
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000948
  01:12:22 STEP  949 H= 237:15 +CPU= 46.007
  01:13:07 STEP  950 H= 237:30 +CPU= 45.005
  01:13:53 STEP  951 H= 237:45 +CPU= 46.518
  01:14:38 STEP  952 H= 238:00 +CPU= 44.523
  01:15:22 STEP  953 H= 238:15 +CPU= 43.906
  01:16:08 STEP  954 H= 238:30 +CPU= 44.944
  01:16:57 STEP  955 H= 238:45 +CPU= 48.918
  01:17:43 STEP  956 H= 239:00 +CPU= 45.852
  01:18:29 STEP  957 H= 239:15 +CPU= 46.158
  01:19:16 STEP  958 H= 239:30 +CPU= 46.153
  01:20:03 STEP  959 H= 239:45 +CPU= 47.359
  01:21:08 STEP  960 H= 240:00 +CPU= 64.293
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  01:21:55 STEP  961 H= 240:15 +CPU= 46.332
  01:22:41 STEP  962 H= 240:30 +CPU= 45.862
  01:23:28 STEP  963 H= 240:45 +CPU= 46.512
  01:24:15 STEP  964 H= 241:00 +CPU= 47.022
  01:25:00 STEP  965 H= 241:15 +CPU= 44.734
  01:25:45 STEP  966 H= 241:30 +CPU= 44.849
  01:26:30 STEP  967 H= 241:45 +CPU= 44.945
  01:27:18 STEP  968 H= 242:00 +CPU= 47.685
  01:28:02 STEP  969 H= 242:15 +CPU= 43.828
  01:28:47 STEP  970 H= 242:30 +CPU= 44.490
  01:29:32 STEP  971 H= 242:45 +CPU= 44.891
  01:30:28 STEP  972 H= 243:00 +CPU= 55.506
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000972
  01:31:14 STEP  973 H= 243:15 +CPU= 45.780
  01:32:00 STEP  974 H= 243:30 +CPU= 45.684
  01:32:47 STEP  975 H= 243:45 +CPU= 46.440
  01:33:33 STEP  976 H= 244:00 +CPU= 46.346
  01:34:20 STEP  977 H= 244:15 +CPU= 46.674
  01:35:09 STEP  978 H= 244:30 +CPU= 48.216
  01:35:55 STEP  979 H= 244:45 +CPU= 45.390
  01:36:41 STEP  980 H= 245:00 +CPU= 45.924
  01:37:28 STEP  981 H= 245:15 +CPU= 46.791
  01:38:13 STEP  982 H= 245:30 +CPU= 44.962
  01:39:03 STEP  983 H= 245:45 +CPU= 49.605
  01:40:03 STEP  984 H= 246:00 +CPU= 60.060
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000984
  01:40:52 STEP  985 H= 246:15 +CPU= 48.749
  01:41:40 STEP  986 H= 246:30 +CPU= 46.885
  01:42:27 STEP  987 H= 246:45 +CPU= 46.768
  01:43:13 STEP  988 H= 247:00 +CPU= 46.010
  01:43:58 STEP  989 H= 247:15 +CPU= 45.088
  01:44:44 STEP  990 H= 247:30 +CPU= 45.745
  01:45:30 STEP  991 H= 247:45 +CPU= 45.251
  01:46:17 STEP  992 H= 248:00 +CPU= 46.520
  01:47:02 STEP  993 H= 248:15 +CPU= 45.134
  01:47:46 STEP  994 H= 248:30 +CPU= 43.809
  01:48:33 STEP  995 H= 248:45 +CPU= 46.127
  01:49:28 STEP  996 H= 249:00 +CPU= 55.498
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000996
  01:50:16 STEP  997 H= 249:15 +CPU= 47.349
  01:51:03 STEP  998 H= 249:30 +CPU= 47.015
  01:51:51 STEP  999 H= 249:45 +CPU= 47.440
  01:52:40 STEP 1000 H= 250:00 +CPU= 48.491
  01:53:25 STEP 1001 H= 250:15 +CPU= 44.797
  01:54:11 STEP 1002 H= 250:30 +CPU= 45.909
  01:55:00 STEP 1003 H= 250:45 +CPU= 48.609
  01:55:48 STEP 1004 H= 251:00 +CPU= 48.461
  01:56:37 STEP 1005 H= 251:15 +CPU= 48.536
  01:57:24 STEP 1006 H= 251:30 +CPU= 46.416
  01:58:10 STEP 1007 H= 251:45 +CPU= 46.056
  01:59:16 STEP 1008 H= 252:00 +CPU= 65.497
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001008
  02:00:02 STEP 1009 H= 252:15 +CPU= 45.682
  02:00:48 STEP 1010 H= 252:30 +CPU= 45.226
  02:01:38 STEP 1011 H= 252:45 +CPU= 50.088
  02:02:23 STEP 1012 H= 253:00 +CPU= 44.703
  02:03:11 STEP 1013 H= 253:15 +CPU= 47.944
  02:04:00 STEP 1014 H= 253:30 +CPU= 48.436
  02:04:44 STEP 1015 H= 253:45 +CPU= 43.944
  02:05:31 STEP 1016 H= 254:00 +CPU= 46.119
  02:06:18 STEP 1017 H= 254:15 +CPU= 46.611
  02:07:04 STEP 1018 H= 254:30 +CPU= 46.175
  02:07:56 STEP 1019 H= 254:45 +CPU= 51.697
  02:08:51 STEP 1020 H= 255:00 +CPU= 54.975
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001020
  02:09:38 STEP 1021 H= 255:15 +CPU= 46.914
  02:10:23 STEP 1022 H= 255:30 +CPU= 44.236
  02:11:10 STEP 1023 H= 255:45 +CPU= 47.098
  02:11:56 STEP 1024 H= 256:00 +CPU= 45.765
  02:12:42 STEP 1025 H= 256:15 +CPU= 45.050
  02:13:28 STEP 1026 H= 256:30 +CPU= 45.677
  02:14:13 STEP 1027 H= 256:45 +CPU= 45.341
  02:15:00 STEP 1028 H= 257:00 +CPU= 46.032
  02:15:45 STEP 1029 H= 257:15 +CPU= 45.493
  02:16:30 STEP 1030 H= 257:30 +CPU= 44.762
  02:17:17 STEP 1031 H= 257:45 +CPU= 46.776
  02:18:12 STEP 1032 H= 258:00 +CPU= 54.197
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001032
  02:18:58 STEP 1033 H= 258:15 +CPU= 46.268
  02:19:45 STEP 1034 H= 258:30 +CPU= 46.380
  02:20:30 STEP 1035 H= 258:45 +CPU= 44.425
  02:21:17 STEP 1036 H= 259:00 +CPU= 47.390
  02:22:08 STEP 1037 H= 259:15 +CPU= 50.404
  02:22:54 STEP 1038 H= 259:30 +CPU= 46.234
  02:23:42 STEP 1039 H= 259:45 +CPU= 47.237
  02:24:29 STEP 1040 H= 260:00 +CPU= 46.446
  02:25:13 STEP 1041 H= 260:15 +CPU= 44.637
  02:25:59 STEP 1042 H= 260:30 +CPU= 45.428
  02:26:47 STEP 1043 H= 260:45 +CPU= 48.002
  02:27:46 STEP 1044 H= 261:00 +CPU= 58.246
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001044
  02:28:33 STEP 1045 H= 261:15 +CPU= 46.778
  02:29:19 STEP 1046 H= 261:30 +CPU= 45.373
  02:30:05 STEP 1047 H= 261:45 +CPU= 45.958
  02:30:54 STEP 1048 H= 262:00 +CPU= 48.738
  02:31:44 STEP 1049 H= 262:15 +CPU= 50.094
  02:32:31 STEP 1050 H= 262:30 +CPU= 46.828
  02:33:17 STEP 1051 H= 262:45 +CPU= 45.113
  02:34:03 STEP 1052 H= 263:00 +CPU= 46.177
  02:34:53 STEP 1053 H= 263:15 +CPU= 49.223
  02:35:40 STEP 1054 H= 263:30 +CPU= 46.795
  02:36:24 STEP 1055 H= 263:45 +CPU= 44.250
  02:37:30 STEP 1056 H= 264:00 +CPU= 65.311
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:38:17 STEP 1057 H= 264:15 +CPU= 46.952
  02:39:05 STEP 1058 H= 264:30 +CPU= 47.091
  02:39:54 STEP 1059 H= 264:45 +CPU= 48.550
  02:40:41 STEP 1060 H= 265:00 +CPU= 46.623
  02:41:26 STEP 1061 H= 265:15 +CPU= 45.106
  02:42:14 STEP 1062 H= 265:30 +CPU= 47.711
  02:42:59 STEP 1063 H= 265:45 +CPU= 45.350
  02:43:48 STEP 1064 H= 266:00 +CPU= 48.029
  02:44:35 STEP 1065 H= 266:15 +CPU= 46.703
  02:45:21 STEP 1066 H= 266:30 +CPU= 45.741
  02:46:06 STEP 1067 H= 266:45 +CPU= 45.290
  02:47:01 STEP 1068 H= 267:00 +CPU= 54.783
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001068
  02:47:48 STEP 1069 H= 267:15 +CPU= 46.211
  02:48:35 STEP 1070 H= 267:30 +CPU= 46.767
  02:49:20 STEP 1071 H= 267:45 +CPU= 44.792
  02:50:08 STEP 1072 H= 268:00 +CPU= 48.286
  02:50:55 STEP 1073 H= 268:15 +CPU= 46.590
  02:51:43 STEP 1074 H= 268:30 +CPU= 47.519
  02:52:33 STEP 1075 H= 268:45 +CPU= 49.393
  02:53:22 STEP 1076 H= 269:00 +CPU= 49.084
  02:54:08 STEP 1077 H= 269:15 +CPU= 45.439
  02:54:54 STEP 1078 H= 269:30 +CPU= 46.359
  02:55:40 STEP 1079 H= 269:45 +CPU= 45.355
  02:56:36 STEP 1080 H= 270:00 +CPU= 55.557
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001080
  02:57:20 STEP 1081 H= 270:15 +CPU= 44.490
  02:58:07 STEP 1082 H= 270:30 +CPU= 46.334
  02:58:53 STEP 1083 H= 270:45 +CPU= 46.085
  02:59:41 STEP 1084 H= 271:00 +CPU= 47.311
  03:00:29 STEP 1085 H= 271:15 +CPU= 47.545
  03:01:14 STEP 1086 H= 271:30 +CPU= 45.120
  03:02:01 STEP 1087 H= 271:45 +CPU= 47.117
  03:02:51 STEP 1088 H= 272:00 +CPU= 49.284
  03:03:37 STEP 1089 H= 272:15 +CPU= 45.677
  03:04:25 STEP 1090 H= 272:30 +CPU= 48.296
  03:05:14 STEP 1091 H= 272:45 +CPU= 48.413
  03:06:11 STEP 1092 H= 273:00 +CPU= 56.582
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001092
  03:06:59 STEP 1093 H= 273:15 +CPU= 47.267
  03:07:46 STEP 1094 H= 273:30 +CPU= 47.438
  03:08:34 STEP 1095 H= 273:45 +CPU= 47.240
  03:09:20 STEP 1096 H= 274:00 +CPU= 46.341
  03:10:09 STEP 1097 H= 274:15 +CPU= 48.310
  03:10:55 STEP 1098 H= 274:30 +CPU= 46.202
  03:11:42 STEP 1099 H= 274:45 +CPU= 46.635
  03:12:29 STEP 1100 H= 275:00 +CPU= 46.580
  03:13:15 STEP 1101 H= 275:15 +CPU= 45.340
  03:13:59 STEP 1102 H= 275:30 +CPU= 44.366
  03:14:46 STEP 1103 H= 275:45 +CPU= 46.395
  03:15:51 STEP 1104 H= 276:00 +CPU= 64.565
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001104
  03:16:40 STEP 1105 H= 276:15 +CPU= 48.503
  03:17:26 STEP 1106 H= 276:30 +CPU= 46.028
  03:18:10 STEP 1107 H= 276:45 +CPU= 44.019
  03:18:56 STEP 1108 H= 277:00 +CPU= 45.539
  03:19:40 STEP 1109 H= 277:15 +CPU= 44.391
  03:20:25 STEP 1110 H= 277:30 +CPU= 44.977
  03:21:11 STEP 1111 H= 277:45 +CPU= 45.480
  03:21:59 STEP 1112 H= 278:00 +CPU= 47.317
  03:22:44 STEP 1113 H= 278:15 +CPU= 45.193
  03:23:31 STEP 1114 H= 278:30 +CPU= 46.186
  03:24:18 STEP 1115 H= 278:45 +CPU= 47.131
  03:25:16 STEP 1116 H= 279:00 +CPU= 57.656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001116
  03:26:02 STEP 1117 H= 279:15 +CPU= 45.413
  03:26:48 STEP 1118 H= 279:30 +CPU= 46.481
  03:27:33 STEP 1119 H= 279:45 +CPU= 44.631
  03:28:20 STEP 1120 H= 280:00 +CPU= 46.331
  03:29:05 STEP 1121 H= 280:15 +CPU= 44.771
  03:29:51 STEP 1122 H= 280:30 +CPU= 46.127
  03:30:38 STEP 1123 H= 280:45 +CPU= 46.297
  03:31:28 STEP 1124 H= 281:00 +CPU= 50.320
  03:32:18 STEP 1125 H= 281:15 +CPU= 48.974
  03:33:05 STEP 1126 H= 281:30 +CPU= 46.791
  03:33:51 STEP 1127 H= 281:45 +CPU= 46.144
  03:34:45 STEP 1128 H= 282:00 +CPU= 53.752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001128
  03:35:30 STEP 1129 H= 282:15 +CPU= 44.901
  03:36:15 STEP 1130 H= 282:30 +CPU= 44.870
  03:37:02 STEP 1131 H= 282:45 +CPU= 46.927
  03:37:49 STEP 1132 H= 283:00 +CPU= 46.435
  03:38:36 STEP 1133 H= 283:15 +CPU= 47.105
  03:39:24 STEP 1134 H= 283:30 +CPU= 47.661
  03:40:09 STEP 1135 H= 283:45 +CPU= 44.205
  03:40:56 STEP 1136 H= 284:00 +CPU= 46.796
  03:41:40 STEP 1137 H= 284:15 +CPU= 43.890
  03:42:25 STEP 1138 H= 284:30 +CPU= 44.915
  03:43:11 STEP 1139 H= 284:45 +CPU= 46.269
  03:44:12 STEP 1140 H= 285:00 +CPU= 59.939
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001140
  03:45:00 STEP 1141 H= 285:15 +CPU= 48.303
  03:45:48 STEP 1142 H= 285:30 +CPU= 47.033
  03:46:35 STEP 1143 H= 285:45 +CPU= 46.862
  03:47:22 STEP 1144 H= 286:00 +CPU= 47.400
  03:48:10 STEP 1145 H= 286:15 +CPU= 47.704
  03:48:56 STEP 1146 H= 286:30 +CPU= 44.975
  03:49:44 STEP 1147 H= 286:45 +CPU= 47.701
  03:50:32 STEP 1148 H= 287:00 +CPU= 48.280
  03:51:18 STEP 1149 H= 287:15 +CPU= 45.664
  03:52:05 STEP 1150 H= 287:30 +CPU= 46.366
  03:52:54 STEP 1151 H= 287:45 +CPU= 48.649
  03:54:09 STEP 1152 H= 288:00 +CPU= 75.112
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:54:57 STEP 1153 H= 288:15 +CPU= 47.031
  03:55:44 STEP 1154 H= 288:30 +CPU= 46.995
  03:56:29 STEP 1155 H= 288:45 +CPU= 45.281
  03:57:16 STEP 1156 H= 289:00 +CPU= 46.241
  03:58:03 STEP 1157 H= 289:15 +CPU= 46.562
  03:58:52 STEP 1158 H= 289:30 +CPU= 48.569
  03:59:39 STEP 1159 H= 289:45 +CPU= 47.095
  04:00:26 STEP 1160 H= 290:00 +CPU= 46.282
  04:01:12 STEP 1161 H= 290:15 +CPU= 46.608
  04:01:59 STEP 1162 H= 290:30 +CPU= 46.916
  04:02:48 STEP 1163 H= 290:45 +CPU= 48.605
  04:03:45 STEP 1164 H= 291:00 +CPU= 56.349
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001164
  04:04:30 STEP 1165 H= 291:15 +CPU= 44.708
  04:05:17 STEP 1166 H= 291:30 +CPU= 46.519
  04:06:05 STEP 1167 H= 291:45 +CPU= 48.139
  04:06:54 STEP 1168 H= 292:00 +CPU= 48.877
  04:07:40 STEP 1169 H= 292:15 +CPU= 45.401
  04:08:25 STEP 1170 H= 292:30 +CPU= 45.160
  04:09:14 STEP 1171 H= 292:45 +CPU= 48.710
  04:10:05 STEP 1172 H= 293:00 +CPU= 50.543
  04:10:52 STEP 1173 H= 293:15 +CPU= 46.184
  04:11:38 STEP 1174 H= 293:30 +CPU= 45.754
  04:12:27 STEP 1175 H= 293:45 +CPU= 48.877
  04:13:23 STEP 1176 H= 294:00 +CPU= 55.532
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001176
  04:14:13 STEP 1177 H= 294:15 +CPU= 49.621
  04:15:01 STEP 1178 H= 294:30 +CPU= 47.691
  04:15:45 STEP 1179 H= 294:45 +CPU= 44.481
  04:16:32 STEP 1180 H= 295:00 +CPU= 46.743
  04:17:19 STEP 1181 H= 295:15 +CPU= 46.600
  04:18:04 STEP 1182 H= 295:30 +CPU= 44.822
  04:18:49 STEP 1183 H= 295:45 +CPU= 44.869
  04:19:38 STEP 1184 H= 296:00 +CPU= 49.017
  04:20:25 STEP 1185 H= 296:15 +CPU= 46.576
  04:21:11 STEP 1186 H= 296:30 +CPU= 45.199
  04:21:58 STEP 1187 H= 296:45 +CPU= 47.439
  04:22:59 STEP 1188 H= 297:00 +CPU= 59.981
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001188
  04:23:45 STEP 1189 H= 297:15 +CPU= 46.345
  04:24:34 STEP 1190 H= 297:30 +CPU= 48.369
  04:25:22 STEP 1191 H= 297:45 +CPU= 47.808
  04:26:12 STEP 1192 H= 298:00 +CPU= 49.530
  04:27:03 STEP 1193 H= 298:15 +CPU= 50.406
  04:27:52 STEP 1194 H= 298:30 +CPU= 48.616
  04:28:39 STEP 1195 H= 298:45 +CPU= 47.291
  04:29:27 STEP 1196 H= 299:00 +CPU= 47.110
  04:30:18 STEP 1197 H= 299:15 +CPU= 50.854
  04:31:06 STEP 1198 H= 299:30 +CPU= 47.367
  04:31:52 STEP 1199 H= 299:45 +CPU= 46.196
  04:32:59 STEP 1200 H= 300:00 +CPU= 66.648
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001200
  04:33:49 STEP 1201 H= 300:15 +CPU= 49.339
  04:34:36 STEP 1202 H= 300:30 +CPU= 46.657
  04:35:23 STEP 1203 H= 300:45 +CPU= 47.264
  04:36:11 STEP 1204 H= 301:00 +CPU= 47.226
  04:36:58 STEP 1205 H= 301:15 +CPU= 46.610
  04:37:43 STEP 1206 H= 301:30 +CPU= 45.132
  04:38:29 STEP 1207 H= 301:45 +CPU= 45.826
  04:39:18 STEP 1208 H= 302:00 +CPU= 48.262
  04:40:11 STEP 1209 H= 302:15 +CPU= 52.517
  04:40:58 STEP 1210 H= 302:30 +CPU= 47.169
  04:41:49 STEP 1211 H= 302:45 +CPU= 50.269
  04:42:46 STEP 1212 H= 303:00 +CPU= 57.401
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001212
  04:43:33 STEP 1213 H= 303:15 +CPU= 46.286
  04:44:22 STEP 1214 H= 303:30 +CPU= 48.716
  04:45:09 STEP 1215 H= 303:45 +CPU= 46.944
  04:45:58 STEP 1216 H= 304:00 +CPU= 48.913
  04:46:48 STEP 1217 H= 304:15 +CPU= 49.289
  04:47:38 STEP 1218 H= 304:30 +CPU= 49.417
  04:48:23 STEP 1219 H= 304:45 +CPU= 45.120
  04:49:20 STEP 1220 H= 305:00 +CPU= 56.940
  04:50:16 STEP 1221 H= 305:15 +CPU= 54.740
  04:51:03 STEP 1222 H= 305:30 +CPU= 47.302
  04:51:51 STEP 1223 H= 305:45 +CPU= 48.011
  04:52:48 STEP 1224 H= 306:00 +CPU= 56.416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001224
  04:53:34 STEP 1225 H= 306:15 +CPU= 45.438
  04:54:23 STEP 1226 H= 306:30 +CPU= 48.811
  04:55:11 STEP 1227 H= 306:45 +CPU= 47.332
  04:56:02 STEP 1228 H= 307:00 +CPU= 51.459
  04:56:52 STEP 1229 H= 307:15 +CPU= 49.300
  04:57:39 STEP 1230 H= 307:30 +CPU= 46.884
  04:58:30 STEP 1231 H= 307:45 +CPU= 50.621
  04:59:19 STEP 1232 H= 308:00 +CPU= 48.724
  05:00:08 STEP 1233 H= 308:15 +CPU= 49.060
  05:00:57 STEP 1234 H= 308:30 +CPU= 48.190
  05:01:44 STEP 1235 H= 308:45 +CPU= 46.447
  05:02:45 STEP 1236 H= 309:00 +CPU= 61.387
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001236
  05:03:39 STEP 1237 H= 309:15 +CPU= 53.214
  05:04:25 STEP 1238 H= 309:30 +CPU= 45.722
  05:05:15 STEP 1239 H= 309:45 +CPU= 49.739
  05:06:03 STEP 1240 H= 310:00 +CPU= 47.956
  05:06:56 STEP 1241 H= 310:15 +CPU= 51.875
  05:07:46 STEP 1242 H= 310:30 +CPU= 49.704
  05:08:34 STEP 1243 H= 310:45 +CPU= 48.414
  05:09:21 STEP 1244 H= 311:00 +CPU= 46.820
  05:10:07 STEP 1245 H= 311:15 +CPU= 45.503
  05:10:56 STEP 1246 H= 311:30 +CPU= 48.245
  05:11:46 STEP 1247 H= 311:45 +CPU= 49.704
  05:12:54 STEP 1248 H= 312:00 +CPU= 67.225
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:13:42 STEP 1249 H= 312:15 +CPU= 47.748
  05:14:29 STEP 1250 H= 312:30 +CPU= 47.616
  05:15:16 STEP 1251 H= 312:45 +CPU= 46.230
  05:16:02 STEP 1252 H= 313:00 +CPU= 46.237
  05:16:51 STEP 1253 H= 313:15 +CPU= 48.733
  05:17:37 STEP 1254 H= 313:30 +CPU= 45.587
  05:18:22 STEP 1255 H= 313:45 +CPU= 44.735
  05:19:13 STEP 1256 H= 314:00 +CPU= 50.250
  05:20:03 STEP 1257 H= 314:15 +CPU= 50.030
  05:20:53 STEP 1258 H= 314:30 +CPU= 49.862
  05:21:39 STEP 1259 H= 314:45 +CPU= 45.631
  05:22:36 STEP 1260 H= 315:00 +CPU= 57.091
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001260
  05:23:25 STEP 1261 H= 315:15 +CPU= 48.049
  05:24:11 STEP 1262 H= 315:30 +CPU= 45.955
  05:24:57 STEP 1263 H= 315:45 +CPU= 45.967
  05:25:44 STEP 1264 H= 316:00 +CPU= 46.854
  05:26:34 STEP 1265 H= 316:15 +CPU= 48.799
  05:27:23 STEP 1266 H= 316:30 +CPU= 49.228
  05:28:11 STEP 1267 H= 316:45 +CPU= 47.267
  05:29:01 STEP 1268 H= 317:00 +CPU= 50.339
  05:29:48 STEP 1269 H= 317:15 +CPU= 46.088
  05:30:35 STEP 1270 H= 317:30 +CPU= 47.203
  05:31:20 STEP 1271 H= 317:45 +CPU= 44.754
  05:32:17 STEP 1272 H= 318:00 +CPU= 56.687
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001272
  05:33:06 STEP 1273 H= 318:15 +CPU= 47.994
  05:33:51 STEP 1274 H= 318:30 +CPU= 45.663
  05:34:40 STEP 1275 H= 318:45 +CPU= 48.318
  05:35:26 STEP 1276 H= 319:00 +CPU= 46.115
  05:36:17 STEP 1277 H= 319:15 +CPU= 49.832
  05:37:07 STEP 1278 H= 319:30 +CPU= 50.423
  05:37:56 STEP 1279 H= 319:45 +CPU= 48.871
  05:38:45 STEP 1280 H= 320:00 +CPU= 47.812
  05:39:31 STEP 1281 H= 320:15 +CPU= 45.720
  05:40:19 STEP 1282 H= 320:30 +CPU= 48.336
  05:41:06 STEP 1283 H= 320:45 +CPU= 46.204
  05:42:04 STEP 1284 H= 321:00 +CPU= 57.845
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001284
  05:42:51 STEP 1285 H= 321:15 +CPU= 47.194
  05:43:36 STEP 1286 H= 321:30 +CPU= 44.096
  05:44:21 STEP 1287 H= 321:45 +CPU= 45.627
  05:45:08 STEP 1288 H= 322:00 +CPU= 46.018
  05:45:54 STEP 1289 H= 322:15 +CPU= 46.441
  05:46:41 STEP 1290 H= 322:30 +CPU= 46.819
  05:47:28 STEP 1291 H= 322:45 +CPU= 46.049
  05:48:13 STEP 1292 H= 323:00 +CPU= 45.015
  05:49:04 STEP 1293 H= 323:15 +CPU= 50.449
  05:49:50 STEP 1294 H= 323:30 +CPU= 46.356
  05:50:34 STEP 1295 H= 323:45 +CPU= 43.954
  05:51:39 STEP 1296 H= 324:00 +CPU= 64.907
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001296
  05:52:27 STEP 1297 H= 324:15 +CPU= 47.358
  05:53:12 STEP 1298 H= 324:30 +CPU= 44.699
  05:53:58 STEP 1299 H= 324:45 +CPU= 45.318
  05:54:48 STEP 1300 H= 325:00 +CPU= 50.085
  05:55:37 STEP 1301 H= 325:15 +CPU= 49.025
  05:56:32 STEP 1302 H= 325:30 +CPU= 54.456
  05:57:19 STEP 1303 H= 325:45 +CPU= 46.461
  05:58:11 STEP 1304 H= 326:00 +CPU= 51.118
  05:58:57 STEP 1305 H= 326:15 +CPU= 46.376
  05:59:43 STEP 1306 H= 326:30 +CPU= 45.726
  06:00:30 STEP 1307 H= 326:45 +CPU= 47.085
  06:01:28 STEP 1308 H= 327:00 +CPU= 56.997
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001308
  06:02:19 STEP 1309 H= 327:15 +CPU= 50.859
  06:03:13 STEP 1310 H= 327:30 +CPU= 53.112
  06:04:00 STEP 1311 H= 327:45 +CPU= 46.744
  06:04:47 STEP 1312 H= 328:00 +CPU= 46.611
  06:05:33 STEP 1313 H= 328:15 +CPU= 45.761
  06:06:20 STEP 1314 H= 328:30 +CPU= 47.318
  06:07:08 STEP 1315 H= 328:45 +CPU= 47.538
  06:07:57 STEP 1316 H= 329:00 +CPU= 48.060
  06:08:44 STEP 1317 H= 329:15 +CPU= 46.842
  06:09:34 STEP 1318 H= 329:30 +CPU= 50.501
  06:10:22 STEP 1319 H= 329:45 +CPU= 47.466
  06:11:19 STEP 1320 H= 330:00 +CPU= 56.395
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001320
  06:12:06 STEP 1321 H= 330:15 +CPU= 47.375
  06:12:57 STEP 1322 H= 330:30 +CPU= 50.144
  06:13:44 STEP 1323 H= 330:45 +CPU= 47.564
  06:14:32 STEP 1324 H= 331:00 +CPU= 47.192
  06:15:20 STEP 1325 H= 331:15 +CPU= 47.767
  06:16:06 STEP 1326 H= 331:30 +CPU= 45.412
  06:16:52 STEP 1327 H= 331:45 +CPU= 46.505
  06:17:39 STEP 1328 H= 332:00 +CPU= 46.026
  06:18:25 STEP 1329 H= 332:15 +CPU= 46.498
  06:19:12 STEP 1330 H= 332:30 +CPU= 46.191
  06:19:57 STEP 1331 H= 332:45 +CPU= 45.112
  06:20:52 STEP 1332 H= 333:00 +CPU= 55.016
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001332
  06:21:38 STEP 1333 H= 333:15 +CPU= 45.622
  06:22:27 STEP 1334 H= 333:30 +CPU= 48.563
  06:23:14 STEP 1335 H= 333:45 +CPU= 46.432
  06:24:02 STEP 1336 H= 334:00 +CPU= 48.294
  06:24:53 STEP 1337 H= 334:15 +CPU= 50.279
  06:25:43 STEP 1338 H= 334:30 +CPU= 50.107
  06:26:30 STEP 1339 H= 334:45 +CPU= 46.740
  06:27:17 STEP 1340 H= 335:00 +CPU= 46.530
  06:28:02 STEP 1341 H= 335:15 +CPU= 45.144
  06:28:47 STEP 1342 H= 335:30 +CPU= 44.350
  06:29:36 STEP 1343 H= 335:45 +CPU= 48.552
  06:30:44 STEP 1344 H= 336:00 +CPU= 67.904
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:31:30 STEP 1345 H= 336:15 +CPU= 45.947
  06:32:21 STEP 1346 H= 336:30 +CPU= 50.063
  06:33:08 STEP 1347 H= 336:45 +CPU= 47.317
  06:33:56 STEP 1348 H= 337:00 +CPU= 47.272
  06:34:42 STEP 1349 H= 337:15 +CPU= 46.063
  06:35:28 STEP 1350 H= 337:30 +CPU= 45.601
  06:36:14 STEP 1351 H= 337:45 +CPU= 45.478
  06:37:02 STEP 1352 H= 338:00 +CPU= 47.975
  06:37:47 STEP 1353 H= 338:15 +CPU= 44.951
  06:38:36 STEP 1354 H= 338:30 +CPU= 48.257
  06:39:23 STEP 1355 H= 338:45 +CPU= 47.056
  06:40:21 STEP 1356 H= 339:00 +CPU= 57.268
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001356
  06:41:07 STEP 1357 H= 339:15 +CPU= 45.934
  06:41:54 STEP 1358 H= 339:30 +CPU= 46.994
  06:42:44 STEP 1359 H= 339:45 +CPU= 49.230
  06:43:31 STEP 1360 H= 340:00 +CPU= 46.658
  06:44:18 STEP 1361 H= 340:15 +CPU= 47.611
  06:45:06 STEP 1362 H= 340:30 +CPU= 47.684
  06:45:53 STEP 1363 H= 340:45 +CPU= 46.032
  06:46:40 STEP 1364 H= 341:00 +CPU= 47.303
  06:47:33 STEP 1365 H= 341:15 +CPU= 52.655
  06:48:26 STEP 1366 H= 341:30 +CPU= 52.560
  06:49:13 STEP 1367 H= 341:45 +CPU= 46.677
  06:50:09 STEP 1368 H= 342:00 +CPU= 55.397
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001368
  06:50:54 STEP 1369 H= 342:15 +CPU= 45.237
  06:51:42 STEP 1370 H= 342:30 +CPU= 47.689
  06:52:35 STEP 1371 H= 342:45 +CPU= 52.713
  06:53:22 STEP 1372 H= 343:00 +CPU= 46.394
  06:54:08 STEP 1373 H= 343:15 +CPU= 45.622
  06:54:54 STEP 1374 H= 343:30 +CPU= 45.949
  06:55:39 STEP 1375 H= 343:45 +CPU= 45.124
  06:56:26 STEP 1376 H= 344:00 +CPU= 46.688
  06:57:14 STEP 1377 H= 344:15 +CPU= 47.433
  06:58:04 STEP 1378 H= 344:30 +CPU= 49.456
  06:58:54 STEP 1379 H= 344:45 +CPU= 49.861
  06:59:50 STEP 1380 H= 345:00 +CPU= 55.571
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001380
  07:00:37 STEP 1381 H= 345:15 +CPU= 47.155
  07:01:25 STEP 1382 H= 345:30 +CPU= 47.232
  07:02:13 STEP 1383 H= 345:45 +CPU= 48.199
  07:03:00 STEP 1384 H= 346:00 +CPU= 46.262
  07:03:46 STEP 1385 H= 346:15 +CPU= 45.829
  07:04:32 STEP 1386 H= 346:30 +CPU= 45.824
  07:05:20 STEP 1387 H= 346:45 +CPU= 47.654
  07:06:11 STEP 1388 H= 347:00 +CPU= 50.853
  07:07:00 STEP 1389 H= 347:15 +CPU= 49.268
  07:07:48 STEP 1390 H= 347:30 +CPU= 47.468
  07:08:38 STEP 1391 H= 347:45 +CPU= 49.295
  07:09:42 STEP 1392 H= 348:00 +CPU= 64.048
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001392
  07:10:29 STEP 1393 H= 348:15 +CPU= 47.040
  07:11:17 STEP 1394 H= 348:30 +CPU= 47.018
  07:12:03 STEP 1395 H= 348:45 +CPU= 46.580
  07:12:50 STEP 1396 H= 349:00 +CPU= 46.082
  07:13:36 STEP 1397 H= 349:15 +CPU= 45.877
  07:14:23 STEP 1398 H= 349:30 +CPU= 47.312
  07:15:12 STEP 1399 H= 349:45 +CPU= 47.874
  07:15:58 STEP 1400 H= 350:00 +CPU= 45.747
  07:16:45 STEP 1401 H= 350:15 +CPU= 47.691
  07:17:34 STEP 1402 H= 350:30 +CPU= 48.586
  07:18:20 STEP 1403 H= 350:45 +CPU= 45.306
  07:19:14 STEP 1404 H= 351:00 +CPU= 53.436
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  07:19:59 STEP 1405 H= 351:15 +CPU= 45.463
  07:20:46 STEP 1406 H= 351:30 +CPU= 46.164
  07:21:32 STEP 1407 H= 351:45 +CPU= 45.854
  07:22:19 STEP 1408 H= 352:00 +CPU= 47.284
  07:23:07 STEP 1409 H= 352:15 +CPU= 47.434
  07:23:54 STEP 1410 H= 352:30 +CPU= 46.918
  07:24:40 STEP 1411 H= 352:45 +CPU= 45.608
  07:25:29 STEP 1412 H= 353:00 +CPU= 48.800
  07:26:17 STEP 1413 H= 353:15 +CPU= 47.130
  07:27:05 STEP 1414 H= 353:30 +CPU= 47.663
  07:27:50 STEP 1415 H= 353:45 +CPU= 45.438
  07:28:50 STEP 1416 H= 354:00 +CPU= 59.499
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  07:29:36 STEP 1417 H= 354:15 +CPU= 45.655
  07:30:24 STEP 1418 H= 354:30 +CPU= 47.526
  07:31:11 STEP 1419 H= 354:45 +CPU= 46.673
  07:31:59 STEP 1420 H= 355:00 +CPU= 47.717
  07:32:44 STEP 1421 H= 355:15 +CPU= 45.242
  07:33:32 STEP 1422 H= 355:30 +CPU= 47.311
  07:34:17 STEP 1423 H= 355:45 +CPU= 45.230
  07:35:04 STEP 1424 H= 356:00 +CPU= 46.289
  07:35:49 STEP 1425 H= 356:15 +CPU= 45.059
  07:36:45 STEP 1426 H= 356:30 +CPU= 55.667
  07:37:37 STEP 1427 H= 356:45 +CPU= 52.210
  07:38:42 STEP 1428 H= 357:00 +CPU= 64.317
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001428
  07:39:42 STEP 1429 H= 357:15 +CPU= 59.184
  07:40:37 STEP 1430 H= 357:30 +CPU= 55.116
  07:41:31 STEP 1431 H= 357:45 +CPU= 53.877
  07:42:33 STEP 1432 H= 358:00 +CPU= 61.738
  07:43:35 STEP 1433 H= 358:15 +CPU= 61.918
  07:44:27 STEP 1434 H= 358:30 +CPU= 51.623
  07:45:17 STEP 1435 H= 358:45 +CPU= 50.040
  07:46:08 STEP 1436 H= 359:00 +CPU= 50.040
  07:46:59 STEP 1437 H= 359:15 +CPU= 51.130
  07:47:51 STEP 1438 H= 359:30 +CPU= 51.159
  07:48:41 STEP 1439 H= 359:45 +CPU= 50.597
  07:49:53 STEP 1440 H= 360:00 +CPU= 71.466
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9524039012E-21      I       0.1425930803E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1382385456E-01      I
I  Relat. Hum. I      0.3894150652E-01      I       0.1241096903E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2666710344E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    328125908 BYTES IN      7 RECORDS TRANSFERRED IN    0.0011 SECONDS298296.3 Mbytes/s, TOTAL TIME=    0.0314( 3.5%)
 07:49:53 STEP 1440 H= 360:00 +CPU= 71.466
 END CNT3
 NSTEP =  1440 CNT0   000000000  54.721  54.721  54.896   0.997               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   147.7     0.1   147.6     0.1   290.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562   58563.8   58563.8     45.90      0.00
   9 SPCM     - SPECTRAL COMP.                    1440   12225.3   12225.3      8.83      0.00
  10 SCAN2M - PHYSICS                             1441  112443.2  112443.2     81.30      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1936.1    1936.1      0.12      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      42.2      42.2      0.00      0.00
  14 SUINIF                                          1   12877.9   12877.9      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      40.6      40.6      0.00      0.00
  18 SUSPECG                                         1    6318.0    6318.0      0.00      0.00
  19 SUSPEC                                          1    6340.0    6340.0      0.00      0.00
  24 SUGRIDU                                         1    5502.0    5502.0      0.00      0.00
  25 SPECRT                                          1     410.3     410.3      0.00      0.00
  26 SUGRIDF                                         1     625.6     625.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    7808.8    7808.8      0.12      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121   29821.0   29821.0      1.81      0.00
  31 POSDDH IN STEPO                                 7       2.8       2.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441  -91130.5       0.0      0.00     65.89
  39 SU0YOMB                                         1    1098.0    1098.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      45.4      45.4      0.03      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     487.7     487.7      0.35      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440    2360.6    2360.6      1.71      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125    3921.6    3921.6      6.15      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006    4447.0    4447.0      6.71      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006    1874.2    1874.2      2.83      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125    2168.7    2168.7      3.40      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     147.8     147.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125    1815.5    1815.5      2.85      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      95.3      95.3      0.14      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125    2172.0    2172.0      3.41      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      27.1      27.1      0.04      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME   199300.5 CPU TIME   69909.6 VECTOR TIME    69909.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY        6.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286571/ICMUAh7zg+001404
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
07:53:34 (2001532): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0_r1845274745_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Jun 2024 13:38:24 1524679 22438192 oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0 1,295,100 69,910 0.0540
12 Jun 2024 07:17:44 1524679 22438192 oifs_43r3_bl_a3ns_2016092300_20_1017_12286571_0 864,000 46,718 0.0541


©2024 cpdn.org