climateprediction.net home page
Task 22313077

Task 22313077

Name oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0
Workunit 12212799
Created 13 Feb 2023, 23:04:24 UTC
Sent 13 Feb 2023, 23:11:18 UTC
Report deadline 14 Apr 2023, 23:11:18 UTC
Received 18 Feb 2023, 5:47:54 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1522997
Run time 10 hours 26 min
CPU time 10 hours 22 min 26 sec
Validate state Invalid
Credit 1,813.14
Device peak FLOPS 3.95 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,618.94 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,375.73 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
EP  834 H= 208:30 +CPU= 25.347
  00:53:06 STEP  835 H= 208:45 +CPU= 25.274
  00:53:32 STEP  836 H= 209:00 +CPU= 25.785
  00:53:57 STEP  837 H= 209:15 +CPU= 25.342
  00:54:23 STEP  838 H= 209:30 +CPU= 25.464
  00:54:48 STEP  839 H= 209:45 +CPU= 25.641
  00:55:20 STEP  840 H= 210:00 +CPU= 31.843
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000840
  00:55:46 STEP  841 H= 210:15 +CPU= 25.856
  00:56:12 STEP  842 H= 210:30 +CPU= 25.468
  00:56:37 STEP  843 H= 210:45 +CPU= 25.340
  00:57:03 STEP  844 H= 211:00 +CPU= 26.173
  00:57:28 STEP  845 H= 211:15 +CPU= 25.368
  00:57:54 STEP  846 H= 211:30 +CPU= 25.514
  00:58:19 STEP  847 H= 211:45 +CPU= 25.537
  00:58:45 STEP  848 H= 212:00 +CPU= 25.787
  00:59:11 STEP  849 H= 212:15 +CPU= 25.919
  00:59:37 STEP  850 H= 212:30 +CPU= 25.439
  01:00:02 STEP  851 H= 212:45 +CPU= 25.383
  01:00:33 STEP  852 H= 213:00 +CPU= 31.445
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000852
  01:00:59 STEP  853 H= 213:15 +CPU= 25.769
  01:01:25 STEP  854 H= 213:30 +CPU= 25.476
  01:01:50 STEP  855 H= 213:45 +CPU= 25.570
  01:02:16 STEP  856 H= 214:00 +CPU= 25.816
  01:02:42 STEP  857 H= 214:15 +CPU= 25.568
  01:03:07 STEP  858 H= 214:30 +CPU= 25.366
  01:03:32 STEP  859 H= 214:45 +CPU= 25.318
  01:03:58 STEP  860 H= 215:00 +CPU= 25.876
  01:04:24 STEP  861 H= 215:15 +CPU= 25.470
  01:04:49 STEP  862 H= 215:30 +CPU= 25.382
  01:05:14 STEP  863 H= 215:45 +CPU= 25.314
  01:05:49 STEP  864 H= 216:00 +CPU= 34.349
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_8.zip
Uploading the intermediate file: upload_file_8.zip
  01:06:14 STEP  865 H= 216:15 +CPU= 25.668
  01:06:40 STEP  866 H= 216:30 +CPU= 25.419
  01:07:05 STEP  867 H= 216:45 +CPU= 25.230
  01:07:31 STEP  868 H= 217:00 +CPU= 25.919
  01:07:56 STEP  869 H= 217:15 +CPU= 25.448
  01:08:22 STEP  870 H= 217:30 +CPU= 25.327
  01:08:47 STEP  871 H= 217:45 +CPU= 25.446
  01:09:13 STEP  872 H= 218:00 +CPU= 25.978
  01:09:38 STEP  873 H= 218:15 +CPU= 25.290
  01:10:04 STEP  874 H= 218:30 +CPU= 25.518
  01:10:29 STEP  875 H= 218:45 +CPU= 25.489
  01:11:01 STEP  876 H= 219:00 +CPU= 31.512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000876
  01:11:27 STEP  877 H= 219:15 +CPU= 25.573
  01:11:52 STEP  878 H= 219:30 +CPU= 25.489
  01:12:17 STEP  879 H= 219:45 +CPU= 25.323
  01:12:43 STEP  880 H= 220:00 +CPU= 25.825
  01:13:09 STEP  881 H= 220:15 +CPU= 25.352
  01:13:34 STEP  882 H= 220:30 +CPU= 25.469
  01:13:59 STEP  883 H= 220:45 +CPU= 25.256
  01:14:25 STEP  884 H= 221:00 +CPU= 25.943
  01:14:50 STEP  885 H= 221:15 +CPU= 25.236
  01:15:16 STEP  886 H= 221:30 +CPU= 25.312
  01:15:41 STEP  887 H= 221:45 +CPU= 25.265
  01:16:12 STEP  888 H= 222:00 +CPU= 31.335
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000888
  01:16:38 STEP  889 H= 222:15 +CPU= 25.458
  01:17:03 STEP  890 H= 222:30 +CPU= 25.519
  01:17:29 STEP  891 H= 222:45 +CPU= 25.375
  01:17:55 STEP  892 H= 223:00 +CPU= 25.852
  01:18:20 STEP  893 H= 223:15 +CPU= 25.312
  01:18:45 STEP  894 H= 223:30 +CPU= 25.429
  01:19:11 STEP  895 H= 223:45 +CPU= 25.587
  01:19:37 STEP  896 H= 224:00 +CPU= 26.627
  01:20:03 STEP  897 H= 224:15 +CPU= 25.361
  01:20:28 STEP  898 H= 224:30 +CPU= 25.366
  01:20:53 STEP  899 H= 224:45 +CPU= 25.261
  01:21:25 STEP  900 H= 225:00 +CPU= 31.343
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000900
  01:21:51 STEP  901 H= 225:15 +CPU= 25.730
  01:22:16 STEP  902 H= 225:30 +CPU= 25.205
  01:22:42 STEP  903 H= 225:45 +CPU= 25.747
  01:23:07 STEP  904 H= 226:00 +CPU= 25.920
  01:23:33 STEP  905 H= 226:15 +CPU= 25.208
  01:23:58 STEP  906 H= 226:30 +CPU= 25.335
  01:24:23 STEP  907 H= 226:45 +CPU= 25.210
  01:24:49 STEP  908 H= 227:00 +CPU= 25.833
  01:25:14 STEP  909 H= 227:15 +CPU= 25.336
  01:25:40 STEP  910 H= 227:30 +CPU= 25.298
  01:26:05 STEP  911 H= 227:45 +CPU= 25.230
  01:26:39 STEP  912 H= 228:00 +CPU= 34.266
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000912
  01:27:05 STEP  913 H= 228:15 +CPU= 25.540
  01:27:30 STEP  914 H= 228:30 +CPU= 25.287
  01:27:55 STEP  915 H= 228:45 +CPU= 25.219
  01:28:21 STEP  916 H= 229:00 +CPU= 25.936
  01:28:47 STEP  917 H= 229:15 +CPU= 25.492
  01:29:12 STEP  918 H= 229:30 +CPU= 25.364
  01:29:37 STEP  919 H= 229:45 +CPU= 25.362
  01:30:04 STEP  920 H= 230:00 +CPU= 26.558
  01:30:30 STEP  921 H= 230:15 +CPU= 25.713
  01:30:55 STEP  922 H= 230:30 +CPU= 25.438
  01:31:21 STEP  923 H= 230:45 +CPU= 25.475
  01:31:52 STEP  924 H= 231:00 +CPU= 31.416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000924
  01:32:17 STEP  925 H= 231:15 +CPU= 25.331
  01:32:43 STEP  926 H= 231:30 +CPU= 25.233
  01:33:08 STEP  927 H= 231:45 +CPU= 25.189
  01:33:34 STEP  928 H= 232:00 +CPU= 26.059
  01:33:59 STEP  929 H= 232:15 +CPU= 25.239
  01:34:24 STEP  930 H= 232:30 +CPU= 25.269
  01:34:50 STEP  931 H= 232:45 +CPU= 25.611
  01:35:16 STEP  932 H= 233:00 +CPU= 25.957
  01:35:41 STEP  933 H= 233:15 +CPU= 25.288
  01:36:06 STEP  934 H= 233:30 +CPU= 25.356
  01:36:32 STEP  935 H= 233:45 +CPU= 25.527
  01:37:03 STEP  936 H= 234:00 +CPU= 31.395
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000936
  01:37:29 STEP  937 H= 234:15 +CPU= 25.507
  01:37:54 STEP  938 H= 234:30 +CPU= 25.012
  01:38:17 STEP  939 H= 234:45 +CPU= 23.541
  01:38:43 STEP  940 H= 235:00 +CPU= 25.254
  01:39:08 STEP  941 H= 235:15 +CPU= 24.767
  01:39:33 STEP  942 H= 235:30 +CPU= 24.995
  01:39:58 STEP  943 H= 235:45 +CPU= 25.109
  01:40:23 STEP  944 H= 236:00 +CPU= 25.411
  01:40:48 STEP  945 H= 236:15 +CPU= 24.878
  01:41:13 STEP  946 H= 236:30 +CPU= 24.824
  01:41:38 STEP  947 H= 236:45 +CPU= 25.634
  01:42:10 STEP  948 H= 237:00 +CPU= 31.225
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000948
  01:42:35 STEP  949 H= 237:15 +CPU= 25.306
  01:43:00 STEP  950 H= 237:30 +CPU= 25.251
  01:43:25 STEP  951 H= 237:45 +CPU= 25.233
  01:43:51 STEP  952 H= 238:00 +CPU= 25.820
  01:44:17 STEP  953 H= 238:15 +CPU= 25.414
  01:44:42 STEP  954 H= 238:30 +CPU= 25.386
  01:45:07 STEP  955 H= 238:45 +CPU= 25.378
  01:45:33 STEP  956 H= 239:00 +CPU= 26.029
  01:45:59 STEP  957 H= 239:15 +CPU= 25.308
  01:46:24 STEP  958 H= 239:30 +CPU= 25.274
  01:46:49 STEP  959 H= 239:45 +CPU= 25.414
  01:47:24 STEP  960 H= 240:00 +CPU= 34.373
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_9.zip
Uploading the intermediate file: upload_file_9.zip
  01:47:50 STEP  961 H= 240:15 +CPU= 25.803
Uploading trickle at timestep: 864000
  01:48:15 STEP  962 H= 240:30 +CPU= 25.626
  01:48:41 STEP  963 H= 240:45 +CPU= 26.207
  01:49:08 STEP  964 H= 241:00 +CPU= 26.239
  01:49:33 STEP  965 H= 241:15 +CPU= 25.464
  01:49:59 STEP  966 H= 241:30 +CPU= 25.574
  01:50:24 STEP  967 H= 241:45 +CPU= 25.526
  01:50:50 STEP  968 H= 242:00 +CPU= 26.128
  01:51:16 STEP  969 H= 242:15 +CPU= 25.792
  01:51:42 STEP  970 H= 242:30 +CPU= 25.722
  01:52:07 STEP  971 H= 242:45 +CPU= 25.305
  01:52:39 STEP  972 H= 243:00 +CPU= 31.549
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000972
  01:53:04 STEP  973 H= 243:15 +CPU= 25.533
  01:53:30 STEP  974 H= 243:30 +CPU= 25.416
  01:53:55 STEP  975 H= 243:45 +CPU= 25.664
  01:54:22 STEP  976 H= 244:00 +CPU= 26.216
  01:54:47 STEP  977 H= 244:15 +CPU= 25.611
  01:55:12 STEP  978 H= 244:30 +CPU= 25.207
  01:55:38 STEP  979 H= 244:45 +CPU= 25.335
  01:56:04 STEP  980 H= 245:00 +CPU= 26.167
  01:56:29 STEP  981 H= 245:15 +CPU= 25.542
  01:56:55 STEP  982 H= 245:30 +CPU= 25.371
  01:57:20 STEP  983 H= 245:45 +CPU= 25.538
  01:57:52 STEP  984 H= 246:00 +CPU= 31.651
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000984
  01:58:17 STEP  985 H= 246:15 +CPU= 25.433
  01:58:43 STEP  986 H= 246:30 +CPU= 25.434
  01:59:08 STEP  987 H= 246:45 +CPU= 25.509
  01:59:34 STEP  988 H= 247:00 +CPU= 25.988
  02:00:00 STEP  989 H= 247:15 +CPU= 25.538
  02:00:26 STEP  990 H= 247:30 +CPU= 25.876
  02:00:51 STEP  991 H= 247:45 +CPU= 25.341
  02:01:17 STEP  992 H= 248:00 +CPU= 26.050
  02:01:43 STEP  993 H= 248:15 +CPU= 25.829
  02:02:09 STEP  994 H= 248:30 +CPU= 26.064
  02:02:35 STEP  995 H= 248:45 +CPU= 26.087
  02:03:07 STEP  996 H= 249:00 +CPU= 32.238
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000996
  02:03:33 STEP  997 H= 249:15 +CPU= 25.489
  02:03:58 STEP  998 H= 249:30 +CPU= 25.421
  02:04:24 STEP  999 H= 249:45 +CPU= 25.534
  02:04:50 STEP 1000 H= 250:00 +CPU= 26.346
  02:05:16 STEP 1001 H= 250:15 +CPU= 25.367
  02:05:41 STEP 1002 H= 250:30 +CPU= 25.225
  02:06:06 STEP 1003 H= 250:45 +CPU= 25.547
  02:06:32 STEP 1004 H= 251:00 +CPU= 26.087
  02:06:58 STEP 1005 H= 251:15 +CPU= 25.841
  02:07:24 STEP 1006 H= 251:30 +CPU= 25.458
  02:07:49 STEP 1007 H= 251:45 +CPU= 25.418
  02:08:24 STEP 1008 H= 252:00 +CPU= 34.479
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001008
  02:08:49 STEP 1009 H= 252:15 +CPU= 25.259
  02:09:14 STEP 1010 H= 252:30 +CPU= 25.296
  02:09:39 STEP 1011 H= 252:45 +CPU= 25.249
  02:10:05 STEP 1012 H= 253:00 +CPU= 25.950
  02:10:31 STEP 1013 H= 253:15 +CPU= 25.439
  02:10:56 STEP 1014 H= 253:30 +CPU= 25.692
  02:11:22 STEP 1015 H= 253:45 +CPU= 25.575
  02:11:48 STEP 1016 H= 254:00 +CPU= 26.063
  02:12:14 STEP 1017 H= 254:15 +CPU= 25.490
  02:12:39 STEP 1018 H= 254:30 +CPU= 25.464
  02:13:05 STEP 1019 H= 254:45 +CPU= 25.609
  02:13:36 STEP 1020 H= 255:00 +CPU= 31.715
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001020
  02:14:02 STEP 1021 H= 255:15 +CPU= 25.469
  02:14:27 STEP 1022 H= 255:30 +CPU= 25.525
  02:14:53 STEP 1023 H= 255:45 +CPU= 25.403
  02:15:19 STEP 1024 H= 256:00 +CPU= 26.162
  02:15:44 STEP 1025 H= 256:15 +CPU= 25.359
  02:16:10 STEP 1026 H= 256:30 +CPU= 25.486
  02:16:35 STEP 1027 H= 256:45 +CPU= 25.422
  02:17:01 STEP 1028 H= 257:00 +CPU= 26.165
  02:17:27 STEP 1029 H= 257:15 +CPU= 25.363
  02:17:52 STEP 1030 H= 257:30 +CPU= 25.373
  02:18:18 STEP 1031 H= 257:45 +CPU= 25.408
  02:18:49 STEP 1032 H= 258:00 +CPU= 31.489
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001032
  02:19:14 STEP 1033 H= 258:15 +CPU= 25.260
  02:19:40 STEP 1034 H= 258:30 +CPU= 25.304
  02:20:05 STEP 1035 H= 258:45 +CPU= 25.249
  02:20:31 STEP 1036 H= 259:00 +CPU= 26.055
  02:20:57 STEP 1037 H= 259:15 +CPU= 25.854
  02:21:22 STEP 1038 H= 259:30 +CPU= 25.472
  02:21:48 STEP 1039 H= 259:45 +CPU= 25.731
  02:22:14 STEP 1040 H= 260:00 +CPU= 26.224
  02:22:40 STEP 1041 H= 260:15 +CPU= 25.608
  02:23:05 STEP 1042 H= 260:30 +CPU= 25.128
  02:23:30 STEP 1043 H= 260:45 +CPU= 25.448
  02:24:02 STEP 1044 H= 261:00 +CPU= 31.745
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001044
  02:24:28 STEP 1045 H= 261:15 +CPU= 26.030
  02:24:54 STEP 1046 H= 261:30 +CPU= 25.426
  02:25:19 STEP 1047 H= 261:45 +CPU= 25.323
  02:25:45 STEP 1048 H= 262:00 +CPU= 26.217
  02:26:11 STEP 1049 H= 262:15 +CPU= 25.407
  02:26:36 STEP 1050 H= 262:30 +CPU= 25.454
  02:27:01 STEP 1051 H= 262:45 +CPU= 25.218
  02:27:27 STEP 1052 H= 263:00 +CPU= 26.022
  02:27:53 STEP 1053 H= 263:15 +CPU= 25.369
  02:28:18 STEP 1054 H= 263:30 +CPU= 25.603
  02:28:44 STEP 1055 H= 263:45 +CPU= 25.654
  02:29:18 STEP 1056 H= 264:00 +CPU= 34.511
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:29:44 STEP 1057 H= 264:15 +CPU= 25.634
  02:30:09 STEP 1058 H= 264:30 +CPU= 25.411
  02:30:35 STEP 1059 H= 264:45 +CPU= 25.449
  02:31:01 STEP 1060 H= 265:00 +CPU= 26.139
  02:31:26 STEP 1061 H= 265:15 +CPU= 25.259
  02:31:52 STEP 1062 H= 265:30 +CPU= 25.726
  02:32:18 STEP 1063 H= 265:45 +CPU= 25.581
  02:32:44 STEP 1064 H= 266:00 +CPU= 26.324
  02:33:10 STEP 1065 H= 266:15 +CPU= 25.643
  02:33:35 STEP 1066 H= 266:30 +CPU= 25.617
  02:34:01 STEP 1067 H= 266:45 +CPU= 25.687
  02:34:32 STEP 1068 H= 267:00 +CPU= 31.475
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001068
  02:34:58 STEP 1069 H= 267:15 +CPU= 25.450
  02:35:23 STEP 1070 H= 267:30 +CPU= 25.363
  02:35:49 STEP 1071 H= 267:45 +CPU= 25.487
  02:36:15 STEP 1072 H= 268:00 +CPU= 26.069
  02:36:40 STEP 1073 H= 268:15 +CPU= 25.532
  02:37:06 STEP 1074 H= 268:30 +CPU= 25.615
  02:37:31 STEP 1075 H= 268:45 +CPU= 25.450
  02:37:57 STEP 1076 H= 269:00 +CPU= 26.197
  02:38:23 STEP 1077 H= 269:15 +CPU= 25.462
  02:38:48 STEP 1078 H= 269:30 +CPU= 25.460
  02:39:14 STEP 1079 H= 269:45 +CPU= 25.306
  02:39:45 STEP 1080 H= 270:00 +CPU= 31.408
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001080
  02:40:10 STEP 1081 H= 270:15 +CPU= 25.328
  02:40:36 STEP 1082 H= 270:30 +CPU= 25.277
  02:41:01 STEP 1083 H= 270:45 +CPU= 25.371
  02:41:27 STEP 1084 H= 271:00 +CPU= 26.214
  02:41:53 STEP 1085 H= 271:15 +CPU= 25.303
  02:42:18 STEP 1086 H= 271:30 +CPU= 25.813
  02:42:44 STEP 1087 H= 271:45 +CPU= 25.370
  02:43:10 STEP 1088 H= 272:00 +CPU= 25.859
  02:43:36 STEP 1089 H= 272:15 +CPU= 25.886
  02:44:01 STEP 1090 H= 272:30 +CPU= 25.877
  02:44:27 STEP 1091 H= 272:45 +CPU= 25.375
  02:44:58 STEP 1092 H= 273:00 +CPU= 31.472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001092
  02:45:24 STEP 1093 H= 273:15 +CPU= 25.483
  02:45:49 STEP 1094 H= 273:30 +CPU= 25.460
  02:46:15 STEP 1095 H= 273:45 +CPU= 25.340
  02:46:40 STEP 1096 H= 274:00 +CPU= 25.732
  02:47:06 STEP 1097 H= 274:15 +CPU= 25.227
  02:47:31 STEP 1098 H= 274:30 +CPU= 25.874
  02:47:57 STEP 1099 H= 274:45 +CPU= 25.631
  02:48:23 STEP 1100 H= 275:00 +CPU= 26.121
  02:48:49 STEP 1101 H= 275:15 +CPU= 25.476
  02:49:14 STEP 1102 H= 275:30 +CPU= 25.330
  02:49:39 STEP 1103 H= 275:45 +CPU= 25.379
  02:50:14 STEP 1104 H= 276:00 +CPU= 34.181
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001104
  02:50:39 STEP 1105 H= 276:15 +CPU= 25.415
  02:51:05 STEP 1106 H= 276:30 +CPU= 25.620
  02:51:30 STEP 1107 H= 276:45 +CPU= 25.914
  02:51:57 STEP 1108 H= 277:00 +CPU= 26.194
  02:52:22 STEP 1109 H= 277:15 +CPU= 25.545
  02:52:48 STEP 1110 H= 277:30 +CPU= 25.568
  02:53:13 STEP 1111 H= 277:45 +CPU= 25.261
  02:53:39 STEP 1112 H= 278:00 +CPU= 26.216
  02:54:05 STEP 1113 H= 278:15 +CPU= 25.659
  02:54:31 STEP 1114 H= 278:30 +CPU= 26.005
  02:54:56 STEP 1115 H= 278:45 +CPU= 25.432
  02:55:28 STEP 1116 H= 279:00 +CPU= 31.522
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001116
  02:55:53 STEP 1117 H= 279:15 +CPU= 25.311
  02:56:19 STEP 1118 H= 279:30 +CPU= 25.384
  02:56:44 STEP 1119 H= 279:45 +CPU= 25.488
  02:57:10 STEP 1120 H= 280:00 +CPU= 25.891
  02:57:35 STEP 1121 H= 280:15 +CPU= 25.306
  02:58:01 STEP 1122 H= 280:30 +CPU= 25.500
  02:58:26 STEP 1123 H= 280:45 +CPU= 25.422
  02:58:53 STEP 1124 H= 281:00 +CPU= 26.339
  02:59:18 STEP 1125 H= 281:15 +CPU= 25.372
  02:59:43 STEP 1126 H= 281:30 +CPU= 25.384
  03:00:09 STEP 1127 H= 281:45 +CPU= 25.275
  03:00:40 STEP 1128 H= 282:00 +CPU= 31.377
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001128
  03:01:05 STEP 1129 H= 282:15 +CPU= 25.425
  03:01:31 STEP 1130 H= 282:30 +CPU= 25.473
  03:01:56 STEP 1131 H= 282:45 +CPU= 25.600
  03:02:23 STEP 1132 H= 283:00 +CPU= 26.161
  03:02:48 STEP 1133 H= 283:15 +CPU= 25.574
  03:03:14 STEP 1134 H= 283:30 +CPU= 25.581
  03:03:39 STEP 1135 H= 283:45 +CPU= 25.502
  03:04:05 STEP 1136 H= 284:00 +CPU= 25.854
  03:04:31 STEP 1137 H= 284:15 +CPU= 25.792
  03:04:57 STEP 1138 H= 284:30 +CPU= 26.304
  03:05:23 STEP 1139 H= 284:45 +CPU= 25.550
  03:05:55 STEP 1140 H= 285:00 +CPU= 31.939
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001140
  03:06:21 STEP 1141 H= 285:15 +CPU= 25.890
  03:06:46 STEP 1142 H= 285:30 +CPU= 25.771
  03:07:12 STEP 1143 H= 285:45 +CPU= 25.448
  03:07:38 STEP 1144 H= 286:00 +CPU= 25.939
  03:08:03 STEP 1145 H= 286:15 +CPU= 25.627
  03:08:29 STEP 1146 H= 286:30 +CPU= 25.468
  03:08:54 STEP 1147 H= 286:45 +CPU= 25.550
  03:09:21 STEP 1148 H= 287:00 +CPU= 26.116
  03:09:46 STEP 1149 H= 287:15 +CPU= 25.478
  03:10:12 STEP 1150 H= 287:30 +CPU= 25.538
  03:10:37 STEP 1151 H= 287:45 +CPU= 25.440
  03:11:11 STEP 1152 H= 288:00 +CPU= 34.326
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:11:37 STEP 1153 H= 288:15 +CPU= 25.735
  03:12:02 STEP 1154 H= 288:30 +CPU= 25.423
  03:12:28 STEP 1155 H= 288:45 +CPU= 25.475
  03:12:54 STEP 1156 H= 289:00 +CPU= 25.892
  03:13:19 STEP 1157 H= 289:15 +CPU= 25.448
  03:13:45 STEP 1158 H= 289:30 +CPU= 25.483
  03:14:10 STEP 1159 H= 289:45 +CPU= 25.487
  03:14:36 STEP 1160 H= 290:00 +CPU= 26.061
  03:15:02 STEP 1161 H= 290:15 +CPU= 25.263
  03:15:27 STEP 1162 H= 290:30 +CPU= 25.552
  03:15:53 STEP 1163 H= 290:45 +CPU= 25.648
  03:16:24 STEP 1164 H= 291:00 +CPU= 31.452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001164
  03:16:50 STEP 1165 H= 291:15 +CPU= 25.294
  03:17:15 STEP 1166 H= 291:30 +CPU= 25.449
  03:17:40 STEP 1167 H= 291:45 +CPU= 25.376
  03:18:06 STEP 1168 H= 292:00 +CPU= 25.946
  03:18:32 STEP 1169 H= 292:15 +CPU= 25.532
  03:18:57 STEP 1170 H= 292:30 +CPU= 25.429
  03:19:23 STEP 1171 H= 292:45 +CPU= 25.313
  03:19:49 STEP 1172 H= 293:00 +CPU= 26.060
  03:20:14 STEP 1173 H= 293:15 +CPU= 25.368
  03:20:39 STEP 1174 H= 293:30 +CPU= 25.261
  03:21:05 STEP 1175 H= 293:45 +CPU= 25.634
  03:21:36 STEP 1176 H= 294:00 +CPU= 31.524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001176
  03:22:02 STEP 1177 H= 294:15 +CPU= 25.446
  03:22:27 STEP 1178 H= 294:30 +CPU= 25.552
  03:22:53 STEP 1179 H= 294:45 +CPU= 25.494
  03:23:19 STEP 1180 H= 295:00 +CPU= 25.959
  03:23:44 STEP 1181 H= 295:15 +CPU= 25.475
  03:24:10 STEP 1182 H= 295:30 +CPU= 25.819
  03:24:36 STEP 1183 H= 295:45 +CPU= 25.832
  03:25:03 STEP 1184 H= 296:00 +CPU= 26.522
  03:25:28 STEP 1185 H= 296:15 +CPU= 25.657
  03:25:54 STEP 1186 H= 296:30 +CPU= 25.377
  03:26:19 STEP 1187 H= 296:45 +CPU= 25.480
  03:26:51 STEP 1188 H= 297:00 +CPU= 31.461
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001188
  03:27:16 STEP 1189 H= 297:15 +CPU= 25.539
  03:27:42 STEP 1190 H= 297:30 +CPU= 25.581
  03:28:07 STEP 1191 H= 297:45 +CPU= 25.445
  03:28:33 STEP 1192 H= 298:00 +CPU= 26.253
  03:28:59 STEP 1193 H= 298:15 +CPU= 25.631
  03:29:25 STEP 1194 H= 298:30 +CPU= 25.740
  03:29:50 STEP 1195 H= 298:45 +CPU= 25.547
  03:30:16 STEP 1196 H= 299:00 +CPU= 26.126
  03:30:42 STEP 1197 H= 299:15 +CPU= 25.447
  03:31:07 STEP 1198 H= 299:30 +CPU= 25.477
  03:31:33 STEP 1199 H= 299:45 +CPU= 25.511
  03:32:07 STEP 1200 H= 300:00 +CPU= 34.637
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001200
  03:32:33 STEP 1201 H= 300:15 +CPU= 25.398
  03:32:58 STEP 1202 H= 300:30 +CPU= 25.490
  03:33:24 STEP 1203 H= 300:45 +CPU= 25.270
  03:33:50 STEP 1204 H= 301:00 +CPU= 26.021
  03:34:15 STEP 1205 H= 301:15 +CPU= 25.455
  03:34:41 STEP 1206 H= 301:30 +CPU= 25.578
  03:35:06 STEP 1207 H= 301:45 +CPU= 25.426
  03:35:32 STEP 1208 H= 302:00 +CPU= 26.056
  03:35:58 STEP 1209 H= 302:15 +CPU= 25.583
  03:36:23 STEP 1210 H= 302:30 +CPU= 25.760
  03:36:50 STEP 1211 H= 302:45 +CPU= 26.045
  03:37:22 STEP 1212 H= 303:00 +CPU= 32.056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001212
  03:37:47 STEP 1213 H= 303:15 +CPU= 25.505
  03:38:13 STEP 1214 H= 303:30 +CPU= 25.545
  03:38:38 STEP 1215 H= 303:45 +CPU= 25.344
  03:39:04 STEP 1216 H= 304:00 +CPU= 26.235
  03:39:30 STEP 1217 H= 304:15 +CPU= 25.511
  03:39:55 STEP 1218 H= 304:30 +CPU= 25.299
  03:40:20 STEP 1219 H= 304:45 +CPU= 25.394
  03:40:46 STEP 1220 H= 305:00 +CPU= 25.828
  03:41:12 STEP 1221 H= 305:15 +CPU= 25.636
  03:41:37 STEP 1222 H= 305:30 +CPU= 25.335
  03:42:03 STEP 1223 H= 305:45 +CPU= 25.483
  03:42:34 STEP 1224 H= 306:00 +CPU= 31.566
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001224
  03:43:00 STEP 1225 H= 306:15 +CPU= 25.526
  03:43:25 STEP 1226 H= 306:30 +CPU= 25.610
  03:43:51 STEP 1227 H= 306:45 +CPU= 25.364
  03:44:17 STEP 1228 H= 307:00 +CPU= 26.323
  03:44:42 STEP 1229 H= 307:15 +CPU= 25.132
  03:45:08 STEP 1230 H= 307:30 +CPU= 25.368
  03:45:33 STEP 1231 H= 307:45 +CPU= 25.470
  03:45:59 STEP 1232 H= 308:00 +CPU= 26.066
  03:46:24 STEP 1233 H= 308:15 +CPU= 25.229
  03:46:50 STEP 1234 H= 308:30 +CPU= 25.325
  03:47:15 STEP 1235 H= 308:45 +CPU= 25.778
  03:47:47 STEP 1236 H= 309:00 +CPU= 31.959
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001236
  03:48:13 STEP 1237 H= 309:15 +CPU= 25.643
  03:48:38 STEP 1238 H= 309:30 +CPU= 25.399
  03:49:04 STEP 1239 H= 309:45 +CPU= 25.447
  03:49:30 STEP 1240 H= 310:00 +CPU= 25.982
  03:49:55 STEP 1241 H= 310:15 +CPU= 25.365
  03:50:21 STEP 1242 H= 310:30 +CPU= 25.335
  03:50:46 STEP 1243 H= 310:45 +CPU= 25.365
  03:51:12 STEP 1244 H= 311:00 +CPU= 26.126
  03:51:37 STEP 1245 H= 311:15 +CPU= 25.348
  03:52:03 STEP 1246 H= 311:30 +CPU= 25.302
  03:52:28 STEP 1247 H= 311:45 +CPU= 25.292
  03:53:02 STEP 1248 H= 312:00 +CPU= 34.123
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_12.zip
Uploading the intermediate file: upload_file_12.zip
  03:53:28 STEP 1249 H= 312:15 +CPU= 25.515
  03:53:53 STEP 1250 H= 312:30 +CPU= 25.458
  03:54:19 STEP 1251 H= 312:45 +CPU= 25.492
  03:54:45 STEP 1252 H= 313:00 +CPU= 26.102
  03:55:10 STEP 1253 H= 313:15 +CPU= 25.436
  03:55:36 STEP 1254 H= 313:30 +CPU= 25.417
  03:56:01 STEP 1255 H= 313:45 +CPU= 25.295
  03:56:27 STEP 1256 H= 314:00 +CPU= 25.960
  03:56:52 STEP 1257 H= 314:15 +CPU= 25.508
  03:57:18 STEP 1258 H= 314:30 +CPU= 25.422
  03:57:43 STEP 1259 H= 314:45 +CPU= 25.299
  03:58:14 STEP 1260 H= 315:00 +CPU= 31.367
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001260
  03:58:40 STEP 1261 H= 315:15 +CPU= 25.321
  03:59:05 STEP 1262 H= 315:30 +CPU= 25.435
  03:59:31 STEP 1263 H= 315:45 +CPU= 25.357
  03:59:57 STEP 1264 H= 316:00 +CPU= 25.949
  04:00:22 STEP 1265 H= 316:15 +CPU= 25.255
  04:00:47 STEP 1266 H= 316:30 +CPU= 25.372
  04:01:12 STEP 1267 H= 316:45 +CPU= 25.286
  04:01:38 STEP 1268 H= 317:00 +CPU= 25.908
  04:02:04 STEP 1269 H= 317:15 +CPU= 25.375
  04:02:29 STEP 1270 H= 317:30 +CPU= 25.308
  04:02:55 STEP 1271 H= 317:45 +CPU= 25.488
  04:03:26 STEP 1272 H= 318:00 +CPU= 31.376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001272
  04:03:51 STEP 1273 H= 318:15 +CPU= 25.392
  04:04:17 STEP 1274 H= 318:30 +CPU= 25.399
  04:04:42 STEP 1275 H= 318:45 +CPU= 25.561
  04:05:09 STEP 1276 H= 319:00 +CPU= 26.435
  04:05:35 STEP 1277 H= 319:15 +CPU= 25.851
  04:06:01 STEP 1278 H= 319:30 +CPU= 26.123
  04:06:26 STEP 1279 H= 319:45 +CPU= 25.653
  04:06:52 STEP 1280 H= 320:00 +CPU= 26.190
  04:07:18 STEP 1281 H= 320:15 +CPU= 25.645
  04:07:44 STEP 1282 H= 320:30 +CPU= 25.574
  04:08:09 STEP 1283 H= 320:45 +CPU= 25.497
  04:08:41 STEP 1284 H= 321:00 +CPU= 31.365
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001284
  04:09:06 STEP 1285 H= 321:15 +CPU= 25.592
  04:09:32 STEP 1286 H= 321:30 +CPU= 25.653
  04:09:57 STEP 1287 H= 321:45 +CPU= 25.604
  04:10:24 STEP 1288 H= 322:00 +CPU= 26.183
  04:10:49 STEP 1289 H= 322:15 +CPU= 25.459
  04:11:15 STEP 1290 H= 322:30 +CPU= 25.550
  04:11:40 STEP 1291 H= 322:45 +CPU= 25.494
  04:12:06 STEP 1292 H= 323:00 +CPU= 26.170
  04:12:32 STEP 1293 H= 323:15 +CPU= 25.532
  04:12:57 STEP 1294 H= 323:30 +CPU= 25.402
  04:13:23 STEP 1295 H= 323:45 +CPU= 25.510
  04:13:57 STEP 1296 H= 324:00 +CPU= 34.644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001296
  04:14:23 STEP 1297 H= 324:15 +CPU= 25.367
  04:14:48 STEP 1298 H= 324:30 +CPU= 25.425
  04:15:14 STEP 1299 H= 324:45 +CPU= 25.481
  04:15:40 STEP 1300 H= 325:00 +CPU= 25.960
  04:16:05 STEP 1301 H= 325:15 +CPU= 25.590
  04:16:31 STEP 1302 H= 325:30 +CPU= 25.532
  04:16:56 STEP 1303 H= 325:45 +CPU= 25.597
  04:17:23 STEP 1304 H= 326:00 +CPU= 26.214
  04:17:48 STEP 1305 H= 326:15 +CPU= 25.548
  04:18:13 STEP 1306 H= 326:30 +CPU= 25.385
  04:18:39 STEP 1307 H= 326:45 +CPU= 25.473
  04:19:11 STEP 1308 H= 327:00 +CPU= 32.139
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001308
  04:19:37 STEP 1309 H= 327:15 +CPU= 25.932
  04:20:03 STEP 1310 H= 327:30 +CPU= 25.900
  04:20:28 STEP 1311 H= 327:45 +CPU= 25.395
  04:20:54 STEP 1312 H= 328:00 +CPU= 26.179
  04:21:20 STEP 1313 H= 328:15 +CPU= 25.563
  04:21:46 STEP 1314 H= 328:30 +CPU= 25.526
  04:22:11 STEP 1315 H= 328:45 +CPU= 25.397
  04:22:37 STEP 1316 H= 329:00 +CPU= 26.253
  04:23:03 STEP 1317 H= 329:15 +CPU= 25.699
  04:23:29 STEP 1318 H= 329:30 +CPU= 25.569
  04:23:54 STEP 1319 H= 329:45 +CPU= 25.334
  04:24:26 STEP 1320 H= 330:00 +CPU= 31.663
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001320
  04:24:51 STEP 1321 H= 330:15 +CPU= 25.615
  04:25:16 STEP 1322 H= 330:30 +CPU= 25.344
  04:25:42 STEP 1323 H= 330:45 +CPU= 25.270
  04:26:08 STEP 1324 H= 331:00 +CPU= 26.182
  04:26:34 STEP 1325 H= 331:15 +CPU= 25.796
  04:26:59 STEP 1326 H= 331:30 +CPU= 25.563
  04:27:25 STEP 1327 H= 331:45 +CPU= 25.425
  04:27:51 STEP 1328 H= 332:00 +CPU= 26.400
  04:28:17 STEP 1329 H= 332:15 +CPU= 25.805
  04:28:43 STEP 1330 H= 332:30 +CPU= 25.839
  04:29:08 STEP 1331 H= 332:45 +CPU= 25.530
  04:29:40 STEP 1332 H= 333:00 +CPU= 31.726
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001332
  04:30:06 STEP 1333 H= 333:15 +CPU= 25.721
  04:30:31 STEP 1334 H= 333:30 +CPU= 25.702
  04:30:57 STEP 1335 H= 333:45 +CPU= 25.704
  04:31:24 STEP 1336 H= 334:00 +CPU= 26.374
  04:31:49 STEP 1337 H= 334:15 +CPU= 25.773
  04:32:15 STEP 1338 H= 334:30 +CPU= 25.481
  04:32:40 STEP 1339 H= 334:45 +CPU= 25.517
  04:33:07 STEP 1340 H= 335:00 +CPU= 26.321
  04:33:32 STEP 1341 H= 335:15 +CPU= 25.470
  04:33:58 STEP 1342 H= 335:30 +CPU= 25.460
  04:34:23 STEP 1343 H= 335:45 +CPU= 25.788
  04:34:58 STEP 1344 H= 336:00 +CPU= 34.410
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_13.zip
Uploading the intermediate file: upload_file_13.zip
  04:35:23 STEP 1345 H= 336:15 +CPU= 25.514
  04:35:49 STEP 1346 H= 336:30 +CPU= 25.443
  04:36:14 STEP 1347 H= 336:45 +CPU= 25.714
  04:36:41 STEP 1348 H= 337:00 +CPU= 26.762
  04:37:07 STEP 1349 H= 337:15 +CPU= 25.974
  04:37:33 STEP 1350 H= 337:30 +CPU= 25.399
  04:37:58 STEP 1351 H= 337:45 +CPU= 25.421
  04:38:24 STEP 1352 H= 338:00 +CPU= 26.147
  04:38:50 STEP 1353 H= 338:15 +CPU= 25.518
  04:39:15 STEP 1354 H= 338:30 +CPU= 25.363
  04:39:40 STEP 1355 H= 338:45 +CPU= 25.495
  04:40:12 STEP 1356 H= 339:00 +CPU= 31.517
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001356
  04:40:38 STEP 1357 H= 339:15 +CPU= 25.555
  04:41:03 STEP 1358 H= 339:30 +CPU= 25.630
  04:41:29 STEP 1359 H= 339:45 +CPU= 25.429
  04:41:55 STEP 1360 H= 340:00 +CPU= 26.208
  04:42:20 STEP 1361 H= 340:15 +CPU= 25.472
  04:42:46 STEP 1362 H= 340:30 +CPU= 25.505
  04:43:11 STEP 1363 H= 340:45 +CPU= 25.547
  04:43:37 STEP 1364 H= 341:00 +CPU= 25.898
  04:44:03 STEP 1365 H= 341:15 +CPU= 25.469
  04:44:28 STEP 1366 H= 341:30 +CPU= 25.526
  04:44:54 STEP 1367 H= 341:45 +CPU= 25.338
  04:45:25 STEP 1368 H= 342:00 +CPU= 31.420
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001368
  04:45:50 STEP 1369 H= 342:15 +CPU= 25.440
  04:46:16 STEP 1370 H= 342:30 +CPU= 25.855
  04:46:42 STEP 1371 H= 342:45 +CPU= 25.574
  04:47:08 STEP 1372 H= 343:00 +CPU= 26.444
  04:47:34 STEP 1373 H= 343:15 +CPU= 25.675
  04:48:00 STEP 1374 H= 343:30 +CPU= 26.292
  04:48:26 STEP 1375 H= 343:45 +CPU= 25.402
  04:48:52 STEP 1376 H= 344:00 +CPU= 26.175
  04:49:17 STEP 1377 H= 344:15 +CPU= 25.514
  04:49:43 STEP 1378 H= 344:30 +CPU= 25.517
  04:50:08 STEP 1379 H= 344:45 +CPU= 25.390
  04:50:40 STEP 1380 H= 345:00 +CPU= 31.613
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001380
  04:51:06 STEP 1381 H= 345:15 +CPU= 25.623
  04:51:31 STEP 1382 H= 345:30 +CPU= 25.685
  04:51:57 STEP 1383 H= 345:45 +CPU= 25.344
  04:52:23 STEP 1384 H= 346:00 +CPU= 25.998
  04:52:48 STEP 1385 H= 346:15 +CPU= 25.599
  04:53:13 STEP 1386 H= 346:30 +CPU= 25.279
  04:53:39 STEP 1387 H= 346:45 +CPU= 25.423
  04:54:05 STEP 1388 H= 347:00 +CPU= 26.145
  04:54:31 STEP 1389 H= 347:15 +CPU= 25.591
  04:54:56 STEP 1390 H= 347:30 +CPU= 25.622
  04:55:22 STEP 1391 H= 347:45 +CPU= 25.544
  04:55:57 STEP 1392 H= 348:00 +CPU= 34.798
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001392
  04:56:22 STEP 1393 H= 348:15 +CPU= 25.571
  04:56:48 STEP 1394 H= 348:30 +CPU= 25.670
  04:57:13 STEP 1395 H= 348:45 +CPU= 25.401
  04:57:39 STEP 1396 H= 349:00 +CPU= 25.859
  04:58:05 STEP 1397 H= 349:15 +CPU= 25.466
  04:58:30 STEP 1398 H= 349:30 +CPU= 25.636
  04:58:55 STEP 1399 H= 349:45 +CPU= 25.307
  04:59:22 STEP 1400 H= 350:00 +CPU= 26.145
  04:59:47 STEP 1401 H= 350:15 +CPU= 25.332
  05:00:12 STEP 1402 H= 350:30 +CPU= 25.242
  05:00:38 STEP 1403 H= 350:45 +CPU= 25.498
  05:01:10 STEP 1404 H= 351:00 +CPU= 31.868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001404
  05:01:35 STEP 1405 H= 351:15 +CPU= 25.571
  05:02:01 STEP 1406 H= 351:30 +CPU= 25.464
  05:02:26 STEP 1407 H= 351:45 +CPU= 25.419
  05:02:52 STEP 1408 H= 352:00 +CPU= 25.945
  05:03:17 STEP 1409 H= 352:15 +CPU= 25.461
  05:03:43 STEP 1410 H= 352:30 +CPU= 25.359
  05:04:09 STEP 1411 H= 352:45 +CPU= 25.737
  05:04:35 STEP 1412 H= 353:00 +CPU= 26.018
  05:05:00 STEP 1413 H= 353:15 +CPU= 25.645
  05:05:26 STEP 1414 H= 353:30 +CPU= 25.349
  05:05:51 STEP 1415 H= 353:45 +CPU= 25.733
  05:06:23 STEP 1416 H= 354:00 +CPU= 31.819
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001416
  05:06:49 STEP 1417 H= 354:15 +CPU= 25.824
  05:07:14 STEP 1418 H= 354:30 +CPU= 25.513
  05:07:40 STEP 1419 H= 354:45 +CPU= 25.600
  05:08:06 STEP 1420 H= 355:00 +CPU= 26.097
  05:08:32 STEP 1421 H= 355:15 +CPU= 25.712
  05:08:57 STEP 1422 H= 355:30 +CPU= 25.588
  05:09:23 STEP 1423 H= 355:45 +CPU= 25.669
  05:09:49 STEP 1424 H= 356:00 +CPU= 26.304
  05:10:16 STEP 1425 H= 356:15 +CPU= 26.104
  05:10:41 STEP 1426 H= 356:30 +CPU= 25.311
  05:11:06 STEP 1427 H= 356:45 +CPU= 25.235
  05:11:36 STEP 1428 H= 357:00 +CPU= 30.267
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001428
  05:12:02 STEP 1429 H= 357:15 +CPU= 25.186
  05:12:27 STEP 1430 H= 357:30 +CPU= 25.249
  05:12:52 STEP 1431 H= 357:45 +CPU= 25.047
  05:13:17 STEP 1432 H= 358:00 +CPU= 25.059
  05:13:41 STEP 1433 H= 358:15 +CPU= 23.635
  05:14:06 STEP 1434 H= 358:30 +CPU= 25.797
  05:14:32 STEP 1435 H= 358:45 +CPU= 25.701
  05:14:58 STEP 1436 H= 359:00 +CPU= 26.263
  05:15:24 STEP 1437 H= 359:15 +CPU= 25.782
  05:15:49 STEP 1438 H= 359:30 +CPU= 25.450
  05:16:15 STEP 1439 H= 359:45 +CPU= 25.348
  05:16:47 STEP 1440 H= 360:00 +CPU= 32.302
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2665859722E-22      I       0.4127797834E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1782090636E-01      I
I  Relat. Hum. I      0.3452323494E+00      I       0.3889204597E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3430179480E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    317151521 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS634303.0 Mbytes/s, TOTAL TIME=    0.0098( 5.1%)
 05:16:47 STEP 1440 H= 360:00 +CPU= 32.302
 END CNT3
 NSTEP =  1440 CNT0   000000000  24.153  24.153  24.153   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    60.4     0.0    60.4     0.0   124.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    3565.9    3565.9     14.91      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     858.4     858.4      3.31      0.00
  10 SCAN2M - PHYSICS                             1441   13544.8   13544.8     52.26      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     706.6     706.6      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      36.9      36.9      0.01      0.00
  14 SUINIF                                          1    3565.1    3565.1      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      24.6      24.6      0.01      0.00
  18 SUSPECG                                         1    1666.7    1666.7      0.00      0.00
  19 SUSPEC                                          1    1672.3    1672.3      0.00      0.00
  24 SUGRIDU                                         1     964.4     964.4      0.00      0.00
  25 SPECRT                                          1     241.4     241.4      0.00      0.00
  26 SUGRIDF                                         1     687.0     687.0      0.00      0.00
  27 RESTART FILES - WRITING                        30    2850.0    2850.0      0.23      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5223.4    5223.4      1.69      0.00
  31 POSDDH IN STEPO                                 7       0.8       0.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    4471.0    4471.0     17.25      0.00
  39 SU0YOMB                                         1     284.9     284.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      23.4      23.4      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     431.6     431.6      1.66      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      67.8      67.8      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     409.0     409.0      3.42      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     231.7     231.7      1.86      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      75.3      75.3      0.61      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     127.0     127.0      1.06      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.7      38.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      36.9      36.9      0.31      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      20.6      20.6      0.17      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      86.1      86.1      0.72      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      47.6      47.6      0.38      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    37347.5 CPU TIME   37346.8 VECTOR TIME    37346.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       34.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212799/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0_r1523875703_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
05:20:15 (5887): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:09 1522997 22313077 oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0 1,295,100 37,346 0.0288
09 May 2023 16:52:08 1522997 22313077 oifs_43r3_bl_a4n0_2016092300_15_991_12212799_0 864,000 24,787 0.0287


©2024 climateprediction.net