climateprediction.net home page
Task 22436562

Task 22436562

Name oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0
Workunit 12284971
Created 7 Jun 2024, 15:23:31 UTC
Sent 7 Jun 2024, 15:30:55 UTC
Report deadline 6 Aug 2024, 15:30:55 UTC
Received 9 Jun 2024, 16:21:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1523278
Run time 10 hours 49 min 20 sec
CPU time 10 hours 49 min 20 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 8.64 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,020.18 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,765.57 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5640:5640] [20240609:080959:1717913399:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:10:14 STEP  864 H= 216:00 +CPU= 12.735
  08:10:26 STEP  865 H= 216:15 +CPU= 11.931
  08:10:38 STEP  866 H= 216:30 +CPU= 12.099
  08:10:50 STEP  867 H= 216:45 +CPU= 12.026
  08:11:03 STEP  868 H= 217:00 +CPU= 12.283
  08:11:15 STEP  869 H= 217:15 +CPU= 12.349
  08:11:28 STEP  870 H= 217:30 +CPU= 12.504
  08:11:40 STEP  871 H= 217:45 +CPU= 12.492
  08:11:53 STEP  872 H= 218:00 +CPU= 12.792
  08:12:05 STEP  873 H= 218:15 +CPU= 12.350
  08:12:17 STEP  874 H= 218:30 +CPU= 12.182
  08:12:30 STEP  875 H= 218:45 +CPU= 12.811
  08:12:46 STEP  876 H= 219:00 +CPU= 16.216
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000876
  08:12:59 STEP  877 H= 219:15 +CPU= 12.499
  08:13:11 STEP  878 H= 219:30 +CPU= 12.540
  08:13:24 STEP  879 H= 219:45 +CPU= 12.256
  08:13:37 STEP  880 H= 220:00 +CPU= 12.803
  08:13:49 STEP  881 H= 220:15 +CPU= 12.568
  08:14:03 STEP  882 H= 220:30 +CPU= 13.039
  08:14:17 STEP  883 H= 220:45 +CPU= 13.622
  08:14:31 STEP  884 H= 221:00 +CPU= 13.769
  08:14:44 STEP  885 H= 221:15 +CPU= 13.942
  08:14:59 STEP  886 H= 221:30 +CPU= 14.360
  08:15:13 STEP  887 H= 221:45 +CPU= 14.797
  08:15:33 STEP  888 H= 222:00 +CPU= 19.661
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000888
  08:15:50 STEP  889 H= 222:15 +CPU= 16.145
  08:16:06 STEP  890 H= 222:30 +CPU= 16.321
  08:16:22 STEP  891 H= 222:45 +CPU= 16.976
  08:16:41 STEP  892 H= 223:00 +CPU= 18.687
  08:16:59 STEP  893 H= 223:15 +CPU= 18.225
  08:17:19 STEP  894 H= 223:30 +CPU= 19.582
  08:17:40 STEP  895 H= 223:45 +CPU= 20.154
  08:18:00 STEP  896 H= 224:00 +CPU= 20.976
  08:18:23 STEP  897 H= 224:15 +CPU= 22.922
  08:18:47 STEP  898 H= 224:30 +CPU= 24.207
  08:19:13 STEP  899 H= 224:45 +CPU= 25.911
  08:19:44 STEP  900 H= 225:00 +CPU= 30.929
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000900
  08:20:10 STEP  901 H= 225:15 +CPU= 25.476
  08:20:36 STEP  902 H= 225:30 +CPU= 26.066
  08:21:02 STEP  903 H= 225:45 +CPU= 26.167
  08:21:28 STEP  904 H= 226:00 +CPU= 26.697
  08:21:54 STEP  905 H= 226:15 +CPU= 25.214
  08:22:19 STEP  906 H= 226:30 +CPU= 25.454
  08:22:44 STEP  907 H= 226:45 +CPU= 24.681
  08:23:09 STEP  908 H= 227:00 +CPU= 25.296
  08:23:34 STEP  909 H= 227:15 +CPU= 24.981
  08:24:00 STEP  910 H= 227:30 +CPU= 25.730
  08:24:25 STEP  911 H= 227:45 +CPU= 25.505
  08:25:02 STEP  912 H= 228:00 +CPU= 36.360
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000912
  08:25:27 STEP  913 H= 228:15 +CPU= 25.776
  08:25:51 STEP  914 H= 228:30 +CPU= 23.903
  08:26:16 STEP  915 H= 228:45 +CPU= 24.601
  08:26:41 STEP  916 H= 229:00 +CPU= 25.077
  08:27:06 STEP  917 H= 229:15 +CPU= 24.653
  08:27:30 STEP  918 H= 229:30 +CPU= 24.477
  08:27:54 STEP  919 H= 229:45 +CPU= 24.321
  08:28:19 STEP  920 H= 230:00 +CPU= 24.273
  08:28:42 STEP  921 H= 230:15 +CPU= 23.670
  08:29:07 STEP  922 H= 230:30 +CPU= 24.354
  08:29:32 STEP  923 H= 230:45 +CPU= 24.875
  08:30:02 STEP  924 H= 231:00 +CPU= 29.814
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000924
  08:30:27 STEP  925 H= 231:15 +CPU= 25.170
  08:30:52 STEP  926 H= 231:30 +CPU= 24.943
  08:31:17 STEP  927 H= 231:45 +CPU= 25.082
  08:31:42 STEP  928 H= 232:00 +CPU= 25.743
  08:32:07 STEP  929 H= 232:15 +CPU= 24.535
  08:32:32 STEP  930 H= 232:30 +CPU= 24.487
  08:32:56 STEP  931 H= 232:45 +CPU= 24.259
  08:33:20 STEP  932 H= 233:00 +CPU= 24.619
  08:33:45 STEP  933 H= 233:15 +CPU= 24.370
  08:34:10 STEP  934 H= 233:30 +CPU= 25.328
  08:34:35 STEP  935 H= 233:45 +CPU= 24.750
  08:35:05 STEP  936 H= 234:00 +CPU= 30.088
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000936
  08:35:30 STEP  937 H= 234:15 +CPU= 24.950
  08:35:55 STEP  938 H= 234:30 +CPU= 25.057
  08:36:20 STEP  939 H= 234:45 +CPU= 24.570
  08:36:45 STEP  940 H= 235:00 +CPU= 25.240
  08:37:10 STEP  941 H= 235:15 +CPU= 24.900
  08:37:35 STEP  942 H= 235:30 +CPU= 24.920
  08:38:01 STEP  943 H= 235:45 +CPU= 25.687
  08:38:27 STEP  944 H= 236:00 +CPU= 26.943
  08:38:53 STEP  945 H= 236:15 +CPU= 25.291
  08:39:18 STEP  946 H= 236:30 +CPU= 25.607
  08:39:44 STEP  947 H= 236:45 +CPU= 25.691
  08:40:16 STEP  948 H= 237:00 +CPU= 31.384
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000948
  08:40:40 STEP  949 H= 237:15 +CPU= 24.957
  08:41:06 STEP  950 H= 237:30 +CPU= 25.229
  08:41:30 STEP  951 H= 237:45 +CPU= 24.730
  08:41:56 STEP  952 H= 238:00 +CPU= 25.444
  08:42:21 STEP  953 H= 238:15 +CPU= 24.698
  08:42:45 STEP  954 H= 238:30 +CPU= 24.511
  08:43:10 STEP  955 H= 238:45 +CPU= 24.632
  08:43:34 STEP  956 H= 239:00 +CPU= 24.426
  08:43:58 STEP  957 H= 239:15 +CPU= 23.935
  08:44:23 STEP  958 H= 239:30 +CPU= 25.152
  08:44:48 STEP  959 H= 239:45 +CPU= 24.464
  08:45:22 STEP  960 H= 240:00 +CPU= 34.041
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_9.zip
Uploading the intermediate file: upload_file_9.zip
  08:45:47 STEP  961 H= 240:15 +CPU= 24.860
  08:46:11 STEP  962 H= 240:30 +CPU= 24.539
  08:46:36 STEP  963 H= 240:45 +CPU= 24.601
  08:47:01 STEP  964 H= 241:00 +CPU= 24.700
  08:47:25 STEP  965 H= 241:15 +CPU= 24.269
  08:47:50 STEP  966 H= 241:30 +CPU= 25.038
  08:48:15 STEP  967 H= 241:45 +CPU= 24.628
  08:48:39 STEP  968 H= 242:00 +CPU= 24.698
  08:49:04 STEP  969 H= 242:15 +CPU= 24.503
  08:49:29 STEP  970 H= 242:30 +CPU= 24.882
  08:49:53 STEP  971 H= 242:45 +CPU= 24.591
  08:50:23 STEP  972 H= 243:00 +CPU= 30.148
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000972
  08:50:49 STEP  973 H= 243:15 +CPU= 25.189
  08:51:14 STEP  974 H= 243:30 +CPU= 25.163
  08:51:38 STEP  975 H= 243:45 +CPU= 24.683
  08:52:03 STEP  976 H= 244:00 +CPU= 24.954
  08:52:28 STEP  977 H= 244:15 +CPU= 24.363
  08:52:52 STEP  978 H= 244:30 +CPU= 24.673
  08:53:17 STEP  979 H= 244:45 +CPU= 24.861
  08:53:43 STEP  980 H= 245:00 +CPU= 25.319
  08:54:07 STEP  981 H= 245:15 +CPU= 24.751
  08:54:32 STEP  982 H= 245:30 +CPU= 24.809
  08:54:57 STEP  983 H= 245:45 +CPU= 25.067
  08:55:26 STEP  984 H= 246:00 +CPU= 28.945
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000984
  08:55:51 STEP  985 H= 246:15 +CPU= 25.063
  08:56:17 STEP  986 H= 246:30 +CPU= 25.332
  08:56:42 STEP  987 H= 246:45 +CPU= 25.324
  08:57:07 STEP  988 H= 247:00 +CPU= 25.057
  08:57:32 STEP  989 H= 247:15 +CPU= 24.707
  08:57:56 STEP  990 H= 247:30 +CPU= 24.206
  08:58:21 STEP  991 H= 247:45 +CPU= 24.906
  08:58:46 STEP  992 H= 248:00 +CPU= 25.094
  08:59:11 STEP  993 H= 248:15 +CPU= 24.692
  08:59:35 STEP  994 H= 248:30 +CPU= 24.382
  09:00:00 STEP  995 H= 248:45 +CPU= 24.810
  09:00:29 STEP  996 H= 249:00 +CPU= 29.056
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+000996
  09:00:54 STEP  997 H= 249:15 +CPU= 24.807
  09:01:19 STEP  998 H= 249:30 +CPU= 24.917
  09:01:43 STEP  999 H= 249:45 +CPU= 24.150
  09:02:08 STEP 1000 H= 250:00 +CPU= 24.698
  09:02:33 STEP 1001 H= 250:15 +CPU= 25.183
  09:02:57 STEP 1002 H= 250:30 +CPU= 24.209
  09:03:21 STEP 1003 H= 250:45 +CPU= 24.508
  09:03:47 STEP 1004 H= 251:00 +CPU= 25.148
  09:04:11 STEP 1005 H= 251:15 +CPU= 24.337
  09:04:36 STEP 1006 H= 251:30 +CPU= 25.288
  09:05:01 STEP 1007 H= 251:45 +CPU= 24.776
  09:05:35 STEP 1008 H= 252:00 +CPU= 33.875
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001008
  09:05:59 STEP 1009 H= 252:15 +CPU= 24.514
  09:06:24 STEP 1010 H= 252:30 +CPU= 24.634
  09:06:48 STEP 1011 H= 252:45 +CPU= 24.236
  09:07:13 STEP 1012 H= 253:00 +CPU= 24.460
  09:07:38 STEP 1013 H= 253:15 +CPU= 24.759
  09:08:02 STEP 1014 H= 253:30 +CPU= 24.686
  09:08:27 STEP 1015 H= 253:45 +CPU= 24.528
  09:08:52 STEP 1016 H= 254:00 +CPU= 25.059
  09:09:17 STEP 1017 H= 254:15 +CPU= 24.701
  09:09:41 STEP 1018 H= 254:30 +CPU= 24.627
  09:10:05 STEP 1019 H= 254:45 +CPU= 24.120
  09:10:36 STEP 1020 H= 255:00 +CPU= 30.421
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001020
  09:11:01 STEP 1021 H= 255:15 +CPU= 25.179
  09:11:27 STEP 1022 H= 255:30 +CPU= 25.519
  09:11:51 STEP 1023 H= 255:45 +CPU= 24.580
  09:12:17 STEP 1024 H= 256:00 +CPU= 25.659
  09:12:41 STEP 1025 H= 256:15 +CPU= 24.484
  09:13:06 STEP 1026 H= 256:30 +CPU= 24.900
  09:13:30 STEP 1027 H= 256:45 +CPU= 24.204
  09:13:55 STEP 1028 H= 257:00 +CPU= 24.856
  09:14:20 STEP 1029 H= 257:15 +CPU= 24.541
  09:14:45 STEP 1030 H= 257:30 +CPU= 24.784
  09:15:09 STEP 1031 H= 257:45 +CPU= 24.382
  09:15:39 STEP 1032 H= 258:00 +CPU= 30.124
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001032
  09:16:03 STEP 1033 H= 258:15 +CPU= 24.412
  09:16:28 STEP 1034 H= 258:30 +CPU= 24.417
  09:16:52 STEP 1035 H= 258:45 +CPU= 23.788
  09:17:17 STEP 1036 H= 259:00 +CPU= 25.196
  09:17:41 STEP 1037 H= 259:15 +CPU= 24.157
  09:18:06 STEP 1038 H= 259:30 +CPU= 24.525
  09:18:30 STEP 1039 H= 259:45 +CPU= 24.102
  09:18:55 STEP 1040 H= 260:00 +CPU= 24.864
  09:19:19 STEP 1041 H= 260:15 +CPU= 24.561
  09:19:44 STEP 1042 H= 260:30 +CPU= 24.525
  09:20:09 STEP 1043 H= 260:45 +CPU= 24.865
  09:20:38 STEP 1044 H= 261:00 +CPU= 29.774
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001044
  09:21:03 STEP 1045 H= 261:15 +CPU= 24.243
  09:21:27 STEP 1046 H= 261:30 +CPU= 24.396
  09:21:52 STEP 1047 H= 261:45 +CPU= 24.522
  09:22:16 STEP 1048 H= 262:00 +CPU= 24.595
  09:22:41 STEP 1049 H= 262:15 +CPU= 24.705
  09:23:05 STEP 1050 H= 262:30 +CPU= 24.220
  09:23:29 STEP 1051 H= 262:45 +CPU= 24.260
  09:23:54 STEP 1052 H= 263:00 +CPU= 24.922
  09:24:19 STEP 1053 H= 263:15 +CPU= 24.649
  09:24:43 STEP 1054 H= 263:30 +CPU= 24.315
  09:25:08 STEP 1055 H= 263:45 +CPU= 24.804
  09:25:43 STEP 1056 H= 264:00 +CPU= 34.771
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_10.zip
Uploading the intermediate file: upload_file_10.zip
  09:26:07 STEP 1057 H= 264:15 +CPU= 24.593
  09:26:32 STEP 1058 H= 264:30 +CPU= 24.223
  09:26:56 STEP 1059 H= 264:45 +CPU= 24.453
  09:27:21 STEP 1060 H= 265:00 +CPU= 24.714
  09:27:45 STEP 1061 H= 265:15 +CPU= 23.927
  09:28:09 STEP 1062 H= 265:30 +CPU= 24.535
  09:28:34 STEP 1063 H= 265:45 +CPU= 24.690
  09:28:58 STEP 1064 H= 266:00 +CPU= 24.308
  09:29:23 STEP 1065 H= 266:15 +CPU= 24.710
  09:29:48 STEP 1066 H= 266:30 +CPU= 24.465
  09:30:12 STEP 1067 H= 266:45 +CPU= 24.240
  09:30:41 STEP 1068 H= 267:00 +CPU= 29.420
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001068
  09:31:05 STEP 1069 H= 267:15 +CPU= 24.048
  09:31:29 STEP 1070 H= 267:30 +CPU= 24.220
  09:31:54 STEP 1071 H= 267:45 +CPU= 24.582
  09:32:19 STEP 1072 H= 268:00 +CPU= 24.945
  09:32:44 STEP 1073 H= 268:15 +CPU= 24.659
  09:33:08 STEP 1074 H= 268:30 +CPU= 24.362
  09:33:33 STEP 1075 H= 268:45 +CPU= 24.946
  09:33:58 STEP 1076 H= 269:00 +CPU= 24.918
  09:34:23 STEP 1077 H= 269:15 +CPU= 24.563
  09:34:47 STEP 1078 H= 269:30 +CPU= 24.492
  09:35:11 STEP 1079 H= 269:45 +CPU= 23.971
  09:35:41 STEP 1080 H= 270:00 +CPU= 29.647
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001080
  09:36:05 STEP 1081 H= 270:15 +CPU= 24.630
  09:36:29 STEP 1082 H= 270:30 +CPU= 23.939
  09:36:53 STEP 1083 H= 270:45 +CPU= 24.260
  09:37:18 STEP 1084 H= 271:00 +CPU= 24.196
  09:37:43 STEP 1085 H= 271:15 +CPU= 24.893
  09:38:07 STEP 1086 H= 271:30 +CPU= 24.436
  09:38:33 STEP 1087 H= 271:45 +CPU= 25.605
  09:38:58 STEP 1088 H= 272:00 +CPU= 25.166
  09:39:22 STEP 1089 H= 272:15 +CPU= 24.464
  09:39:47 STEP 1090 H= 272:30 +CPU= 25.011
  09:40:11 STEP 1091 H= 272:45 +CPU= 23.976
  09:40:41 STEP 1092 H= 273:00 +CPU= 29.568
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001092
  09:41:06 STEP 1093 H= 273:15 +CPU= 24.711
  09:41:30 STEP 1094 H= 273:30 +CPU= 24.132
  09:41:54 STEP 1095 H= 273:45 +CPU= 24.622
  09:42:20 STEP 1096 H= 274:00 +CPU= 25.124
  09:42:44 STEP 1097 H= 274:15 +CPU= 24.945
  09:43:09 STEP 1098 H= 274:30 +CPU= 24.601
  09:43:34 STEP 1099 H= 274:45 +CPU= 25.035
  09:43:59 STEP 1100 H= 275:00 +CPU= 25.039
  09:44:25 STEP 1101 H= 275:15 +CPU= 25.366
  09:44:49 STEP 1102 H= 275:30 +CPU= 24.859
  09:45:14 STEP 1103 H= 275:45 +CPU= 24.378
  09:45:48 STEP 1104 H= 276:00 +CPU= 34.019
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001104
  09:46:12 STEP 1105 H= 276:15 +CPU= 24.480
  09:46:37 STEP 1106 H= 276:30 +CPU= 24.668
  09:47:02 STEP 1107 H= 276:45 +CPU= 24.735
  09:47:27 STEP 1108 H= 277:00 +CPU= 25.181
  09:47:52 STEP 1109 H= 277:15 +CPU= 24.706
  09:48:17 STEP 1110 H= 277:30 +CPU= 25.108
  09:48:41 STEP 1111 H= 277:45 +CPU= 24.461
  09:49:06 STEP 1112 H= 278:00 +CPU= 24.885
  09:49:31 STEP 1113 H= 278:15 +CPU= 24.403
  09:49:55 STEP 1114 H= 278:30 +CPU= 24.942
  09:50:20 STEP 1115 H= 278:45 +CPU= 24.771
  09:50:50 STEP 1116 H= 279:00 +CPU= 30.101
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001116
  09:51:15 STEP 1117 H= 279:15 +CPU= 24.350
  09:51:39 STEP 1118 H= 279:30 +CPU= 24.638
  09:52:04 STEP 1119 H= 279:45 +CPU= 24.210
  09:52:28 STEP 1120 H= 280:00 +CPU= 24.485
  09:52:52 STEP 1121 H= 280:15 +CPU= 24.049
  09:53:17 STEP 1122 H= 280:30 +CPU= 25.067
  09:53:42 STEP 1123 H= 280:45 +CPU= 24.946
  09:54:07 STEP 1124 H= 281:00 +CPU= 25.297
  09:54:32 STEP 1125 H= 281:15 +CPU= 24.455
  09:54:56 STEP 1126 H= 281:30 +CPU= 24.239
  09:55:21 STEP 1127 H= 281:45 +CPU= 24.690
  09:55:51 STEP 1128 H= 282:00 +CPU= 30.534
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001128
  09:56:16 STEP 1129 H= 282:15 +CPU= 24.870
  09:56:41 STEP 1130 H= 282:30 +CPU= 24.421
  09:57:05 STEP 1131 H= 282:45 +CPU= 24.299
  09:57:30 STEP 1132 H= 283:00 +CPU= 25.397
  09:57:55 STEP 1133 H= 283:15 +CPU= 24.853
  09:58:21 STEP 1134 H= 283:30 +CPU= 25.520
  09:58:46 STEP 1135 H= 283:45 +CPU= 25.234
  09:59:11 STEP 1136 H= 284:00 +CPU= 24.804
  09:59:35 STEP 1137 H= 284:15 +CPU= 24.335
  09:59:59 STEP 1138 H= 284:30 +CPU= 24.027
  10:00:24 STEP 1139 H= 284:45 +CPU= 25.066
  10:00:54 STEP 1140 H= 285:00 +CPU= 29.446
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001140
  10:01:19 STEP 1141 H= 285:15 +CPU= 25.168
  10:01:44 STEP 1142 H= 285:30 +CPU= 25.480
  10:02:09 STEP 1143 H= 285:45 +CPU= 24.943
  10:02:35 STEP 1144 H= 286:00 +CPU= 25.219
  10:02:59 STEP 1145 H= 286:15 +CPU= 24.529
  10:03:24 STEP 1146 H= 286:30 +CPU= 24.613
  10:03:49 STEP 1147 H= 286:45 +CPU= 25.058
  10:04:14 STEP 1148 H= 287:00 +CPU= 24.788
  10:04:38 STEP 1149 H= 287:15 +CPU= 24.586
  10:05:02 STEP 1150 H= 287:30 +CPU= 24.329
  10:05:27 STEP 1151 H= 287:45 +CPU= 24.194
  10:06:02 STEP 1152 H= 288:00 +CPU= 35.464
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_11.zip
Uploading the intermediate file: upload_file_11.zip
  10:06:27 STEP 1153 H= 288:15 +CPU= 24.763
  10:06:51 STEP 1154 H= 288:30 +CPU= 24.484
  10:07:16 STEP 1155 H= 288:45 +CPU= 25.064
  10:07:41 STEP 1156 H= 289:00 +CPU= 24.518
  10:08:05 STEP 1157 H= 289:15 +CPU= 23.663
  10:08:29 STEP 1158 H= 289:30 +CPU= 24.546
  10:08:54 STEP 1159 H= 289:45 +CPU= 25.105
  10:09:20 STEP 1160 H= 290:00 +CPU= 25.591
  10:09:44 STEP 1161 H= 290:15 +CPU= 23.826
  10:10:08 STEP 1162 H= 290:30 +CPU= 24.513
  10:10:32 STEP 1163 H= 290:45 +CPU= 24.095
  10:11:02 STEP 1164 H= 291:00 +CPU= 29.895
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001164
  10:11:27 STEP 1165 H= 291:15 +CPU= 24.505
  10:11:51 STEP 1166 H= 291:30 +CPU= 24.424
  10:12:16 STEP 1167 H= 291:45 +CPU= 24.903
  10:12:40 STEP 1168 H= 292:00 +CPU= 24.038
  10:13:05 STEP 1169 H= 292:15 +CPU= 25.087
  10:13:30 STEP 1170 H= 292:30 +CPU= 25.039
  10:13:55 STEP 1171 H= 292:45 +CPU= 25.033
  10:14:20 STEP 1172 H= 293:00 +CPU= 24.502
  10:14:44 STEP 1173 H= 293:15 +CPU= 24.268
  10:15:09 STEP 1174 H= 293:30 +CPU= 24.936
  10:15:33 STEP 1175 H= 293:45 +CPU= 24.338
  10:16:04 STEP 1176 H= 294:00 +CPU= 30.315
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001176
  10:16:29 STEP 1177 H= 294:15 +CPU= 24.768
  10:16:54 STEP 1178 H= 294:30 +CPU= 25.173
  10:17:19 STEP 1179 H= 294:45 +CPU= 24.907
  10:17:43 STEP 1180 H= 295:00 +CPU= 24.752
  10:18:08 STEP 1181 H= 295:15 +CPU= 24.964
  10:18:33 STEP 1182 H= 295:30 +CPU= 24.751
  10:18:59 STEP 1183 H= 295:45 +CPU= 25.558
  10:19:23 STEP 1184 H= 296:00 +CPU= 24.737
  10:19:48 STEP 1185 H= 296:15 +CPU= 24.506
  10:20:13 STEP 1186 H= 296:30 +CPU= 24.645
  10:20:37 STEP 1187 H= 296:45 +CPU= 24.787
  10:21:08 STEP 1188 H= 297:00 +CPU= 30.126
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001188
  10:21:33 STEP 1189 H= 297:15 +CPU= 25.215
  10:21:57 STEP 1190 H= 297:30 +CPU= 24.430
  10:22:22 STEP 1191 H= 297:45 +CPU= 24.623
  10:22:47 STEP 1192 H= 298:00 +CPU= 24.785
  10:23:10 STEP 1193 H= 298:15 +CPU= 23.818
  10:23:33 STEP 1194 H= 298:30 +CPU= 22.139
  10:23:55 STEP 1195 H= 298:45 +CPU= 22.474
  10:24:18 STEP 1196 H= 299:00 +CPU= 22.598
  10:24:39 STEP 1197 H= 299:15 +CPU= 21.801
  10:25:00 STEP 1198 H= 299:30 +CPU= 20.906
  10:25:20 STEP 1199 H= 299:45 +CPU= 19.423
  10:25:48 STEP 1200 H= 300:00 +CPU= 28.029
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001200
  10:26:07 STEP 1201 H= 300:15 +CPU= 19.473
  10:26:27 STEP 1202 H= 300:30 +CPU= 19.393
  10:26:47 STEP 1203 H= 300:45 +CPU= 19.821
  10:27:09 STEP 1204 H= 301:00 +CPU= 22.521
  10:27:31 STEP 1205 H= 301:15 +CPU= 21.778
  10:27:53 STEP 1206 H= 301:30 +CPU= 22.233
  10:28:15 STEP 1207 H= 301:45 +CPU= 22.041
  10:28:37 STEP 1208 H= 302:00 +CPU= 22.293
  10:29:02 STEP 1209 H= 302:15 +CPU= 24.740
  10:29:27 STEP 1210 H= 302:30 +CPU= 24.954
  10:29:51 STEP 1211 H= 302:45 +CPU= 24.166
  10:30:21 STEP 1212 H= 303:00 +CPU= 29.821
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001212
  10:30:43 STEP 1213 H= 303:15 +CPU= 21.684
  10:31:05 STEP 1214 H= 303:30 +CPU= 22.182
  10:31:26 STEP 1215 H= 303:45 +CPU= 21.388
  10:31:49 STEP 1216 H= 304:00 +CPU= 22.533
  10:32:11 STEP 1217 H= 304:15 +CPU= 21.789
  10:32:32 STEP 1218 H= 304:30 +CPU= 21.713
  10:32:55 STEP 1219 H= 304:45 +CPU= 22.267
  10:33:17 STEP 1220 H= 305:00 +CPU= 22.457
  10:33:39 STEP 1221 H= 305:15 +CPU= 21.734
  10:34:02 STEP 1222 H= 305:30 +CPU= 23.183
  10:34:27 STEP 1223 H= 305:45 +CPU= 25.148
  10:34:57 STEP 1224 H= 306:00 +CPU= 29.915
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001224
  10:35:22 STEP 1225 H= 306:15 +CPU= 24.953
  10:35:47 STEP 1226 H= 306:30 +CPU= 25.040
  10:36:12 STEP 1227 H= 306:45 +CPU= 24.374
  10:36:37 STEP 1228 H= 307:00 +CPU= 25.248
  10:37:02 STEP 1229 H= 307:15 +CPU= 25.418
  10:37:27 STEP 1230 H= 307:30 +CPU= 24.273
  10:37:50 STEP 1231 H= 307:45 +CPU= 23.438
  10:38:12 STEP 1232 H= 308:00 +CPU= 22.261
  10:38:34 STEP 1233 H= 308:15 +CPU= 21.544
  10:38:56 STEP 1234 H= 308:30 +CPU= 21.759
  10:39:18 STEP 1235 H= 308:45 +CPU= 22.405
  10:39:45 STEP 1236 H= 309:00 +CPU= 26.616
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001236
  10:40:06 STEP 1237 H= 309:15 +CPU= 21.598
  10:40:28 STEP 1238 H= 309:30 +CPU= 22.130
  10:40:51 STEP 1239 H= 309:45 +CPU= 22.205
  10:41:13 STEP 1240 H= 310:00 +CPU= 22.821
  10:41:38 STEP 1241 H= 310:15 +CPU= 24.788
  10:42:03 STEP 1242 H= 310:30 +CPU= 24.936
  10:42:28 STEP 1243 H= 310:45 +CPU= 25.034
  10:42:54 STEP 1244 H= 311:00 +CPU= 25.507
  10:43:18 STEP 1245 H= 311:15 +CPU= 24.013
  10:43:42 STEP 1246 H= 311:30 +CPU= 24.744
  10:44:07 STEP 1247 H= 311:45 +CPU= 24.599
  10:44:43 STEP 1248 H= 312:00 +CPU= 35.825
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_12.zip
Uploading the intermediate file: upload_file_12.zip
  10:45:09 STEP 1249 H= 312:15 +CPU= 25.752
  10:45:34 STEP 1250 H= 312:30 +CPU= 24.944
  10:45:59 STEP 1251 H= 312:45 +CPU= 25.045
  10:46:23 STEP 1252 H= 313:00 +CPU= 24.430
  10:46:48 STEP 1253 H= 313:15 +CPU= 25.336
  10:47:14 STEP 1254 H= 313:30 +CPU= 25.287
  10:47:39 STEP 1255 H= 313:45 +CPU= 24.944
  10:48:04 STEP 1256 H= 314:00 +CPU= 25.184
  10:48:29 STEP 1257 H= 314:15 +CPU= 24.650
  10:48:54 STEP 1258 H= 314:30 +CPU= 25.395
  10:49:18 STEP 1259 H= 314:45 +CPU= 24.432
  10:49:48 STEP 1260 H= 315:00 +CPU= 29.726
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001260
  10:50:12 STEP 1261 H= 315:15 +CPU= 24.180
  10:50:37 STEP 1262 H= 315:30 +CPU= 24.203
  10:51:01 STEP 1263 H= 315:45 +CPU= 24.549
  10:51:26 STEP 1264 H= 316:00 +CPU= 24.635
  10:51:52 STEP 1265 H= 316:15 +CPU= 25.833
  10:52:16 STEP 1266 H= 316:30 +CPU= 24.783
  10:52:41 STEP 1267 H= 316:45 +CPU= 24.872
  10:53:07 STEP 1268 H= 317:00 +CPU= 25.594
  10:53:31 STEP 1269 H= 317:15 +CPU= 24.454
  10:53:56 STEP 1270 H= 317:30 +CPU= 24.696
  10:54:21 STEP 1271 H= 317:45 +CPU= 25.410
  10:54:51 STEP 1272 H= 318:00 +CPU= 29.776
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001272
  10:55:15 STEP 1273 H= 318:15 +CPU= 24.239
  10:55:40 STEP 1274 H= 318:30 +CPU= 24.363
  10:56:05 STEP 1275 H= 318:45 +CPU= 24.841
  10:56:29 STEP 1276 H= 319:00 +CPU= 24.237
  10:56:53 STEP 1277 H= 319:15 +CPU= 23.924
  10:57:17 STEP 1278 H= 319:30 +CPU= 23.829
  10:57:42 STEP 1279 H= 319:45 +CPU= 24.904
  10:58:07 STEP 1280 H= 320:00 +CPU= 25.527
  10:58:32 STEP 1281 H= 320:15 +CPU= 24.913
  10:58:57 STEP 1282 H= 320:30 +CPU= 24.860
  10:59:21 STEP 1283 H= 320:45 +CPU= 24.322
  10:59:51 STEP 1284 H= 321:00 +CPU= 29.680
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001284
  11:00:16 STEP 1285 H= 321:15 +CPU= 24.748
  11:00:40 STEP 1286 H= 321:30 +CPU= 24.622
  11:01:05 STEP 1287 H= 321:45 +CPU= 24.696
  11:01:30 STEP 1288 H= 322:00 +CPU= 24.875
  11:01:55 STEP 1289 H= 322:15 +CPU= 25.181
  11:02:20 STEP 1290 H= 322:30 +CPU= 24.878
  11:02:45 STEP 1291 H= 322:45 +CPU= 24.848
  11:03:10 STEP 1292 H= 323:00 +CPU= 25.323
  11:03:35 STEP 1293 H= 323:15 +CPU= 25.031
  11:04:00 STEP 1294 H= 323:30 +CPU= 24.927
  11:04:24 STEP 1295 H= 323:45 +CPU= 24.354
  11:04:55 STEP 1296 H= 324:00 +CPU= 30.662
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001296
  11:05:18 STEP 1297 H= 324:15 +CPU= 22.353
  11:05:40 STEP 1298 H= 324:30 +CPU= 22.180
  11:06:02 STEP 1299 H= 324:45 +CPU= 22.025
  11:06:24 STEP 1300 H= 325:00 +CPU= 22.451
  11:06:46 STEP 1301 H= 325:15 +CPU= 21.703
  11:07:07 STEP 1302 H= 325:30 +CPU= 21.301
  11:07:29 STEP 1303 H= 325:45 +CPU= 21.296
  11:07:51 STEP 1304 H= 326:00 +CPU= 22.637
  11:08:15 STEP 1305 H= 326:15 +CPU= 24.197
  11:08:41 STEP 1306 H= 326:30 +CPU= 25.554
  11:09:06 STEP 1307 H= 326:45 +CPU= 25.147
  11:09:36 STEP 1308 H= 327:00 +CPU= 29.857
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001308
  11:10:01 STEP 1309 H= 327:15 +CPU= 25.049
  11:10:26 STEP 1310 H= 327:30 +CPU= 25.230
  11:10:52 STEP 1311 H= 327:45 +CPU= 25.425
  11:11:17 STEP 1312 H= 328:00 +CPU= 25.171
  11:11:42 STEP 1313 H= 328:15 +CPU= 25.327
  11:12:07 STEP 1314 H= 328:30 +CPU= 25.126
  11:12:32 STEP 1315 H= 328:45 +CPU= 24.989
  11:12:58 STEP 1316 H= 329:00 +CPU= 25.856
  11:13:23 STEP 1317 H= 329:15 +CPU= 24.831
  11:13:48 STEP 1318 H= 329:30 +CPU= 24.695
  11:14:12 STEP 1319 H= 329:45 +CPU= 24.403
  11:14:43 STEP 1320 H= 330:00 +CPU= 30.887
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001320
  11:15:09 STEP 1321 H= 330:15 +CPU= 25.687
  11:15:34 STEP 1322 H= 330:30 +CPU= 25.199
  11:15:59 STEP 1323 H= 330:45 +CPU= 24.574
  11:16:24 STEP 1324 H= 331:00 +CPU= 25.155
  11:16:48 STEP 1325 H= 331:15 +CPU= 24.652
  11:17:13 STEP 1326 H= 331:30 +CPU= 24.587
  11:17:37 STEP 1327 H= 331:45 +CPU= 24.370
  11:18:03 STEP 1328 H= 332:00 +CPU= 25.224
  11:18:27 STEP 1329 H= 332:15 +CPU= 24.310
  11:18:51 STEP 1330 H= 332:30 +CPU= 24.643
  11:19:16 STEP 1331 H= 332:45 +CPU= 24.596
  11:19:46 STEP 1332 H= 333:00 +CPU= 29.873
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001332
  11:20:11 STEP 1333 H= 333:15 +CPU= 24.622
  11:20:35 STEP 1334 H= 333:30 +CPU= 24.565
  11:21:00 STEP 1335 H= 333:45 +CPU= 24.804
  11:21:25 STEP 1336 H= 334:00 +CPU= 24.871
  11:21:49 STEP 1337 H= 334:15 +CPU= 24.458
  11:22:15 STEP 1338 H= 334:30 +CPU= 25.491
  11:22:40 STEP 1339 H= 334:45 +CPU= 24.981
  11:23:05 STEP 1340 H= 335:00 +CPU= 24.863
  11:23:30 STEP 1341 H= 335:15 +CPU= 25.298
  11:23:55 STEP 1342 H= 335:30 +CPU= 25.307
  11:24:20 STEP 1343 H= 335:45 +CPU= 24.667
  11:24:55 STEP 1344 H= 336:00 +CPU= 34.692
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_13.zip
Uploading the intermediate file: upload_file_13.zip
  11:25:20 STEP 1345 H= 336:15 +CPU= 25.524
  11:25:45 STEP 1346 H= 336:30 +CPU= 24.531
  11:26:08 STEP 1347 H= 336:45 +CPU= 23.674
  11:26:33 STEP 1348 H= 337:00 +CPU= 24.976
  11:26:58 STEP 1349 H= 337:15 +CPU= 24.525
  11:27:22 STEP 1350 H= 337:30 +CPU= 24.080
  11:27:47 STEP 1351 H= 337:45 +CPU= 24.792
  11:28:12 STEP 1352 H= 338:00 +CPU= 24.907
  11:28:36 STEP 1353 H= 338:15 +CPU= 24.602
  11:29:01 STEP 1354 H= 338:30 +CPU= 24.935
  11:29:26 STEP 1355 H= 338:45 +CPU= 24.960
  11:29:56 STEP 1356 H= 339:00 +CPU= 29.615
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001356
  11:30:21 STEP 1357 H= 339:15 +CPU= 25.326
  11:30:46 STEP 1358 H= 339:30 +CPU= 24.501
  11:31:11 STEP 1359 H= 339:45 +CPU= 24.820
  11:31:36 STEP 1360 H= 340:00 +CPU= 25.158
  11:32:00 STEP 1361 H= 340:15 +CPU= 24.038
  11:32:24 STEP 1362 H= 340:30 +CPU= 24.542
  11:32:49 STEP 1363 H= 340:45 +CPU= 24.946
  11:33:14 STEP 1364 H= 341:00 +CPU= 24.967
  11:33:39 STEP 1365 H= 341:15 +CPU= 24.639
  11:34:03 STEP 1366 H= 341:30 +CPU= 24.200
  11:34:28 STEP 1367 H= 341:45 +CPU= 24.901
  11:34:58 STEP 1368 H= 342:00 +CPU= 29.863
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001368
  11:35:23 STEP 1369 H= 342:15 +CPU= 25.331
  11:35:49 STEP 1370 H= 342:30 +CPU= 25.430
  11:36:13 STEP 1371 H= 342:45 +CPU= 24.540
  11:36:38 STEP 1372 H= 343:00 +CPU= 24.325
  11:37:02 STEP 1373 H= 343:15 +CPU= 24.843
  11:37:27 STEP 1374 H= 343:30 +CPU= 24.916
  11:37:53 STEP 1375 H= 343:45 +CPU= 25.374
  11:38:18 STEP 1376 H= 344:00 +CPU= 25.315
  11:38:43 STEP 1377 H= 344:15 +CPU= 25.186
  11:39:08 STEP 1378 H= 344:30 +CPU= 24.704
  11:39:33 STEP 1379 H= 344:45 +CPU= 24.654
  11:40:02 STEP 1380 H= 345:00 +CPU= 29.835
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001380
  11:40:27 STEP 1381 H= 345:15 +CPU= 24.571
  11:40:52 STEP 1382 H= 345:30 +CPU= 25.240
  11:41:17 STEP 1383 H= 345:45 +CPU= 25.026
  11:41:42 STEP 1384 H= 346:00 +CPU= 24.245
  11:42:06 STEP 1385 H= 346:15 +CPU= 24.214
  11:42:31 STEP 1386 H= 346:30 +CPU= 25.121
  11:42:56 STEP 1387 H= 346:45 +CPU= 25.339
  11:43:22 STEP 1388 H= 347:00 +CPU= 25.369
  11:43:47 STEP 1389 H= 347:15 +CPU= 25.223
  11:44:12 STEP 1390 H= 347:30 +CPU= 24.806
  11:44:36 STEP 1391 H= 347:45 +CPU= 24.784
  11:45:11 STEP 1392 H= 348:00 +CPU= 34.962
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001392
  11:45:36 STEP 1393 H= 348:15 +CPU= 24.908
  11:46:01 STEP 1394 H= 348:30 +CPU= 24.688
  11:46:26 STEP 1395 H= 348:45 +CPU= 25.209
  11:46:51 STEP 1396 H= 349:00 +CPU= 24.820
  11:47:16 STEP 1397 H= 349:15 +CPU= 24.472
  11:47:40 STEP 1398 H= 349:30 +CPU= 24.745
  11:48:05 STEP 1399 H= 349:45 +CPU= 24.867
  11:48:30 STEP 1400 H= 350:00 +CPU= 25.100
  11:48:56 STEP 1401 H= 350:15 +CPU= 25.371
  11:49:20 STEP 1402 H= 350:30 +CPU= 24.351
  11:49:45 STEP 1403 H= 350:45 +CPU= 24.812
  11:50:15 STEP 1404 H= 351:00 +CPU= 29.797
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001404
  11:50:40 STEP 1405 H= 351:15 +CPU= 25.325
  11:51:04 STEP 1406 H= 351:30 +CPU= 24.276
  11:51:29 STEP 1407 H= 351:45 +CPU= 24.846
  11:51:53 STEP 1408 H= 352:00 +CPU= 24.422
  11:52:18 STEP 1409 H= 352:15 +CPU= 24.826
  11:52:43 STEP 1410 H= 352:30 +CPU= 24.915
  11:53:08 STEP 1411 H= 352:45 +CPU= 24.429
  11:53:33 STEP 1412 H= 353:00 +CPU= 25.606
  11:53:58 STEP 1413 H= 353:15 +CPU= 24.724
  11:54:23 STEP 1414 H= 353:30 +CPU= 25.052
  11:54:48 STEP 1415 H= 353:45 +CPU= 25.375
  11:55:19 STEP 1416 H= 354:00 +CPU= 30.181
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001416
  11:55:43 STEP 1417 H= 354:15 +CPU= 24.517
  11:56:07 STEP 1418 H= 354:30 +CPU= 24.201
  11:56:32 STEP 1419 H= 354:45 +CPU= 24.765
  11:56:57 STEP 1420 H= 355:00 +CPU= 24.722
  11:57:22 STEP 1421 H= 355:15 +CPU= 25.345
  11:57:47 STEP 1422 H= 355:30 +CPU= 25.179
  11:58:13 STEP 1423 H= 355:45 +CPU= 25.206
  11:58:38 STEP 1424 H= 356:00 +CPU= 25.190
  11:59:03 STEP 1425 H= 356:15 +CPU= 25.212
  11:59:29 STEP 1426 H= 356:30 +CPU= 25.439
  11:59:53 STEP 1427 H= 356:45 +CPU= 24.892
  12:00:24 STEP 1428 H= 357:00 +CPU= 30.576
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001428
  12:00:49 STEP 1429 H= 357:15 +CPU= 24.820
  12:01:13 STEP 1430 H= 357:30 +CPU= 24.352
  12:01:37 STEP 1431 H= 357:45 +CPU= 24.228
  12:02:02 STEP 1432 H= 358:00 +CPU= 24.566
  12:02:26 STEP 1433 H= 358:15 +CPU= 24.523
  12:02:50 STEP 1434 H= 358:30 +CPU= 23.930
  12:03:15 STEP 1435 H= 358:45 +CPU= 24.646
  12:03:40 STEP 1436 H= 359:00 +CPU= 25.405
  12:04:05 STEP 1437 H= 359:15 +CPU= 24.985
  12:04:30 STEP 1438 H= 359:30 +CPU= 24.474
  12:04:55 STEP 1439 H= 359:45 +CPU= 24.559
  12:05:26 STEP 1440 H= 360:00 +CPU= 31.509
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8442456883E-21      I       0.2919345505E-06      I
ICloud fractionI      0.0000000000E+00      I       0.6698541959E-02      I
I  Relat. Hum. I      0.2107483064E+00      I       0.2568363970E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5490444288E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    324538772 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS463626.8 Mbytes/s, TOTAL TIME=    0.0095( 7.4%)
 12:05:26 STEP 1440 H= 360:00 +CPU= 31.509
 END CNT3
 NSTEP =  1440 CNT0   000000000  21.868  21.868  21.881   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        17160/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    303    0       46      1044068    17160 ************    37.6     1.3    36.3     1.9    66.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  625    4501.9    4501.9     19.92      0.00
   9 SPCM     - SPECTRAL COMP.                     576    1289.7    1289.7      5.26      0.00
  10 SCAN2M - PHYSICS                              577   10099.4   10099.4     41.25      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 48    1163.4    1163.4      0.40      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 25      75.5      75.5      0.01      0.00
  17 GRIDFPOS IN CNT4                               48      30.2      30.2      0.01      0.00
  27 RESTART FILES - WRITING                        12    4652.9    4652.9      0.40      0.00
  28 RESTART FILES - READING                         1    2488.2    2488.2      0.02      0.00
  29 SU4FPOS IN CNT4                                48       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                48    4369.3    4369.3      1.48      0.00
  31 POSDDH IN STEPO                                 3       7.8       7.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    577    4946.7    4946.7     20.20      0.00
  39 SU0YOMB                                         1     317.0     317.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    577      29.5      29.5      0.12      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              576     690.2     690.2      2.81      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              576      78.0      78.0      0.32      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 25       0.6       0.6      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1252     248.2     248.2      2.20      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1200     151.0     151.0      1.28      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1200      85.3      85.3      0.72      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1252     107.2     107.2      0.95      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      25.9      25.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1252      99.8      99.8      0.88      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1200      64.0      64.0      0.54      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1252      98.1      98.1      0.87      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1200      56.3      56.3      0.48      0.00
 400 GSTATS                                      67705       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 62941       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    14127.3 CPU TIME   14122.9 VECTOR TIME    14122.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       91.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/12/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/12/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284971/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
12:08:52 (5637): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0_r952120999_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 16:23:01 1523278 22436562 oifs_43r3_bl_a2fc_2016092300_20_1017_12284971_0 1,295,100 38,960 0.0301


©2024 climateprediction.net