climateprediction.net home page
Task 22308695

Task 22308695

Name oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0
Workunit 12208516
Created 13 Feb 2023, 15:11:48 UTC
Sent 14 Feb 2023, 9:54:13 UTC
Report deadline 15 Apr 2023, 9:54:13 UTC
Received 24 Feb 2023, 10:16:05 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536616
Run time 10 hours 42 min 58 sec
CPU time 10 hours 42 min 58 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.72 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,076.25 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,357.13 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1530687:1530687] [20230224:053833:1677217113:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:39:03 STEP  864 H= 216:00 +CPU= 24.292
  05:39:27 STEP  865 H= 216:15 +CPU= 24.054
  05:39:51 STEP  866 H= 216:30 +CPU= 24.682
  05:40:15 STEP  867 H= 216:45 +CPU= 23.522
  05:40:39 STEP  868 H= 217:00 +CPU= 24.237
  05:41:05 STEP  869 H= 217:15 +CPU= 25.049
  05:41:29 STEP  870 H= 217:30 +CPU= 24.337
  05:41:52 STEP  871 H= 217:45 +CPU= 22.958
  05:42:17 STEP  872 H= 218:00 +CPU= 25.248
  05:42:42 STEP  873 H= 218:15 +CPU= 24.441
  05:43:05 STEP  874 H= 218:30 +CPU= 22.985
  05:43:29 STEP  875 H= 218:45 +CPU= 23.588
  05:44:00 STEP  876 H= 219:00 +CPU= 30.868
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000876
  05:44:24 STEP  877 H= 219:15 +CPU= 24.436
  05:44:48 STEP  878 H= 219:30 +CPU= 24.167
  05:45:13 STEP  879 H= 219:45 +CPU= 24.105
  05:45:38 STEP  880 H= 220:00 +CPU= 25.578
  05:46:03 STEP  881 H= 220:15 +CPU= 24.743
  05:46:28 STEP  882 H= 220:30 +CPU= 24.673
  05:46:52 STEP  883 H= 220:45 +CPU= 23.936
  05:47:17 STEP  884 H= 221:00 +CPU= 24.949
  05:47:41 STEP  885 H= 221:15 +CPU= 24.218
  05:48:06 STEP  886 H= 221:30 +CPU= 24.516
  05:48:29 STEP  887 H= 221:45 +CPU= 23.475
  05:49:02 STEP  888 H= 222:00 +CPU= 32.382
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000888
  05:49:26 STEP  889 H= 222:15 +CPU= 24.307
  05:49:51 STEP  890 H= 222:30 +CPU= 24.878
  05:50:16 STEP  891 H= 222:45 +CPU= 24.412
  05:50:41 STEP  892 H= 223:00 +CPU= 24.957
  05:51:05 STEP  893 H= 223:15 +CPU= 24.366
  05:51:29 STEP  894 H= 223:30 +CPU= 23.548
  05:51:53 STEP  895 H= 223:45 +CPU= 24.341
  05:52:19 STEP  896 H= 224:00 +CPU= 25.352
  05:52:43 STEP  897 H= 224:15 +CPU= 24.386
  05:53:07 STEP  898 H= 224:30 +CPU= 23.983
  05:53:31 STEP  899 H= 224:45 +CPU= 23.389
  05:54:03 STEP  900 H= 225:00 +CPU= 31.959
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000900
  05:54:26 STEP  901 H= 225:15 +CPU= 23.622
  05:54:49 STEP  902 H= 225:30 +CPU= 22.922
  05:55:13 STEP  903 H= 225:45 +CPU= 23.874
  05:55:39 STEP  904 H= 226:00 +CPU= 25.265
  05:56:03 STEP  905 H= 226:15 +CPU= 24.208
  05:56:27 STEP  906 H= 226:30 +CPU= 23.681
  05:56:52 STEP  907 H= 226:45 +CPU= 24.957
  05:57:17 STEP  908 H= 227:00 +CPU= 25.012
  05:57:41 STEP  909 H= 227:15 +CPU= 24.103
  05:58:05 STEP  910 H= 227:30 +CPU= 23.570
  05:58:29 STEP  911 H= 227:45 +CPU= 23.646
  05:59:04 STEP  912 H= 228:00 +CPU= 35.147
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000912
  05:59:29 STEP  913 H= 228:15 +CPU= 24.522
  05:59:53 STEP  914 H= 228:30 +CPU= 24.341
  06:00:18 STEP  915 H= 228:45 +CPU= 24.467
  06:00:42 STEP  916 H= 229:00 +CPU= 24.225
  06:01:06 STEP  917 H= 229:15 +CPU= 24.360
  06:01:31 STEP  918 H= 229:30 +CPU= 24.019
  06:01:55 STEP  919 H= 229:45 +CPU= 24.056
  06:02:20 STEP  920 H= 230:00 +CPU= 25.054
  06:02:45 STEP  921 H= 230:15 +CPU= 24.824
  06:03:09 STEP  922 H= 230:30 +CPU= 24.049
  06:03:33 STEP  923 H= 230:45 +CPU= 24.376
  06:04:04 STEP  924 H= 231:00 +CPU= 30.840
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000924
  06:04:28 STEP  925 H= 231:15 +CPU= 23.935
  06:04:53 STEP  926 H= 231:30 +CPU= 24.426
  06:05:18 STEP  927 H= 231:45 +CPU= 24.863
  06:05:43 STEP  928 H= 232:00 +CPU= 24.981
  06:06:07 STEP  929 H= 232:15 +CPU= 23.941
  06:06:31 STEP  930 H= 232:30 +CPU= 23.508
  06:06:54 STEP  931 H= 232:45 +CPU= 23.197
  06:07:19 STEP  932 H= 233:00 +CPU= 24.649
  06:07:43 STEP  933 H= 233:15 +CPU= 24.089
  06:08:07 STEP  934 H= 233:30 +CPU= 24.336
  06:08:31 STEP  935 H= 233:45 +CPU= 23.808
  06:09:02 STEP  936 H= 234:00 +CPU= 30.792
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000936
  06:09:26 STEP  937 H= 234:15 +CPU= 23.683
  06:09:49 STEP  938 H= 234:30 +CPU= 23.093
  06:10:13 STEP  939 H= 234:45 +CPU= 23.748
  06:10:38 STEP  940 H= 235:00 +CPU= 24.741
  06:11:02 STEP  941 H= 235:15 +CPU= 23.913
  06:11:26 STEP  942 H= 235:30 +CPU= 23.952
  06:11:49 STEP  943 H= 235:45 +CPU= 23.617
  06:12:14 STEP  944 H= 236:00 +CPU= 24.895
  06:12:39 STEP  945 H= 236:15 +CPU= 24.155
  06:13:03 STEP  946 H= 236:30 +CPU= 24.672
  06:13:27 STEP  947 H= 236:45 +CPU= 23.311
  06:13:58 STEP  948 H= 237:00 +CPU= 30.852
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000948
  06:14:22 STEP  949 H= 237:15 +CPU= 24.109
  06:14:46 STEP  950 H= 237:30 +CPU= 24.325
  06:15:10 STEP  951 H= 237:45 +CPU= 23.327
  06:15:35 STEP  952 H= 238:00 +CPU= 24.729
  06:15:59 STEP  953 H= 238:15 +CPU= 23.935
  06:16:24 STEP  954 H= 238:30 +CPU= 25.159
  06:16:47 STEP  955 H= 238:45 +CPU= 23.393
  06:17:12 STEP  956 H= 239:00 +CPU= 24.968
  06:17:36 STEP  957 H= 239:15 +CPU= 23.108
  06:18:01 STEP  958 H= 239:30 +CPU= 24.899
  06:18:25 STEP  959 H= 239:45 +CPU= 23.893
  06:19:00 STEP  960 H= 240:00 +CPU= 35.052
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_9.zip
Uploading the intermediate file: upload_file_9.zip
  06:19:24 STEP  961 H= 240:15 +CPU= 24.265
  06:19:49 STEP  962 H= 240:30 +CPU= 24.954
  06:20:13 STEP  963 H= 240:45 +CPU= 24.028
  06:20:38 STEP  964 H= 241:00 +CPU= 24.461
  06:21:02 STEP  965 H= 241:15 +CPU= 24.111
  06:21:26 STEP  966 H= 241:30 +CPU= 23.417
  06:21:50 STEP  967 H= 241:45 +CPU= 23.975
  06:22:14 STEP  968 H= 242:00 +CPU= 24.460
  06:22:38 STEP  969 H= 242:15 +CPU= 23.769
  06:23:02 STEP  970 H= 242:30 +CPU= 23.738
  06:23:26 STEP  971 H= 242:45 +CPU= 23.788
  06:23:57 STEP  972 H= 243:00 +CPU= 30.744
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000972
  06:24:20 STEP  973 H= 243:15 +CPU= 23.758
  06:24:44 STEP  974 H= 243:30 +CPU= 23.456
  06:25:08 STEP  975 H= 243:45 +CPU= 24.291
  06:25:34 STEP  976 H= 244:00 +CPU= 25.345
  06:25:58 STEP  977 H= 244:15 +CPU= 24.262
  06:26:21 STEP  978 H= 244:30 +CPU= 23.233
  06:26:46 STEP  979 H= 244:45 +CPU= 24.228
  06:27:11 STEP  980 H= 245:00 +CPU= 24.659
  06:27:35 STEP  981 H= 245:15 +CPU= 24.068
  06:27:59 STEP  982 H= 245:30 +CPU= 23.772
  06:28:22 STEP  983 H= 245:45 +CPU= 23.538
  06:28:53 STEP  984 H= 246:00 +CPU= 30.899
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000984
  06:29:17 STEP  985 H= 246:15 +CPU= 23.661
  06:29:40 STEP  986 H= 246:30 +CPU= 23.300
  06:30:04 STEP  987 H= 246:45 +CPU= 23.749
  06:30:29 STEP  988 H= 247:00 +CPU= 25.167
  06:30:53 STEP  989 H= 247:15 +CPU= 23.609
  06:31:17 STEP  990 H= 247:30 +CPU= 23.603
  06:31:41 STEP  991 H= 247:45 +CPU= 23.632
  06:32:05 STEP  992 H= 248:00 +CPU= 24.675
  06:32:29 STEP  993 H= 248:15 +CPU= 23.985
  06:32:54 STEP  994 H= 248:30 +CPU= 24.509
  06:33:18 STEP  995 H= 248:45 +CPU= 23.768
  06:33:49 STEP  996 H= 249:00 +CPU= 31.296
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+000996
  06:34:13 STEP  997 H= 249:15 +CPU= 23.494
  06:34:37 STEP  998 H= 249:30 +CPU= 24.044
  06:35:01 STEP  999 H= 249:45 +CPU= 23.539
  06:35:25 STEP 1000 H= 250:00 +CPU= 24.514
  06:35:49 STEP 1001 H= 250:15 +CPU= 23.436
  06:36:12 STEP 1002 H= 250:30 +CPU= 23.121
  06:36:36 STEP 1003 H= 250:45 +CPU= 23.932
  06:37:00 STEP 1004 H= 251:00 +CPU= 24.311
  06:37:27 STEP 1005 H= 251:15 +CPU= 26.094
  06:37:56 STEP 1006 H= 251:30 +CPU= 28.268
  06:38:25 STEP 1007 H= 251:45 +CPU= 27.978
  06:39:06 STEP 1008 H= 252:00 +CPU= 39.544
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001008
  06:39:35 STEP 1009 H= 252:15 +CPU= 27.599
  06:40:03 STEP 1010 H= 252:30 +CPU= 28.424
  06:40:31 STEP 1011 H= 252:45 +CPU= 26.804
  06:41:01 STEP 1012 H= 253:00 +CPU= 29.336
  06:41:29 STEP 1013 H= 253:15 +CPU= 27.141
  06:41:57 STEP 1014 H= 253:30 +CPU= 28.429
  06:42:27 STEP 1015 H= 253:45 +CPU= 29.164
  06:42:55 STEP 1016 H= 254:00 +CPU= 27.781
  06:43:23 STEP 1017 H= 254:15 +CPU= 27.388
  06:43:50 STEP 1018 H= 254:30 +CPU= 26.753
  06:44:19 STEP 1019 H= 254:45 +CPU= 27.828
  06:44:56 STEP 1020 H= 255:00 +CPU= 36.348
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001020
  06:45:24 STEP 1021 H= 255:15 +CPU= 27.961
  06:45:52 STEP 1022 H= 255:30 +CPU= 27.630
  06:46:20 STEP 1023 H= 255:45 +CPU= 27.513
  06:46:49 STEP 1024 H= 256:00 +CPU= 28.052
  06:47:17 STEP 1025 H= 256:15 +CPU= 28.044
  06:47:45 STEP 1026 H= 256:30 +CPU= 27.361
  06:48:14 STEP 1027 H= 256:45 +CPU= 27.995
  06:48:43 STEP 1028 H= 257:00 +CPU= 28.661
  06:49:11 STEP 1029 H= 257:15 +CPU= 27.885
  06:49:39 STEP 1030 H= 257:30 +CPU= 27.307
  06:50:08 STEP 1031 H= 257:45 +CPU= 28.016
  06:50:44 STEP 1032 H= 258:00 +CPU= 35.650
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001032
  06:51:12 STEP 1033 H= 258:15 +CPU= 28.103
  06:51:41 STEP 1034 H= 258:30 +CPU= 28.334
  06:52:10 STEP 1035 H= 258:45 +CPU= 28.190
  06:52:39 STEP 1036 H= 259:00 +CPU= 29.074
  06:53:08 STEP 1037 H= 259:15 +CPU= 28.600
  06:53:38 STEP 1038 H= 259:30 +CPU= 28.994
  06:54:07 STEP 1039 H= 259:45 +CPU= 28.826
  06:54:35 STEP 1040 H= 260:00 +CPU= 27.763
  06:55:04 STEP 1041 H= 260:15 +CPU= 28.326
  06:55:31 STEP 1042 H= 260:30 +CPU= 26.665
  06:55:59 STEP 1043 H= 260:45 +CPU= 27.454
  06:56:35 STEP 1044 H= 261:00 +CPU= 35.148
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001044
  06:57:03 STEP 1045 H= 261:15 +CPU= 28.514
  06:57:32 STEP 1046 H= 261:30 +CPU= 28.256
  06:57:59 STEP 1047 H= 261:45 +CPU= 26.361
  06:58:29 STEP 1048 H= 262:00 +CPU= 29.326
  06:58:57 STEP 1049 H= 262:15 +CPU= 27.705
  06:59:23 STEP 1050 H= 262:30 +CPU= 26.054
  06:59:53 STEP 1051 H= 262:45 +CPU= 28.739
  07:00:23 STEP 1052 H= 263:00 +CPU= 30.107
  07:00:52 STEP 1053 H= 263:15 +CPU= 28.515
  07:01:20 STEP 1054 H= 263:30 +CPU= 27.817
  07:01:50 STEP 1055 H= 263:45 +CPU= 29.046
  07:02:31 STEP 1056 H= 264:00 +CPU= 39.643
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_10.zip
Uploading the intermediate file: upload_file_10.zip
  07:03:00 STEP 1057 H= 264:15 +CPU= 28.704
  07:03:28 STEP 1058 H= 264:30 +CPU= 27.547
  07:03:57 STEP 1059 H= 264:45 +CPU= 28.208
  07:04:27 STEP 1060 H= 265:00 +CPU= 30.128
  07:04:56 STEP 1061 H= 265:15 +CPU= 28.184
  07:05:26 STEP 1062 H= 265:30 +CPU= 28.995
  07:05:55 STEP 1063 H= 265:45 +CPU= 28.679
  07:06:24 STEP 1064 H= 266:00 +CPU= 29.293
  07:06:53 STEP 1065 H= 266:15 +CPU= 28.075
  07:07:22 STEP 1066 H= 266:30 +CPU= 28.685
  07:07:51 STEP 1067 H= 266:45 +CPU= 28.025
  07:08:27 STEP 1068 H= 267:00 +CPU= 36.028
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001068
  07:08:56 STEP 1069 H= 267:15 +CPU= 28.674
  07:09:26 STEP 1070 H= 267:30 +CPU= 29.627
  07:09:56 STEP 1071 H= 267:45 +CPU= 28.603
  07:10:25 STEP 1072 H= 268:00 +CPU= 28.443
  07:10:54 STEP 1073 H= 268:15 +CPU= 29.388
  07:11:24 STEP 1074 H= 268:30 +CPU= 29.667
  07:11:53 STEP 1075 H= 268:45 +CPU= 28.269
  07:12:23 STEP 1076 H= 269:00 +CPU= 29.787
  07:12:52 STEP 1077 H= 269:15 +CPU= 27.899
  07:13:20 STEP 1078 H= 269:30 +CPU= 27.932
  07:13:48 STEP 1079 H= 269:45 +CPU= 27.967
  07:14:24 STEP 1080 H= 270:00 +CPU= 34.848
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001080
  07:14:52 STEP 1081 H= 270:15 +CPU= 27.770
  07:15:21 STEP 1082 H= 270:30 +CPU= 28.308
  07:15:49 STEP 1083 H= 270:45 +CPU= 28.201
  07:16:19 STEP 1084 H= 271:00 +CPU= 28.737
  07:16:47 STEP 1085 H= 271:15 +CPU= 28.194
  07:17:16 STEP 1086 H= 271:30 +CPU= 28.467
  07:17:45 STEP 1087 H= 271:45 +CPU= 28.408
  07:18:13 STEP 1088 H= 272:00 +CPU= 28.138
  07:18:43 STEP 1089 H= 272:15 +CPU= 28.716
  07:19:11 STEP 1090 H= 272:30 +CPU= 27.613
  07:19:39 STEP 1091 H= 272:45 +CPU= 27.965
  07:20:15 STEP 1092 H= 273:00 +CPU= 35.557
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001092
  07:20:44 STEP 1093 H= 273:15 +CPU= 28.157
  07:21:11 STEP 1094 H= 273:30 +CPU= 27.011
  07:21:39 STEP 1095 H= 273:45 +CPU= 27.941
  07:22:08 STEP 1096 H= 274:00 +CPU= 28.374
  07:22:37 STEP 1097 H= 274:15 +CPU= 28.312
  07:23:05 STEP 1098 H= 274:30 +CPU= 27.679
  07:23:34 STEP 1099 H= 274:45 +CPU= 28.605
  07:24:03 STEP 1100 H= 275:00 +CPU= 28.466
  07:24:32 STEP 1101 H= 275:15 +CPU= 28.357
  07:24:59 STEP 1102 H= 275:30 +CPU= 26.868
  07:25:29 STEP 1103 H= 275:45 +CPU= 29.018
  07:26:10 STEP 1104 H= 276:00 +CPU= 39.833
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001104
  07:26:38 STEP 1105 H= 276:15 +CPU= 27.285
  07:27:07 STEP 1106 H= 276:30 +CPU= 28.196
  07:27:35 STEP 1107 H= 276:45 +CPU= 27.442
  07:28:04 STEP 1108 H= 277:00 +CPU= 28.575
  07:28:32 STEP 1109 H= 277:15 +CPU= 28.061
  07:29:00 STEP 1110 H= 277:30 +CPU= 26.501
  07:29:28 STEP 1111 H= 277:45 +CPU= 28.270
  07:29:58 STEP 1112 H= 278:00 +CPU= 29.423
  07:30:28 STEP 1113 H= 278:15 +CPU= 29.266
  07:30:56 STEP 1114 H= 278:30 +CPU= 27.510
  07:31:25 STEP 1115 H= 278:45 +CPU= 28.082
  07:32:00 STEP 1116 H= 279:00 +CPU= 34.849
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001116
  07:32:29 STEP 1117 H= 279:15 +CPU= 28.110
  07:32:56 STEP 1118 H= 279:30 +CPU= 26.856
  07:33:24 STEP 1119 H= 279:45 +CPU= 27.558
  07:33:54 STEP 1120 H= 280:00 +CPU= 29.160
  07:34:21 STEP 1121 H= 280:15 +CPU= 27.397
  07:34:50 STEP 1122 H= 280:30 +CPU= 27.387
  07:35:17 STEP 1123 H= 280:45 +CPU= 27.316
  07:35:46 STEP 1124 H= 281:00 +CPU= 28.634
  07:36:16 STEP 1125 H= 281:15 +CPU= 29.141
  07:36:44 STEP 1126 H= 281:30 +CPU= 28.037
  07:37:12 STEP 1127 H= 281:45 +CPU= 27.233
  07:37:49 STEP 1128 H= 282:00 +CPU= 36.750
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001128
  07:38:17 STEP 1129 H= 282:15 +CPU= 27.840
  07:38:46 STEP 1130 H= 282:30 +CPU= 27.741
  07:39:15 STEP 1131 H= 282:45 +CPU= 28.814
  07:39:44 STEP 1132 H= 283:00 +CPU= 29.182
  07:40:14 STEP 1133 H= 283:15 +CPU= 28.827
  07:40:43 STEP 1134 H= 283:30 +CPU= 28.867
  07:41:12 STEP 1135 H= 283:45 +CPU= 28.284
  07:41:40 STEP 1136 H= 284:00 +CPU= 28.231
  07:42:10 STEP 1137 H= 284:15 +CPU= 29.738
  07:42:39 STEP 1138 H= 284:30 +CPU= 28.115
  07:43:07 STEP 1139 H= 284:45 +CPU= 27.482
  07:43:43 STEP 1140 H= 285:00 +CPU= 35.843
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001140
  07:44:12 STEP 1141 H= 285:15 +CPU= 28.312
  07:44:40 STEP 1142 H= 285:30 +CPU= 27.315
  07:45:07 STEP 1143 H= 285:45 +CPU= 26.926
  07:45:36 STEP 1144 H= 286:00 +CPU= 28.022
  07:46:05 STEP 1145 H= 286:15 +CPU= 28.545
  07:46:33 STEP 1146 H= 286:30 +CPU= 27.316
  07:47:00 STEP 1147 H= 286:45 +CPU= 27.013
  07:47:30 STEP 1148 H= 287:00 +CPU= 28.625
  07:47:58 STEP 1149 H= 287:15 +CPU= 28.273
  07:48:28 STEP 1150 H= 287:30 +CPU= 28.995
  07:48:57 STEP 1151 H= 287:45 +CPU= 28.312
  07:49:39 STEP 1152 H= 288:00 +CPU= 41.514
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_11.zip
Uploading the intermediate file: upload_file_11.zip
  07:50:07 STEP 1153 H= 288:15 +CPU= 27.238
  07:50:37 STEP 1154 H= 288:30 +CPU= 28.971
  07:51:05 STEP 1155 H= 288:45 +CPU= 27.826
  07:51:33 STEP 1156 H= 289:00 +CPU= 27.870
  07:52:02 STEP 1157 H= 289:15 +CPU= 28.107
  07:52:29 STEP 1158 H= 289:30 +CPU= 26.438
  07:52:59 STEP 1159 H= 289:45 +CPU= 29.572
  07:53:29 STEP 1160 H= 290:00 +CPU= 29.408
  07:53:57 STEP 1161 H= 290:15 +CPU= 26.894
  07:54:25 STEP 1162 H= 290:30 +CPU= 27.917
  07:54:53 STEP 1163 H= 290:45 +CPU= 26.934
  07:55:29 STEP 1164 H= 291:00 +CPU= 35.329
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001164
  07:55:57 STEP 1165 H= 291:15 +CPU= 28.046
  07:56:27 STEP 1166 H= 291:30 +CPU= 28.928
  07:56:56 STEP 1167 H= 291:45 +CPU= 29.178
  07:57:25 STEP 1168 H= 292:00 +CPU= 27.809
  07:57:54 STEP 1169 H= 292:15 +CPU= 28.742
  07:58:22 STEP 1170 H= 292:30 +CPU= 27.305
  07:58:51 STEP 1171 H= 292:45 +CPU= 28.552
  07:59:20 STEP 1172 H= 293:00 +CPU= 28.753
  07:59:48 STEP 1173 H= 293:15 +CPU= 27.675
  08:00:17 STEP 1174 H= 293:30 +CPU= 27.705
  08:00:44 STEP 1175 H= 293:45 +CPU= 27.084
  08:01:21 STEP 1176 H= 294:00 +CPU= 36.009
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001176
  08:01:51 STEP 1177 H= 294:15 +CPU= 29.270
  08:02:20 STEP 1178 H= 294:30 +CPU= 28.320
  08:02:48 STEP 1179 H= 294:45 +CPU= 27.793
  08:03:18 STEP 1180 H= 295:00 +CPU= 29.685
  08:03:47 STEP 1181 H= 295:15 +CPU= 27.956
  08:04:15 STEP 1182 H= 295:30 +CPU= 28.297
  08:04:43 STEP 1183 H= 295:45 +CPU= 26.992
  08:05:11 STEP 1184 H= 296:00 +CPU= 28.055
  08:05:41 STEP 1185 H= 296:15 +CPU= 28.393
  08:06:08 STEP 1186 H= 296:30 +CPU= 26.932
  08:06:37 STEP 1187 H= 296:45 +CPU= 27.991
  08:07:14 STEP 1188 H= 297:00 +CPU= 36.786
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001188
  08:07:43 STEP 1189 H= 297:15 +CPU= 28.157
  08:08:12 STEP 1190 H= 297:30 +CPU= 29.447
  08:08:41 STEP 1191 H= 297:45 +CPU= 28.122
  08:09:11 STEP 1192 H= 298:00 +CPU= 29.873
  08:09:41 STEP 1193 H= 298:15 +CPU= 29.028
  08:10:09 STEP 1194 H= 298:30 +CPU= 27.377
  08:10:38 STEP 1195 H= 298:45 +CPU= 28.889
  08:11:07 STEP 1196 H= 299:00 +CPU= 29.165
  08:11:36 STEP 1197 H= 299:15 +CPU= 27.511
  08:12:05 STEP 1198 H= 299:30 +CPU= 28.611
  08:12:33 STEP 1199 H= 299:45 +CPU= 27.881
  08:13:15 STEP 1200 H= 300:00 +CPU= 40.564
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001200
  08:13:43 STEP 1201 H= 300:15 +CPU= 27.807
  08:14:12 STEP 1202 H= 300:30 +CPU= 28.856
  08:14:41 STEP 1203 H= 300:45 +CPU= 28.170
  08:15:12 STEP 1204 H= 301:00 +CPU= 30.212
  08:15:41 STEP 1205 H= 301:15 +CPU= 28.205
  08:16:09 STEP 1206 H= 301:30 +CPU= 27.733
  08:16:37 STEP 1207 H= 301:45 +CPU= 27.778
  08:17:06 STEP 1208 H= 302:00 +CPU= 28.142
  08:17:35 STEP 1209 H= 302:15 +CPU= 28.598
  08:18:03 STEP 1210 H= 302:30 +CPU= 27.342
  08:18:32 STEP 1211 H= 302:45 +CPU= 28.379
  08:19:08 STEP 1212 H= 303:00 +CPU= 35.663
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001212
  08:19:35 STEP 1213 H= 303:15 +CPU= 27.370
  08:20:03 STEP 1214 H= 303:30 +CPU= 27.126
  08:20:30 STEP 1215 H= 303:45 +CPU= 26.630
  08:20:58 STEP 1216 H= 304:00 +CPU= 28.028
  08:21:26 STEP 1217 H= 304:15 +CPU= 27.468
  08:21:54 STEP 1218 H= 304:30 +CPU= 28.163
  08:22:23 STEP 1219 H= 304:45 +CPU= 27.994
  08:22:51 STEP 1220 H= 305:00 +CPU= 28.290
  08:23:20 STEP 1221 H= 305:15 +CPU= 27.855
  08:23:46 STEP 1222 H= 305:30 +CPU= 26.314
  08:24:14 STEP 1223 H= 305:45 +CPU= 26.926
  08:24:50 STEP 1224 H= 306:00 +CPU= 35.834
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001224
  08:25:18 STEP 1225 H= 306:15 +CPU= 27.648
  08:25:46 STEP 1226 H= 306:30 +CPU= 27.528
  08:26:14 STEP 1227 H= 306:45 +CPU= 27.796
  08:26:42 STEP 1228 H= 307:00 +CPU= 27.518
  08:27:10 STEP 1229 H= 307:15 +CPU= 27.564
  08:27:38 STEP 1230 H= 307:30 +CPU= 27.518
  08:28:07 STEP 1231 H= 307:45 +CPU= 27.991
  08:28:35 STEP 1232 H= 308:00 +CPU= 27.667
  08:29:03 STEP 1233 H= 308:15 +CPU= 27.660
  08:29:31 STEP 1234 H= 308:30 +CPU= 27.861
  08:29:58 STEP 1235 H= 308:45 +CPU= 26.580
  08:30:34 STEP 1236 H= 309:00 +CPU= 35.413
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001236
  08:31:02 STEP 1237 H= 309:15 +CPU= 27.774
  08:31:30 STEP 1238 H= 309:30 +CPU= 27.870
  08:31:58 STEP 1239 H= 309:45 +CPU= 27.186
  08:32:26 STEP 1240 H= 310:00 +CPU= 27.803
  08:32:53 STEP 1241 H= 310:15 +CPU= 26.598
  08:33:21 STEP 1242 H= 310:30 +CPU= 27.660
  08:33:48 STEP 1243 H= 310:45 +CPU= 27.321
  08:34:17 STEP 1244 H= 311:00 +CPU= 28.557
  08:34:44 STEP 1245 H= 311:15 +CPU= 26.497
  08:35:11 STEP 1246 H= 311:30 +CPU= 25.594
  08:35:38 STEP 1247 H= 311:45 +CPU= 26.662
  08:36:19 STEP 1248 H= 312:00 +CPU= 40.543
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_12.zip
Uploading the intermediate file: upload_file_12.zip
  08:36:47 STEP 1249 H= 312:15 +CPU= 27.620
  08:37:14 STEP 1250 H= 312:30 +CPU= 27.045
  08:37:42 STEP 1251 H= 312:45 +CPU= 27.571
  08:38:10 STEP 1252 H= 313:00 +CPU= 27.369
  08:38:37 STEP 1253 H= 313:15 +CPU= 26.295
  08:39:05 STEP 1254 H= 313:30 +CPU= 27.648
  08:39:32 STEP 1255 H= 313:45 +CPU= 25.734
  08:40:02 STEP 1256 H= 314:00 +CPU= 29.189
  08:40:29 STEP 1257 H= 314:15 +CPU= 26.830
  08:40:56 STEP 1258 H= 314:30 +CPU= 26.461
  08:41:24 STEP 1259 H= 314:45 +CPU= 27.586
  08:41:59 STEP 1260 H= 315:00 +CPU= 34.595
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001260
  08:42:27 STEP 1261 H= 315:15 +CPU= 27.612
  08:42:54 STEP 1262 H= 315:30 +CPU= 26.830
  08:43:22 STEP 1263 H= 315:45 +CPU= 27.008
  08:43:50 STEP 1264 H= 316:00 +CPU= 28.114
  08:44:17 STEP 1265 H= 316:15 +CPU= 26.734
  08:44:43 STEP 1266 H= 316:30 +CPU= 25.469
  08:45:10 STEP 1267 H= 316:45 +CPU= 25.965
  08:45:37 STEP 1268 H= 317:00 +CPU= 27.194
  08:46:03 STEP 1269 H= 317:15 +CPU= 26.028
  08:46:30 STEP 1270 H= 317:30 +CPU= 26.559
  08:46:56 STEP 1271 H= 317:45 +CPU= 25.690
  08:47:31 STEP 1272 H= 318:00 +CPU= 34.288
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001272
  08:47:59 STEP 1273 H= 318:15 +CPU= 27.497
  08:48:26 STEP 1274 H= 318:30 +CPU= 26.679
  08:48:54 STEP 1275 H= 318:45 +CPU= 27.409
  08:49:21 STEP 1276 H= 319:00 +CPU= 27.289
  08:49:48 STEP 1277 H= 319:15 +CPU= 25.765
  08:50:15 STEP 1278 H= 319:30 +CPU= 27.095
  08:50:42 STEP 1279 H= 319:45 +CPU= 25.958
  08:51:08 STEP 1280 H= 320:00 +CPU= 26.379
  08:51:34 STEP 1281 H= 320:15 +CPU= 25.972
  08:52:01 STEP 1282 H= 320:30 +CPU= 26.316
  08:52:28 STEP 1283 H= 320:45 +CPU= 26.837
  08:53:02 STEP 1284 H= 321:00 +CPU= 33.862
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001284
  08:53:28 STEP 1285 H= 321:15 +CPU= 25.770
  08:53:55 STEP 1286 H= 321:30 +CPU= 26.583
  08:54:21 STEP 1287 H= 321:45 +CPU= 25.837
  08:54:48 STEP 1288 H= 322:00 +CPU= 26.636
  08:55:14 STEP 1289 H= 322:15 +CPU= 25.815
  08:55:40 STEP 1290 H= 322:30 +CPU= 25.592
  08:56:07 STEP 1291 H= 322:45 +CPU= 26.054
  08:56:34 STEP 1292 H= 323:00 +CPU= 27.095
  08:57:00 STEP 1293 H= 323:15 +CPU= 25.862
  08:57:27 STEP 1294 H= 323:30 +CPU= 26.406
  08:57:54 STEP 1295 H= 323:45 +CPU= 26.057
  08:58:33 STEP 1296 H= 324:00 +CPU= 38.944
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001296
  08:58:59 STEP 1297 H= 324:15 +CPU= 25.786
  08:59:26 STEP 1298 H= 324:30 +CPU= 26.024
  08:59:52 STEP 1299 H= 324:45 +CPU= 25.949
  09:00:20 STEP 1300 H= 325:00 +CPU= 27.107
  09:00:46 STEP 1301 H= 325:15 +CPU= 25.783
  09:01:12 STEP 1302 H= 325:30 +CPU= 25.525
  09:01:37 STEP 1303 H= 325:45 +CPU= 25.703
  09:02:04 STEP 1304 H= 326:00 +CPU= 25.899
  09:02:29 STEP 1305 H= 326:15 +CPU= 25.481
  09:02:54 STEP 1306 H= 326:30 +CPU= 24.894
  09:03:20 STEP 1307 H= 326:45 +CPU= 25.507
  09:03:53 STEP 1308 H= 327:00 +CPU= 32.759
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001308
  09:04:19 STEP 1309 H= 327:15 +CPU= 25.483
  09:04:45 STEP 1310 H= 327:30 +CPU= 25.793
  09:05:10 STEP 1311 H= 327:45 +CPU= 25.216
  09:05:37 STEP 1312 H= 328:00 +CPU= 26.378
  09:06:02 STEP 1313 H= 328:15 +CPU= 25.409
  09:06:28 STEP 1314 H= 328:30 +CPU= 25.484
  09:06:53 STEP 1315 H= 328:45 +CPU= 24.493
  09:07:19 STEP 1316 H= 329:00 +CPU= 26.134
  09:07:44 STEP 1317 H= 329:15 +CPU= 24.866
  09:08:09 STEP 1318 H= 329:30 +CPU= 25.039
  09:08:34 STEP 1319 H= 329:45 +CPU= 24.568
  09:09:07 STEP 1320 H= 330:00 +CPU= 32.578
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001320
  09:09:33 STEP 1321 H= 330:15 +CPU= 25.441
  09:09:58 STEP 1322 H= 330:30 +CPU= 25.291
  09:10:24 STEP 1323 H= 330:45 +CPU= 25.538
  09:10:49 STEP 1324 H= 331:00 +CPU= 24.507
  09:11:14 STEP 1325 H= 331:15 +CPU= 25.195
  09:11:40 STEP 1326 H= 331:30 +CPU= 24.979
  09:12:05 STEP 1327 H= 331:45 +CPU= 25.158
  09:12:31 STEP 1328 H= 332:00 +CPU= 25.876
  09:12:56 STEP 1329 H= 332:15 +CPU= 25.142
  09:13:22 STEP 1330 H= 332:30 +CPU= 25.132
  09:13:47 STEP 1331 H= 332:45 +CPU= 24.628
  09:14:20 STEP 1332 H= 333:00 +CPU= 32.931
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001332
  09:14:45 STEP 1333 H= 333:15 +CPU= 24.751
  09:15:10 STEP 1334 H= 333:30 +CPU= 24.776
  09:15:35 STEP 1335 H= 333:45 +CPU= 24.841
  09:16:00 STEP 1336 H= 334:00 +CPU= 24.977
  09:16:25 STEP 1337 H= 334:15 +CPU= 25.246
  09:16:50 STEP 1338 H= 334:30 +CPU= 24.767
  09:17:15 STEP 1339 H= 334:45 +CPU= 24.248
  09:17:40 STEP 1340 H= 335:00 +CPU= 25.737
  09:18:06 STEP 1341 H= 335:15 +CPU= 25.482
  09:18:31 STEP 1342 H= 335:30 +CPU= 25.073
  09:18:57 STEP 1343 H= 335:45 +CPU= 25.421
  09:19:34 STEP 1344 H= 336:00 +CPU= 36.293
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_13.zip
Uploading the intermediate file: upload_file_13.zip
  09:20:00 STEP 1345 H= 336:15 +CPU= 25.889
  09:20:25 STEP 1346 H= 336:30 +CPU= 24.417
  09:20:49 STEP 1347 H= 336:45 +CPU= 23.961
  09:21:15 STEP 1348 H= 337:00 +CPU= 25.726
  09:21:40 STEP 1349 H= 337:15 +CPU= 25.291
  09:22:05 STEP 1350 H= 337:30 +CPU= 24.539
  09:22:29 STEP 1351 H= 337:45 +CPU= 24.118
  09:22:55 STEP 1352 H= 338:00 +CPU= 25.245
  09:23:19 STEP 1353 H= 338:15 +CPU= 24.238
  09:23:43 STEP 1354 H= 338:30 +CPU= 24.107
  09:24:08 STEP 1355 H= 338:45 +CPU= 24.502
  09:24:39 STEP 1356 H= 339:00 +CPU= 31.463
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001356
  09:25:03 STEP 1357 H= 339:15 +CPU= 23.768
  09:25:27 STEP 1358 H= 339:30 +CPU= 23.899
  09:25:51 STEP 1359 H= 339:45 +CPU= 24.251
  09:26:16 STEP 1360 H= 340:00 +CPU= 24.518
  09:26:40 STEP 1361 H= 340:15 +CPU= 23.326
  09:27:04 STEP 1362 H= 340:30 +CPU= 24.501
  09:27:28 STEP 1363 H= 340:45 +CPU= 24.177
  09:27:54 STEP 1364 H= 341:00 +CPU= 25.454
  09:28:19 STEP 1365 H= 341:15 +CPU= 24.860
  09:28:43 STEP 1366 H= 341:30 +CPU= 24.373
  09:29:07 STEP 1367 H= 341:45 +CPU= 23.689
  09:29:39 STEP 1368 H= 342:00 +CPU= 31.324
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001368
  09:30:02 STEP 1369 H= 342:15 +CPU= 23.816
  09:30:27 STEP 1370 H= 342:30 +CPU= 24.056
  09:30:51 STEP 1371 H= 342:45 +CPU= 23.995
  09:31:16 STEP 1372 H= 343:00 +CPU= 25.443
  09:31:40 STEP 1373 H= 343:15 +CPU= 24.132
  09:32:04 STEP 1374 H= 343:30 +CPU= 23.817
  09:32:28 STEP 1375 H= 343:45 +CPU= 23.625
  09:32:53 STEP 1376 H= 344:00 +CPU= 24.457
  09:33:16 STEP 1377 H= 344:15 +CPU= 23.607
  09:33:41 STEP 1378 H= 344:30 +CPU= 24.128
  09:34:05 STEP 1379 H= 344:45 +CPU= 24.617
  09:34:37 STEP 1380 H= 345:00 +CPU= 31.631
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001380
  09:35:01 STEP 1381 H= 345:15 +CPU= 23.716
  09:35:25 STEP 1382 H= 345:30 +CPU= 24.446
  09:35:48 STEP 1383 H= 345:45 +CPU= 23.020
  09:36:13 STEP 1384 H= 346:00 +CPU= 24.436
  09:36:37 STEP 1385 H= 346:15 +CPU= 24.333
  09:37:01 STEP 1386 H= 346:30 +CPU= 23.710
  09:37:25 STEP 1387 H= 346:45 +CPU= 24.233
  09:37:51 STEP 1388 H= 347:00 +CPU= 25.387
  09:38:15 STEP 1389 H= 347:15 +CPU= 23.736
  09:38:38 STEP 1390 H= 347:30 +CPU= 23.582
  09:39:03 STEP 1391 H= 347:45 +CPU= 24.237
  09:39:39 STEP 1392 H= 348:00 +CPU= 36.163
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001392
  09:40:04 STEP 1393 H= 348:15 +CPU= 24.564
  09:40:28 STEP 1394 H= 348:30 +CPU= 23.732
  09:40:52 STEP 1395 H= 348:45 +CPU= 23.998
  09:41:16 STEP 1396 H= 349:00 +CPU= 24.317
  09:41:40 STEP 1397 H= 349:15 +CPU= 23.924
  09:42:03 STEP 1398 H= 349:30 +CPU= 22.780
  09:42:27 STEP 1399 H= 349:45 +CPU= 24.110
  09:42:51 STEP 1400 H= 350:00 +CPU= 23.772
  09:43:14 STEP 1401 H= 350:15 +CPU= 23.341
  09:43:38 STEP 1402 H= 350:30 +CPU= 23.171
  09:44:01 STEP 1403 H= 350:45 +CPU= 22.882
  09:44:30 STEP 1404 H= 351:00 +CPU= 29.323
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001404
  09:44:53 STEP 1405 H= 351:15 +CPU= 22.438
  09:45:16 STEP 1406 H= 351:30 +CPU= 23.424
  09:45:38 STEP 1407 H= 351:45 +CPU= 22.232
  09:46:02 STEP 1408 H= 352:00 +CPU= 23.658
  09:46:25 STEP 1409 H= 352:15 +CPU= 23.089
  09:46:49 STEP 1410 H= 352:30 +CPU= 23.546
  09:47:13 STEP 1411 H= 352:45 +CPU= 24.068
  09:47:37 STEP 1412 H= 353:00 +CPU= 23.520
  09:48:00 STEP 1413 H= 353:15 +CPU= 22.781
  09:48:23 STEP 1414 H= 353:30 +CPU= 23.346
  09:48:46 STEP 1415 H= 353:45 +CPU= 22.822
  09:49:16 STEP 1416 H= 354:00 +CPU= 30.087
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001416
  09:49:40 STEP 1417 H= 354:15 +CPU= 23.350
  09:50:03 STEP 1418 H= 354:30 +CPU= 23.033
  09:50:26 STEP 1419 H= 354:45 +CPU= 23.099
  09:50:50 STEP 1420 H= 355:00 +CPU= 24.428
  09:51:14 STEP 1421 H= 355:15 +CPU= 23.122
  09:51:37 STEP 1422 H= 355:30 +CPU= 23.252
  09:52:00 STEP 1423 H= 355:45 +CPU= 22.784
  09:52:22 STEP 1424 H= 356:00 +CPU= 21.769
  09:52:44 STEP 1425 H= 356:15 +CPU= 22.527
  09:53:08 STEP 1426 H= 356:30 +CPU= 23.398
  09:53:31 STEP 1427 H= 356:45 +CPU= 23.616
  09:54:01 STEP 1428 H= 357:00 +CPU= 29.674
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001428
  09:54:25 STEP 1429 H= 357:15 +CPU= 23.296
  09:54:47 STEP 1430 H= 357:30 +CPU= 21.951
  09:55:09 STEP 1431 H= 357:45 +CPU= 22.700
  09:55:33 STEP 1432 H= 358:00 +CPU= 23.436
  09:55:56 STEP 1433 H= 358:15 +CPU= 22.618
  09:56:18 STEP 1434 H= 358:30 +CPU= 22.867
  09:56:41 STEP 1435 H= 358:45 +CPU= 22.816
  09:57:05 STEP 1436 H= 359:00 +CPU= 23.822
  09:57:28 STEP 1437 H= 359:15 +CPU= 22.853
  09:57:52 STEP 1438 H= 359:30 +CPU= 23.230
  09:58:14 STEP 1439 H= 359:45 +CPU= 22.308
  09:58:45 STEP 1440 H= 360:00 +CPU= 31.309
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1945040832E-20      I       0.1720584488E-07      I
ICloud fractionI      0.0000000000E+00      I       0.9719054250E-02      I
I  Relat. Hum. I      0.4017625955E+00      I       0.4227358768E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3184055181E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    299929569 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS499882.6 Mbytes/s, TOTAL TIME=    0.0109( 5.5%)
 09:58:45 STEP 1440 H= 360:00 +CPU= 31.309
 END CNT3
 NSTEP =  1440 CNT0   000000000  21.979  21.979  22.063   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        17016/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    303    0       34      1044068    17016 ************    40.1     1.9    38.2     3.1    69.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  625    4907.7    4907.7     19.65      0.00
   9 SPCM     - SPECTRAL COMP.                     576     803.1     803.1      2.96      0.00
  10 SCAN2M - PHYSICS                              577   12234.5   12234.5     45.22      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 48    1099.0    1099.0      0.34      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 25      68.3      68.3      0.01      0.00
  17 GRIDFPOS IN CNT4                               48      30.3      30.3      0.01      0.00
  27 RESTART FILES - WRITING                        12    4396.1    4396.1      0.34      0.00
  28 RESTART FILES - READING                         1    4281.9    4281.9      0.03      0.00
  29 SU4FPOS IN CNT4                                48       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                48    6469.4    6469.4      1.99      0.00
  31 POSDDH IN STEPO                                 3       1.1       1.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    577    5378.3    5378.3     19.88      0.00
  39 SU0YOMB                                         1     416.0     416.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    577      25.7      25.7      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              576     234.4     234.4      0.86      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              576      59.3      59.3      0.22      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 25       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1252     438.2     438.2      3.51      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1200     250.9     250.9      1.93      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1200      91.2      91.2      0.70      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1252     135.1     135.1      1.08      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      45.0      45.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1252      58.1      58.1      0.47      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1200      30.4      30.4      0.23      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1252      88.7      88.7      0.71      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1200      40.3      40.3      0.31      0.00
 400 GSTATS                                      67525       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 62773       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    15612.1 CPU TIME   15437.7 VECTOR TIME    15437.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       83.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client50002/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client50002/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12208516/ICMSHh7zg+001368
Zipping up the final file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0_r846150627_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
10:02:17 (1530655): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:37 1536616 22308695 oifs_43r3_bl_a1c1_2016092300_15_991_12208516_0 1,295,100 38,578 0.0298


©2024 cpdn.org