climateprediction.net home page
Task 22436609

Task 22436609

Name oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0
Workunit 12285017
Created 7 Jun 2024, 15:27:31 UTC
Sent 7 Jun 2024, 15:30:55 UTC
Report deadline 6 Aug 2024, 15:30:55 UTC
Received 9 Jun 2024, 16:21:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1523278
Run time 10 hours 54 min 35 sec
CPU time 10 hours 54 min 35 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 8.64 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,018.00 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,807.82 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
5] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Dinger7:1:1:5663:5663] [20240609:081401:1717913641:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:14:19 STEP  864 H= 216:00 +CPU= 14.338
  08:14:33 STEP  865 H= 216:15 +CPU= 13.211
  08:14:46 STEP  866 H= 216:30 +CPU= 13.984
  08:15:01 STEP  867 H= 216:45 +CPU= 14.626
  08:15:16 STEP  868 H= 217:00 +CPU= 15.510
  08:15:31 STEP  869 H= 217:15 +CPU= 15.017
  08:15:49 STEP  870 H= 217:30 +CPU= 16.783
  08:16:05 STEP  871 H= 217:45 +CPU= 15.823
  08:16:22 STEP  872 H= 218:00 +CPU= 17.744
  08:16:39 STEP  873 H= 218:15 +CPU= 17.609
  08:16:58 STEP  874 H= 218:30 +CPU= 18.882
  08:17:17 STEP  875 H= 218:45 +CPU= 19.303
  08:17:43 STEP  876 H= 219:00 +CPU= 24.829
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000876
  08:18:03 STEP  877 H= 219:15 +CPU= 21.193
  08:18:26 STEP  878 H= 219:30 +CPU= 22.766
  08:18:52 STEP  879 H= 219:45 +CPU= 25.493
  08:19:18 STEP  880 H= 220:00 +CPU= 25.956
  08:19:43 STEP  881 H= 220:15 +CPU= 25.316
  08:20:10 STEP  882 H= 220:30 +CPU= 27.029
  08:20:37 STEP  883 H= 220:45 +CPU= 26.522
  08:21:04 STEP  884 H= 221:00 +CPU= 27.126
  08:21:29 STEP  885 H= 221:15 +CPU= 25.433
  08:21:55 STEP  886 H= 221:30 +CPU= 25.557
  08:22:21 STEP  887 H= 221:45 +CPU= 27.071
  08:22:52 STEP  888 H= 222:00 +CPU= 30.856
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000888
  08:23:17 STEP  889 H= 222:15 +CPU= 24.474
  08:23:43 STEP  890 H= 222:30 +CPU= 26.076
  08:24:07 STEP  891 H= 222:45 +CPU= 24.487
  08:24:33 STEP  892 H= 223:00 +CPU= 25.919
  08:25:00 STEP  893 H= 223:15 +CPU= 26.659
  08:25:26 STEP  894 H= 223:30 +CPU= 25.914
  08:25:53 STEP  895 H= 223:45 +CPU= 26.522
  08:26:20 STEP  896 H= 224:00 +CPU= 27.058
  08:26:46 STEP  897 H= 224:15 +CPU= 26.545
  08:27:11 STEP  898 H= 224:30 +CPU= 24.873
  08:27:36 STEP  899 H= 224:45 +CPU= 25.057
  08:28:06 STEP  900 H= 225:00 +CPU= 29.351
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000900
  08:28:30 STEP  901 H= 225:15 +CPU= 24.429
  08:28:55 STEP  902 H= 225:30 +CPU= 24.818
  08:29:20 STEP  903 H= 225:45 +CPU= 24.821
  08:29:45 STEP  904 H= 226:00 +CPU= 25.546
  08:30:10 STEP  905 H= 226:15 +CPU= 25.062
  08:30:35 STEP  906 H= 226:30 +CPU= 24.836
  08:31:00 STEP  907 H= 226:45 +CPU= 24.663
  08:31:24 STEP  908 H= 227:00 +CPU= 24.439
  08:31:49 STEP  909 H= 227:15 +CPU= 24.514
  08:32:13 STEP  910 H= 227:30 +CPU= 24.609
  08:32:38 STEP  911 H= 227:45 +CPU= 24.419
  08:33:13 STEP  912 H= 228:00 +CPU= 35.134
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000912
  08:33:37 STEP  913 H= 228:15 +CPU= 24.424
  08:34:02 STEP  914 H= 228:30 +CPU= 24.660
  08:34:27 STEP  915 H= 228:45 +CPU= 25.090
  08:34:53 STEP  916 H= 229:00 +CPU= 25.598
  08:35:17 STEP  917 H= 229:15 +CPU= 24.617
  08:35:42 STEP  918 H= 229:30 +CPU= 25.153
  08:36:08 STEP  919 H= 229:45 +CPU= 25.255
  08:36:33 STEP  920 H= 230:00 +CPU= 24.820
  08:36:58 STEP  921 H= 230:15 +CPU= 24.929
  08:37:22 STEP  922 H= 230:30 +CPU= 24.574
  08:37:47 STEP  923 H= 230:45 +CPU= 25.247
  08:38:19 STEP  924 H= 231:00 +CPU= 31.361
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000924
  08:38:44 STEP  925 H= 231:15 +CPU= 25.199
  08:39:10 STEP  926 H= 231:30 +CPU= 26.033
  08:39:35 STEP  927 H= 231:45 +CPU= 25.227
  08:40:02 STEP  928 H= 232:00 +CPU= 26.315
  08:40:27 STEP  929 H= 232:15 +CPU= 25.137
  08:40:51 STEP  930 H= 232:30 +CPU= 24.491
  08:41:16 STEP  931 H= 232:45 +CPU= 24.973
  08:41:41 STEP  932 H= 233:00 +CPU= 25.081
  08:42:06 STEP  933 H= 233:15 +CPU= 24.476
  08:42:31 STEP  934 H= 233:30 +CPU= 25.411
  08:42:56 STEP  935 H= 233:45 +CPU= 24.853
  08:43:26 STEP  936 H= 234:00 +CPU= 30.295
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000936
  08:43:51 STEP  937 H= 234:15 +CPU= 24.444
  08:44:16 STEP  938 H= 234:30 +CPU= 25.418
  08:44:41 STEP  939 H= 234:45 +CPU= 24.550
  08:45:05 STEP  940 H= 235:00 +CPU= 24.658
  08:45:30 STEP  941 H= 235:15 +CPU= 24.990
  08:45:56 STEP  942 H= 235:30 +CPU= 25.320
  08:46:20 STEP  943 H= 235:45 +CPU= 24.316
  08:46:45 STEP  944 H= 236:00 +CPU= 24.976
  08:47:10 STEP  945 H= 236:15 +CPU= 24.739
  08:47:34 STEP  946 H= 236:30 +CPU= 24.390
  08:47:59 STEP  947 H= 236:45 +CPU= 24.706
  08:48:28 STEP  948 H= 237:00 +CPU= 29.420
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000948
  08:48:53 STEP  949 H= 237:15 +CPU= 24.706
  08:49:18 STEP  950 H= 237:30 +CPU= 24.858
  08:49:43 STEP  951 H= 237:45 +CPU= 24.748
  08:50:07 STEP  952 H= 238:00 +CPU= 24.581
  08:50:32 STEP  953 H= 238:15 +CPU= 25.132
  08:50:58 STEP  954 H= 238:30 +CPU= 25.120
  08:51:23 STEP  955 H= 238:45 +CPU= 25.174
  08:51:48 STEP  956 H= 239:00 +CPU= 25.450
  08:52:13 STEP  957 H= 239:15 +CPU= 25.237
  08:52:39 STEP  958 H= 239:30 +CPU= 25.331
  08:53:04 STEP  959 H= 239:45 +CPU= 25.346
  08:53:40 STEP  960 H= 240:00 +CPU= 35.436
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_9.zip
Uploading the intermediate file: upload_file_9.zip
  08:54:04 STEP  961 H= 240:15 +CPU= 24.725
  08:54:29 STEP  962 H= 240:30 +CPU= 24.502
  08:54:54 STEP  963 H= 240:45 +CPU= 24.941
  08:55:18 STEP  964 H= 241:00 +CPU= 24.568
  08:55:43 STEP  965 H= 241:15 +CPU= 24.157
  08:56:07 STEP  966 H= 241:30 +CPU= 24.663
  08:56:32 STEP  967 H= 241:45 +CPU= 24.525
  08:56:56 STEP  968 H= 242:00 +CPU= 24.419
  08:57:21 STEP  969 H= 242:15 +CPU= 24.567
  08:57:46 STEP  970 H= 242:30 +CPU= 25.184
  08:58:11 STEP  971 H= 242:45 +CPU= 24.637
  08:58:40 STEP  972 H= 243:00 +CPU= 29.596
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000972
  08:59:05 STEP  973 H= 243:15 +CPU= 24.658
  08:59:30 STEP  974 H= 243:30 +CPU= 25.036
  08:59:55 STEP  975 H= 243:45 +CPU= 25.058
  09:00:20 STEP  976 H= 244:00 +CPU= 24.854
  09:00:44 STEP  977 H= 244:15 +CPU= 24.257
  09:01:10 STEP  978 H= 244:30 +CPU= 25.670
  09:01:35 STEP  979 H= 244:45 +CPU= 25.179
  09:02:00 STEP  980 H= 245:00 +CPU= 25.494
  09:02:26 STEP  981 H= 245:15 +CPU= 25.212
  09:02:51 STEP  982 H= 245:30 +CPU= 25.111
  09:03:16 STEP  983 H= 245:45 +CPU= 25.021
  09:03:46 STEP  984 H= 246:00 +CPU= 30.023
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000984
  09:04:11 STEP  985 H= 246:15 +CPU= 24.814
  09:04:36 STEP  986 H= 246:30 +CPU= 25.260
  09:05:01 STEP  987 H= 246:45 +CPU= 24.805
  09:05:25 STEP  988 H= 247:00 +CPU= 24.168
  09:05:50 STEP  989 H= 247:15 +CPU= 24.767
  09:06:14 STEP  990 H= 247:30 +CPU= 24.797
  09:06:39 STEP  991 H= 247:45 +CPU= 24.660
  09:07:04 STEP  992 H= 248:00 +CPU= 24.977
  09:07:29 STEP  993 H= 248:15 +CPU= 24.476
  09:07:53 STEP  994 H= 248:30 +CPU= 24.759
  09:08:18 STEP  995 H= 248:45 +CPU= 25.024
  09:08:49 STEP  996 H= 249:00 +CPU= 30.451
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+000996
  09:09:14 STEP  997 H= 249:15 +CPU= 24.917
  09:09:39 STEP  998 H= 249:30 +CPU= 24.799
  09:10:04 STEP  999 H= 249:45 +CPU= 25.424
  09:10:29 STEP 1000 H= 250:00 +CPU= 25.523
  09:10:55 STEP 1001 H= 250:15 +CPU= 25.521
  09:11:20 STEP 1002 H= 250:30 +CPU= 24.643
  09:11:45 STEP 1003 H= 250:45 +CPU= 24.911
  09:12:10 STEP 1004 H= 251:00 +CPU= 25.375
  09:12:35 STEP 1005 H= 251:15 +CPU= 25.026
  09:13:00 STEP 1006 H= 251:30 +CPU= 24.571
  09:13:23 STEP 1007 H= 251:45 +CPU= 23.868
  09:13:59 STEP 1008 H= 252:00 +CPU= 35.411
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001008
  09:14:24 STEP 1009 H= 252:15 +CPU= 25.418
  09:14:49 STEP 1010 H= 252:30 +CPU= 24.919
  09:15:14 STEP 1011 H= 252:45 +CPU= 24.665
  09:15:39 STEP 1012 H= 253:00 +CPU= 25.435
  09:16:04 STEP 1013 H= 253:15 +CPU= 24.772
  09:16:29 STEP 1014 H= 253:30 +CPU= 24.758
  09:16:53 STEP 1015 H= 253:45 +CPU= 24.543
  09:17:19 STEP 1016 H= 254:00 +CPU= 25.116
  09:17:43 STEP 1017 H= 254:15 +CPU= 24.859
  09:18:09 STEP 1018 H= 254:30 +CPU= 25.124
  09:18:33 STEP 1019 H= 254:45 +CPU= 24.793
  09:19:03 STEP 1020 H= 255:00 +CPU= 29.602
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001020
  09:19:27 STEP 1021 H= 255:15 +CPU= 24.512
  09:19:52 STEP 1022 H= 255:30 +CPU= 24.570
  09:20:16 STEP 1023 H= 255:45 +CPU= 24.308
  09:20:41 STEP 1024 H= 256:00 +CPU= 24.896
  09:21:06 STEP 1025 H= 256:15 +CPU= 24.782
  09:21:30 STEP 1026 H= 256:30 +CPU= 24.165
  09:21:54 STEP 1027 H= 256:45 +CPU= 24.227
  09:22:20 STEP 1028 H= 257:00 +CPU= 25.213
  09:22:44 STEP 1029 H= 257:15 +CPU= 24.819
  09:23:10 STEP 1030 H= 257:30 +CPU= 25.365
  09:23:35 STEP 1031 H= 257:45 +CPU= 24.689
  09:24:04 STEP 1032 H= 258:00 +CPU= 29.937
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001032
  09:24:29 STEP 1033 H= 258:15 +CPU= 24.376
  09:24:54 STEP 1034 H= 258:30 +CPU= 24.631
  09:25:17 STEP 1035 H= 258:45 +CPU= 23.685
  09:25:42 STEP 1036 H= 259:00 +CPU= 25.158
  09:26:07 STEP 1037 H= 259:15 +CPU= 24.948
  09:26:32 STEP 1038 H= 259:30 +CPU= 24.463
  09:26:56 STEP 1039 H= 259:45 +CPU= 24.247
  09:27:21 STEP 1040 H= 260:00 +CPU= 24.700
  09:27:46 STEP 1041 H= 260:15 +CPU= 24.870
  09:28:11 STEP 1042 H= 260:30 +CPU= 24.847
  09:28:35 STEP 1043 H= 260:45 +CPU= 24.848
  09:29:04 STEP 1044 H= 261:00 +CPU= 28.826
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001044
  09:29:29 STEP 1045 H= 261:15 +CPU= 24.631
  09:29:53 STEP 1046 H= 261:30 +CPU= 23.981
  09:30:16 STEP 1047 H= 261:45 +CPU= 23.554
  09:30:41 STEP 1048 H= 262:00 +CPU= 24.754
  09:31:05 STEP 1049 H= 262:15 +CPU= 24.008
  09:31:30 STEP 1050 H= 262:30 +CPU= 24.511
  09:31:55 STEP 1051 H= 262:45 +CPU= 24.969
  09:32:20 STEP 1052 H= 263:00 +CPU= 25.135
  09:32:44 STEP 1053 H= 263:15 +CPU= 24.278
  09:33:09 STEP 1054 H= 263:30 +CPU= 25.146
  09:33:34 STEP 1055 H= 263:45 +CPU= 24.574
  09:34:08 STEP 1056 H= 264:00 +CPU= 34.216
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_10.zip
Uploading the intermediate file: upload_file_10.zip
  09:34:33 STEP 1057 H= 264:15 +CPU= 25.042
  09:34:58 STEP 1058 H= 264:30 +CPU= 24.982
  09:35:23 STEP 1059 H= 264:45 +CPU= 25.038
  09:35:48 STEP 1060 H= 265:00 +CPU= 25.286
  09:36:13 STEP 1061 H= 265:15 +CPU= 24.526
  09:36:38 STEP 1062 H= 265:30 +CPU= 24.548
  09:37:03 STEP 1063 H= 265:45 +CPU= 25.161
  09:37:28 STEP 1064 H= 266:00 +CPU= 25.419
  09:37:53 STEP 1065 H= 266:15 +CPU= 24.772
  09:38:18 STEP 1066 H= 266:30 +CPU= 24.945
  09:38:43 STEP 1067 H= 266:45 +CPU= 24.670
  09:39:13 STEP 1068 H= 267:00 +CPU= 30.253
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001068
  09:39:38 STEP 1069 H= 267:15 +CPU= 24.727
  09:40:03 STEP 1070 H= 267:30 +CPU= 25.400
  09:40:29 STEP 1071 H= 267:45 +CPU= 25.632
  09:40:54 STEP 1072 H= 268:00 +CPU= 25.636
  09:41:19 STEP 1073 H= 268:15 +CPU= 25.184
  09:41:45 STEP 1074 H= 268:30 +CPU= 25.146
  09:42:10 STEP 1075 H= 268:45 +CPU= 25.392
  09:42:35 STEP 1076 H= 269:00 +CPU= 25.332
  09:43:00 STEP 1077 H= 269:15 +CPU= 24.750
  09:43:24 STEP 1078 H= 269:30 +CPU= 23.994
  09:43:49 STEP 1079 H= 269:45 +CPU= 25.275
  09:44:19 STEP 1080 H= 270:00 +CPU= 30.033
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001080
  09:44:44 STEP 1081 H= 270:15 +CPU= 24.704
  09:45:09 STEP 1082 H= 270:30 +CPU= 24.470
  09:45:33 STEP 1083 H= 270:45 +CPU= 24.748
  09:45:58 STEP 1084 H= 271:00 +CPU= 24.636
  09:46:23 STEP 1085 H= 271:15 +CPU= 24.928
  09:46:48 STEP 1086 H= 271:30 +CPU= 24.757
  09:47:13 STEP 1087 H= 271:45 +CPU= 24.856
  09:47:37 STEP 1088 H= 272:00 +CPU= 24.754
  09:48:01 STEP 1089 H= 272:15 +CPU= 23.840
  09:48:26 STEP 1090 H= 272:30 +CPU= 25.100
  09:48:51 STEP 1091 H= 272:45 +CPU= 25.223
  09:49:21 STEP 1092 H= 273:00 +CPU= 29.760
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001092
  09:49:46 STEP 1093 H= 273:15 +CPU= 24.800
  09:50:11 STEP 1094 H= 273:30 +CPU= 25.148
  09:50:36 STEP 1095 H= 273:45 +CPU= 25.246
  09:51:02 STEP 1096 H= 274:00 +CPU= 25.672
  09:51:27 STEP 1097 H= 274:15 +CPU= 24.598
  09:51:51 STEP 1098 H= 274:30 +CPU= 24.612
  09:52:17 STEP 1099 H= 274:45 +CPU= 25.370
  09:52:41 STEP 1100 H= 275:00 +CPU= 24.647
  09:53:06 STEP 1101 H= 275:15 +CPU= 24.439
  09:53:31 STEP 1102 H= 275:30 +CPU= 25.086
  09:53:56 STEP 1103 H= 275:45 +CPU= 24.782
  09:54:31 STEP 1104 H= 276:00 +CPU= 35.501
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001104
  09:54:57 STEP 1105 H= 276:15 +CPU= 25.660
  09:55:22 STEP 1106 H= 276:30 +CPU= 25.478
  09:55:48 STEP 1107 H= 276:45 +CPU= 25.409
  09:56:13 STEP 1108 H= 277:00 +CPU= 25.505
  09:56:39 STEP 1109 H= 277:15 +CPU= 25.827
  09:57:04 STEP 1110 H= 277:30 +CPU= 25.227
  09:57:30 STEP 1111 H= 277:45 +CPU= 25.489
  09:57:55 STEP 1112 H= 278:00 +CPU= 25.576
  09:58:20 STEP 1113 H= 278:15 +CPU= 24.811
  09:58:45 STEP 1114 H= 278:30 +CPU= 24.569
  09:59:10 STEP 1115 H= 278:45 +CPU= 24.727
  09:59:39 STEP 1116 H= 279:00 +CPU= 29.775
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001116
  10:00:04 STEP 1117 H= 279:15 +CPU= 24.186
  10:00:28 STEP 1118 H= 279:30 +CPU= 24.467
  10:00:53 STEP 1119 H= 279:45 +CPU= 25.267
  10:01:19 STEP 1120 H= 280:00 +CPU= 25.424
  10:01:45 STEP 1121 H= 280:15 +CPU= 25.912
  10:02:09 STEP 1122 H= 280:30 +CPU= 24.520
  10:02:34 STEP 1123 H= 280:45 +CPU= 24.719
  10:02:59 STEP 1124 H= 281:00 +CPU= 24.903
  10:03:23 STEP 1125 H= 281:15 +CPU= 24.608
  10:03:48 STEP 1126 H= 281:30 +CPU= 24.716
  10:04:12 STEP 1127 H= 281:45 +CPU= 24.351
  10:04:44 STEP 1128 H= 282:00 +CPU= 31.250
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001128
  10:05:09 STEP 1129 H= 282:15 +CPU= 25.160
  10:05:33 STEP 1130 H= 282:30 +CPU= 24.592
  10:05:59 STEP 1131 H= 282:45 +CPU= 25.222
  10:06:24 STEP 1132 H= 283:00 +CPU= 24.826
  10:06:49 STEP 1133 H= 283:15 +CPU= 25.674
  10:07:14 STEP 1134 H= 283:30 +CPU= 25.125
  10:07:38 STEP 1135 H= 283:45 +CPU= 23.973
  10:08:03 STEP 1136 H= 284:00 +CPU= 24.721
  10:08:28 STEP 1137 H= 284:15 +CPU= 24.898
  10:08:53 STEP 1138 H= 284:30 +CPU= 24.949
  10:09:18 STEP 1139 H= 284:45 +CPU= 25.026
  10:09:48 STEP 1140 H= 285:00 +CPU= 30.007
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001140
  10:10:12 STEP 1141 H= 285:15 +CPU= 24.207
  10:10:36 STEP 1142 H= 285:30 +CPU= 23.979
  10:11:01 STEP 1143 H= 285:45 +CPU= 24.473
  10:11:26 STEP 1144 H= 286:00 +CPU= 25.367
  10:11:51 STEP 1145 H= 286:15 +CPU= 24.932
  10:12:16 STEP 1146 H= 286:30 +CPU= 25.343
  10:12:40 STEP 1147 H= 286:45 +CPU= 24.106
  10:13:06 STEP 1148 H= 287:00 +CPU= 25.291
  10:13:31 STEP 1149 H= 287:15 +CPU= 25.408
  10:13:56 STEP 1150 H= 287:30 +CPU= 25.139
  10:14:21 STEP 1151 H= 287:45 +CPU= 25.220
  10:14:56 STEP 1152 H= 288:00 +CPU= 34.313
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_11.zip
Uploading the intermediate file: upload_file_11.zip
  10:15:21 STEP 1153 H= 288:15 +CPU= 24.748
  10:15:46 STEP 1154 H= 288:30 +CPU= 25.162
  10:16:11 STEP 1155 H= 288:45 +CPU= 24.958
  10:16:36 STEP 1156 H= 289:00 +CPU= 25.555
  10:17:01 STEP 1157 H= 289:15 +CPU= 24.650
  10:17:26 STEP 1158 H= 289:30 +CPU= 24.674
  10:17:51 STEP 1159 H= 289:45 +CPU= 25.063
  10:18:16 STEP 1160 H= 290:00 +CPU= 25.564
  10:18:41 STEP 1161 H= 290:15 +CPU= 25.050
  10:19:06 STEP 1162 H= 290:30 +CPU= 24.990
  10:19:31 STEP 1163 H= 290:45 +CPU= 24.622
  10:20:01 STEP 1164 H= 291:00 +CPU= 29.945
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001164
  10:20:26 STEP 1165 H= 291:15 +CPU= 24.941
  10:20:51 STEP 1166 H= 291:30 +CPU= 25.494
  10:21:16 STEP 1167 H= 291:45 +CPU= 25.049
  10:21:41 STEP 1168 H= 292:00 +CPU= 24.886
  10:22:06 STEP 1169 H= 292:15 +CPU= 24.704
  10:22:31 STEP 1170 H= 292:30 +CPU= 25.314
  10:22:55 STEP 1171 H= 292:45 +CPU= 23.845
  10:23:19 STEP 1172 H= 293:00 +CPU= 23.596
  10:23:41 STEP 1173 H= 293:15 +CPU= 22.242
  10:24:03 STEP 1174 H= 293:30 +CPU= 21.969
  10:24:26 STEP 1175 H= 293:45 +CPU= 22.504
  10:24:53 STEP 1176 H= 294:00 +CPU= 26.998
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001176
  10:25:14 STEP 1177 H= 294:15 +CPU= 20.988
  10:25:33 STEP 1178 H= 294:30 +CPU= 19.925
  10:25:53 STEP 1179 H= 294:45 +CPU= 19.750
  10:26:13 STEP 1180 H= 295:00 +CPU= 20.086
  10:26:33 STEP 1181 H= 295:15 +CPU= 19.455
  10:26:54 STEP 1182 H= 295:30 +CPU= 21.280
  10:27:17 STEP 1183 H= 295:45 +CPU= 22.677
  10:27:39 STEP 1184 H= 296:00 +CPU= 21.856
  10:28:01 STEP 1185 H= 296:15 +CPU= 22.009
  10:28:23 STEP 1186 H= 296:30 +CPU= 22.051
  10:28:46 STEP 1187 H= 296:45 +CPU= 23.522
  10:29:18 STEP 1188 H= 297:00 +CPU= 31.551
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001188
  10:29:43 STEP 1189 H= 297:15 +CPU= 24.837
  10:30:08 STEP 1190 H= 297:30 +CPU= 25.209
  10:30:31 STEP 1191 H= 297:45 +CPU= 22.822
  10:30:54 STEP 1192 H= 298:00 +CPU= 23.047
  10:31:16 STEP 1193 H= 298:15 +CPU= 22.010
  10:31:38 STEP 1194 H= 298:30 +CPU= 21.828
  10:31:59 STEP 1195 H= 298:45 +CPU= 21.610
  10:32:22 STEP 1196 H= 299:00 +CPU= 22.558
  10:32:44 STEP 1197 H= 299:15 +CPU= 22.485
  10:33:07 STEP 1198 H= 299:30 +CPU= 22.545
  10:33:28 STEP 1199 H= 299:45 +CPU= 21.498
  10:34:01 STEP 1200 H= 300:00 +CPU= 32.268
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001200
  10:34:26 STEP 1201 H= 300:15 +CPU= 25.341
  10:34:51 STEP 1202 H= 300:30 +CPU= 24.767
  10:35:15 STEP 1203 H= 300:45 +CPU= 24.844
  10:35:41 STEP 1204 H= 301:00 +CPU= 25.869
  10:36:07 STEP 1205 H= 301:15 +CPU= 25.637
  10:36:32 STEP 1206 H= 301:30 +CPU= 25.393
  10:36:57 STEP 1207 H= 301:45 +CPU= 24.819
  10:37:23 STEP 1208 H= 302:00 +CPU= 25.666
  10:37:47 STEP 1209 H= 302:15 +CPU= 24.164
  10:38:09 STEP 1210 H= 302:30 +CPU= 21.921
  10:38:31 STEP 1211 H= 302:45 +CPU= 21.840
  10:38:59 STEP 1212 H= 303:00 +CPU= 28.206
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001212
  10:39:21 STEP 1213 H= 303:15 +CPU= 21.676
  10:39:43 STEP 1214 H= 303:30 +CPU= 21.777
  10:40:06 STEP 1215 H= 303:45 +CPU= 23.016
  10:40:29 STEP 1216 H= 304:00 +CPU= 23.118
  10:40:51 STEP 1217 H= 304:15 +CPU= 22.404
  10:41:14 STEP 1218 H= 304:30 +CPU= 23.033
  10:41:39 STEP 1219 H= 304:45 +CPU= 24.646
  10:42:05 STEP 1220 H= 305:00 +CPU= 25.740
  10:42:30 STEP 1221 H= 305:15 +CPU= 25.519
  10:42:54 STEP 1222 H= 305:30 +CPU= 24.351
  10:43:19 STEP 1223 H= 305:45 +CPU= 25.053
  10:43:50 STEP 1224 H= 306:00 +CPU= 30.850
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001224
  10:44:16 STEP 1225 H= 306:15 +CPU= 25.802
  10:44:41 STEP 1226 H= 306:30 +CPU= 24.871
  10:45:07 STEP 1227 H= 306:45 +CPU= 25.938
  10:45:32 STEP 1228 H= 307:00 +CPU= 25.155
  10:45:57 STEP 1229 H= 307:15 +CPU= 24.732
  10:46:21 STEP 1230 H= 307:30 +CPU= 24.233
  10:46:46 STEP 1231 H= 307:45 +CPU= 25.121
  10:47:13 STEP 1232 H= 308:00 +CPU= 26.277
  10:47:38 STEP 1233 H= 308:15 +CPU= 25.449
  10:48:03 STEP 1234 H= 308:30 +CPU= 25.143
  10:48:28 STEP 1235 H= 308:45 +CPU= 24.997
  10:48:59 STEP 1236 H= 309:00 +CPU= 30.822
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001236
  10:49:23 STEP 1237 H= 309:15 +CPU= 24.404
  10:49:48 STEP 1238 H= 309:30 +CPU= 24.555
  10:50:13 STEP 1239 H= 309:45 +CPU= 25.040
  10:50:38 STEP 1240 H= 310:00 +CPU= 24.907
  10:51:03 STEP 1241 H= 310:15 +CPU= 25.022
  10:51:28 STEP 1242 H= 310:30 +CPU= 24.703
  10:51:53 STEP 1243 H= 310:45 +CPU= 25.181
  10:52:18 STEP 1244 H= 311:00 +CPU= 25.538
  10:52:43 STEP 1245 H= 311:15 +CPU= 24.792
  10:53:08 STEP 1246 H= 311:30 +CPU= 25.092
  10:53:33 STEP 1247 H= 311:45 +CPU= 24.556
  10:54:07 STEP 1248 H= 312:00 +CPU= 34.618
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_12.zip
Uploading the intermediate file: upload_file_12.zip
  10:54:34 STEP 1249 H= 312:15 +CPU= 26.091
  10:54:58 STEP 1250 H= 312:30 +CPU= 24.601
  10:55:24 STEP 1251 H= 312:45 +CPU= 25.782
  10:55:49 STEP 1252 H= 313:00 +CPU= 25.510
  10:56:14 STEP 1253 H= 313:15 +CPU= 24.921
  10:56:39 STEP 1254 H= 313:30 +CPU= 24.167
  10:57:03 STEP 1255 H= 313:45 +CPU= 24.508
  10:57:29 STEP 1256 H= 314:00 +CPU= 25.527
  10:57:54 STEP 1257 H= 314:15 +CPU= 25.138
  10:58:19 STEP 1258 H= 314:30 +CPU= 24.977
  10:58:44 STEP 1259 H= 314:45 +CPU= 25.450
  10:59:15 STEP 1260 H= 315:00 +CPU= 30.768
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001260
  10:59:40 STEP 1261 H= 315:15 +CPU= 24.797
  11:00:05 STEP 1262 H= 315:30 +CPU= 25.137
  11:00:30 STEP 1263 H= 315:45 +CPU= 25.058
  11:00:56 STEP 1264 H= 316:00 +CPU= 26.066
  11:01:21 STEP 1265 H= 316:15 +CPU= 24.594
  11:01:45 STEP 1266 H= 316:30 +CPU= 24.357
  11:02:10 STEP 1267 H= 316:45 +CPU= 25.003
  11:02:36 STEP 1268 H= 317:00 +CPU= 25.876
  11:03:02 STEP 1269 H= 317:15 +CPU= 26.117
  11:03:27 STEP 1270 H= 317:30 +CPU= 25.287
  11:03:52 STEP 1271 H= 317:45 +CPU= 25.005
  11:04:23 STEP 1272 H= 318:00 +CPU= 30.244
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001272
  11:04:45 STEP 1273 H= 318:15 +CPU= 22.830
  11:05:08 STEP 1274 H= 318:30 +CPU= 22.716
  11:05:31 STEP 1275 H= 318:45 +CPU= 22.365
  11:05:53 STEP 1276 H= 319:00 +CPU= 22.594
  11:06:16 STEP 1277 H= 319:15 +CPU= 22.670
  11:06:38 STEP 1278 H= 319:30 +CPU= 21.962
  11:07:00 STEP 1279 H= 319:45 +CPU= 22.350
  11:07:24 STEP 1280 H= 320:00 +CPU= 23.357
  11:07:46 STEP 1281 H= 320:15 +CPU= 22.759
  11:08:11 STEP 1282 H= 320:30 +CPU= 24.614
  11:08:36 STEP 1283 H= 320:45 +CPU= 25.412
  11:09:07 STEP 1284 H= 321:00 +CPU= 30.533
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001284
  11:09:31 STEP 1285 H= 321:15 +CPU= 24.460
  11:09:56 STEP 1286 H= 321:30 +CPU= 24.964
  11:10:21 STEP 1287 H= 321:45 +CPU= 24.885
  11:10:46 STEP 1288 H= 322:00 +CPU= 24.839
  11:11:11 STEP 1289 H= 322:15 +CPU= 24.894
  11:11:36 STEP 1290 H= 322:30 +CPU= 25.006
  11:12:01 STEP 1291 H= 322:45 +CPU= 25.306
  11:12:27 STEP 1292 H= 323:00 +CPU= 25.741
  11:12:52 STEP 1293 H= 323:15 +CPU= 25.309
  11:13:17 STEP 1294 H= 323:30 +CPU= 25.027
  11:13:42 STEP 1295 H= 323:45 +CPU= 24.947
  11:14:19 STEP 1296 H= 324:00 +CPU= 36.439
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001296
  11:14:44 STEP 1297 H= 324:15 +CPU= 25.542
  11:15:11 STEP 1298 H= 324:30 +CPU= 26.576
  11:15:36 STEP 1299 H= 324:45 +CPU= 25.319
  11:16:02 STEP 1300 H= 325:00 +CPU= 25.497
  11:16:27 STEP 1301 H= 325:15 +CPU= 24.938
  11:16:53 STEP 1302 H= 325:30 +CPU= 25.929
  11:17:18 STEP 1303 H= 325:45 +CPU= 25.214
  11:17:43 STEP 1304 H= 326:00 +CPU= 25.259
  11:18:08 STEP 1305 H= 326:15 +CPU= 24.599
  11:18:33 STEP 1306 H= 326:30 +CPU= 24.852
  11:18:59 STEP 1307 H= 326:45 +CPU= 26.687
  11:19:30 STEP 1308 H= 327:00 +CPU= 30.675
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001308
  11:19:55 STEP 1309 H= 327:15 +CPU= 24.749
  11:20:19 STEP 1310 H= 327:30 +CPU= 24.819
  11:20:44 STEP 1311 H= 327:45 +CPU= 24.786
  11:21:11 STEP 1312 H= 328:00 +CPU= 26.505
  11:21:35 STEP 1313 H= 328:15 +CPU= 24.134
  11:22:01 STEP 1314 H= 328:30 +CPU= 25.944
  11:22:26 STEP 1315 H= 328:45 +CPU= 25.348
  11:22:52 STEP 1316 H= 329:00 +CPU= 25.769
  11:23:17 STEP 1317 H= 329:15 +CPU= 25.148
  11:23:43 STEP 1318 H= 329:30 +CPU= 25.327
  11:24:09 STEP 1319 H= 329:45 +CPU= 26.668
  11:24:40 STEP 1320 H= 330:00 +CPU= 31.077
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001320
  11:25:06 STEP 1321 H= 330:15 +CPU= 25.241
  11:25:30 STEP 1322 H= 330:30 +CPU= 24.946
  11:25:55 STEP 1323 H= 330:45 +CPU= 24.714
  11:26:21 STEP 1324 H= 331:00 +CPU= 25.414
  11:26:46 STEP 1325 H= 331:15 +CPU= 25.106
  11:27:11 STEP 1326 H= 331:30 +CPU= 25.639
  11:27:37 STEP 1327 H= 331:45 +CPU= 25.633
  11:28:02 STEP 1328 H= 332:00 +CPU= 25.417
  11:28:27 STEP 1329 H= 332:15 +CPU= 25.050
  11:28:52 STEP 1330 H= 332:30 +CPU= 24.403
  11:29:18 STEP 1331 H= 332:45 +CPU= 25.810
  11:29:48 STEP 1332 H= 333:00 +CPU= 30.323
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001332
  11:30:13 STEP 1333 H= 333:15 +CPU= 24.723
  11:30:38 STEP 1334 H= 333:30 +CPU= 25.023
  11:31:03 STEP 1335 H= 333:45 +CPU= 25.233
  11:31:29 STEP 1336 H= 334:00 +CPU= 25.936
  11:31:53 STEP 1337 H= 334:15 +CPU= 24.308
  11:32:18 STEP 1338 H= 334:30 +CPU= 24.825
  11:32:43 STEP 1339 H= 334:45 +CPU= 25.122
  11:33:09 STEP 1340 H= 335:00 +CPU= 25.800
  11:33:34 STEP 1341 H= 335:15 +CPU= 24.994
  11:33:58 STEP 1342 H= 335:30 +CPU= 24.265
  11:34:23 STEP 1343 H= 335:45 +CPU= 24.581
  11:34:58 STEP 1344 H= 336:00 +CPU= 35.208
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_13.zip
Uploading the intermediate file: upload_file_13.zip
  11:35:23 STEP 1345 H= 336:15 +CPU= 25.275
  11:35:49 STEP 1346 H= 336:30 +CPU= 25.370
  11:36:14 STEP 1347 H= 336:45 +CPU= 24.912
  11:36:39 STEP 1348 H= 337:00 +CPU= 25.544
  11:37:04 STEP 1349 H= 337:15 +CPU= 24.975
  11:37:30 STEP 1350 H= 337:30 +CPU= 25.416
  11:37:55 STEP 1351 H= 337:45 +CPU= 25.072
  11:38:21 STEP 1352 H= 338:00 +CPU= 26.058
  11:38:45 STEP 1353 H= 338:15 +CPU= 24.192
  11:39:10 STEP 1354 H= 338:30 +CPU= 24.536
  11:39:34 STEP 1355 H= 338:45 +CPU= 24.645
  11:40:05 STEP 1356 H= 339:00 +CPU= 30.513
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001356
  11:40:30 STEP 1357 H= 339:15 +CPU= 25.013
  11:40:54 STEP 1358 H= 339:30 +CPU= 24.279
  11:41:20 STEP 1359 H= 339:45 +CPU= 26.156
  11:41:45 STEP 1360 H= 340:00 +CPU= 24.610
  11:42:10 STEP 1361 H= 340:15 +CPU= 25.269
  11:42:36 STEP 1362 H= 340:30 +CPU= 25.484
  11:43:01 STEP 1363 H= 340:45 +CPU= 25.445
  11:43:26 STEP 1364 H= 341:00 +CPU= 25.388
  11:43:51 STEP 1365 H= 341:15 +CPU= 24.843
  11:44:17 STEP 1366 H= 341:30 +CPU= 25.617
  11:44:42 STEP 1367 H= 341:45 +CPU= 25.151
  11:45:12 STEP 1368 H= 342:00 +CPU= 29.964
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001368
  11:45:37 STEP 1369 H= 342:15 +CPU= 25.389
  11:46:03 STEP 1370 H= 342:30 +CPU= 25.531
  11:46:28 STEP 1371 H= 342:45 +CPU= 25.000
  11:46:53 STEP 1372 H= 343:00 +CPU= 25.005
  11:47:18 STEP 1373 H= 343:15 +CPU= 25.427
  11:47:44 STEP 1374 H= 343:30 +CPU= 25.390
  11:48:09 STEP 1375 H= 343:45 +CPU= 25.366
  11:48:34 STEP 1376 H= 344:00 +CPU= 25.295
  11:49:00 STEP 1377 H= 344:15 +CPU= 25.462
  11:49:25 STEP 1378 H= 344:30 +CPU= 25.285
  11:49:51 STEP 1379 H= 344:45 +CPU= 25.521
  11:50:21 STEP 1380 H= 345:00 +CPU= 30.142
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001380
  11:50:46 STEP 1381 H= 345:15 +CPU= 25.536
  11:51:12 STEP 1382 H= 345:30 +CPU= 25.342
  11:51:37 STEP 1383 H= 345:45 +CPU= 24.767
  11:52:02 STEP 1384 H= 346:00 +CPU= 25.830
  11:52:27 STEP 1385 H= 346:15 +CPU= 24.903
  11:52:52 STEP 1386 H= 346:30 +CPU= 24.865
  11:53:17 STEP 1387 H= 346:45 +CPU= 25.024
  11:53:43 STEP 1388 H= 347:00 +CPU= 25.572
  11:54:07 STEP 1389 H= 347:15 +CPU= 24.357
  11:54:32 STEP 1390 H= 347:30 +CPU= 25.237
  11:54:57 STEP 1391 H= 347:45 +CPU= 24.574
  11:55:33 STEP 1392 H= 348:00 +CPU= 35.467
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001392
  11:55:58 STEP 1393 H= 348:15 +CPU= 25.643
  11:56:23 STEP 1394 H= 348:30 +CPU= 25.116
  11:56:49 STEP 1395 H= 348:45 +CPU= 25.708
  11:57:15 STEP 1396 H= 349:00 +CPU= 25.821
  11:57:40 STEP 1397 H= 349:15 +CPU= 25.429
  11:58:06 STEP 1398 H= 349:30 +CPU= 25.932
  11:58:32 STEP 1399 H= 349:45 +CPU= 25.975
  11:58:58 STEP 1400 H= 350:00 +CPU= 26.068
  11:59:23 STEP 1401 H= 350:15 +CPU= 24.928
  11:59:48 STEP 1402 H= 350:30 +CPU= 25.118
  12:00:13 STEP 1403 H= 350:45 +CPU= 24.946
  12:00:44 STEP 1404 H= 351:00 +CPU= 30.433
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001404
  12:01:08 STEP 1405 H= 351:15 +CPU= 24.721
  12:01:33 STEP 1406 H= 351:30 +CPU= 24.851
  12:01:58 STEP 1407 H= 351:45 +CPU= 24.976
  12:02:23 STEP 1408 H= 352:00 +CPU= 24.746
  12:02:48 STEP 1409 H= 352:15 +CPU= 24.880
  12:03:13 STEP 1410 H= 352:30 +CPU= 24.860
  12:03:37 STEP 1411 H= 352:45 +CPU= 24.566
  12:04:03 STEP 1412 H= 353:00 +CPU= 25.720
  12:04:28 STEP 1413 H= 353:15 +CPU= 24.518
  12:04:52 STEP 1414 H= 353:30 +CPU= 24.773
  12:05:17 STEP 1415 H= 353:45 +CPU= 24.334
  12:05:44 STEP 1416 H= 354:00 +CPU= 27.699
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001416
  12:06:06 STEP 1417 H= 354:15 +CPU= 21.782
  12:06:28 STEP 1418 H= 354:30 +CPU= 21.794
  12:06:48 STEP 1419 H= 354:45 +CPU= 19.915
  12:07:08 STEP 1420 H= 355:00 +CPU= 19.929
  12:07:27 STEP 1421 H= 355:15 +CPU= 19.486
  12:07:47 STEP 1422 H= 355:30 +CPU= 19.417
  12:08:07 STEP 1423 H= 355:45 +CPU= 19.827
  12:08:27 STEP 1424 H= 356:00 +CPU= 19.857
  12:08:46 STEP 1425 H= 356:15 +CPU= 19.666
  12:09:07 STEP 1426 H= 356:30 +CPU= 20.994
  12:09:29 STEP 1427 H= 356:45 +CPU= 22.218
  12:09:56 STEP 1428 H= 357:00 +CPU= 26.540
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001428
  12:10:21 STEP 1429 H= 357:15 +CPU= 24.620
  12:10:46 STEP 1430 H= 357:30 +CPU= 24.911
  12:11:11 STEP 1431 H= 357:45 +CPU= 25.316
  12:11:36 STEP 1432 H= 358:00 +CPU= 25.074
  12:12:01 STEP 1433 H= 358:15 +CPU= 25.045
  12:12:26 STEP 1434 H= 358:30 +CPU= 24.533
  12:12:50 STEP 1435 H= 358:45 +CPU= 24.801
  12:13:16 STEP 1436 H= 359:00 +CPU= 25.346
  12:13:41 STEP 1437 H= 359:15 +CPU= 25.017
  12:14:05 STEP 1438 H= 359:30 +CPU= 24.502
  12:14:30 STEP 1439 H= 359:45 +CPU= 24.477
  12:15:03 STEP 1440 H= 360:00 +CPU= 33.123
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9659501575E-21      I       0.7953449292E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1510051092E-01      I
I  Relat. Hum. I      0.2033558530E+00      I       0.2737668566E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1367828582E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    322478484 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS322478.5 Mbytes/s, TOTAL TIME=    0.0096(10.4%)
 12:15:03 STEP 1440 H= 360:00 +CPU= 33.123
 END CNT3
 NSTEP =  1440 CNT0   000000000  23.542  23.542  23.552   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        17160/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    303    0       46      1044068    17160 ************    38.7     1.6    37.0     2.4    69.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  625    4629.9    4629.9     20.01      0.00
   9 SPCM     - SPECTRAL COMP.                     576    1289.9    1289.9      5.14      0.00
  10 SCAN2M - PHYSICS                              577   10388.8   10388.8     41.45      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 48    1198.4    1198.4      0.40      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 25      77.6      77.6      0.01      0.00
  17 GRIDFPOS IN CNT4                               48      30.9      30.9      0.01      0.00
  27 RESTART FILES - WRITING                        12    4792.8    4792.8      0.40      0.00
  28 RESTART FILES - READING                         1    3191.8    3191.8      0.02      0.00
  29 SU4FPOS IN CNT4                                48       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                48    4485.5    4485.5      1.49      0.00
  31 POSDDH IN STEPO                                 3       3.4       3.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    577    5056.7    5056.7     20.18      0.00
  39 SU0YOMB                                         1     325.6     325.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    577      31.0      31.0      0.12      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              576     686.1     686.1      2.73      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              576      78.2      78.2      0.31      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 25       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1252     254.4     254.4      2.20      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1200     150.2     150.2      1.25      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1200      84.3      84.3      0.70      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1252     111.2     111.2      0.96      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      28.3      28.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1252     104.0     104.0      0.90      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1200      63.2      63.2      0.52      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1252     101.6     101.6      0.88      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1200      56.5      56.5      0.47      0.00
 400 GSTATS                                      67705       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 62941       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    14461.6 CPU TIME   14458.2 VECTOR TIME    14458.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       89.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/15/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/15/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285017/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
12:18:29 (5660): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0_r1938074476_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 16:23:01 1523278 22436609 oifs_43r3_bl_a2gm_2016092300_20_1017_12285017_0 1,295,100 39,275 0.0303


©2024 climateprediction.net