climateprediction.net home page
Task 22312204

Task 22312204

Name oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0
Workunit 12211954
Created 13 Feb 2023, 21:31:10 UTC
Sent 13 Feb 2023, 21:52:19 UTC
Report deadline 14 Apr 2023, 21:52:19 UTC
Received 14 Feb 2023, 15:55:09 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1534455
Run time 14 hours 53 min 29 sec
CPU time 14 hours 37 min 46 sec
Validate state Valid
Credit 1,815.66
Device peak FLOPS 4.58 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,054.23 MB
Peak swap size 5,930.79 MB
Peak disk usage 2,049.04 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
ib/boinc-client/slots/7/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_9.zip
Uploading the intermediate file: upload_file_9.zip
  12:07:55 STEP  961 H= 240:15 +CPU= 28.540
  12:08:26 STEP  962 H= 240:30 +CPU= 29.754
  12:08:58 STEP  963 H= 240:45 +CPU= 29.935
  12:09:28 STEP  964 H= 241:00 +CPU= 29.336
  12:09:58 STEP  965 H= 241:15 +CPU= 30.328
  12:10:28 STEP  966 H= 241:30 +CPU= 29.414
  12:10:57 STEP  967 H= 241:45 +CPU= 28.692
  12:11:29 STEP  968 H= 242:00 +CPU= 29.868
  12:12:00 STEP  969 H= 242:15 +CPU= 29.310
  12:12:30 STEP  970 H= 242:30 +CPU= 30.038
  12:13:01 STEP  971 H= 242:45 +CPU= 28.796
  12:13:42 STEP  972 H= 243:00 +CPU= 37.130
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000972
  12:14:14 STEP  973 H= 243:15 +CPU= 29.092
  12:14:44 STEP  974 H= 243:30 +CPU= 28.460
  12:15:14 STEP  975 H= 243:45 +CPU= 29.626
  12:15:46 STEP  976 H= 244:00 +CPU= 30.644
  12:16:19 STEP  977 H= 244:15 +CPU= 28.962
  12:16:52 STEP  978 H= 244:30 +CPU= 30.143
  12:17:22 STEP  979 H= 244:45 +CPU= 29.832
  12:17:54 STEP  980 H= 245:00 +CPU= 29.910
  12:18:23 STEP  981 H= 245:15 +CPU= 28.517
  12:18:53 STEP  982 H= 245:30 +CPU= 30.089
  12:19:23 STEP  983 H= 245:45 +CPU= 29.450
  12:20:01 STEP  984 H= 246:00 +CPU= 35.826
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000984
  12:20:32 STEP  985 H= 246:15 +CPU= 30.360
  12:21:03 STEP  986 H= 246:30 +CPU= 29.303
  12:21:31 STEP  987 H= 246:45 +CPU= 27.577
  12:22:01 STEP  988 H= 247:00 +CPU= 29.534
  12:22:35 STEP  989 H= 247:15 +CPU= 30.101
  12:23:06 STEP  990 H= 247:30 +CPU= 29.213
  12:23:35 STEP  991 H= 247:45 +CPU= 28.751
  12:24:07 STEP  992 H= 248:00 +CPU= 29.807
  12:24:37 STEP  993 H= 248:15 +CPU= 29.637
  12:25:05 STEP  994 H= 248:30 +CPU= 28.389
  12:25:39 STEP  995 H= 248:45 +CPU= 30.418
  12:26:19 STEP  996 H= 249:00 +CPU= 37.421
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000996
  12:26:48 STEP  997 H= 249:15 +CPU= 28.365
  12:27:20 STEP  998 H= 249:30 +CPU= 30.267
  12:27:50 STEP  999 H= 249:45 +CPU= 29.514
  12:28:21 STEP 1000 H= 250:00 +CPU= 29.062
  12:28:53 STEP 1001 H= 250:15 +CPU= 29.297
  12:29:27 STEP 1002 H= 250:30 +CPU= 30.185
  12:29:58 STEP 1003 H= 250:45 +CPU= 30.219
  12:30:30 STEP 1004 H= 251:00 +CPU= 29.440
  12:31:00 STEP 1005 H= 251:15 +CPU= 29.570
  12:31:32 STEP 1006 H= 251:30 +CPU= 30.356
  12:32:03 STEP 1007 H= 251:45 +CPU= 28.785
  12:32:45 STEP 1008 H= 252:00 +CPU= 41.518
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001008
  12:33:16 STEP 1009 H= 252:15 +CPU= 30.607
  12:33:46 STEP 1010 H= 252:30 +CPU= 28.652
  12:34:18 STEP 1011 H= 252:45 +CPU= 30.239
  12:34:49 STEP 1012 H= 253:00 +CPU= 30.591
  12:35:19 STEP 1013 H= 253:15 +CPU= 28.999
  12:35:48 STEP 1014 H= 253:30 +CPU= 28.690
  12:36:18 STEP 1015 H= 253:45 +CPU= 29.161
  12:36:52 STEP 1016 H= 254:00 +CPU= 30.569
  12:37:21 STEP 1017 H= 254:15 +CPU= 28.530
  12:37:51 STEP 1018 H= 254:30 +CPU= 30.388
  12:38:22 STEP 1019 H= 254:45 +CPU= 29.475
  12:38:59 STEP 1020 H= 255:00 +CPU= 36.165
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001020
  12:39:30 STEP 1021 H= 255:15 +CPU= 30.018
  12:40:01 STEP 1022 H= 255:30 +CPU= 30.345
  12:40:32 STEP 1023 H= 255:45 +CPU= 29.203
  12:41:03 STEP 1024 H= 256:00 +CPU= 29.809
  12:41:32 STEP 1025 H= 256:15 +CPU= 29.690
  12:42:03 STEP 1026 H= 256:30 +CPU= 30.010
  12:42:31 STEP 1027 H= 256:45 +CPU= 28.377
  12:43:02 STEP 1028 H= 257:00 +CPU= 30.847
  12:43:33 STEP 1029 H= 257:15 +CPU= 30.110
  12:44:02 STEP 1030 H= 257:30 +CPU= 28.859
  12:44:35 STEP 1031 H= 257:45 +CPU= 29.293
  12:45:13 STEP 1032 H= 258:00 +CPU= 38.014
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001032
  12:45:43 STEP 1033 H= 258:15 +CPU= 29.608
  12:46:15 STEP 1034 H= 258:30 +CPU= 29.670
  12:46:46 STEP 1035 H= 258:45 +CPU= 30.795
  12:47:18 STEP 1036 H= 259:00 +CPU= 30.858
  12:47:47 STEP 1037 H= 259:15 +CPU= 28.757
  12:48:17 STEP 1038 H= 259:30 +CPU= 29.961
  12:48:49 STEP 1039 H= 259:45 +CPU= 30.456
  12:49:20 STEP 1040 H= 260:00 +CPU= 28.750
  12:49:50 STEP 1041 H= 260:15 +CPU= 29.138
  12:50:20 STEP 1042 H= 260:30 +CPU= 29.568
  12:50:50 STEP 1043 H= 260:45 +CPU= 29.517
  12:51:29 STEP 1044 H= 261:00 +CPU= 36.498
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001044
  12:51:59 STEP 1045 H= 261:15 +CPU= 29.800
  12:52:30 STEP 1046 H= 261:30 +CPU= 30.390
  12:52:59 STEP 1047 H= 261:45 +CPU= 26.664
  12:53:27 STEP 1048 H= 262:00 +CPU= 27.463
  12:53:55 STEP 1049 H= 262:15 +CPU= 26.807
  12:54:23 STEP 1050 H= 262:30 +CPU= 26.294
  12:54:50 STEP 1051 H= 262:45 +CPU= 27.048
  12:55:18 STEP 1052 H= 263:00 +CPU= 27.575
  12:55:45 STEP 1053 H= 263:15 +CPU= 27.219
  12:56:12 STEP 1054 H= 263:30 +CPU= 26.635
  12:56:40 STEP 1055 H= 263:45 +CPU= 26.980
  12:57:18 STEP 1056 H= 264:00 +CPU= 36.218
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_10.zip
Uploading the intermediate file: upload_file_10.zip
  12:57:48 STEP 1057 H= 264:15 +CPU= 26.704
  12:58:15 STEP 1058 H= 264:30 +CPU= 26.533
  12:58:42 STEP 1059 H= 264:45 +CPU= 26.293
  12:59:08 STEP 1060 H= 265:00 +CPU= 26.004
  12:59:35 STEP 1061 H= 265:15 +CPU= 26.675
  13:00:02 STEP 1062 H= 265:30 +CPU= 26.710
  13:00:30 STEP 1063 H= 265:45 +CPU= 26.023
  13:00:56 STEP 1064 H= 266:00 +CPU= 26.709
  13:01:23 STEP 1065 H= 266:15 +CPU= 26.177
  13:01:50 STEP 1066 H= 266:30 +CPU= 26.193
  13:02:17 STEP 1067 H= 266:45 +CPU= 26.133
  13:02:50 STEP 1068 H= 267:00 +CPU= 32.852
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001068
  13:03:17 STEP 1069 H= 267:15 +CPU= 26.217
  13:03:43 STEP 1070 H= 267:30 +CPU= 26.177
  13:04:09 STEP 1071 H= 267:45 +CPU= 26.344
  13:04:37 STEP 1072 H= 268:00 +CPU= 26.933
  13:05:03 STEP 1073 H= 268:15 +CPU= 25.960
  13:05:30 STEP 1074 H= 268:30 +CPU= 26.389
  13:05:58 STEP 1075 H= 268:45 +CPU= 26.575
  13:06:24 STEP 1076 H= 269:00 +CPU= 26.425
  13:06:51 STEP 1077 H= 269:15 +CPU= 26.405
  13:07:18 STEP 1078 H= 269:30 +CPU= 26.172
  13:07:45 STEP 1079 H= 269:45 +CPU= 26.608
  13:08:20 STEP 1080 H= 270:00 +CPU= 32.754
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001080
  13:08:46 STEP 1081 H= 270:15 +CPU= 25.974
  13:09:12 STEP 1082 H= 270:30 +CPU= 26.161
  13:09:40 STEP 1083 H= 270:45 +CPU= 25.721
  13:10:08 STEP 1084 H= 271:00 +CPU= 26.924
  13:10:34 STEP 1085 H= 271:15 +CPU= 26.331
  13:11:01 STEP 1086 H= 271:30 +CPU= 25.798
  13:11:28 STEP 1087 H= 271:45 +CPU= 26.306
  13:11:55 STEP 1088 H= 272:00 +CPU= 26.824
  13:12:22 STEP 1089 H= 272:15 +CPU= 25.932
  13:12:49 STEP 1090 H= 272:30 +CPU= 26.458
  13:13:16 STEP 1091 H= 272:45 +CPU= 26.210
  13:13:50 STEP 1092 H= 273:00 +CPU= 32.952
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001092
  13:14:16 STEP 1093 H= 273:15 +CPU= 26.021
  13:14:43 STEP 1094 H= 273:30 +CPU= 26.318
  13:15:10 STEP 1095 H= 273:45 +CPU= 26.285
  13:15:37 STEP 1096 H= 274:00 +CPU= 26.247
  13:16:04 STEP 1097 H= 274:15 +CPU= 26.232
  13:16:31 STEP 1098 H= 274:30 +CPU= 26.605
  13:16:57 STEP 1099 H= 274:45 +CPU= 26.058
  13:17:26 STEP 1100 H= 275:00 +CPU= 26.804
  13:17:52 STEP 1101 H= 275:15 +CPU= 26.544
  13:18:19 STEP 1102 H= 275:30 +CPU= 26.345
  13:18:45 STEP 1103 H= 275:45 +CPU= 25.908
  13:19:22 STEP 1104 H= 276:00 +CPU= 35.638
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001104
  13:19:49 STEP 1105 H= 276:15 +CPU= 26.247
  13:20:15 STEP 1106 H= 276:30 +CPU= 25.898
  13:20:43 STEP 1107 H= 276:45 +CPU= 26.536
  13:21:12 STEP 1108 H= 277:00 +CPU= 27.121
  13:21:38 STEP 1109 H= 277:15 +CPU= 26.167
  13:22:05 STEP 1110 H= 277:30 +CPU= 26.259
  13:22:34 STEP 1111 H= 277:45 +CPU= 26.305
  13:23:00 STEP 1112 H= 278:00 +CPU= 26.605
  13:23:27 STEP 1113 H= 278:15 +CPU= 26.295
  13:23:54 STEP 1114 H= 278:30 +CPU= 26.568
  13:24:20 STEP 1115 H= 278:45 +CPU= 26.167
  13:24:53 STEP 1116 H= 279:00 +CPU= 32.833
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001116
  13:25:21 STEP 1117 H= 279:15 +CPU= 26.599
  13:25:48 STEP 1118 H= 279:30 +CPU= 26.179
  13:26:15 STEP 1119 H= 279:45 +CPU= 26.119
  13:26:42 STEP 1120 H= 280:00 +CPU= 26.963
  13:27:09 STEP 1121 H= 280:15 +CPU= 26.532
  13:27:38 STEP 1122 H= 280:30 +CPU= 26.067
  13:28:04 STEP 1123 H= 280:45 +CPU= 26.227
  13:28:31 STEP 1124 H= 281:00 +CPU= 27.003
  13:28:58 STEP 1125 H= 281:15 +CPU= 24.948
  13:29:22 STEP 1126 H= 281:30 +CPU= 23.861
  13:29:47 STEP 1127 H= 281:45 +CPU= 23.959
  13:30:20 STEP 1128 H= 282:00 +CPU= 30.301
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001128
  13:30:44 STEP 1129 H= 282:15 +CPU= 24.003
  13:31:09 STEP 1130 H= 282:30 +CPU= 24.657
  13:31:34 STEP 1131 H= 282:45 +CPU= 23.977
  13:31:58 STEP 1132 H= 283:00 +CPU= 24.007
  13:32:23 STEP 1133 H= 283:15 +CPU= 24.018
  13:32:47 STEP 1134 H= 283:30 +CPU= 23.890
  13:33:13 STEP 1135 H= 283:45 +CPU= 23.850
  13:33:37 STEP 1136 H= 284:00 +CPU= 24.226
  13:34:01 STEP 1137 H= 284:15 +CPU= 23.773
  13:34:25 STEP 1138 H= 284:30 +CPU= 23.616
  13:34:49 STEP 1139 H= 284:45 +CPU= 23.713
  13:35:21 STEP 1140 H= 285:00 +CPU= 29.794
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001140
  13:35:45 STEP 1141 H= 285:15 +CPU= 23.640
  13:36:09 STEP 1142 H= 285:30 +CPU= 23.714
  13:36:35 STEP 1143 H= 285:45 +CPU= 23.765
  13:37:01 STEP 1144 H= 286:00 +CPU= 24.319
  13:37:26 STEP 1145 H= 286:15 +CPU= 23.565
  13:37:51 STEP 1146 H= 286:30 +CPU= 23.601
  13:38:17 STEP 1147 H= 286:45 +CPU= 23.721
  13:38:41 STEP 1148 H= 287:00 +CPU= 24.130
  13:39:05 STEP 1149 H= 287:15 +CPU= 23.692
  13:39:30 STEP 1150 H= 287:30 +CPU= 23.774
  13:39:54 STEP 1151 H= 287:45 +CPU= 23.708
  13:40:28 STEP 1152 H= 288:00 +CPU= 32.639
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_11.zip
Uploading the intermediate file: upload_file_11.zip
  13:40:53 STEP 1153 H= 288:15 +CPU= 23.845
  13:41:20 STEP 1154 H= 288:30 +CPU= 23.695
  13:41:44 STEP 1155 H= 288:45 +CPU= 23.595
  13:42:08 STEP 1156 H= 289:00 +CPU= 24.260
  13:42:32 STEP 1157 H= 289:15 +CPU= 23.852
  13:42:57 STEP 1158 H= 289:30 +CPU= 23.823
  13:43:22 STEP 1159 H= 289:45 +CPU= 23.730
  13:43:47 STEP 1160 H= 290:00 +CPU= 24.182
  13:44:12 STEP 1161 H= 290:15 +CPU= 23.676
  13:44:36 STEP 1162 H= 290:30 +CPU= 23.663
  13:45:03 STEP 1163 H= 290:45 +CPU= 23.644
  13:45:33 STEP 1164 H= 291:00 +CPU= 29.847
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001164
  13:45:57 STEP 1165 H= 291:15 +CPU= 23.686
  13:46:22 STEP 1166 H= 291:30 +CPU= 23.820
  13:46:47 STEP 1167 H= 291:45 +CPU= 23.807
  13:47:12 STEP 1168 H= 292:00 +CPU= 24.223
  13:47:36 STEP 1169 H= 292:15 +CPU= 23.719
  13:48:00 STEP 1170 H= 292:30 +CPU= 23.656
  13:48:24 STEP 1171 H= 292:45 +CPU= 23.669
  13:48:49 STEP 1172 H= 293:00 +CPU= 24.400
  13:49:12 STEP 1173 H= 293:15 +CPU= 23.759
  13:49:37 STEP 1174 H= 293:30 +CPU= 23.813
  13:50:01 STEP 1175 H= 293:45 +CPU= 23.795
  13:50:32 STEP 1176 H= 294:00 +CPU= 29.857
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001176
  13:50:57 STEP 1177 H= 294:15 +CPU= 23.834
  13:51:21 STEP 1178 H= 294:30 +CPU= 23.896
  13:51:45 STEP 1179 H= 294:45 +CPU= 23.902
  13:52:10 STEP 1180 H= 295:00 +CPU= 24.347
  13:52:34 STEP 1181 H= 295:15 +CPU= 23.787
  13:52:57 STEP 1182 H= 295:30 +CPU= 23.765
  13:53:22 STEP 1183 H= 295:45 +CPU= 23.802
  13:53:46 STEP 1184 H= 296:00 +CPU= 24.258
  13:54:10 STEP 1185 H= 296:15 +CPU= 23.703
  13:54:34 STEP 1186 H= 296:30 +CPU= 23.686
  13:54:58 STEP 1187 H= 296:45 +CPU= 23.799
  13:55:30 STEP 1188 H= 297:00 +CPU= 29.838
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001188
  13:55:55 STEP 1189 H= 297:15 +CPU= 23.789
  13:56:19 STEP 1190 H= 297:30 +CPU= 23.804
  13:56:45 STEP 1191 H= 297:45 +CPU= 23.711
  13:57:13 STEP 1192 H= 298:00 +CPU= 24.288
  13:57:38 STEP 1193 H= 298:15 +CPU= 23.763
  13:58:03 STEP 1194 H= 298:30 +CPU= 23.707
  13:58:27 STEP 1195 H= 298:45 +CPU= 23.747
  13:58:53 STEP 1196 H= 299:00 +CPU= 24.236
  13:59:17 STEP 1197 H= 299:15 +CPU= 23.741
  13:59:41 STEP 1198 H= 299:30 +CPU= 23.713
  14:00:06 STEP 1199 H= 299:45 +CPU= 23.721
  14:00:38 STEP 1200 H= 300:00 +CPU= 32.505
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001200
  14:01:02 STEP 1201 H= 300:15 +CPU= 23.805
  14:01:26 STEP 1202 H= 300:30 +CPU= 23.833
  14:01:50 STEP 1203 H= 300:45 +CPU= 23.781
  14:02:16 STEP 1204 H= 301:00 +CPU= 24.382
  14:02:40 STEP 1205 H= 301:15 +CPU= 23.809
  14:03:04 STEP 1206 H= 301:30 +CPU= 23.853
  14:03:29 STEP 1207 H= 301:45 +CPU= 23.887
  14:03:54 STEP 1208 H= 302:00 +CPU= 24.426
  14:04:19 STEP 1209 H= 302:15 +CPU= 23.820
  14:04:43 STEP 1210 H= 302:30 +CPU= 23.794
  14:05:07 STEP 1211 H= 302:45 +CPU= 23.863
  14:05:38 STEP 1212 H= 303:00 +CPU= 29.747
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001212
  14:06:02 STEP 1213 H= 303:15 +CPU= 23.761
  14:06:28 STEP 1214 H= 303:30 +CPU= 23.738
  14:06:51 STEP 1215 H= 303:45 +CPU= 23.757
  14:07:16 STEP 1216 H= 304:00 +CPU= 24.278
  14:07:42 STEP 1217 H= 304:15 +CPU= 23.858
  14:08:06 STEP 1218 H= 304:30 +CPU= 23.648
  14:08:30 STEP 1219 H= 304:45 +CPU= 23.833
  14:08:55 STEP 1220 H= 305:00 +CPU= 24.455
  14:09:19 STEP 1221 H= 305:15 +CPU= 23.777
  14:09:43 STEP 1222 H= 305:30 +CPU= 23.811
  14:10:08 STEP 1223 H= 305:45 +CPU= 23.810
  14:10:39 STEP 1224 H= 306:00 +CPU= 29.721
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001224
  14:11:04 STEP 1225 H= 306:15 +CPU= 23.791
  14:11:28 STEP 1226 H= 306:30 +CPU= 23.794
  14:11:52 STEP 1227 H= 306:45 +CPU= 23.753
  14:12:17 STEP 1228 H= 307:00 +CPU= 24.348
  14:12:42 STEP 1229 H= 307:15 +CPU= 23.791
  14:13:06 STEP 1230 H= 307:30 +CPU= 23.757
  14:13:30 STEP 1231 H= 307:45 +CPU= 23.731
  14:13:55 STEP 1232 H= 308:00 +CPU= 24.438
  14:14:19 STEP 1233 H= 308:15 +CPU= 23.944
  14:14:43 STEP 1234 H= 308:30 +CPU= 23.785
  14:15:07 STEP 1235 H= 308:45 +CPU= 23.846
  14:15:38 STEP 1236 H= 309:00 +CPU= 30.020
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001236
  14:16:02 STEP 1237 H= 309:15 +CPU= 23.972
  14:16:26 STEP 1238 H= 309:30 +CPU= 23.971
  14:16:50 STEP 1239 H= 309:45 +CPU= 23.904
  14:17:14 STEP 1240 H= 310:00 +CPU= 24.428
  14:17:38 STEP 1241 H= 310:15 +CPU= 23.861
  14:18:03 STEP 1242 H= 310:30 +CPU= 23.732
  14:18:30 STEP 1243 H= 310:45 +CPU= 23.773
  14:18:55 STEP 1244 H= 311:00 +CPU= 24.356
  14:19:19 STEP 1245 H= 311:15 +CPU= 23.795
  14:19:43 STEP 1246 H= 311:30 +CPU= 23.781
  14:20:07 STEP 1247 H= 311:45 +CPU= 23.905
  14:20:40 STEP 1248 H= 312:00 +CPU= 32.760
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_12.zip
Uploading the intermediate file: upload_file_12.zip
  14:21:06 STEP 1249 H= 312:15 +CPU= 23.945
  14:21:30 STEP 1250 H= 312:30 +CPU= 23.919
  14:21:54 STEP 1251 H= 312:45 +CPU= 23.794
  14:22:19 STEP 1252 H= 313:00 +CPU= 24.314
  14:22:45 STEP 1253 H= 313:15 +CPU= 23.862
  14:23:09 STEP 1254 H= 313:30 +CPU= 23.891
  14:23:33 STEP 1255 H= 313:45 +CPU= 23.900
  14:23:57 STEP 1256 H= 314:00 +CPU= 24.428
  14:24:21 STEP 1257 H= 314:15 +CPU= 23.996
  14:24:46 STEP 1258 H= 314:30 +CPU= 23.914
  14:25:06 STEP 1259 H= 314:45 +CPU= 19.890
  14:25:27 STEP 1260 H= 315:00 +CPU= 20.399
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001260
  14:25:43 STEP 1261 H= 315:15 +CPU= 16.432
  14:25:59 STEP 1262 H= 315:30 +CPU= 15.878
  14:26:16 STEP 1263 H= 315:45 +CPU= 16.601
  14:26:34 STEP 1264 H= 316:00 +CPU= 18.210
  14:26:51 STEP 1265 H= 316:15 +CPU= 16.933
  14:27:07 STEP 1266 H= 316:30 +CPU= 16.670
  14:27:24 STEP 1267 H= 316:45 +CPU= 16.827
  14:27:42 STEP 1268 H= 317:00 +CPU= 17.927
  14:28:01 STEP 1269 H= 317:15 +CPU= 18.425
  14:28:19 STEP 1270 H= 317:30 +CPU= 18.134
  14:28:35 STEP 1271 H= 317:45 +CPU= 16.593
  14:28:57 STEP 1272 H= 318:00 +CPU= 21.262
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001272
  14:29:14 STEP 1273 H= 318:15 +CPU= 17.101
  14:29:31 STEP 1274 H= 318:30 +CPU= 17.015
  14:29:48 STEP 1275 H= 318:45 +CPU= 16.847
  14:30:05 STEP 1276 H= 319:00 +CPU= 17.048
  14:30:21 STEP 1277 H= 319:15 +CPU= 16.867
  14:30:38 STEP 1278 H= 319:30 +CPU= 16.870
  14:30:56 STEP 1279 H= 319:45 +CPU= 17.621
  14:31:13 STEP 1280 H= 320:00 +CPU= 16.721
  14:31:30 STEP 1281 H= 320:15 +CPU= 16.943
  14:31:48 STEP 1282 H= 320:30 +CPU= 18.265
  14:32:04 STEP 1283 H= 320:45 +CPU= 16.495
  14:32:26 STEP 1284 H= 321:00 +CPU= 22.016
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001284
  14:32:43 STEP 1285 H= 321:15 +CPU= 16.624
  14:33:00 STEP 1286 H= 321:30 +CPU= 16.549
  14:33:17 STEP 1287 H= 321:45 +CPU= 17.182
  14:33:34 STEP 1288 H= 322:00 +CPU= 17.580
  14:33:51 STEP 1289 H= 322:15 +CPU= 16.709
  14:34:08 STEP 1290 H= 322:30 +CPU= 16.481
  14:34:24 STEP 1291 H= 322:45 +CPU= 16.953
  14:34:42 STEP 1292 H= 323:00 +CPU= 17.362
  14:34:59 STEP 1293 H= 323:15 +CPU= 16.714
  14:35:19 STEP 1294 H= 323:30 +CPU= 20.448
  14:35:37 STEP 1295 H= 323:45 +CPU= 18.360
  14:36:04 STEP 1296 H= 324:00 +CPU= 25.945
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001296
  14:36:22 STEP 1297 H= 324:15 +CPU= 18.375
  14:36:46 STEP 1298 H= 324:30 +CPU= 23.927
  14:37:10 STEP 1299 H= 324:45 +CPU= 23.701
  14:37:36 STEP 1300 H= 325:00 +CPU= 24.217
  14:38:02 STEP 1301 H= 325:15 +CPU= 25.242
  14:38:27 STEP 1302 H= 325:30 +CPU= 25.216
  14:38:55 STEP 1303 H= 325:45 +CPU= 26.532
  14:39:24 STEP 1304 H= 326:00 +CPU= 27.449
  14:39:50 STEP 1305 H= 326:15 +CPU= 26.278
  14:40:17 STEP 1306 H= 326:30 +CPU= 26.038
  14:40:43 STEP 1307 H= 326:45 +CPU= 25.910
  14:41:15 STEP 1308 H= 327:00 +CPU= 32.150
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001308
  14:41:42 STEP 1309 H= 327:15 +CPU= 26.091
  14:42:09 STEP 1310 H= 327:30 +CPU= 26.566
  14:42:35 STEP 1311 H= 327:45 +CPU= 26.089
  14:43:02 STEP 1312 H= 328:00 +CPU= 26.330
  14:43:30 STEP 1313 H= 328:15 +CPU= 26.177
  14:44:00 STEP 1314 H= 328:30 +CPU= 26.011
  14:44:26 STEP 1315 H= 328:45 +CPU= 25.662
  14:44:53 STEP 1316 H= 329:00 +CPU= 26.861
  14:45:19 STEP 1317 H= 329:15 +CPU= 26.235
  14:45:45 STEP 1318 H= 329:30 +CPU= 25.539
  14:46:11 STEP 1319 H= 329:45 +CPU= 26.007
  14:46:46 STEP 1320 H= 330:00 +CPU= 33.075
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001320
  14:47:12 STEP 1321 H= 330:15 +CPU= 25.707
  14:47:38 STEP 1322 H= 330:30 +CPU= 25.929
  14:48:06 STEP 1323 H= 330:45 +CPU= 26.405
  14:48:33 STEP 1324 H= 331:00 +CPU= 26.953
  14:49:02 STEP 1325 H= 331:15 +CPU= 25.978
  14:49:28 STEP 1326 H= 331:30 +CPU= 25.917
  14:49:54 STEP 1327 H= 331:45 +CPU= 26.076
  14:50:21 STEP 1328 H= 332:00 +CPU= 26.161
  14:50:47 STEP 1329 H= 332:15 +CPU= 26.323
  14:51:16 STEP 1330 H= 332:30 +CPU= 26.305
  14:51:43 STEP 1331 H= 332:45 +CPU= 25.698
  14:52:17 STEP 1332 H= 333:00 +CPU= 32.424
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001332
  14:52:45 STEP 1333 H= 333:15 +CPU= 26.265
  14:53:11 STEP 1334 H= 333:30 +CPU= 25.870
  14:53:38 STEP 1335 H= 333:45 +CPU= 25.970
  14:54:05 STEP 1336 H= 334:00 +CPU= 26.881
  14:54:32 STEP 1337 H= 334:15 +CPU= 26.626
  14:55:01 STEP 1338 H= 334:30 +CPU= 26.167
  14:55:27 STEP 1339 H= 334:45 +CPU= 26.109
  14:55:54 STEP 1340 H= 335:00 +CPU= 26.821
  14:56:21 STEP 1341 H= 335:15 +CPU= 25.916
  14:56:44 STEP 1342 H= 335:30 +CPU= 23.499
  14:57:04 STEP 1343 H= 335:45 +CPU= 19.740
  14:57:39 STEP 1344 H= 336:00 +CPU= 34.867
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_13.zip
Uploading the intermediate file: upload_file_13.zip
  14:58:06 STEP 1345 H= 336:15 +CPU= 26.099
  14:58:31 STEP 1346 H= 336:30 +CPU= 25.069
  14:58:59 STEP 1347 H= 336:45 +CPU= 27.133
  14:59:27 STEP 1348 H= 337:00 +CPU= 27.795
  14:59:54 STEP 1349 H= 337:15 +CPU= 27.517
  15:00:17 STEP 1350 H= 337:30 +CPU= 22.966
  15:00:43 STEP 1351 H= 337:45 +CPU= 25.626
  15:01:08 STEP 1352 H= 338:00 +CPU= 25.182
  15:01:35 STEP 1353 H= 338:15 +CPU= 26.801
  15:02:02 STEP 1354 H= 338:30 +CPU= 27.259
  15:02:29 STEP 1355 H= 338:45 +CPU= 26.811
  15:03:03 STEP 1356 H= 339:00 +CPU= 33.667
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001356
  15:03:27 STEP 1357 H= 339:15 +CPU= 24.100
  15:03:50 STEP 1358 H= 339:30 +CPU= 23.141
  15:04:13 STEP 1359 H= 339:45 +CPU= 22.153
  15:04:34 STEP 1360 H= 340:00 +CPU= 21.355
  15:04:57 STEP 1361 H= 340:15 +CPU= 22.754
  15:05:17 STEP 1362 H= 340:30 +CPU= 19.560
  15:05:37 STEP 1363 H= 340:45 +CPU= 19.856
  15:06:01 STEP 1364 H= 341:00 +CPU= 23.852
  15:06:21 STEP 1365 H= 341:15 +CPU= 20.885
  15:06:45 STEP 1366 H= 341:30 +CPU= 23.946
  15:07:05 STEP 1367 H= 341:45 +CPU= 20.057
  15:07:32 STEP 1368 H= 342:00 +CPU= 26.814
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001368
  15:08:00 STEP 1369 H= 342:15 +CPU= 27.203
  15:08:25 STEP 1370 H= 342:30 +CPU= 25.822
  15:08:47 STEP 1371 H= 342:45 +CPU= 21.102
  15:09:07 STEP 1372 H= 343:00 +CPU= 20.549
  15:09:32 STEP 1373 H= 343:15 +CPU= 24.963
  15:09:52 STEP 1374 H= 343:30 +CPU= 19.676
  15:10:16 STEP 1375 H= 343:45 +CPU= 24.485
  15:10:41 STEP 1376 H= 344:00 +CPU= 24.753
  15:11:06 STEP 1377 H= 344:15 +CPU= 24.699
  15:11:38 STEP 1378 H= 344:30 +CPU= 32.117
  15:12:09 STEP 1379 H= 344:45 +CPU= 30.828
  15:12:44 STEP 1380 H= 345:00 +CPU= 34.948
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001380
  15:13:17 STEP 1381 H= 345:15 +CPU= 32.947
  15:13:52 STEP 1382 H= 345:30 +CPU= 34.600
  15:14:26 STEP 1383 H= 345:45 +CPU= 33.975
  15:15:02 STEP 1384 H= 346:00 +CPU= 35.211
  15:15:33 STEP 1385 H= 346:15 +CPU= 31.230
  15:15:58 STEP 1386 H= 346:30 +CPU= 24.806
  15:16:28 STEP 1387 H= 346:45 +CPU= 29.395
  15:16:54 STEP 1388 H= 347:00 +CPU= 25.409
  15:17:25 STEP 1389 H= 347:15 +CPU= 30.249
  15:18:01 STEP 1390 H= 347:30 +CPU= 36.469
  15:18:39 STEP 1391 H= 347:45 +CPU= 37.064
  15:19:33 STEP 1392 H= 348:00 +CPU= 51.319
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001392
  15:20:15 STEP 1393 H= 348:15 +CPU= 40.818
  15:20:53 STEP 1394 H= 348:30 +CPU= 37.883
  15:21:33 STEP 1395 H= 348:45 +CPU= 38.034
  15:22:12 STEP 1396 H= 349:00 +CPU= 39.094
  15:22:50 STEP 1397 H= 349:15 +CPU= 38.097
  15:23:32 STEP 1398 H= 349:30 +CPU= 37.429
  15:24:12 STEP 1399 H= 349:45 +CPU= 38.282
  15:24:54 STEP 1400 H= 350:00 +CPU= 39.299
  15:25:33 STEP 1401 H= 350:15 +CPU= 37.454
  15:26:13 STEP 1402 H= 350:30 +CPU= 39.470
  15:26:54 STEP 1403 H= 350:45 +CPU= 39.115
  15:27:46 STEP 1404 H= 351:00 +CPU= 46.123
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001404
  15:28:26 STEP 1405 H= 351:15 +CPU= 38.471
  15:29:08 STEP 1406 H= 351:30 +CPU= 38.916
  15:29:52 STEP 1407 H= 351:45 +CPU= 38.612
  15:30:31 STEP 1408 H= 352:00 +CPU= 38.227
  15:31:13 STEP 1409 H= 352:15 +CPU= 39.653
  15:31:54 STEP 1410 H= 352:30 +CPU= 40.186
  15:32:34 STEP 1411 H= 352:45 +CPU= 38.084
  15:33:13 STEP 1412 H= 353:00 +CPU= 38.656
  15:33:54 STEP 1413 H= 353:15 +CPU= 40.379
  15:34:32 STEP 1414 H= 353:30 +CPU= 37.903
  15:35:09 STEP 1415 H= 353:45 +CPU= 36.540
  15:36:01 STEP 1416 H= 354:00 +CPU= 48.905
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001416
  15:36:41 STEP 1417 H= 354:15 +CPU= 39.664
  15:37:22 STEP 1418 H= 354:30 +CPU= 39.248
  15:38:02 STEP 1419 H= 354:45 +CPU= 39.381
  15:38:43 STEP 1420 H= 355:00 +CPU= 40.181
  15:39:16 STEP 1421 H= 355:15 +CPU= 33.742
  15:39:59 STEP 1422 H= 355:30 +CPU= 41.770
  15:40:38 STEP 1423 H= 355:45 +CPU= 39.122
  15:41:21 STEP 1424 H= 356:00 +CPU= 42.732
  15:42:00 STEP 1425 H= 356:15 +CPU= 39.399
  15:42:40 STEP 1426 H= 356:30 +CPU= 39.172
  15:43:19 STEP 1427 H= 356:45 +CPU= 39.143
  15:44:07 STEP 1428 H= 357:00 +CPU= 47.668
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001428
  15:44:40 STEP 1429 H= 357:15 +CPU= 32.893
  15:45:14 STEP 1430 H= 357:30 +CPU= 33.426
  15:45:56 STEP 1431 H= 357:45 +CPU= 41.934
  15:46:31 STEP 1432 H= 358:00 +CPU= 35.293
  15:47:10 STEP 1433 H= 358:15 +CPU= 38.395
  15:47:44 STEP 1434 H= 358:30 +CPU= 33.921
  15:48:19 STEP 1435 H= 358:45 +CPU= 34.943
  15:48:54 STEP 1436 H= 359:00 +CPU= 35.070
  15:49:25 STEP 1437 H= 359:15 +CPU= 30.930
  15:49:56 STEP 1438 H= 359:30 +CPU= 30.652
  15:50:30 STEP 1439 H= 359:45 +CPU= 33.978
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3zj
(argv4) batchid: 991
(argv5) wuid: 12211954
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_450c8239a0d1c26dacd73daea324f9b0 to: /var/lib/boinc-client/slots/7/oifs_43r3_bl_a3zj_2016092300_15_991_12211954.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_bl_a3zj_2016092300_15_991_12211954.zip
ic_ancil_file: ic_ancil_12211954
ifsdata_file: ifsdata_12211954
climate_data_file: clim_data_12211954
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/7/ic_ancil_12211954.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12211954.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e77761a193ef8c5be03e9a526a047db1 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12211954.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12211954.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12211954.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12211954.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12211954.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12211954.xml
-- Model is restarting --
Adjusting last_iter, 1440, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12211954.xml
last_cpu_time: 52625
upload_file_number: 14
last_iter: 1441
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105
The child process has been launched with process id: 22521
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKTRF:1:1:22521:22521] [20230214:155541:1676386541:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:56:40 STEP 1440 H= 360:00 +CPU= 36.177
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I      I Hor. Flux of PEII     -0.00000 I              I              I              I               I
I      I Vert.Flux of PEII      0.00000 I              I              I              I               I
I      I Work Pres.G.F  II              I      0.00015 I              I              I               I
I      I Conv. Ad.-Int. II     -0.00015 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux   II     -0.00006 I      0.00000 I     -0.00102 I      0.00000 I      0.00000  I
I    I Vertical Flux    II      0.00000 I      0.00000 I      0.00000 I      0.00000 I      0.00000  I
DDH--------------------------------------------------------------------------------------------------I
  
DDH----------------------------------------------------------------------------------------------------------------------------------
  I   - Mass balance    (10**(-6)  KG/M**2) 
  
  I INITIAL      I HORIZ. FLUX  I DYN. FLUX    I DYN. FLUX    I PHYS. FLUX   I PHYS. FLUX   I CURRENT      I I I RESIDUAL     I
  I MASS         I              I TOA          I SURFACE      I TOA          I SURFACE      I MASS         I I I              I
  ---------------------------------------------------------------------------------------------------------- I ----------------
  -              -              -              -              -              -              -              - I -              -
  - 10206523039. I          -0. .           0. .           0. .           0. .           0. I 10206523883. - I -         844. -
  -              -              -              -              -              -              -              - I -              -
  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.6181915859E-21      I       0.8805537604E-08      I
ICloud fractionI      0.0000000000E+00      I       0.2700494180E-01      I
I  Relat. Hum. I      0.1123026601E+00      I       0.1793770673E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.8604104661E+02      I
DDH------------------------------------------------------------------------
  
 15:56:40 STEP 1440 H= 360:00 +CPU= 36.177
 END CNT3
 NSTEP =  1440 CNT0   000000000  35.909  35.909  36.542   0.983               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN            0/           0
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1      3    0       34      1044068        0            0    18.7    18.7     0.0    19.9     0.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1   58790.7   58790.7    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1   36970.4   36970.4     62.88      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                    1    7373.2    7373.2     12.54      0.00
  10 SCAN2M - PHYSICS                                1   19705.6   19705.6     33.52      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  1     212.0     212.0      0.36      0.00
  28 RESTART FILES - READING                         1   21169.8   21169.8     36.01      0.00
  31 POSDDH IN STEPO                                 1      12.8      12.8      0.02      0.00
  37 CPGLAG   - SL COMPUTATIONS                      1    7138.3    7138.3     12.14      0.00
  39 SU0YOMB                                         1     398.7     398.7      0.68      0.00
  51 SCAN2M   - SL COMM. PART 1                      1      42.4      42.4      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  1       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM        4     295.7     295.7      2.01      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM         4     103.4     103.4      0.70      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      76.0      76.0      0.13      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION              4      35.6      35.6      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION              4     106.2     106.2      0.72      0.00
 400 GSTATS                                       1083       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                   963       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME       58.8 CPU TIME      41.5 VECTOR TIME       41.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY    35055.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/7/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/7/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211954/ICMSHh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0_r531458105_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1296900
16:00:12 (22518): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:17 1534455 22312204 oifs_43r3_bl_a3zj_2016092300_15_991_12211954_0 1,296,900 52,666 0.0406


©2024 cpdn.org