climateprediction.net home page
Task 22307620

Task 22307620

Name oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0
Workunit 12207446
Created 13 Feb 2023, 13:13:50 UTC
Sent 14 Feb 2023, 6:42:29 UTC
Report deadline 15 Apr 2023, 6:42:29 UTC
Received 15 Feb 2023, 6:53:26 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1478188
Run time 13 hours 49 min 13 sec
CPU time 13 hours 40 min 44 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,884.32 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,842.78 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
U= 31.427
  02:30:18 STEP 1051 H= 262:45 +CPU= 30.194
  02:30:49 STEP 1052 H= 263:00 +CPU= 30.782
  02:31:20 STEP 1053 H= 263:15 +CPU= 30.352
  02:31:50 STEP 1054 H= 263:30 +CPU= 29.944
  02:32:17 STEP 1055 H= 263:45 +CPU= 26.712
  02:32:55 STEP 1056 H= 264:00 +CPU= 37.452
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001044
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:33:24 STEP 1057 H= 264:15 +CPU= 28.790
  02:33:53 STEP 1058 H= 264:30 +CPU= 29.208
  02:34:24 STEP 1059 H= 264:45 +CPU= 30.162
  02:34:53 STEP 1060 H= 265:00 +CPU= 29.646
  02:35:25 STEP 1061 H= 265:15 +CPU= 31.222
  02:35:58 STEP 1062 H= 265:30 +CPU= 33.372
  02:36:31 STEP 1063 H= 265:45 +CPU= 32.128
  02:37:03 STEP 1064 H= 266:00 +CPU= 31.990
  02:37:31 STEP 1065 H= 266:15 +CPU= 27.882
  02:38:01 STEP 1066 H= 266:30 +CPU= 29.614
  02:38:28 STEP 1067 H= 266:45 +CPU= 27.014
  02:39:05 STEP 1068 H= 267:00 +CPU= 36.181
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001068
  02:39:33 STEP 1069 H= 267:15 +CPU= 27.712
  02:40:03 STEP 1070 H= 267:30 +CPU= 29.958
  02:40:32 STEP 1071 H= 267:45 +CPU= 29.307
  02:41:06 STEP 1072 H= 268:00 +CPU= 33.816
  02:41:35 STEP 1073 H= 268:15 +CPU= 28.750
  02:42:04 STEP 1074 H= 268:30 +CPU= 28.694
  02:42:36 STEP 1075 H= 268:45 +CPU= 31.488
  02:43:23 STEP 1076 H= 269:00 +CPU= 35.839
  02:44:02 STEP 1077 H= 269:15 +CPU= 34.870
  02:44:36 STEP 1078 H= 269:30 +CPU= 33.345
  02:45:09 STEP 1079 H= 269:45 +CPU= 32.916
  02:45:53 STEP 1080 H= 270:00 +CPU= 43.596
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001080
  02:46:25 STEP 1081 H= 270:15 +CPU= 31.899
  02:46:58 STEP 1082 H= 270:30 +CPU= 31.864
  02:47:32 STEP 1083 H= 270:45 +CPU= 33.936
  02:48:07 STEP 1084 H= 271:00 +CPU= 35.017
  02:48:41 STEP 1085 H= 271:15 +CPU= 33.770
  02:49:16 STEP 1086 H= 271:30 +CPU= 34.792
  02:49:50 STEP 1087 H= 271:45 +CPU= 33.507
  02:50:23 STEP 1088 H= 272:00 +CPU= 33.766
  02:50:57 STEP 1089 H= 272:15 +CPU= 33.340
  02:51:30 STEP 1090 H= 272:30 +CPU= 33.257
  02:52:05 STEP 1091 H= 272:45 +CPU= 34.448
  02:52:47 STEP 1092 H= 273:00 +CPU= 41.743
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001092
  02:53:20 STEP 1093 H= 273:15 +CPU= 32.401
  02:53:52 STEP 1094 H= 273:30 +CPU= 32.813
  02:54:25 STEP 1095 H= 273:45 +CPU= 32.144
  02:54:59 STEP 1096 H= 274:00 +CPU= 33.871
  02:55:30 STEP 1097 H= 274:15 +CPU= 31.425
  02:56:03 STEP 1098 H= 274:30 +CPU= 32.622
  02:56:34 STEP 1099 H= 274:45 +CPU= 29.905
  02:57:05 STEP 1100 H= 275:00 +CPU= 30.875
  02:57:38 STEP 1101 H= 275:15 +CPU= 33.401
  02:58:12 STEP 1102 H= 275:30 +CPU= 33.269
  02:58:46 STEP 1103 H= 275:45 +CPU= 33.831
  02:59:34 STEP 1104 H= 276:00 +CPU= 46.733
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001104
  03:00:07 STEP 1105 H= 276:15 +CPU= 33.577
  03:00:40 STEP 1106 H= 276:30 +CPU= 32.623
  03:01:15 STEP 1107 H= 276:45 +CPU= 35.054
  03:01:49 STEP 1108 H= 277:00 +CPU= 33.141
  03:02:21 STEP 1109 H= 277:15 +CPU= 31.922
  03:02:53 STEP 1110 H= 277:30 +CPU= 31.781
  03:03:26 STEP 1111 H= 277:45 +CPU= 33.374
  03:03:59 STEP 1112 H= 278:00 +CPU= 33.012
  03:04:35 STEP 1113 H= 278:15 +CPU= 35.086
  03:05:09 STEP 1114 H= 278:30 +CPU= 34.331
  03:05:44 STEP 1115 H= 278:45 +CPU= 34.460
  03:06:28 STEP 1116 H= 279:00 +CPU= 43.649
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001116
  03:07:02 STEP 1117 H= 279:15 +CPU= 33.168
  03:07:37 STEP 1118 H= 279:30 +CPU= 34.878
  03:08:13 STEP 1119 H= 279:45 +CPU= 35.712
  03:08:49 STEP 1120 H= 280:00 +CPU= 35.808
  03:09:22 STEP 1121 H= 280:15 +CPU= 32.650
  03:09:54 STEP 1122 H= 280:30 +CPU= 32.841
  03:10:29 STEP 1123 H= 280:45 +CPU= 33.899
  03:11:03 STEP 1124 H= 281:00 +CPU= 34.229
  03:11:37 STEP 1125 H= 281:15 +CPU= 34.243
  03:12:12 STEP 1126 H= 281:30 +CPU= 34.762
  03:12:48 STEP 1127 H= 281:45 +CPU= 35.075
  03:13:30 STEP 1128 H= 282:00 +CPU= 41.789
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001128
  03:14:02 STEP 1129 H= 282:15 +CPU= 32.762
  03:14:37 STEP 1130 H= 282:30 +CPU= 33.929
  03:15:11 STEP 1131 H= 282:45 +CPU= 34.777
  03:15:48 STEP 1132 H= 283:00 +CPU= 36.700
  03:16:23 STEP 1133 H= 283:15 +CPU= 34.172
  03:16:58 STEP 1134 H= 283:30 +CPU= 34.913
  03:17:34 STEP 1135 H= 283:45 +CPU= 35.755
  03:18:10 STEP 1136 H= 284:00 +CPU= 35.934
  03:18:43 STEP 1137 H= 284:15 +CPU= 33.143
  03:19:16 STEP 1138 H= 284:30 +CPU= 33.122
  03:19:51 STEP 1139 H= 284:45 +CPU= 34.553
  03:20:33 STEP 1140 H= 285:00 +CPU= 42.257
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001140
  03:21:05 STEP 1141 H= 285:15 +CPU= 31.062
  03:21:37 STEP 1142 H= 285:30 +CPU= 32.396
  03:22:11 STEP 1143 H= 285:45 +CPU= 33.560
  03:22:46 STEP 1144 H= 286:00 +CPU= 34.900
  03:23:19 STEP 1145 H= 286:15 +CPU= 33.131
  03:23:52 STEP 1146 H= 286:30 +CPU= 32.182
  03:24:26 STEP 1147 H= 286:45 +CPU= 33.853
  03:25:00 STEP 1148 H= 287:00 +CPU= 34.774
  03:25:34 STEP 1149 H= 287:15 +CPU= 33.146
  03:26:08 STEP 1150 H= 287:30 +CPU= 34.604
  03:26:41 STEP 1151 H= 287:45 +CPU= 32.629
  03:27:26 STEP 1152 H= 288:00 +CPU= 44.059
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001140
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:28:00 STEP 1153 H= 288:15 +CPU= 34.086
  03:28:33 STEP 1154 H= 288:30 +CPU= 32.870
  03:29:06 STEP 1155 H= 288:45 +CPU= 33.159
  03:29:39 STEP 1156 H= 289:00 +CPU= 32.616
  03:30:12 STEP 1157 H= 289:15 +CPU= 33.179
  03:30:46 STEP 1158 H= 289:30 +CPU= 33.305
  03:31:18 STEP 1159 H= 289:45 +CPU= 32.009
  03:31:50 STEP 1160 H= 290:00 +CPU= 32.376
  03:32:23 STEP 1161 H= 290:15 +CPU= 32.807
  03:32:55 STEP 1162 H= 290:30 +CPU= 31.909
  03:33:29 STEP 1163 H= 290:45 +CPU= 33.867
  03:34:12 STEP 1164 H= 291:00 +CPU= 42.842
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001164
  03:34:47 STEP 1165 H= 291:15 +CPU= 34.329
  03:35:20 STEP 1166 H= 291:30 +CPU= 33.204
  03:35:54 STEP 1167 H= 291:45 +CPU= 33.440
  03:36:27 STEP 1168 H= 292:00 +CPU= 32.873
  03:37:02 STEP 1169 H= 292:15 +CPU= 34.980
  03:37:35 STEP 1170 H= 292:30 +CPU= 33.061
  03:38:10 STEP 1171 H= 292:45 +CPU= 34.850
  03:38:46 STEP 1172 H= 293:00 +CPU= 35.268
  03:39:20 STEP 1173 H= 293:15 +CPU= 33.777
  03:39:54 STEP 1174 H= 293:30 +CPU= 34.051
  03:40:27 STEP 1175 H= 293:45 +CPU= 33.481
  03:41:08 STEP 1176 H= 294:00 +CPU= 40.044
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001176
  03:41:43 STEP 1177 H= 294:15 +CPU= 34.873
  03:42:16 STEP 1178 H= 294:30 +CPU= 33.203
  03:42:51 STEP 1179 H= 294:45 +CPU= 35.003
  03:43:26 STEP 1180 H= 295:00 +CPU= 34.237
  03:44:00 STEP 1181 H= 295:15 +CPU= 34.181
  03:44:33 STEP 1182 H= 295:30 +CPU= 33.149
  03:45:06 STEP 1183 H= 295:45 +CPU= 32.462
  03:45:39 STEP 1184 H= 296:00 +CPU= 32.637
  03:46:11 STEP 1185 H= 296:15 +CPU= 31.954
  03:46:43 STEP 1186 H= 296:30 +CPU= 31.707
  03:47:16 STEP 1187 H= 296:45 +CPU= 33.053
  03:47:58 STEP 1188 H= 297:00 +CPU= 42.147
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001188
  03:48:31 STEP 1189 H= 297:15 +CPU= 33.196
  03:49:05 STEP 1190 H= 297:30 +CPU= 33.869
  03:49:41 STEP 1191 H= 297:45 +CPU= 35.564
  03:50:16 STEP 1192 H= 298:00 +CPU= 34.909
  03:50:49 STEP 1193 H= 298:15 +CPU= 32.580
  03:51:21 STEP 1194 H= 298:30 +CPU= 32.035
  03:51:53 STEP 1195 H= 298:45 +CPU= 31.683
  03:52:24 STEP 1196 H= 299:00 +CPU= 30.674
  03:52:55 STEP 1197 H= 299:15 +CPU= 31.146
  03:53:26 STEP 1198 H= 299:30 +CPU= 31.304
  03:53:58 STEP 1199 H= 299:45 +CPU= 31.225
  03:54:42 STEP 1200 H= 300:00 +CPU= 43.978
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001200
  03:55:13 STEP 1201 H= 300:15 +CPU= 30.482
  03:55:46 STEP 1202 H= 300:30 +CPU= 32.937
  03:56:18 STEP 1203 H= 300:45 +CPU= 31.216
  03:56:51 STEP 1204 H= 301:00 +CPU= 33.115
  03:57:23 STEP 1205 H= 301:15 +CPU= 31.537
  03:57:55 STEP 1206 H= 301:30 +CPU= 31.938
  03:58:28 STEP 1207 H= 301:45 +CPU= 32.612
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01

I     I Cond. Ice       II      0.22279 I              I     -0.01021 I              I      0.01021  I
I     I Snow            II              I              I              I              I     -0.07860  I
I     I Sens. heat rain II      0.00000 I              I              I              I               I
I     I Sens. heat snow II      0.00000 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I PREC- Pot. and kin. E.II      0.00000 I      0.00000 I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I   Orographic drag     II      0.00000 I      0.00000 I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I      I Balance        II      0.00002 I              I              I              I               I
I ADIAB- of which       II              I              I              I              I               I
I      I Hor. Flux of PEII     -0.00000 I              I              I              I               I
I      I Vert.Flux of PEII      0.00000 I              I              I              I               I
I      I Work Pres.G.F  II              I      0.08295 I              I              I               I
I      I Conv. Ad.-Int. II     -0.08293 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux   II      0.00403 I     -0.00053 I      0.05330 I      0.00010 I      0.00004  I
I    I Vertical Flux    II      0.00000 I      0.00000 I      0.00000 I      0.00000 I      0.00000  I
DDH--------------------------------------------------------------------------------------------------I
  
DDH----------------------------------------------------------------------------------------------------------------------------------
  I   - Mass balance    (10**(-6)  KG/M**2) 
  
  I INITIAL      I HORIZ. FLUX  I DYN. FLUX    I DYN. FLUX    I PHYS. FLUX   I PHYS. FLUX   I CURRENT      I I I RESIDUAL     I
  I MASS         I              I TOA          I SURFACE      I TOA          I SURFACE      I MASS         I I I              I
  ---------------------------------------------------------------------------------------------------------- I ----------------
  -              -              -              -              -              -              -              - I -              -
  - 10206523039. I           0. .           0. .           0. .           0. .           0. I 10206613982. - I -       90942. -
  -              -              -              -              -              -              -              - I -              -
  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  300.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1127350843E-20      I       0.2311376077E-05      I
ICloud fractionI      0.0000000000E+00      I       0.9669903392E-02      I
I  Relat. Hum. I      0.3943685266E+00      I       0.4094349162E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1674749910E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1200 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001200 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001200
 MPI-TASK:   1 -    306852033 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS613704.1 Mbytes/s, TOTAL TIME=    0.0095( 5.3%)
 03:54:42 STEP 1200 H= 300:00 +CPU= 43.978
 NSTEP =  1201 STEPO   0AAA00AAA
 03:55:13 STEP 1201 H= 300:15 +CPU= 30.482
 NSTEP =  1202 STEPO   0AAA00AAA
 03:55:46 STEP 1202 H= 300:30 +CPU= 32.937
 NSTEP =  1203 STEPO   0AAA00AAA
 03:56:18 STEP 1203 H= 300:45 +CPU= 31.216
 NSTEP =  1204 STEPO   0AAA00AAA
 03:56:51 STEP 1204 H= 301:00 +CPU= 33.115
ISTEP=    1205 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1205 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1205 STEPO   0AAA00AAA
 03:57:23 STEP 1205 H= 301:15 +CPU= 31.537
 NSTEP =  1206 STEPO   0AAA00AAA
 03:57:55 STEP 1206 H= 301:30 +CPU= 31.938
 NSTEP =  1207 STEPO   0AAA00AAA
 03:58:28 STEP 1207 H= 301:45 +CPU= 32.612
 NSTEP =  1208 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 03:55:13 0AAA00AAA STEPO     1202    30.482   30.482   30.637    684:31   1230:27 0.74502213141351E-06       2GB       0MB
 03:55:46 0AAA00AAA STEPO     1203    32.937   32.937   33.228    685:04   1231:00 0.74502213141351E-06       2GB       0MB
 03:56:18 0AAA00AAA STEPO     1204    31.216   31.216   31.428    685:35   1231:32 0.74502213141351E-06       2GB       0MB
 03:56:51 0AAA00AAA STEPO     1205    33.115   33.115   33.331    686:08   1232:05 0.74502213141351E-06       2GB       0MB
 03:57:23 0AAA00AAA STEPO     1206    31.537   31.537   31.716    686:40   1232:37 0.74502213141351E-06       2GB       0MB
 03:57:55 0AAA00AAA STEPO     1207    31.939   31.939   32.157    687:12   1233:09 0.74502213141351E-06       2GB       0MB
 03:58:28 0AAA00AAA STEPO     1208    32.613   32.613   32.773    687:44   1233:42 0.74502213141351E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1200",
 CTIME   = "00121200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,        1188, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /data/boinc/boinc-client/slots/22/progress_file_12207446.xml

<running_values>
  <last_cpu_time>41275.670000</last_cpu_time>
  <upload_file_number>12</upload_file_number>
  <last_iter>1208</last_iter>
  <last_upload>1036800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0ib
(argv4) batchid: 991
(argv5) wuid: 12207446
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/22
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/22/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/22/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_65bde5706863fd889e98a228d4d8bc9f to: /data/boinc/boinc-client/slots/22/oifs_43r3_bl_a0ib_2016092300_15_991_12207446.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/22/oifs_43r3_bl_a0ib_2016092300_15_991_12207446.zip
ic_ancil_file: ic_ancil_12207446
ifsdata_file: ifsdata_12207446
climate_data_file: clim_data_12207446
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/22/ic_ancil_12207446.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/22/ic_ancil_12207446.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2dc478a743e4263135873924a90cb816 to: /data/boinc/boinc-client/slots/22/ifsdata/ifsdata_12207446.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/22/ifsdata/ifsdata_12207446.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/22/159l_2/clim_data_12207446.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/22/159l_2/clim_data_12207446.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/22/progress_file_12207446.xml
Opened progress file ok : /data/boinc/boinc-client/slots/22/progress_file_12207446.xml
-- Model is restarting --
Adjusting last_iter, 1208, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/22/progress_file_12207446.xml
last_cpu_time: 41275
upload_file_number: 12
last_iter: 1201
last_upload: 1036800
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127
The child process has been launched with process id: 165011
Executing the command: /data/boinc/boinc-client/slots/22/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165011:165011] [20230215:040123:1676433683:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  04:02:22 STEP 1200 H= 300:00 +CPU= 36.165
  04:02:58 STEP 1201 H= 300:15 +CPU= 35.306
  04:03:32 STEP 1202 H= 300:30 +CPU= 34.455
  04:04:07 STEP 1203 H= 300:45 +CPU= 34.992
  04:04:42 STEP 1204 H= 301:00 +CPU= 34.326
  04:05:16 STEP 1205 H= 301:15 +CPU= 33.637
  04:05:51 STEP 1206 H= 301:30 +CPU= 35.678
  04:06:25 STEP 1207 H= 301:45 +CPU= 33.463
  04:07:02 STEP 1208 H= 302:00 +CPU= 36.658
  04:07:27 STEP 1209 H= 302:15 +CPU= 25.071
  04:07:52 STEP 1210 H= 302:30 +CPU= 24.355
  04:08:16 STEP 1211 H= 302:45 +CPU= 24.657
  04:08:48 STEP 1212 H= 303:00 +CPU= 30.913
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001212
  04:09:13 STEP 1213 H= 303:15 +CPU= 24.584
  04:09:38 STEP 1214 H= 303:30 +CPU= 25.038
  04:10:03 STEP 1215 H= 303:45 +CPU= 24.859
  04:10:30 STEP 1216 H= 304:00 +CPU= 26.259
  04:10:55 STEP 1217 H= 304:15 +CPU= 25.029
  04:11:20 STEP 1218 H= 304:30 +CPU= 24.415
  04:11:44 STEP 1219 H= 304:45 +CPU= 24.204
  04:12:11 STEP 1220 H= 305:00 +CPU= 26.082
  04:12:36 STEP 1221 H= 305:15 +CPU= 24.833
  04:13:00 STEP 1222 H= 305:30 +CPU= 23.780
  04:13:25 STEP 1223 H= 305:45 +CPU= 24.896
  04:13:54 STEP 1224 H= 306:00 +CPU= 29.391
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001224
  04:14:19 STEP 1225 H= 306:15 +CPU= 24.380
  04:14:43 STEP 1226 H= 306:30 +CPU= 24.424
  04:15:08 STEP 1227 H= 306:45 +CPU= 24.219
  04:15:32 STEP 1228 H= 307:00 +CPU= 24.470
  04:15:56 STEP 1229 H= 307:15 +CPU= 24.046
  04:16:21 STEP 1230 H= 307:30 +CPU= 24.438
  04:16:45 STEP 1231 H= 307:45 +CPU= 24.533
  04:17:11 STEP 1232 H= 308:00 +CPU= 25.359
  04:17:35 STEP 1233 H= 308:15 +CPU= 24.440
  04:18:00 STEP 1234 H= 308:30 +CPU= 24.737
  04:18:24 STEP 1235 H= 308:45 +CPU= 23.420
  04:18:55 STEP 1236 H= 309:00 +CPU= 30.797
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001236
  04:19:20 STEP 1237 H= 309:15 +CPU= 25.181
  04:19:44 STEP 1238 H= 309:30 +CPU= 23.879
  04:20:09 STEP 1239 H= 309:45 +CPU= 24.447
  04:20:33 STEP 1240 H= 310:00 +CPU= 24.488
  04:20:57 STEP 1241 H= 310:15 +CPU= 24.166
  04:21:23 STEP 1242 H= 310:30 +CPU= 25.076
  04:21:47 STEP 1243 H= 310:45 +CPU= 24.164
  04:22:12 STEP 1244 H= 311:00 +CPU= 24.996
  04:22:37 STEP 1245 H= 311:15 +CPU= 25.091
  04:23:04 STEP 1246 H= 311:30 +CPU= 26.601
  04:23:38 STEP 1247 H= 311:45 +CPU= 33.641
  04:24:27 STEP 1248 H= 312:00 +CPU= 48.369
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127_12.zip
Uploading the intermediate file: upload_file_12.zip
  04:25:00 STEP 1249 H= 312:15 +CPU= 32.815
  04:25:34 STEP 1250 H= 312:30 +CPU= 33.687
  04:26:08 STEP 1251 H= 312:45 +CPU= 33.832
  04:26:42 STEP 1252 H= 313:00 +CPU= 33.834
  04:27:14 STEP 1253 H= 313:15 +CPU= 32.610
  04:27:49 STEP 1254 H= 313:30 +CPU= 34.139
  04:28:23 STEP 1255 H= 313:45 +CPU= 34.351
  04:28:57 STEP 1256 H= 314:00 +CPU= 33.167
  04:29:28 STEP 1257 H= 314:15 +CPU= 31.347
  04:30:03 STEP 1258 H= 314:30 +CPU= 34.407
  04:30:35 STEP 1259 H= 314:45 +CPU= 32.053
  04:31:17 STEP 1260 H= 315:00 +CPU= 41.849
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001260
  04:31:51 STEP 1261 H= 315:15 +CPU= 34.119
  04:32:24 STEP 1262 H= 315:30 +CPU= 33.067
  04:32:58 STEP 1263 H= 315:45 +CPU= 33.755
  04:33:33 STEP 1264 H= 316:00 +CPU= 35.003
  04:34:08 STEP 1265 H= 316:15 +CPU= 34.469
  04:34:42 STEP 1266 H= 316:30 +CPU= 34.022
  04:35:16 STEP 1267 H= 316:45 +CPU= 33.519
  04:35:51 STEP 1268 H= 317:00 +CPU= 34.439
  04:36:25 STEP 1269 H= 317:15 +CPU= 34.328
  04:37:00 STEP 1270 H= 317:30 +CPU= 34.341
  04:37:34 STEP 1271 H= 317:45 +CPU= 34.035
  04:38:19 STEP 1272 H= 318:00 +CPU= 45.037
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001272
  04:38:53 STEP 1273 H= 318:15 +CPU= 34.021
  04:39:26 STEP 1274 H= 318:30 +CPU= 32.949
  04:40:00 STEP 1275 H= 318:45 +CPU= 33.277
  04:40:33 STEP 1276 H= 319:00 +CPU= 32.745
  04:41:14 STEP 1277 H= 319:15 +CPU= 36.479
  04:41:47 STEP 1278 H= 319:30 +CPU= 32.996
  04:42:20 STEP 1279 H= 319:45 +CPU= 33.510
  04:42:55 STEP 1280 H= 320:00 +CPU= 34.109
  04:43:28 STEP 1281 H= 320:15 +CPU= 33.767
  04:44:01 STEP 1282 H= 320:30 +CPU= 32.466
  04:44:34 STEP 1283 H= 320:45 +CPU= 32.552
  04:45:17 STEP 1284 H= 321:00 +CPU= 42.938
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001284
  04:45:51 STEP 1285 H= 321:15 +CPU= 33.628
  04:46:26 STEP 1286 H= 321:30 +CPU= 34.915
  04:47:00 STEP 1287 H= 321:45 +CPU= 33.679
  04:47:34 STEP 1288 H= 322:00 +CPU= 33.888
  04:48:08 STEP 1289 H= 322:15 +CPU= 34.023
  04:48:42 STEP 1290 H= 322:30 +CPU= 34.216
  04:49:14 STEP 1291 H= 322:45 +CPU= 31.521
  04:49:47 STEP 1292 H= 323:00 +CPU= 33.129
  04:50:20 STEP 1293 H= 323:15 +CPU= 32.598
  04:50:55 STEP 1294 H= 323:30 +CPU= 34.391
  04:51:29 STEP 1295 H= 323:45 +CPU= 34.233
  04:52:17 STEP 1296 H= 324:00 +CPU= 47.541
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001296
  04:52:50 STEP 1297 H= 324:15 +CPU= 32.889
  04:53:23 STEP 1298 H= 324:30 +CPU= 32.332
  04:53:55 STEP 1299 H= 324:45 +CPU= 31.885
  04:54:26 STEP 1300 H= 325:00 +CPU= 31.602
  04:54:58 STEP 1301 H= 325:15 +CPU= 31.058
  04:55:31 STEP 1302 H= 325:30 +CPU= 33.339
  04:56:03 STEP 1303 H= 325:45 +CPU= 31.439
  04:56:35 STEP 1304 H= 326:00 +CPU= 32.439
  04:57:07 STEP 1305 H= 326:15 +CPU= 31.188
  04:57:38 STEP 1306 H= 326:30 +CPU= 31.183
  04:58:11 STEP 1307 H= 326:45 +CPU= 33.012
  04:58:53 STEP 1308 H= 327:00 +CPU= 41.634
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001308
  04:59:26 STEP 1309 H= 327:15 +CPU= 32.944
  04:59:58 STEP 1310 H= 327:30 +CPU= 31.384
  05:00:30 STEP 1311 H= 327:45 +CPU= 31.856
  05:01:02 STEP 1312 H= 328:00 +CPU= 31.679
  05:01:33 STEP 1313 H= 328:15 +CPU= 31.236
  05:02:06 STEP 1314 H= 328:30 +CPU= 33.112
  05:02:39 STEP 1315 H= 328:45 +CPU= 31.894
  05:03:10 STEP 1316 H= 329:00 +CPU= 31.743
  05:03:45 STEP 1317 H= 329:15 +CPU= 34.196
  05:04:18 STEP 1318 H= 329:30 +CPU= 32.726
  05:04:52 STEP 1319 H= 329:45 +CPU= 34.449
  05:05:35 STEP 1320 H= 330:00 +CPU= 42.908
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001320
  05:06:08 STEP 1321 H= 330:15 +CPU= 32.868
  05:06:40 STEP 1322 H= 330:30 +CPU= 31.545
  05:07:14 STEP 1323 H= 330:45 +CPU= 33.166
  05:07:48 STEP 1324 H= 331:00 +CPU= 34.427
  05:08:21 STEP 1325 H= 331:15 +CPU= 32.445
  05:08:54 STEP 1326 H= 331:30 +CPU= 32.770
  05:09:26 STEP 1327 H= 331:45 +CPU= 32.693
  05:10:01 STEP 1328 H= 332:00 +CPU= 34.002
  05:10:41 STEP 1329 H= 332:15 +CPU= 36.085
  05:11:15 STEP 1330 H= 332:30 +CPU= 33.953
  05:11:49 STEP 1331 H= 332:45 +CPU= 33.747
  05:12:32 STEP 1332 H= 333:00 +CPU= 42.313
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001332
  05:13:04 STEP 1333 H= 333:15 +CPU= 32.428
  05:13:40 STEP 1334 H= 333:30 +CPU= 35.151
  05:14:14 STEP 1335 H= 333:45 +CPU= 34.867
  05:14:49 STEP 1336 H= 334:00 +CPU= 34.318
  05:15:24 STEP 1337 H= 334:15 +CPU= 34.741
  05:15:59 STEP 1338 H= 334:30 +CPU= 34.766
  05:16:34 STEP 1339 H= 334:45 +CPU= 34.849
  05:17:07 STEP 1340 H= 335:00 +CPU= 33.110
  05:17:42 STEP 1341 H= 335:15 +CPU= 35.133
  05:18:16 STEP 1342 H= 335:30 +CPU= 34.090
  05:18:51 STEP 1343 H= 335:45 +CPU= 34.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:20:59 STEP 1344 H= 336:00 +CPU= 47.273
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127_13.zip
Uploading the intermediate file: upload_file_13.zip
  05:21:33 STEP 1345 H= 336:15 +CPU= 33.824
  05:22:06 STEP 1346 H= 336:30 +CPU= 33.427
  05:22:40 STEP 1347 H= 336:45 +CPU= 33.178
  05:23:14 STEP 1348 H= 337:00 +CPU= 33.869
  05:23:48 STEP 1349 H= 337:15 +CPU= 34.642
  05:24:24 STEP 1350 H= 337:30 +CPU= 35.951
  05:24:57 STEP 1351 H= 337:45 +CPU= 32.722
  05:25:31 STEP 1352 H= 338:00 +CPU= 33.294
  05:26:06 STEP 1353 H= 338:15 +CPU= 34.726
  05:26:41 STEP 1354 H= 338:30 +CPU= 35.030
  05:27:16 STEP 1355 H= 338:45 +CPU= 34.640
  05:27:59 STEP 1356 H= 339:00 +CPU= 42.887
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001356
  05:28:32 STEP 1357 H= 339:15 +CPU= 33.253
  05:29:08 STEP 1358 H= 339:30 +CPU= 35.422
  05:29:44 STEP 1359 H= 339:45 +CPU= 34.622
  05:30:19 STEP 1360 H= 340:00 +CPU= 34.759
  05:30:54 STEP 1361 H= 340:15 +CPU= 34.884
  05:31:28 STEP 1362 H= 340:30 +CPU= 33.537
  05:32:03 STEP 1363 H= 340:45 +CPU= 34.551
  05:32:40 STEP 1364 H= 341:00 +CPU= 36.029
  05:33:12 STEP 1365 H= 341:15 +CPU= 32.765
  05:33:46 STEP 1366 H= 341:30 +CPU= 33.602
  05:34:20 STEP 1367 H= 341:45 +CPU= 33.603
  05:35:02 STEP 1368 H= 342:00 +CPU= 41.560
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001368
  05:35:37 STEP 1369 H= 342:15 +CPU= 35.257
  05:36:12 STEP 1370 H= 342:30 +CPU= 34.270
  05:36:46 STEP 1371 H= 342:45 +CPU= 34.459
  05:37:21 STEP 1372 H= 343:00 +CPU= 34.436
  05:37:56 STEP 1373 H= 343:15 +CPU= 34.524
  05:38:29 STEP 1374 H= 343:30 +CPU= 32.809
  05:39:02 STEP 1375 H= 343:45 +CPU= 33.641
  05:39:37 STEP 1376 H= 344:00 +CPU= 34.776
  05:40:11 STEP 1377 H= 344:15 +CPU= 33.865
  05:40:45 STEP 1378 H= 344:30 +CPU= 33.681
  05:41:20 STEP 1379 H= 344:45 +CPU= 34.946
  05:42:04 STEP 1380 H= 345:00 +CPU= 43.688
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001380
  05:42:38 STEP 1381 H= 345:15 +CPU= 33.810
  05:43:12 STEP 1382 H= 345:30 +CPU= 33.959
  05:43:46 STEP 1383 H= 345:45 +CPU= 33.200
  05:44:19 STEP 1384 H= 346:00 +CPU= 33.636
  05:44:52 STEP 1385 H= 346:15 +CPU= 32.599
  05:45:25 STEP 1386 H= 346:30 +CPU= 32.901
  05:46:00 STEP 1387 H= 346:45 +CPU= 34.889
  05:46:36 STEP 1388 H= 347:00 +CPU= 35.531
  05:47:09 STEP 1389 H= 347:15 +CPU= 33.038
  05:47:41 STEP 1390 H= 347:30 +CPU= 32.243
  05:48:16 STEP 1391 H= 347:45 +CPU= 34.005
  05:49:03 STEP 1392 H= 348:00 +CPU= 47.024
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001392
  05:49:36 STEP 1393 H= 348:15 +CPU= 33.222
  05:50:10 STEP 1394 H= 348:30 +CPU= 33.279
  05:50:42 STEP 1395 H= 348:45 +CPU= 31.961
  05:51:17 STEP 1396 H= 349:00 +CPU= 34.377
  05:51:49 STEP 1397 H= 349:15 +CPU= 32.572
  05:52:22 STEP 1398 H= 349:30 +CPU= 32.804
  05:52:55 STEP 1399 H= 349:45 +CPU= 32.825
  05:53:27 STEP 1400 H= 350:00 +CPU= 31.759
  05:54:00 STEP 1401 H= 350:15 +CPU= 32.568
  05:54:33 STEP 1402 H= 350:30 +CPU= 32.644
  05:55:05 STEP 1403 H= 350:45 +CPU= 32.452
  05:55:48 STEP 1404 H= 351:00 +CPU= 42.531
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001404
  05:56:23 STEP 1405 H= 351:15 +CPU= 34.533
  05:56:56 STEP 1406 H= 351:30 +CPU= 33.284
  05:57:31 STEP 1407 H= 351:45 +CPU= 34.476
  05:58:04 STEP 1408 H= 352:00 +CPU= 33.652
  05:58:38 STEP 1409 H= 352:15 +CPU= 33.778
  05:59:14 STEP 1410 H= 352:30 +CPU= 35.085
  05:59:48 STEP 1411 H= 352:45 +CPU= 34.357
  06:00:23 STEP 1412 H= 353:00 +CPU= 34.653
  06:00:58 STEP 1413 H= 353:15 +CPU= 34.424
  06:01:31 STEP 1414 H= 353:30 +CPU= 33.112
  06:02:06 STEP 1415 H= 353:45 +CPU= 35.530
  06:02:49 STEP 1416 H= 354:00 +CPU= 41.955
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001416
  06:03:21 STEP 1417 H= 354:15 +CPU= 32.056
  06:03:56 STEP 1418 H= 354:30 +CPU= 34.766
  06:04:30 STEP 1419 H= 354:45 +CPU= 34.419
  06:05:05 STEP 1420 H= 355:00 +CPU= 34.589
  06:05:37 STEP 1421 H= 355:15 +CPU= 31.532
  06:06:11 STEP 1422 H= 355:30 +CPU= 34.498
  06:06:44 STEP 1423 H= 355:45 +CPU= 32.984
  06:07:19 STEP 1424 H= 356:00 +CPU= 34.799
  06:07:55 STEP 1425 H= 356:15 +CPU= 35.717
  06:08:29 STEP 1426 H= 356:30 +CPU= 33.618
  06:09:04 STEP 1427 H= 356:45 +CPU= 35.058
  06:09:46 STEP 1428 H= 357:00 +CPU= 41.877
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001428
  06:10:19 STEP 1429 H= 357:15 +CPU= 32.492
  06:10:53 STEP 1430 H= 357:30 +CPU= 33.803
  06:11:25 STEP 1431 H= 357:45 +CPU= 32.057
  06:11:59 STEP 1432 H= 358:00 +CPU= 33.904
  06:12:33 STEP 1433 H= 358:15 +CPU= 34.026
  06:13:07 STEP 1434 H= 358:30 +CPU= 33.047
  06:13:40 STEP 1435 H= 358:45 +CPU= 32.843
  06:14:13 STEP 1436 H= 359:00 +CPU= 33.209
  06:14:48 STEP 1437 H= 359:15 +CPU= 35.000
  06:15:23 STEP 1438 H= 359:30 +CPU= 34.592
  06:15:57 STEP 1439 H= 359:45 +CPU= 34.319
  06:16:40 STEP 1440 H= 360:00 +CPU= 42.157
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1127350843E-20      I       0.2569588541E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1370446770E-01      I
I  Relat. Hum. I      0.3943685266E+00      I       0.4142900065E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2406882574E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313137073 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS521895.1 Mbytes/s, TOTAL TIME=    0.0166( 3.6%)
 06:16:40 STEP 1440 H= 360:00 +CPU= 42.157
 END CNT3
 NSTEP =  1440 CNT0   000000000  30.546  30.546  30.737   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN         7090/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    128    0       34      1044068     7090 ************    38.0    19.6    18.3    20.9   114.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 8117203.7 8117203.7    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 8094381.7 8094381.7     99.72      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  261    5631.1    5631.1     18.11      0.00
   9 SPCM     - SPECTRAL COMP.                     240     871.3     871.3      2.58      0.00
  10 SCAN2M - PHYSICS                              241   14958.4   14958.4     44.41      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 20    5204.4    5204.4      1.28      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 11      53.2      53.2      0.01      0.00
  17 GRIDFPOS IN CNT4                               20      32.3      32.3      0.01      0.00
  27 RESTART FILES - WRITING                         5   20793.5   20793.5      1.28      0.00
  28 RESTART FILES - READING                         1   21941.1   21941.1      0.27      0.00
  29 SU4FPOS IN CNT4                                20       2.1       2.1      0.00      0.00
  30 DYNFPOS IN CNT4                                20    7326.5    7326.5      1.81      0.00
  31 POSDDH IN STEPO                                 2       9.0       9.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    241    7492.0    7492.0     22.24      0.00
  39 SU0YOMB                                         1     464.5     464.5      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    241      24.4      24.4      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              240     332.9     332.9      0.98      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              240      72.3      72.3      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 11      25.8      25.8      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      524     546.0     546.0      3.52      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       500     294.0     294.0      1.81      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        500     108.4     108.4      0.67      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       524     145.2     145.2      0.94      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      51.5      51.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            524      77.9      77.9      0.50      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            500      38.0      38.0      0.23      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            524      70.0      70.0      0.45      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            500      19.7      19.7      0.12      0.00
 400 GSTATS                                      28768       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 26718       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     8117.2 CPU TIME    7969.2 VECTOR TIME     7969.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      160.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/22/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/slots/22/NODE.001_01
Adding to the zip: /data/boinc/boinc-client/slots/22/ifs.stat
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMGGh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207446/ICMSHh7zg+001344
Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0_r1749936127_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
06:20:14 (164996): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:34 1478188 22307620 oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0 1,295,100 49,244 0.0380
09 May 2023 16:51:30 1478188 22307620 oifs_43r3_bl_a0ib_2016092300_15_991_12207446_0 864,000 33,338 0.0386


©2024 cpdn.org