climateprediction.net home page
Task 22312547

Task 22312547

Name oifs_43r3_bl_a48u_2016092300_15_991_12212289_0
Workunit 12212289
Created 13 Feb 2023, 22:08:14 UTC
Sent 14 Feb 2023, 6:42:29 UTC
Report deadline 15 Apr 2023, 6:42:29 UTC
Received 15 Feb 2023, 6:53:26 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1478188
Run time 13 hours 53 min 22 sec
CPU time 13 hours 40 min 21 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,827.05 MB
Peak swap size 5,930.79 MB
Peak disk usage 2,089.71 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
ects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001044
  02:36:04 STEP 1045 H= 261:15 +CPU= 33.748
  02:36:35 STEP 1046 H= 261:30 +CPU= 30.802
  02:37:06 STEP 1047 H= 261:45 +CPU= 30.870
  02:37:35 STEP 1048 H= 262:00 +CPU= 28.729
  02:38:05 STEP 1049 H= 262:15 +CPU= 29.966
  02:38:33 STEP 1050 H= 262:30 +CPU= 27.425
  02:39:03 STEP 1051 H= 262:45 +CPU= 30.189
  02:39:32 STEP 1052 H= 263:00 +CPU= 28.655
  02:40:01 STEP 1053 H= 263:15 +CPU= 28.749
  02:40:31 STEP 1054 H= 263:30 +CPU= 29.765
  02:41:05 STEP 1055 H= 263:45 +CPU= 33.344
  02:41:45 STEP 1056 H= 264:00 +CPU= 39.763
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001044
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:42:15 STEP 1057 H= 264:15 +CPU= 29.699
  02:42:46 STEP 1058 H= 264:30 +CPU= 30.246
  02:43:19 STEP 1059 H= 264:45 +CPU= 28.920
  02:43:57 STEP 1060 H= 265:00 +CPU= 34.127
  02:44:30 STEP 1061 H= 265:15 +CPU= 32.855
  02:45:05 STEP 1062 H= 265:30 +CPU= 34.782
  02:45:39 STEP 1063 H= 265:45 +CPU= 33.436
  02:46:13 STEP 1064 H= 266:00 +CPU= 33.839
  02:46:44 STEP 1065 H= 266:15 +CPU= 31.221
  02:47:16 STEP 1066 H= 266:30 +CPU= 31.659
  02:47:48 STEP 1067 H= 266:45 +CPU= 32.082
  02:48:33 STEP 1068 H= 267:00 +CPU= 43.469
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001068
  02:49:08 STEP 1069 H= 267:15 +CPU= 35.175
  02:49:41 STEP 1070 H= 267:30 +CPU= 33.284
  02:50:15 STEP 1071 H= 267:45 +CPU= 33.740
  02:50:52 STEP 1072 H= 268:00 +CPU= 36.018
  02:51:25 STEP 1073 H= 268:15 +CPU= 33.718
  02:51:59 STEP 1074 H= 268:30 +CPU= 33.892
  02:52:33 STEP 1075 H= 268:45 +CPU= 33.103
  02:53:06 STEP 1076 H= 269:00 +CPU= 33.662
  02:53:39 STEP 1077 H= 269:15 +CPU= 32.700
  02:54:12 STEP 1078 H= 269:30 +CPU= 32.389
  02:54:46 STEP 1079 H= 269:45 +CPU= 34.310
  02:55:26 STEP 1080 H= 270:00 +CPU= 39.335
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001080
  02:55:59 STEP 1081 H= 270:15 +CPU= 33.391
  02:56:30 STEP 1082 H= 270:30 +CPU= 29.916
  02:57:02 STEP 1083 H= 270:45 +CPU= 32.384
  02:57:37 STEP 1084 H= 271:00 +CPU= 34.121
  02:58:08 STEP 1085 H= 271:15 +CPU= 31.295
  02:58:41 STEP 1086 H= 271:30 +CPU= 32.673
  02:59:14 STEP 1087 H= 271:45 +CPU= 32.925
  02:59:49 STEP 1088 H= 272:00 +CPU= 35.277
  03:00:22 STEP 1089 H= 272:15 +CPU= 32.481
  03:00:56 STEP 1090 H= 272:30 +CPU= 34.021
  03:01:30 STEP 1091 H= 272:45 +CPU= 33.553
  03:02:13 STEP 1092 H= 273:00 +CPU= 42.263
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001092
  03:02:47 STEP 1093 H= 273:15 +CPU= 33.756
  03:03:19 STEP 1094 H= 273:30 +CPU= 32.173
  03:03:54 STEP 1095 H= 273:45 +CPU= 34.963
  03:04:28 STEP 1096 H= 274:00 +CPU= 34.075
  03:05:03 STEP 1097 H= 274:15 +CPU= 34.698
  03:05:38 STEP 1098 H= 274:30 +CPU= 34.457
  03:06:12 STEP 1099 H= 274:45 +CPU= 34.431
  03:06:46 STEP 1100 H= 275:00 +CPU= 34.050
  03:07:20 STEP 1101 H= 275:15 +CPU= 33.154
  03:07:56 STEP 1102 H= 275:30 +CPU= 35.921
  03:08:31 STEP 1103 H= 275:45 +CPU= 35.237
  03:09:19 STEP 1104 H= 276:00 +CPU= 47.035
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001104
  03:09:51 STEP 1105 H= 276:15 +CPU= 31.479
  03:10:24 STEP 1106 H= 276:30 +CPU= 33.361
  03:10:58 STEP 1107 H= 276:45 +CPU= 34.100
  03:11:33 STEP 1108 H= 277:00 +CPU= 34.107
  03:12:07 STEP 1109 H= 277:15 +CPU= 34.161
  03:12:42 STEP 1110 H= 277:30 +CPU= 34.976
  03:13:15 STEP 1111 H= 277:45 +CPU= 33.301
  03:13:49 STEP 1112 H= 278:00 +CPU= 33.266
  03:14:22 STEP 1113 H= 278:15 +CPU= 32.837
  03:14:56 STEP 1114 H= 278:30 +CPU= 34.051
  03:15:31 STEP 1115 H= 278:45 +CPU= 34.289
  03:16:13 STEP 1116 H= 279:00 +CPU= 42.720
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001116
  03:16:48 STEP 1117 H= 279:15 +CPU= 34.882
  03:17:24 STEP 1118 H= 279:30 +CPU= 35.370
  03:17:58 STEP 1119 H= 279:45 +CPU= 33.539
  03:18:31 STEP 1120 H= 280:00 +CPU= 33.387
  03:19:04 STEP 1121 H= 280:15 +CPU= 33.169
  03:19:39 STEP 1122 H= 280:30 +CPU= 34.745
  03:20:14 STEP 1123 H= 280:45 +CPU= 34.210
  03:20:48 STEP 1124 H= 281:00 +CPU= 34.121
  03:21:19 STEP 1125 H= 281:15 +CPU= 30.986
  03:21:54 STEP 1126 H= 281:30 +CPU= 34.757
  03:22:27 STEP 1127 H= 281:45 +CPU= 32.690
  03:23:10 STEP 1128 H= 282:00 +CPU= 43.007
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001128
  03:23:45 STEP 1129 H= 282:15 +CPU= 34.785
  03:24:19 STEP 1130 H= 282:30 +CPU= 33.514
  03:24:52 STEP 1131 H= 282:45 +CPU= 33.056
  03:25:26 STEP 1132 H= 283:00 +CPU= 33.801
  03:25:59 STEP 1133 H= 283:15 +CPU= 33.372
  03:26:32 STEP 1134 H= 283:30 +CPU= 32.654
  03:27:05 STEP 1135 H= 283:45 +CPU= 32.796
  03:27:39 STEP 1136 H= 284:00 +CPU= 33.402
  03:28:13 STEP 1137 H= 284:15 +CPU= 34.674
  03:28:46 STEP 1138 H= 284:30 +CPU= 32.604
  03:29:18 STEP 1139 H= 284:45 +CPU= 31.963
  03:29:59 STEP 1140 H= 285:00 +CPU= 40.358
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001140
  03:30:34 STEP 1141 H= 285:15 +CPU= 34.583
  03:31:07 STEP 1142 H= 285:30 +CPU= 33.177
  03:31:40 STEP 1143 H= 285:45 +CPU= 32.985
  03:32:14 STEP 1144 H= 286:00 +CPU= 33.879
  03:32:47 STEP 1145 H= 286:15 +CPU= 32.402
  03:33:22 STEP 1146 H= 286:30 +CPU= 35.197
  03:33:57 STEP 1147 H= 286:45 +CPU= 34.442
  03:34:31 STEP 1148 H= 287:00 +CPU= 34.072
  03:35:05 STEP 1149 H= 287:15 +CPU= 33.967
  03:35:39 STEP 1150 H= 287:30 +CPU= 34.000
  03:36:12 STEP 1151 H= 287:45 +CPU= 32.708
  03:36:59 STEP 1152 H= 288:00 +CPU= 46.357
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001140
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:37:31 STEP 1153 H= 288:15 +CPU= 31.771
  03:38:03 STEP 1154 H= 288:30 +CPU= 32.684
  03:38:38 STEP 1155 H= 288:45 +CPU= 34.211
  03:39:10 STEP 1156 H= 289:00 +CPU= 32.457
  03:39:45 STEP 1157 H= 289:15 +CPU= 34.387
  03:40:19 STEP 1158 H= 289:30 +CPU= 34.130
  03:40:53 STEP 1159 H= 289:45 +CPU= 34.108
  03:41:29 STEP 1160 H= 290:00 +CPU= 35.195
  03:42:01 STEP 1161 H= 290:15 +CPU= 32.401
  03:42:36 STEP 1162 H= 290:30 +CPU= 34.201
  03:43:11 STEP 1163 H= 290:45 +CPU= 35.042
  03:43:55 STEP 1164 H= 291:00 +CPU= 44.238
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001164
  03:44:29 STEP 1165 H= 291:15 +CPU= 33.711
  03:45:01 STEP 1166 H= 291:30 +CPU= 31.970
  03:45:34 STEP 1167 H= 291:45 +CPU= 33.053
  03:46:08 STEP 1168 H= 292:00 +CPU= 33.667
  03:46:41 STEP 1169 H= 292:15 +CPU= 32.370
  03:47:14 STEP 1170 H= 292:30 +CPU= 32.779
  03:47:47 STEP 1171 H= 292:45 +CPU= 33.406
  03:48:22 STEP 1172 H= 293:00 +CPU= 34.266
  03:48:55 STEP 1173 H= 293:15 +CPU= 33.548
  03:49:29 STEP 1174 H= 293:30 +CPU= 33.832
  03:50:05 STEP 1175 H= 293:45 +CPU= 35.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:57:52 STEP 1176 H= 294:00 +CPU= 42.098
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001176
  03:58:23 STEP 1177 H= 294:15 +CPU= 31.334
  03:58:56 STEP 1178 H= 294:30 +CPU= 31.981
  03:59:26 STEP 1179 H= 294:45 +CPU= 30.602
  04:00:01 STEP 1180 H= 295:00 +CPU= 33.673
  04:00:38 STEP 1181 H= 295:15 +CPU= 34.887
  04:01:11 STEP 1182 H= 295:30 +CPU= 33.168
  04:01:46 STEP 1183 H= 295:45 +CPU= 34.173
  04:02:21 STEP 1184 H= 296:00 +CPU= 35.183
  04:02:56 STEP 1185 H= 296:15 +CPU= 34.899
  04:03:30 STEP 1186 H= 296:30 +CPU= 33.536
  04:04:07 STEP 1187 H= 296:45 +CPU= 36.719
  04:04:50 STEP 1188 H= 297:00 +CPU= 42.481
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001188
  04:05:22 STEP 1189 H= 297:15 +CPU= 32.520
  04:05:58 STEP 1190 H= 297:30 +CPU= 35.374
  04:06:32 STEP 1191 H= 297:45 +CPU= 34.444
  04:07:07 STEP 1192 H= 298:00 +CPU= 34.577
  04:07:32 STEP 1193 H= 298:15 +CPU= 24.692
  04:07:57 STEP 1194 H= 298:30 +CPU= 24.644
  04:08:22 STEP 1195 H= 298:45 +CPU= 24.767
  04:08:49 STEP 1196 H= 299:00 +CPU= 26.756
  04:09:14 STEP 1197 H= 299:15 +CPU= 24.849
  04:09:40 STEP 1198 H= 299:30 +CPU= 25.437
  04:10:05 STEP 1199 H= 299:45 +CPU= 25.364
  04:10:41 STEP 1200 H= 300:00 +CPU= 35.436
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001200
  04:11:07 STEP 1201 H= 300:15 +CPU= 25.513
  04:11:32 STEP 1202 H= 300:30 +CPU= 24.425
  04:11:57 STEP 1203 H= 300:45 +CPU= 25.433
  04:12:24 STEP 1204 H= 301:00 +CPU= 25.978
  04:12:48 STEP 1205 H= 301:15 +CPU= 24.036
  04:13:12 STEP 1206 H= 301:30 +CPU= 24.437
  04:13:37 STEP 1207 H= 301:45 +CPU= 24.355
  04:14:02 STEP 1208 H= 302:00 +CPU= 24.460
  04:14:26 STEP 1209 H= 302:15 +CPU= 24.475
  04:14:51 STEP 1210 H= 302:30 +CPU= 24.511
  04:15:15 STEP 1211 H= 302:45 +CPU= 24.476
  04:15:46 STEP 1212 H= 303:00 +CPU= 30.416
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001212
  04:16:10 STEP 1213 H= 303:15 +CPU= 24.344
  04:16:34 STEP 1214 H= 303:30 +CPU= 24.045
  04:16:59 STEP 1215 H= 303:45 +CPU= 24.427
  04:17:24 STEP 1216 H= 304:00 +CPU= 24.937
  04:17:49 STEP 1217 H= 304:15 +CPU= 24.437
  04:18:14 STEP 1218 H= 304:30 +CPU= 25.028
  04:18:39 STEP 1219 H= 304:45 +CPU= 24.656
  04:19:03 STEP 1220 H= 305:00 +CPU= 24.714
  04:19:28 STEP 1221 H= 305:15 +CPU= 24.521
  04:19:52 STEP 1222 H= 305:30 +CPU= 24.136
  04:20:17 STEP 1223 H= 305:45 +CPU= 24.389
  04:20:47 STEP 1224 H= 306:00 +CPU= 30.342
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001224
  04:21:12 STEP 1225 H= 306:15 +CPU= 24.396
  04:21:37 STEP 1226 H= 306:30 +CPU= 25.237
  04:22:02 STEP 1227 H= 306:45 +CPU= 24.676
  04:22:26 STEP 1228 H= 307:00 +CPU= 24.573
  04:22:51 STEP 1229 H= 307:15 +CPU= 24.286
  04:23:22 STEP 1230 H= 307:30 +CPU= 30.924
  04:23:56 STEP 1231 H= 307:45 +CPU= 34.191
  04:24:31 STEP 1232 H= 308:00 +CPU= 34.220
  04:25:04 STEP 1233 H= 308:15 +CPU= 32.719
  04:25:37 STEP 1234 H= 308:30 +CPU= 32.858
  04:26:10 STEP 1235 H= 308:45 +CPU= 33.584
  04:26:52 STEP 1236 H= 309:00 +CPU= 41.034
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001236
  04:27:26 STEP 1237 H= 309:15 +CPU= 34.696
  04:28:02 STEP 1238 H= 309:30 +CPU= 35.865
  04:28:37 STEP 1239 H= 309:45 +CPU= 34.208
  04:29:11 STEP 1240 H= 310:00 +CPU= 33.567
  04:29:44 STEP 1241 H= 310:15 +CPU= 33.716
  04:30:17 STEP 1242 H= 310:30 +CPU= 32.212
  04:30:50 STEP 1243 H= 310:45 +CPU= 33.399
  04:31:25 STEP 1244 H= 311:00 +CPU= 34.386
  04:32:00 STEP 1245 H= 311:15 +CPU= 34.917
  04:32:34 STEP 1246 H= 311:30 +CPU= 34.322
  04:33:10 STEP 1247 H= 311:45 +CPU= 35.407
  04:33:59 STEP 1248 H= 312:00 +CPU= 48.481
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182_12.zip
Uploading the intermediate file: upload_file_12.zip
  04:34:33 STEP 1249 H= 312:15 +CPU= 33.417
  04:35:07 STEP 1250 H= 312:30 +CPU= 34.469
  04:35:41 STEP 1251 H= 312:45 +CPU= 34.108
  04:36:15 STEP 1252 H= 313:00 +CPU= 33.700
  04:36:49 STEP 1253 H= 313:15 +CPU= 33.871
  04:37:23 STEP 1254 H= 313:30 +CPU= 33.921
  04:37:56 STEP 1255 H= 313:45 +CPU= 32.613
  04:38:31 STEP 1256 H= 314:00 +CPU= 34.508
  04:39:04 STEP 1257 H= 314:15 +CPU= 33.451
  04:39:37 STEP 1258 H= 314:30 +CPU= 32.795
  04:40:08 STEP 1259 H= 314:45 +CPU= 30.859
  04:40:54 STEP 1260 H= 315:00 +CPU= 42.998
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001260
  04:41:31 STEP 1261 H= 315:15 +CPU= 34.131
  04:42:05 STEP 1262 H= 315:30 +CPU= 34.143
  04:42:37 STEP 1263 H= 315:45 +CPU= 31.928
  04:43:12 STEP 1264 H= 316:00 +CPU= 35.122
  04:43:46 STEP 1265 H= 316:15 +CPU= 34.064
  04:44:19 STEP 1266 H= 316:30 +CPU= 32.674
  04:44:54 STEP 1267 H= 316:45 +CPU= 34.842
  04:45:29 STEP 1268 H= 317:00 +CPU= 34.745
  04:46:05 STEP 1269 H= 317:15 +CPU= 36.187
  04:46:39 STEP 1270 H= 317:30 +CPU= 33.146
  04:47:13 STEP 1271 H= 317:45 +CPU= 33.917
  04:47:56 STEP 1272 H= 318:00 +CPU= 42.610
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001272
  04:48:30 STEP 1273 H= 318:15 +CPU= 33.990
  04:49:03 STEP 1274 H= 318:30 +CPU= 32.791
  04:49:35 STEP 1275 H= 318:45 +CPU= 32.107
  04:50:10 STEP 1276 H= 319:00 +CPU= 34.681
  04:50:42 STEP 1277 H= 319:15 +CPU= 32.129
  04:51:17 STEP 1278 H= 319:30 +CPU= 34.519
  04:51:52 STEP 1279 H= 319:45 +CPU= 34.849
  04:52:26 STEP 1280 H= 320:00 +CPU= 33.979
  04:52:58 STEP 1281 H= 320:15 +CPU= 31.495
  04:53:28 STEP 1282 H= 320:30 +CPU= 30.813
  04:53:59 STEP 1283 H= 320:45 +CPU= 30.880
  04:54:37 STEP 1284 H= 321:00 +CPU= 37.747
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001284
  04:55:10 STEP 1285 H= 321:15 +CPU= 32.680
  04:55:42 STEP 1286 H= 321:30 +CPU= 31.577
  04:56:13 STEP 1287 H= 321:45 +CPU= 30.726
  04:56:47 STEP 1288 H= 322:00 +CPU= 33.754
  04:57:18 STEP 1289 H= 322:15 +CPU= 31.240
  04:57:51 STEP 1290 H= 322:30 +CPU= 32.247
  04:58:23 STEP 1291 H= 322:45 +CPU= 32.511
  04:58:57 STEP 1292 H= 323:00 +CPU= 33.348
  04:59:29 STEP 1293 H= 323:15 +CPU= 31.916
  05:00:02 STEP 1294 H= 323:30 +CPU= 32.713
  05:00:35 STEP 1295 H= 323:45 +CPU= 32.631
  05:01:20 STEP 1296 H= 324:00 +CPU= 43.317
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001296
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.126914271826180E-07 0.000000000000000E+00 0.375793921715228E-04
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.999632163265240E-09 0.000000000000000E+00 0.648456518296447E-04
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.597926646894659E-09 0.000000000000000E+00 0.128944708201000E-04
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.751816841077311E-01 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.633124667044996E-07 0.000000000000000E+00 0.325377871802633E-03
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.126991484396556E-07 0.000000000000000E+00 0.373675773295036E-04
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.752030315134495E-01 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.255380816950668E-08 0.000000000000000E+00 0.581386818481896E-04
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.909034617050707E-09 0.000000000000000E+00 0.485016847145371E-04
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.693194594373190E-08 0.000000000000000E+00 0.138939330281872E-03
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.608123764981086E-09 0.000000000000000E+00 0.648892740121303E-04
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.148804295222246E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1296 STEPO   F00000000
 CREATE RESTART FILE ./srf00131200.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00131200.0001 MODE=w
 IO-STREAM CLOSED - ./srf00131200.0001
 MPI-TASK:   1 - ************ BYTES IN     34 RECORDS TRANSFERRED IN    3.5828 SECONDS******** Mbytes/s, TOTAL TIME=    5.9749(60.0%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00130000.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1296 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001296 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+001296
 MPI-TASK:   1 -    318367674 BYTES IN      6 RECORDS TRANSFERRED IN    0.0014 SECONDS227405.5 Mbytes/s, TOTAL TIME=    0.0147( 9.5%)
 NSTEP =  1296 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+001296 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+001296
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0131 SECONDS 54027.9 Mbytes/s, TOTAL TIME=    0.2906( 4.5%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001296 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001296
 MPI-TASK:   1 -   5093882775 BYTES IN    125 RECORDS TRANSFERRED IN    0.0085 SECONDS599280.3 Mbytes/s, TOTAL TIME=    0.2698( 3.2%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001296 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001296
 MPI-TASK:   1 -    309794041 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0062( 3.2%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001296 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001296
 MPI-TASK:   1 -    318367674 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0058( 5.2%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =  1296 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1296 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001296 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001296
 MPI-TASK:   1 -    318367665 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS636735.3 Mbytes/s, TOTAL TIME=    0.0112( 4.5%)
 05:01:20 STEP 1296 H= 324:00 +CPU= 43.317
 NSTEP =  1297 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 05:00:35 F00000000 STEPO     1296    32.847   32.847   32.997    311:42    356:26 0.16419618749055E-06       2GB       0MB
 05:00:42 0AA000000 STEPO     1296     4.945    4.945    6.803    311:47    356:32 0.16419618749055E-06       2GB       0MB
 05:00:44 FULLPOS-B DYNFPOS   1296     1.962    1.962    1.972    311:49    356:34 0.16419618749055E-06       2GB       0MB
 05:00:48 FULLPOS-V DYNFPOS   1296     4.029    4.029    4.061    311:53    356:38 0.16419618749055E-06       2GB       0MB
 05:00:49 FULLPOS-T DYNFPOS   1296     0.761    0.761    0.766    311:54    356:39 0.16419618749055E-06       2GB       0MB
 05:00:49 0AAA00AAA STEPO     1296     0.523    0.523    0.525    311:55    356:40 0.16419618749055E-06       2GB       0MB
 05:01:20 0AAA00AAA STEPO     1297    30.882   30.882   31.029    312:26    357:11 0.16419618749055E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1296",
 CTIME   = "00131200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,        1284, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /data/boinc/boinc-client/slots/25/progress_file_12212289.xml

<running_values>
  <last_cpu_time>44197.460000</last_cpu_time>
  <upload_file_number>13</upload_file_number>
  <last_iter>1297</last_iter>
  <last_upload>1123200</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a48u
(argv4) batchid: 991
(argv5) wuid: 12212289
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/25
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/25/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/25/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_edc2561ee4e656946b388547a067e2c7 to: /data/boinc/boinc-client/slots/25/oifs_43r3_bl_a48u_2016092300_15_991_12212289.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/25/oifs_43r3_bl_a48u_2016092300_15_991_12212289.zip
ic_ancil_file: ic_ancil_12212289
ifsdata_file: ifsdata_12212289
climate_data_file: clim_data_12212289
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/25/ic_ancil_12212289.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/25/ic_ancil_12212289.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_929947b2ef95ae1077cac839688457ad to: /data/boinc/boinc-client/slots/25/ifsdata/ifsdata_12212289.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/25/ifsdata/ifsdata_12212289.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/25/159l_2/clim_data_12212289.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/25/159l_2/clim_data_12212289.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/25/progress_file_12212289.xml
Opened progress file ok : /data/boinc/boinc-client/slots/25/progress_file_12212289.xml
-- Model is restarting --
Adjusting last_iter, 1297, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/25/progress_file_12212289.xml
last_cpu_time: 44197
upload_file_number: 13
last_iter: 1297
last_upload: 1123200
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182
The child process has been launched with process id: 165885
Executing the command: /data/boinc/boinc-client/slots/25/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:165885:165885] [20230215:050325:1676437405:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:04:05 STEP 1296 H= 324:00 +CPU= 34.872
  05:04:40 STEP 1297 H= 324:15 +CPU= 34.776
  05:05:15 STEP 1298 H= 324:30 +CPU= 34.771
  05:05:48 STEP 1299 H= 324:45 +CPU= 33.123
  05:06:21 STEP 1300 H= 325:00 +CPU= 32.939
  05:06:54 STEP 1301 H= 325:15 +CPU= 32.716
  05:07:27 STEP 1302 H= 325:30 +CPU= 32.761
  05:07:59 STEP 1303 H= 325:45 +CPU= 31.873
  05:08:31 STEP 1304 H= 326:00 +CPU= 31.286
  05:09:04 STEP 1305 H= 326:15 +CPU= 32.985
  05:09:36 STEP 1306 H= 326:30 +CPU= 32.703
  05:10:14 STEP 1307 H= 326:45 +CPU= 34.805
  05:11:04 STEP 1308 H= 327:00 +CPU= 45.193
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001308
  05:11:36 STEP 1309 H= 327:15 +CPU= 32.482
  05:12:11 STEP 1310 H= 327:30 +CPU= 34.881
  05:12:45 STEP 1311 H= 327:45 +CPU= 33.478
  05:13:20 STEP 1312 H= 328:00 +CPU= 35.191
  05:13:55 STEP 1313 H= 328:15 +CPU= 34.783
  05:14:30 STEP 1314 H= 328:30 +CPU= 35.385
  05:15:04 STEP 1315 H= 328:45 +CPU= 33.482
  05:15:40 STEP 1316 H= 329:00 +CPU= 36.097
  05:16:15 STEP 1317 H= 329:15 +CPU= 34.551
  05:16:49 STEP 1318 H= 329:30 +CPU= 34.422
  05:17:24 STEP 1319 H= 329:45 +CPU= 34.133
  05:18:06 STEP 1320 H= 330:00 +CPU= 42.445
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001320
  05:18:39 STEP 1321 H= 330:15 +CPU= 32.372
  05:19:11 STEP 1322 H= 330:30 +CPU= 32.128
  05:19:45 STEP 1323 H= 330:45 +CPU= 33.964
  05:20:21 STEP 1324 H= 331:00 +CPU= 34.986
  05:20:53 STEP 1325 H= 331:15 +CPU= 32.398
  05:21:28 STEP 1326 H= 331:30 +CPU= 34.442
  05:22:01 STEP 1327 H= 331:45 +CPU= 33.204
  05:22:36 STEP 1328 H= 332:00 +CPU= 34.303
  05:23:09 STEP 1329 H= 332:15 +CPU= 33.369
  05:23:43 STEP 1330 H= 332:30 +CPU= 34.145
  05:24:18 STEP 1331 H= 332:45 +CPU= 34.662
  05:25:03 STEP 1332 H= 333:00 +CPU= 43.961
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001332
  05:25:37 STEP 1333 H= 333:15 +CPU= 34.648
  05:26:13 STEP 1334 H= 333:30 +CPU= 35.298
  05:26:49 STEP 1335 H= 333:45 +CPU= 35.888
  05:27:25 STEP 1336 H= 334:00 +CPU= 35.460
  05:27:59 STEP 1337 H= 334:15 +CPU= 34.051
  05:28:34 STEP 1338 H= 334:30 +CPU= 34.972
  05:29:08 STEP 1339 H= 334:45 +CPU= 34.134
  05:29:46 STEP 1340 H= 335:00 +CPU= 36.029
  05:30:22 STEP 1341 H= 335:15 +CPU= 35.292
  05:30:55 STEP 1342 H= 335:30 +CPU= 33.420
  05:31:28 STEP 1343 H= 335:45 +CPU= 32.791
  05:32:18 STEP 1344 H= 336:00 +CPU= 46.409
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182_13.zip
Uploading the intermediate file: upload_file_13.zip
  05:32:53 STEP 1345 H= 336:15 +CPU= 34.255
  05:33:26 STEP 1346 H= 336:30 +CPU= 33.541
  05:34:00 STEP 1347 H= 336:45 +CPU= 33.109
  05:34:33 STEP 1348 H= 337:00 +CPU= 33.407
  05:35:09 STEP 1349 H= 337:15 +CPU= 35.206
  05:35:44 STEP 1350 H= 337:30 +CPU= 35.040
  05:36:19 STEP 1351 H= 337:45 +CPU= 34.902
  05:36:53 STEP 1352 H= 338:00 +CPU= 34.112
  05:37:27 STEP 1353 H= 338:15 +CPU= 33.365
  05:38:01 STEP 1354 H= 338:30 +CPU= 34.427
  05:38:36 STEP 1355 H= 338:45 +CPU= 34.924
  05:39:17 STEP 1356 H= 339:00 +CPU= 40.532
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001356
  05:39:50 STEP 1357 H= 339:15 +CPU= 32.346
  05:40:22 STEP 1358 H= 339:30 +CPU= 32.666
  05:40:57 STEP 1359 H= 339:45 +CPU= 33.927
  05:41:32 STEP 1360 H= 340:00 +CPU= 35.293
  05:42:09 STEP 1361 H= 340:15 +CPU= 36.800
  05:42:44 STEP 1362 H= 340:30 +CPU= 34.986
  05:43:17 STEP 1363 H= 340:45 +CPU= 32.934
  05:43:52 STEP 1364 H= 341:00 +CPU= 34.674
  05:44:26 STEP 1365 H= 341:15 +CPU= 33.810
  05:45:01 STEP 1366 H= 341:30 +CPU= 35.055
  05:45:36 STEP 1367 H= 341:45 +CPU= 34.907
  05:46:21 STEP 1368 H= 342:00 +CPU= 44.320
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001368
  05:46:55 STEP 1369 H= 342:15 +CPU= 34.236
  05:47:28 STEP 1370 H= 342:30 +CPU= 32.444
  05:48:01 STEP 1371 H= 342:45 +CPU= 33.138
  05:48:35 STEP 1372 H= 343:00 +CPU= 33.878
  05:49:09 STEP 1373 H= 343:15 +CPU= 33.748
  05:49:41 STEP 1374 H= 343:30 +CPU= 32.303
  05:50:15 STEP 1375 H= 343:45 +CPU= 33.479
  05:50:48 STEP 1376 H= 344:00 +CPU= 33.128
  05:51:22 STEP 1377 H= 344:15 +CPU= 33.778
  05:51:54 STEP 1378 H= 344:30 +CPU= 31.239
  05:52:26 STEP 1379 H= 344:45 +CPU= 32.328
  05:53:06 STEP 1380 H= 345:00 +CPU= 39.639
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001380
  05:53:37 STEP 1381 H= 345:15 +CPU= 30.919
  05:54:10 STEP 1382 H= 345:30 +CPU= 33.132
  05:54:43 STEP 1383 H= 345:45 +CPU= 32.802
  05:55:17 STEP 1384 H= 346:00 +CPU= 33.332
  05:55:50 STEP 1385 H= 346:15 +CPU= 32.751
  05:56:23 STEP 1386 H= 346:30 +CPU= 33.720
  05:56:57 STEP 1387 H= 346:45 +CPU= 33.291
  05:57:32 STEP 1388 H= 347:00 +CPU= 34.793
  05:58:07 STEP 1389 H= 347:15 +CPU= 35.237
  05:58:42 STEP 1390 H= 347:30 +CPU= 34.795
  05:59:17 STEP 1391 H= 347:45 +CPU= 35.011
  06:00:04 STEP 1392 H= 348:00 +CPU= 46.439
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001392
  06:00:38 STEP 1393 H= 348:15 +CPU= 34.318
  06:01:12 STEP 1394 H= 348:30 +CPU= 33.471
  06:01:47 STEP 1395 H= 348:45 +CPU= 34.546
  06:02:22 STEP 1396 H= 349:00 +CPU= 35.016
  06:02:57 STEP 1397 H= 349:15 +CPU= 34.711
  06:03:33 STEP 1398 H= 349:30 +CPU= 35.517
  06:04:06 STEP 1399 H= 349:45 +CPU= 33.453
  06:04:39 STEP 1400 H= 350:00 +CPU= 32.974
  06:05:12 STEP 1401 H= 350:15 +CPU= 32.970
  06:05:46 STEP 1402 H= 350:30 +CPU= 33.566
  06:06:20 STEP 1403 H= 350:45 +CPU= 33.994
  06:07:05 STEP 1404 H= 351:00 +CPU= 44.587
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001404
  06:07:41 STEP 1405 H= 351:15 +CPU= 35.691
  06:08:15 STEP 1406 H= 351:30 +CPU= 33.572
  06:08:51 STEP 1407 H= 351:45 +CPU= 36.473
  06:09:28 STEP 1408 H= 352:00 +CPU= 36.946
  06:10:03 STEP 1409 H= 352:15 +CPU= 34.060
  06:10:37 STEP 1410 H= 352:30 +CPU= 33.879
  06:11:11 STEP 1411 H= 352:45 +CPU= 34.525
  06:11:45 STEP 1412 H= 353:00 +CPU= 34.062
  06:12:19 STEP 1413 H= 353:15 +CPU= 33.141
  06:12:52 STEP 1414 H= 353:30 +CPU= 33.569
  06:13:25 STEP 1415 H= 353:45 +CPU= 32.836
  06:14:08 STEP 1416 H= 354:00 +CPU= 42.224
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001416
  06:14:42 STEP 1417 H= 354:15 +CPU= 34.349
  06:15:14 STEP 1418 H= 354:30 +CPU= 31.849
  06:15:51 STEP 1419 H= 354:45 +CPU= 36.245
  06:16:24 STEP 1420 H= 355:00 +CPU= 32.718
  06:16:54 STEP 1421 H= 355:15 +CPU= 30.760
  06:17:27 STEP 1422 H= 355:30 +CPU= 31.954
  06:18:00 STEP 1423 H= 355:45 +CPU= 33.047
  06:18:33 STEP 1424 H= 356:00 +CPU= 33.104
  06:19:07 STEP 1425 H= 356:15 +CPU= 33.404
  06:19:40 STEP 1426 H= 356:30 +CPU= 33.650
  06:20:12 STEP 1427 H= 356:45 +CPU= 31.343
  06:20:54 STEP 1428 H= 357:00 +CPU= 42.059
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001428
  06:21:27 STEP 1429 H= 357:15 +CPU= 32.975
  06:22:01 STEP 1430 H= 357:30 +CPU= 33.724
  06:22:35 STEP 1431 H= 357:45 +CPU= 33.639
  06:23:06 STEP 1432 H= 358:00 +CPU= 30.597
  06:23:36 STEP 1433 H= 358:15 +CPU= 30.658
  06:24:09 STEP 1434 H= 358:30 +CPU= 32.296
  06:24:41 STEP 1435 H= 358:45 +CPU= 31.955
  06:25:17 STEP 1436 H= 359:00 +CPU= 35.574
  06:25:51 STEP 1437 H= 359:15 +CPU= 34.126
  06:26:25 STEP 1438 H= 359:30 +CPU= 33.369
  06:27:00 STEP 1439 H= 359:45 +CPU= 35.302
  06:27:45 STEP 1440 H= 360:00 +CPU= 44.561
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1092070545E-20      I       0.3060392889E-06      I
ICloud fractionI      0.0000000000E+00      I       0.8036266311E-02      I
I  Relat. Hum. I      0.3868366427E+00      I       0.4087027369E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5253182467E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    318735329 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS455336.2 Mbytes/s, TOTAL TIME=    0.0142( 4.9%)
 06:27:45 STEP 1440 H= 360:00 +CPU= 44.561
 END CNT3
 NSTEP =  1440 CNT0   000000000  32.064  32.064  32.221   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN         4254/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     78    0       34      1044068     4254 ************    12.2     1.9    10.3     3.0    23.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 5059472.9 5059472.9    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 5054681.1 5054681.1     99.91      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  157    5827.1    5827.1     18.08      0.00
   9 SPCM     - SPECTRAL COMP.                     144     904.8     904.8      2.58      0.00
  10 SCAN2M - PHYSICS                              145   15847.9   15847.9     45.42      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 12    1348.4    1348.4      0.32      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  7      48.4      48.4      0.01      0.00
  17 GRIDFPOS IN CNT4                               12      34.6      34.6      0.01      0.00
  27 RESTART FILES - WRITING                         3    5388.2    5388.2      0.32      0.00
  28 RESTART FILES - READING                         1    3959.6    3959.6      0.08      0.00
  29 SU4FPOS IN CNT4                                12       4.3       4.3      0.00      0.00
  30 DYNFPOS IN CNT4                                12    7809.5    7809.5      1.85      0.00
  31 POSDDH IN STEPO                                 1      21.0      21.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    145    7758.5    7758.5     22.24      0.00
  39 SU0YOMB                                         1     460.3     460.3      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    145      23.8      23.8      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              144     332.4     332.4      0.95      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              144      73.5      73.5      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  7       3.0       3.0      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      316     571.8     571.8      3.57      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       300     313.2     313.2      1.86      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        300     110.9     110.9      0.66      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       316     154.1     154.1      0.96      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      63.8      63.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            316      81.5      81.5      0.51      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            300      38.5      38.5      0.23      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            316      76.5      76.5      0.48      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            300      21.5      21.5      0.13      0.00
 400 GSTATS                                      17691       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 16413       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     5059.5 CPU TIME    5024.7 VECTOR TIME     5024.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      256.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/25/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/slots/25/NODE.001_01
Adding to the zip: /data/boinc/boinc-client/slots/25/ifs.stat
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMGGh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212289/ICMSHh7zg+001344
Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a48u_2016092300_15_991_12212289_0_r252337182_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
06:31:21 (165867): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:34 1478188 22312547 oifs_43r3_bl_a48u_2016092300_15_991_12212289_0 1,295,100 49,221 0.0380


©2024 cpdn.org