Name | oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0 |
Workunit | 12283255 |
Created | 7 Jun 2024, 12:54:49 UTC |
Sent | 7 Jun 2024, 13:04:44 UTC |
Report deadline | 6 Aug 2024, 13:04:44 UTC |
Received | 12 Jun 2024, 22:03:55 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 0 (0x00000000) |
Computer ID | 1478188 |
Run time | 14 hours 15 min 31 sec |
CPU time | 14 hours 15 min 31 sec |
Validate state | Invalid |
Credit | 1,976.32 |
Device peak FLOPS | 4.22 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,013.32 MB |
Peak swap size | 5,980.80 MB |
Peak disk usage | 1,599.59 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <stderr_txt> ifs_43r3_bl_12283255/ICMGGh7zg+001032 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001032 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001032 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001044 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001044 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001044 Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_10.zip Uploading the intermediate file: upload_file_10.zip 19:07:35 STEP 1057 H= 264:15 +CPU= 33.026 19:08:08 STEP 1058 H= 264:30 +CPU= 32.595 19:08:41 STEP 1059 H= 264:45 +CPU= 32.800 19:09:15 STEP 1060 H= 265:00 +CPU= 32.667 19:09:48 STEP 1061 H= 265:15 +CPU= 32.528 19:10:21 STEP 1062 H= 265:30 +CPU= 32.336 19:10:54 STEP 1063 H= 265:45 +CPU= 32.497 19:11:28 STEP 1064 H= 266:00 +CPU= 33.520 19:12:02 STEP 1065 H= 266:15 +CPU= 32.932 19:12:35 STEP 1066 H= 266:30 +CPU= 32.177 19:13:08 STEP 1067 H= 266:45 +CPU= 32.980 19:13:50 STEP 1068 H= 267:00 +CPU= 41.169 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001068 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001068 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001068 19:14:23 STEP 1069 H= 267:15 +CPU= 32.194 19:14:56 STEP 1070 H= 267:30 +CPU= 32.529 19:15:29 STEP 1071 H= 267:45 +CPU= 32.492 19:16:04 STEP 1072 H= 268:00 +CPU= 33.612 19:16:37 STEP 1073 H= 268:15 +CPU= 32.730 19:17:10 STEP 1074 H= 268:30 +CPU= 32.684 19:17:44 STEP 1075 H= 268:45 +CPU= 32.533 19:18:18 STEP 1076 H= 269:00 +CPU= 33.639 19:18:52 STEP 1077 H= 269:15 +CPU= 32.831 19:19:25 STEP 1078 H= 269:30 +CPU= 31.988 19:19:58 STEP 1079 H= 269:45 +CPU= 32.345 19:20:39 STEP 1080 H= 270:00 +CPU= 40.424 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001080 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001080 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001080 19:21:12 STEP 1081 H= 270:15 +CPU= 32.397 19:21:46 STEP 1082 H= 270:30 +CPU= 32.675 19:22:19 STEP 1083 H= 270:45 +CPU= 32.262 19:22:53 STEP 1084 H= 271:00 +CPU= 33.805 19:23:26 STEP 1085 H= 271:15 +CPU= 32.503 19:24:00 STEP 1086 H= 271:30 +CPU= 32.740 19:24:34 STEP 1087 H= 271:45 +CPU= 32.717 19:25:08 STEP 1088 H= 272:00 +CPU= 33.365 19:25:42 STEP 1089 H= 272:15 +CPU= 32.808 19:26:15 STEP 1090 H= 272:30 +CPU= 32.199 19:26:48 STEP 1091 H= 272:45 +CPU= 32.774 19:27:30 STEP 1092 H= 273:00 +CPU= 40.834 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001092 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001092 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001092 19:28:04 STEP 1093 H= 273:15 +CPU= 32.866 19:28:37 STEP 1094 H= 273:30 +CPU= 32.650 19:29:11 STEP 1095 H= 273:45 +CPU= 32.615 19:29:45 STEP 1096 H= 274:00 +CPU= 33.696 19:30:19 STEP 1097 H= 274:15 +CPU= 32.870 19:30:52 STEP 1098 H= 274:30 +CPU= 32.641 19:31:25 STEP 1099 H= 274:45 +CPU= 32.646 19:32:00 STEP 1100 H= 275:00 +CPU= 33.794 19:32:33 STEP 1101 H= 275:15 +CPU= 32.791 19:33:07 STEP 1102 H= 275:30 +CPU= 32.694 19:33:40 STEP 1103 H= 275:45 +CPU= 32.697 19:34:26 STEP 1104 H= 276:00 +CPU= 45.549 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001104 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001104 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001104 19:35:00 STEP 1105 H= 276:15 +CPU= 32.881 19:35:33 STEP 1106 H= 276:30 +CPU= 32.742 19:36:06 STEP 1107 H= 276:45 +CPU= 32.213 19:36:40 STEP 1108 H= 277:00 +CPU= 33.166 19:37:13 STEP 1109 H= 277:15 +CPU= 32.365 19:37:46 STEP 1110 H= 277:30 +CPU= 32.563 19:38:19 STEP 1111 H= 277:45 +CPU= 32.195 19:38:53 STEP 1112 H= 278:00 +CPU= 33.373 19:39:27 STEP 1113 H= 278:15 +CPU= 33.218 19:40:00 STEP 1114 H= 278:30 +CPU= 32.510 19:40:33 STEP 1115 H= 278:45 +CPU= 32.397 19:41:15 STEP 1116 H= 279:00 +CPU= 40.591 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001116 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001116 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001116 19:41:48 STEP 1117 H= 279:15 +CPU= 32.119 19:42:22 STEP 1118 H= 279:30 +CPU= 33.183 19:42:55 STEP 1119 H= 279:45 +CPU= 32.806 19:43:29 STEP 1120 H= 280:00 +CPU= 33.231 19:44:02 STEP 1121 H= 280:15 +CPU= 32.509 19:44:36 STEP 1122 H= 280:30 +CPU= 32.756 19:45:09 STEP 1123 H= 280:45 +CPU= 32.448 19:45:43 STEP 1124 H= 281:00 +CPU= 33.560 19:46:17 STEP 1125 H= 281:15 +CPU= 32.962 19:46:50 STEP 1126 H= 281:30 +CPU= 32.372 19:47:23 STEP 1127 H= 281:45 +CPU= 32.213 19:48:05 STEP 1128 H= 282:00 +CPU= 40.745 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001128 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001128 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001128 19:48:38 STEP 1129 H= 282:15 +CPU= 32.646 19:49:11 STEP 1130 H= 282:30 +CPU= 32.234 19:49:44 STEP 1131 H= 282:45 +CPU= 32.882 19:50:19 STEP 1132 H= 283:00 +CPU= 33.451 19:50:52 STEP 1133 H= 283:15 +CPU= 33.154 19:51:25 STEP 1134 H= 283:30 +CPU= 31.993 19:51:58 STEP 1135 H= 283:45 +CPU= 32.272 19:52:32 STEP 1136 H= 284:00 +CPU= 33.304 19:53:06 STEP 1137 H= 284:15 +CPU= 32.588 19:53:39 STEP 1138 H= 284:30 +CPU= 32.646 19:54:13 STEP 1139 H= 284:45 +CPU= 32.601 19:54:55 STEP 1140 H= 285:00 +CPU= 40.756 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001140 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001140 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001140 19:55:28 STEP 1141 H= 285:15 +CPU= 32.769 19:56:02 STEP 1142 H= 285:30 +CPU= 32.729 19:56:36 STEP 1143 H= 285:45 +CPU= 33.108 19:57:10 STEP 1144 H= 286:00 +CPU= 33.238 19:57:43 STEP 1145 H= 286:15 +CPU= 32.771 19:58:17 STEP 1146 H= 286:30 +CPU= 32.959 19:58:50 STEP 1147 H= 286:45 +CPU= 32.814 19:59:24 STEP 1148 H= 287:00 +CPU= 32.918 19:59:57 STEP 1149 H= 287:15 +CPU= 32.576 20:00:30 STEP 1150 H= 287:30 +CPU= 32.125 20:01:03 STEP 1151 H= 287:45 +CPU= 32.789 20:01:50 STEP 1152 H= 288:00 +CPU= 45.659 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001152 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001152 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001152 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001056 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001056 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001056 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001068 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001068 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001068 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001080 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001080 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001080 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001092 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001092 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001092 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001104 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001104 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001104 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001116 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001116 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001116 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001128 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001128 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001128 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001140 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001140 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001140 Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_11.zip Uploading the intermediate file: upload_file_11.zip 20:02:23 STEP 1153 H= 288:15 +CPU= 32.605 20:02:56 STEP 1154 H= 288:30 +CPU= 32.376 20:03:29 STEP 1155 H= 288:45 +CPU= 32.377 20:04:02 STEP 1156 H= 289:00 +CPU= 32.796 20:04:35 STEP 1157 H= 289:15 +CPU= 32.210 20:05:08 STEP 1158 H= 289:30 +CPU= 31.910 20:05:41 STEP 1159 H= 289:45 +CPU= 32.807 20:06:15 STEP 1160 H= 290:00 +CPU= 33.129 20:06:48 STEP 1161 H= 290:15 +CPU= 32.492 20:07:21 STEP 1162 H= 290:30 +CPU= 32.702 20:07:54 STEP 1163 H= 290:45 +CPU= 31.955 20:08:35 STEP 1164 H= 291:00 +CPU= 40.624 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001164 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001164 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001164 20:09:08 STEP 1165 H= 291:15 +CPU= 31.941 20:09:41 STEP 1166 H= 291:30 +CPU= 32.653 Suspend request received from the BOINC client, suspending the child process Resuming the child process 20:15:26 STEP 1167 H= 291:45 +CPU= 32.563 Suspend request received from the BOINC client, suspending the child process Resuming the child process 20:29:41 STEP 1168 H= 292:00 +CPU= 33.200 20:30:15 STEP 1169 H= 292:15 +CPU= 32.869 20:30:52 STEP 1170 H= 292:30 +CPU= 32.602 20:31:26 STEP 1171 H= 292:45 +CPU= 33.169 20:32:00 STEP 1172 H= 293:00 +CPU= 33.467 20:32:34 STEP 1173 H= 293:15 +CPU= 32.954 20:33:08 STEP 1174 H= 293:30 +CPU= 32.493 20:33:40 STEP 1175 H= 293:45 +CPU= 31.864 20:34:21 STEP 1176 H= 294:00 +CPU= 40.119 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001176 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001176 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001176 20:34:54 STEP 1177 H= 294:15 +CPU= 32.626 20:35:28 STEP 1178 H= 294:30 +CPU= 32.986 20:36:01 STEP 1179 H= 294:45 +CPU= 32.185 20:36:34 STEP 1180 H= 295:00 +CPU= 33.042 20:37:08 STEP 1181 H= 295:15 +CPU= 32.778 20:37:41 STEP 1182 H= 295:30 +CPU= 32.438 20:38:14 STEP 1183 H= 295:45 +CPU= 32.598 20:38:47 STEP 1184 H= 296:00 +CPU= 32.688 20:39:21 STEP 1185 H= 296:15 +CPU= 32.402 20:39:54 STEP 1186 H= 296:30 +CPU= 32.689 20:40:27 STEP 1187 H= 296:45 +CPU= 32.424 20:41:09 STEP 1188 H= 297:00 +CPU= 41.044 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001188 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001188 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001188 20:41:42 STEP 1189 H= 297:15 +CPU= 32.284 20:42:15 STEP 1190 H= 297:30 +CPU= 32.565 20:42:48 STEP 1191 H= 297:45 +CPU= 32.449 20:43:22 STEP 1192 H= 298:00 +CPU= 33.494 20:43:56 STEP 1193 H= 298:15 +CPU= 32.848 20:44:29 STEP 1194 H= 298:30 +CPU= 32.399 20:45:02 STEP 1195 H= 298:45 +CPU= 32.610 20:45:36 STEP 1196 H= 299:00 +CPU= 33.107 20:46:09 STEP 1197 H= 299:15 +CPU= 32.435 20:46:42 STEP 1198 H= 299:30 +CPU= 32.479 20:47:15 STEP 1199 H= 299:45 +CPU= 32.070 20:48:01 STEP 1200 H= 300:00 +CPU= 44.941 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001200 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001200 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001200 20:48:34 STEP 1201 H= 300:15 +CPU= 32.497 20:49:07 STEP 1202 H= 300:30 +CPU= 32.585 20:49:41 STEP 1203 H= 300:45 +CPU= 32.603 20:50:15 STEP 1204 H= 301:00 +CPU= 33.590 20:50:48 STEP 1205 H= 301:15 +CPU= 32.552 20:51:22 STEP 1206 H= 301:30 +CPU= 32.370 20:51:55 STEP 1207 H= 301:45 +CPU= 32.547 20:52:29 STEP 1208 H= 302:00 +CPU= 32.773 20:53:02 STEP 1209 H= 302:15 +CPU= 32.467 20:53:36 STEP 1210 H= 302:30 +CPU= 33.137 20:54:09 STEP 1211 H= 302:45 +CPU= 32.757 20:54:51 STEP 1212 H= 303:00 +CPU= 40.571 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001212 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001212 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001212 20:55:24 STEP 1213 H= 303:15 +CPU= 32.529 20:55:57 STEP 1214 H= 303:30 +CPU= 32.224 20:56:30 STEP 1215 H= 303:45 +CPU= 31.979 20:57:03 STEP 1216 H= 304:00 +CPU= 32.072 20:57:36 STEP 1217 H= 304:15 +CPU= 31.794 20:58:08 STEP 1218 H= 304:30 +CPU= 31.396 20:58:40 STEP 1219 H= 304:45 +CPU= 31.020 20:59:12 STEP 1220 H= 305:00 +CPU= 31.797 20:59:45 STEP 1221 H= 305:15 +CPU= 31.436 21:00:18 STEP 1222 H= 305:30 +CPU= 32.300 21:00:50 STEP 1223 H= 305:45 +CPU= 31.566 21:01:31 STEP 1224 H= 306:00 +CPU= 40.544 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001224 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001224 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001224 21:02:04 STEP 1225 H= 306:15 +CPU= 32.251 21:02:37 STEP 1226 H= 306:30 +CPU= 32.083 21:03:10 STEP 1227 H= 306:45 +CPU= 31.972 21:03:43 STEP 1228 H= 307:00 +CPU= 32.786 21:04:16 STEP 1229 H= 307:15 +CPU= 32.770 21:04:49 STEP 1230 H= 307:30 +CPU= 32.000 21:05:21 STEP 1231 H= 307:45 +CPU= 31.973 21:05:55 STEP 1232 H= 308:00 +CPU= 32.861 21:06:28 STEP 1233 H= 308:15 +CPU= 32.269 21:07:00 STEP 1234 H= 308:30 +CPU= 31.685 Suspend request received from the BOINC client, suspending the child process Resuming the child process 21:09:33 STEP 1235 H= 308:45 +CPU= 31.555 21:10:14 STEP 1236 H= 309:00 +CPU= 40.067 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001236 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001236 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001236 21:10:46 STEP 1237 H= 309:15 +CPU= 31.617 21:11:19 STEP 1238 H= 309:30 +CPU= 31.974 21:11:52 STEP 1239 H= 309:45 +CPU= 32.046 21:12:25 STEP 1240 H= 310:00 +CPU= 32.781 21:12:57 STEP 1241 H= 310:15 +CPU= 31.504 21:13:30 STEP 1242 H= 310:30 +CPU= 32.464 21:14:03 STEP 1243 H= 310:45 +CPU= 32.435 21:14:36 STEP 1244 H= 311:00 +CPU= 32.372 21:15:08 STEP 1245 H= 311:15 +CPU= 32.168 21:15:41 STEP 1246 H= 311:30 +CPU= 31.931 21:16:13 STEP 1247 H= 311:45 +CPU= 31.975 21:16:58 STEP 1248 H= 312:00 +CPU= 44.051 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001248 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001248 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001248 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001152 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001152 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001152 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001164 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001164 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001164 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001176 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001176 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001176 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001188 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001188 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001188 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001200 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001200 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001200 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001212 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001212 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001212 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001224 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001224 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001224 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001236 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001236 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001236 Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_12.zip Uploading the intermediate file: upload_file_12.zip 21:17:31 STEP 1249 H= 312:15 +CPU= 32.225 21:18:03 STEP 1250 H= 312:30 +CPU= 31.907 21:18:35 STEP 1251 H= 312:45 +CPU= 31.980 21:19:09 STEP 1252 H= 313:00 +CPU= 32.788 21:19:41 STEP 1253 H= 313:15 +CPU= 31.904 21:20:13 STEP 1254 H= 313:30 +CPU= 31.706 21:20:46 STEP 1255 H= 313:45 +CPU= 32.422 21:21:19 STEP 1256 H= 314:00 +CPU= 32.079 21:21:50 STEP 1257 H= 314:15 +CPU= 31.391 21:22:23 STEP 1258 H= 314:30 +CPU= 32.003 21:22:56 STEP 1259 H= 314:45 +CPU= 32.264 21:23:36 STEP 1260 H= 315:00 +CPU= 40.063 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001260 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001260 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001260 21:24:09 STEP 1261 H= 315:15 +CPU= 31.644 21:24:41 STEP 1262 H= 315:30 +CPU= 31.573 21:25:13 STEP 1263 H= 315:45 +CPU= 31.923 21:25:45 STEP 1264 H= 316:00 +CPU= 31.441 21:26:16 STEP 1265 H= 316:15 +CPU= 31.119 21:26:47 STEP 1266 H= 316:30 +CPU= 30.367 21:27:18 STEP 1267 H= 316:45 +CPU= 30.336 21:27:50 STEP 1268 H= 317:00 +CPU= 31.650 21:28:22 STEP 1269 H= 317:15 +CPU= 30.710 21:28:53 STEP 1270 H= 317:30 +CPU= 30.941 21:29:25 STEP 1271 H= 317:45 +CPU= 31.380 21:30:05 STEP 1272 H= 318:00 +CPU= 39.214 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001272 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001272 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001272 Suspend request received from the BOINC client, suspending the child process [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.563] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3958MB (heap), 4792MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.585] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.588] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.588] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.588] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.588] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 4792 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.588] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.590] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CLOUD_LAYER [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CLOUDSC [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230732:1718143652:55126.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CUADJTQ [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230733:1718143653:55127.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:20279:20279] [20240611:230733:1718143653:55127.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1 forrtl: error (78): process killed (SIGTERM) Image PC Routine Line Source oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown oifs_43r3_model.e 00000000011041F2 cuadjtq_ 296 cuadjtq.F90 oifs_43r3_model.e 000000000116D0DE cloudsc_ 1522 cloudsc.F90 oifs_43r3_model.e 000000000115C847 cloud_layer_ 131 cloud_layer.F90 oifs_43r3_model.e 0000000000FBB064 callpar_ 1223 callpar.F90 oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90 oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a13o (argv4) batchid: 1017 (argv5) wuid: 12283255 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /data/boinc/boinc-client/slots/2 Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255 ..mkdir for temp folder for results failed Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /data/boinc/boinc-client/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_cc3236643c1504e3e309f1ec709f2d5d to: /data/boinc/boinc-client/slots/2/oifs_43r3_bl_a13o_2016092300_20_1017_12283255.zip Unzipping the namelist zip file: /data/boinc/boinc-client/slots/2/oifs_43r3_bl_a13o_2016092300_20_1017_12283255.zip ic_ancil_file: ic_ancil_12283255 ifsdata_file: ifsdata_12283255 climate_data_file: clim_data_12283255 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/2/ic_ancil_12283255.zip Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/2/ic_ancil_12283255.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0a45f9448f481640a566b2e26310dd98 to: /data/boinc/boinc-client/slots/2/ifsdata/ifsdata_12283255.zip Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/2/ifsdata/ifsdata_12283255.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/2/159l_2/clim_data_12283255.zip Unzipping the climate data zip file: /data/boinc/boinc-client/slots/2/159l_2/clim_data_12283255.zip Checking for progress XML file: /data/boinc/boinc-client/slots/2/progress_file_12283255.xml Opened progress file ok : /data/boinc/boinc-client/slots/2/progress_file_12283255.xml -- Model is restarting -- Adjusting last_iter, 1273, to previous model restart step. Creating progress file: /data/boinc/boinc-client/slots/2/progress_file_12283255.xml last_cpu_time: 45183 upload_file_number: 13 last_iter: 1249 last_upload: 1123200 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125 The child process has been launched with process id: 107219 Executing the command: /data/boinc/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:victor-Precision-7920-Tower:1:1:107219:107219] [20240612:135539:1718196939:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 13:56:22 STEP 1248 H= 312:00 +CPU= 32.229 13:56:52 STEP 1249 H= 312:15 +CPU= 29.498 13:57:22 STEP 1250 H= 312:30 +CPU= 29.650 13:57:52 STEP 1251 H= 312:45 +CPU= 29.765 13:58:23 STEP 1252 H= 313:00 +CPU= 30.917 13:58:54 STEP 1253 H= 313:15 +CPU= 29.985 13:59:24 STEP 1254 H= 313:30 +CPU= 30.062 13:59:55 STEP 1255 H= 313:45 +CPU= 30.162 14:00:25 STEP 1256 H= 314:00 +CPU= 30.302 14:00:57 STEP 1257 H= 314:15 +CPU= 30.618 14:01:27 STEP 1258 H= 314:30 +CPU= 30.150 14:01:58 STEP 1259 H= 314:45 +CPU= 30.499 14:02:37 STEP 1260 H= 315:00 +CPU= 38.469 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001260 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001260 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001260 14:03:08 STEP 1261 H= 315:15 +CPU= 30.251 14:03:39 STEP 1262 H= 315:30 +CPU= 30.815 14:04:10 STEP 1263 H= 315:45 +CPU= 30.565 14:04:42 STEP 1264 H= 316:00 +CPU= 31.454 14:05:13 STEP 1265 H= 316:15 +CPU= 30.554 14:05:43 STEP 1266 H= 316:30 +CPU= 30.359 14:06:14 STEP 1267 H= 316:45 +CPU= 30.254 14:06:45 STEP 1268 H= 317:00 +CPU= 30.435 14:07:16 STEP 1269 H= 317:15 +CPU= 31.045 14:07:47 STEP 1270 H= 317:30 +CPU= 30.623 14:08:18 STEP 1271 H= 317:45 +CPU= 30.581 14:08:56 STEP 1272 H= 318:00 +CPU= 38.058 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001272 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001272 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001272 14:09:28 STEP 1273 H= 318:15 +CPU= 30.939 14:09:59 STEP 1274 H= 318:30 +CPU= 30.504 14:10:29 STEP 1275 H= 318:45 +CPU= 30.546 14:11:01 STEP 1276 H= 319:00 +CPU= 31.517 14:11:33 STEP 1277 H= 319:15 +CPU= 31.135 14:12:04 STEP 1278 H= 319:30 +CPU= 30.969 14:12:35 STEP 1279 H= 319:45 +CPU= 30.694 14:13:07 STEP 1280 H= 320:00 +CPU= 31.535 14:13:38 STEP 1281 H= 320:15 +CPU= 31.043 14:14:10 STEP 1282 H= 320:30 +CPU= 31.285 14:14:41 STEP 1283 H= 320:45 +CPU= 30.971 14:15:20 STEP 1284 H= 321:00 +CPU= 38.705 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001284 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001284 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001284 14:15:51 STEP 1285 H= 321:15 +CPU= 30.726 14:16:23 STEP 1286 H= 321:30 +CPU= 31.656 14:16:56 STEP 1287 H= 321:45 +CPU= 31.746 14:17:27 STEP 1288 H= 322:00 +CPU= 31.588 14:17:59 STEP 1289 H= 322:15 +CPU= 30.914 14:18:30 STEP 1290 H= 322:30 +CPU= 30.641 14:19:01 STEP 1291 H= 322:45 +CPU= 30.879 14:19:33 STEP 1292 H= 323:00 +CPU= 31.545 14:20:05 STEP 1293 H= 323:15 +CPU= 31.653 14:20:37 STEP 1294 H= 323:30 +CPU= 31.450 14:21:09 STEP 1295 H= 323:45 +CPU= 31.679 14:21:53 STEP 1296 H= 324:00 +CPU= 43.541 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001296 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001296 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001296 14:22:25 STEP 1297 H= 324:15 +CPU= 31.066 14:22:56 STEP 1298 H= 324:30 +CPU= 30.706 14:23:27 STEP 1299 H= 324:45 +CPU= 31.074 14:24:00 STEP 1300 H= 325:00 +CPU= 31.975 14:24:31 STEP 1301 H= 325:15 +CPU= 30.523 14:25:01 STEP 1302 H= 325:30 +CPU= 30.437 14:25:33 STEP 1303 H= 325:45 +CPU= 31.348 14:26:06 STEP 1304 H= 326:00 +CPU= 32.175 14:26:37 STEP 1305 H= 326:15 +CPU= 31.109 14:27:09 STEP 1306 H= 326:30 +CPU= 30.724 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:35:05 STEP 1307 H= 326:45 +CPU= 31.240 14:35:44 STEP 1308 H= 327:00 +CPU= 38.540 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001308 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001308 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001308 14:36:16 STEP 1309 H= 327:15 +CPU= 31.014 14:36:47 STEP 1310 H= 327:30 +CPU= 31.171 14:37:19 STEP 1311 H= 327:45 +CPU= 31.080 14:37:51 STEP 1312 H= 328:00 +CPU= 31.542 14:38:23 STEP 1313 H= 328:15 +CPU= 31.366 14:38:55 STEP 1314 H= 328:30 +CPU= 31.440 14:39:26 STEP 1315 H= 328:45 +CPU= 30.719 14:39:58 STEP 1316 H= 329:00 +CPU= 32.369 14:40:31 STEP 1317 H= 329:15 +CPU= 32.021 14:41:03 STEP 1318 H= 329:30 +CPU= 31.807 14:41:34 STEP 1319 H= 329:45 +CPU= 30.561 14:42:13 STEP 1320 H= 330:00 +CPU= 39.083 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001320 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001320 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001320 14:42:44 STEP 1321 H= 330:15 +CPU= 30.923 14:43:16 STEP 1322 H= 330:30 +CPU= 30.983 14:43:47 STEP 1323 H= 330:45 +CPU= 31.400 14:44:20 STEP 1324 H= 331:00 +CPU= 31.825 14:44:52 STEP 1325 H= 331:15 +CPU= 31.596 14:45:24 STEP 1326 H= 331:30 +CPU= 31.765 14:45:55 STEP 1327 H= 331:45 +CPU= 31.345 14:46:28 STEP 1328 H= 332:00 +CPU= 31.857 14:47:00 STEP 1329 H= 332:15 +CPU= 31.508 14:47:31 STEP 1330 H= 332:30 +CPU= 30.680 14:48:02 STEP 1331 H= 332:45 +CPU= 30.970 14:48:41 STEP 1332 H= 333:00 +CPU= 38.696 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001332 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001332 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001332 14:49:12 STEP 1333 H= 333:15 +CPU= 31.129 14:49:44 STEP 1334 H= 333:30 +CPU= 31.169 14:50:16 STEP 1335 H= 333:45 +CPU= 31.384 14:50:47 STEP 1336 H= 334:00 +CPU= 30.600 14:51:18 STEP 1337 H= 334:15 +CPU= 31.327 14:51:50 STEP 1338 H= 334:30 +CPU= 31.303 14:52:21 STEP 1339 H= 334:45 +CPU= 30.560 14:52:53 STEP 1340 H= 335:00 +CPU= 32.092 14:53:25 STEP 1341 H= 335:15 +CPU= 31.178 14:53:57 STEP 1342 H= 335:30 +CPU= 31.129 14:54:28 STEP 1343 H= 335:45 +CPU= 31.206 14:55:13 STEP 1344 H= 336:00 +CPU= 43.832 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001344 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001344 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001344 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001248 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001248 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001248 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001260 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001260 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001260 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001272 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001272 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001272 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001284 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001284 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001284 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001296 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001296 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001296 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001308 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001308 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001308 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001320 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001320 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001320 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001332 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001332 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001332 Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_13.zip Uploading the intermediate file: upload_file_13.zip 14:55:45 STEP 1345 H= 336:15 +CPU= 31.388 14:56:17 STEP 1346 H= 336:30 +CPU= 31.858 14:56:49 STEP 1347 H= 336:45 +CPU= 31.815 14:57:21 STEP 1348 H= 337:00 +CPU= 31.327 14:57:53 STEP 1349 H= 337:15 +CPU= 31.306 14:58:25 STEP 1350 H= 337:30 +CPU= 31.970 14:58:57 STEP 1351 H= 337:45 +CPU= 31.007 14:59:28 STEP 1352 H= 338:00 +CPU= 30.986 15:00:00 STEP 1353 H= 338:15 +CPU= 31.155 15:00:32 STEP 1354 H= 338:30 +CPU= 31.220 15:01:03 STEP 1355 H= 338:45 +CPU= 30.832 15:01:43 STEP 1356 H= 339:00 +CPU= 38.875 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001356 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001356 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001356 15:02:14 STEP 1357 H= 339:15 +CPU= 31.153 15:02:46 STEP 1358 H= 339:30 +CPU= 31.562 15:03:18 STEP 1359 H= 339:45 +CPU= 31.465 15:03:51 STEP 1360 H= 340:00 +CPU= 32.032 15:04:23 STEP 1361 H= 340:15 +CPU= 31.575 15:04:55 STEP 1362 H= 340:30 +CPU= 31.607 15:05:26 STEP 1363 H= 340:45 +CPU= 31.363 15:05:59 STEP 1364 H= 341:00 +CPU= 32.380 15:06:30 STEP 1365 H= 341:15 +CPU= 30.606 15:07:01 STEP 1366 H= 341:30 +CPU= 31.071 15:07:33 STEP 1367 H= 341:45 +CPU= 31.586 15:08:14 STEP 1368 H= 342:00 +CPU= 39.802 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001368 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001368 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001368 15:08:45 STEP 1369 H= 342:15 +CPU= 31.257 15:09:17 STEP 1370 H= 342:30 +CPU= 31.533 15:09:49 STEP 1371 H= 342:45 +CPU= 31.187 15:10:21 STEP 1372 H= 343:00 +CPU= 31.678 15:10:51 STEP 1373 H= 343:15 +CPU= 30.448 15:11:23 STEP 1374 H= 343:30 +CPU= 30.906 15:11:54 STEP 1375 H= 343:45 +CPU= 31.517 15:12:26 STEP 1376 H= 344:00 +CPU= 31.401 15:12:58 STEP 1377 H= 344:15 +CPU= 31.877 15:13:30 STEP 1378 H= 344:30 +CPU= 31.459 15:14:02 STEP 1379 H= 344:45 +CPU= 31.306 15:14:42 STEP 1380 H= 345:00 +CPU= 39.754 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001380 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001380 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001380 15:15:14 STEP 1381 H= 345:15 +CPU= 31.033 15:15:46 STEP 1382 H= 345:30 +CPU= 31.778 15:16:18 STEP 1383 H= 345:45 +CPU= 31.270 15:16:50 STEP 1384 H= 346:00 +CPU= 32.113 15:17:22 STEP 1385 H= 346:15 +CPU= 31.400 15:17:53 STEP 1386 H= 346:30 +CPU= 30.729 15:18:24 STEP 1387 H= 346:45 +CPU= 30.210 15:18:55 STEP 1388 H= 347:00 +CPU= 30.936 15:19:27 STEP 1389 H= 347:15 +CPU= 31.327 15:19:59 STEP 1390 H= 347:30 +CPU= 31.328 15:20:30 STEP 1391 H= 347:45 +CPU= 30.979 15:21:14 STEP 1392 H= 348:00 +CPU= 43.003 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001392 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001392 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001392 15:21:46 STEP 1393 H= 348:15 +CPU= 31.132 15:22:17 STEP 1394 H= 348:30 +CPU= 31.314 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 21:35:34 STEP 1395 H= 348:45 +CPU= 31.166 21:36:05 STEP 1396 H= 349:00 +CPU= 31.133 21:36:37 STEP 1397 H= 349:15 +CPU= 31.164 21:37:07 STEP 1398 H= 349:30 +CPU= 30.298 21:37:39 STEP 1399 H= 349:45 +CPU= 30.941 21:38:10 STEP 1400 H= 350:00 +CPU= 31.027 21:38:41 STEP 1401 H= 350:15 +CPU= 31.103 21:39:12 STEP 1402 H= 350:30 +CPU= 30.852 21:39:43 STEP 1403 H= 350:45 +CPU= 30.716 21:40:22 STEP 1404 H= 351:00 +CPU= 38.688 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001404 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001404 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001404 21:40:54 STEP 1405 H= 351:15 +CPU= 30.900 21:41:25 STEP 1406 H= 351:30 +CPU= 31.149 21:41:57 STEP 1407 H= 351:45 +CPU= 31.748 21:42:30 STEP 1408 H= 352:00 +CPU= 32.358 21:43:01 STEP 1409 H= 352:15 +CPU= 30.823 21:43:32 STEP 1410 H= 352:30 +CPU= 31.270 21:44:05 STEP 1411 H= 352:45 +CPU= 31.958 21:44:36 STEP 1412 H= 353:00 +CPU= 31.332 21:45:07 STEP 1413 H= 353:15 +CPU= 30.714 21:45:39 STEP 1414 H= 353:30 +CPU= 31.056 21:46:10 STEP 1415 H= 353:45 +CPU= 31.430 21:46:51 STEP 1416 H= 354:00 +CPU= 39.949 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001416 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001416 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001416 21:47:23 STEP 1417 H= 354:15 +CPU= 31.859 21:47:54 STEP 1418 H= 354:30 +CPU= 31.192 21:48:25 STEP 1419 H= 354:45 +CPU= 30.842 21:48:57 STEP 1420 H= 355:00 +CPU= 31.299 21:49:28 STEP 1421 H= 355:15 +CPU= 30.600 21:49:57 STEP 1422 H= 355:30 +CPU= 29.395 21:50:29 STEP 1423 H= 355:45 +CPU= 31.316 21:51:01 STEP 1424 H= 356:00 +CPU= 31.436 21:51:32 STEP 1425 H= 356:15 +CPU= 30.772 21:52:03 STEP 1426 H= 356:30 +CPU= 30.394 21:52:34 STEP 1427 H= 356:45 +CPU= 31.485 21:53:12 STEP 1428 H= 357:00 +CPU= 37.673 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001428 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001428 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001428 21:53:43 STEP 1429 H= 357:15 +CPU= 30.627 21:54:15 STEP 1430 H= 357:30 +CPU= 30.641 21:54:46 STEP 1431 H= 357:45 +CPU= 30.559 21:55:17 STEP 1432 H= 358:00 +CPU= 31.172 21:55:49 STEP 1433 H= 358:15 +CPU= 31.164 21:56:20 STEP 1434 H= 358:30 +CPU= 30.790 21:56:51 STEP 1435 H= 358:45 +CPU= 30.991 21:57:23 STEP 1436 H= 359:00 +CPU= 31.559 21:57:55 STEP 1437 H= 359:15 +CPU= 30.918 21:58:25 STEP 1438 H= 359:30 +CPU= 30.416 21:58:56 STEP 1439 H= 359:45 +CPU= 30.397 21:59:37 STEP 1440 H= 360:00 +CPU= 40.235 ..The child process terminated with status: 0 >>> Printing last 70 lines from file: NODE.001_01 ---------------------------------------------------------------------------------------------------------- I ---------------- DDH------------------------------------------------------------------------ I I I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I I I I-------------------------------------------------------------------------I I VARIABLE I Initial value I Current value I I-------------------------------------------------------------------------I I OMEGA (P/S) I -0.1037859866E-20 I 0.2080523851E-07 I ICloud fractionI 0.0000000000E+00 I 0.1450403849E-03 I I Relat. Hum. I 0.4896942253E+00 I 0.4989502537E+00 I I PASS 01 I 0.0000000000E+00 I 0.8338833207E+01 I DDH------------------------------------------------------------------------ MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 1440 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+001440 MODE=a IO-STREAM CLOSED - ICMGGh7zg+001440 MPI-TASK: 1 - 296948308 BYTES IN 7 RECORDS TRANSFERRED IN 0.0007 SECONDS424211.9 Mbytes/s, TOTAL TIME= 0.0150( 4.7%) 21:59:37 STEP 1440 H= 360:00 +CPU= 40.235 END CNT3 NSTEP = 1440 CNT0 000000000 28.926 28.926 29.303 0.987 0 0 0 0 0 IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 5720/************ -TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL OU-TOT IN -TOT OUT 1 103 0 46 1044068 5720 ************ 19.7 7.2 12.5 8.1 23.8 ===-=== START OF TIMING STATISTICS ===-=== STATS FOR ALL TASKS NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%) 0 CNT0 - COMPLETE EXECUTION 1 ********* 0.0 100.00 -100.00 1 CNT4 - FORWARD INTEGRATION 1 ********* 0.0 100.01 -100.01 8 SCAN2M - GRID-POINT DYNAMICS 209 5274.8 5274.8 0.00 0.00 9 SPCM - SPECTRAL COMP. 192 842.0 842.0 0.00 0.00 10 SCAN2M - PHYSICS 193 81104.0 81104.0 0.00 0.00 11 IOPACK - OUTPUT P.P. RESULTS 16 1059.6 1059.6 0.00 0.00 12 SPNORM - SPECTRAL NORM COMP. 9 43.0 43.0 0.00 0.00 17 GRIDFPOS IN CNT4 16 29.5 29.5 0.00 0.00 27 RESTART FILES - WRITING 4 4234.0 4234.0 0.00 0.00 28 RESTART FILES - READING 1 8969.4 8969.4 0.00 0.00 29 SU4FPOS IN CNT4 16 0.1 0.1 0.00 0.00 30 DYNFPOS IN CNT4 16 7012.2 7012.2 0.00 0.00 31 POSDDH IN STEPO 1 15.1 15.1 0.00 0.00 37 CPGLAG - SL COMPUTATIONS 193 ********* 0.0 109.51 -109.51 39 SU0YOMB 1 518.2 518.2 0.00 0.00 51 SCAN2M - SL COMM. PART 1 193 21.9 21.9 0.00 0.00 54 SPCM - M TO S/S TO M TRANSP. 192 261.6 261.6 0.00 0.00 55 SPCIMPF - S TO M/M TO S TRANSP. 192 71.0 71.0 0.00 0.00 56 SPNORM - SPECTRAL NORM COMM. 9 0.2 0.2 0.00 0.00 102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 420 545.8 545.8 0.00 0.00 103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 400 312.4 312.4 0.00 0.00 106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 400 115.1 115.1 0.00 0.00 107 FTINV_CTL - INVERSE FOURIER TRANSFORM 420 152.0 152.0 0.00 0.00 140 SULEG - COMP. OF LEGENDRE POL. 1 36.9 36.9 0.00 0.00 152 LTINV_CTL - M TO L TRANSPOSITION 420 80.4 80.4 0.00 0.00 153 LTDIR_CTL - L TO M TRANSPOSITION 400 37.5 37.5 0.00 0.00 157 FTINV_CTL - L TO G TRANSPOSITION 420 66.1 66.1 0.00 0.00 158 FTDIR_CTL - G TO L TRANSPOSITION 400 19.5 19.5 0.00 0.00 400 GSTATS 23311 0.0 0.0 0.00 0.00 401 GSTATS HOOK 21635 0.0 0.0 0.00 0.00 TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT TOTAL WALLCLOCK TIME -185710.6 CPU TIME 6148.1 VECTOR TIME 6148.1 ===-=== END OF TIMING STATISTICS ===-=== *** END CNT0 *** ------------------------------------------------ Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMGGh7zg+001440 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMSHh7zg+001440 Moving to projects directory: /data/boinc/boinc-client/slots/2/ICMUAh7zg+001440 Adding to the zip: /data/boinc/boinc-client/slots/2/NODE.001_01 Adding to the zip: /data/boinc/boinc-client/slots/2/ifs.stat Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001404 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001440 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001392 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001428 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001392 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001440 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001380 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001368 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001356 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001368 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001344 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001416 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001380 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001356 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001368 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001428 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001380 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001404 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001416 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001404 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001392 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001416 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001428 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001344 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMUAh7zg+001440 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMGGh7zg+001356 Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283255/ICMSHh7zg+001344 Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_14.zip Uploading the final file: upload_file_14.zip Uploading trickle at timestep: 1295100 22:03:10 (107212): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_15.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_16.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_17.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_18.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0_r1303159125_19.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]] |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
12 Jun 2024 21:01:41 | 1478188 | 22434832 | oifs_43r3_bl_a13o_2016092300_20_1017_12283255_0 | 1,295,100 | 51,331 | 0.0396 |
©2024 cpdn.org