climateprediction.net home page
Task 22310449

Task 22310449

Name oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0
Workunit 12210237
Created 13 Feb 2023, 18:21:51 UTC
Sent 13 Feb 2023, 18:25:35 UTC
Report deadline 14 Apr 2023, 18:25:35 UTC
Received 14 Feb 2023, 20:37:55 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1494992
Run time 10 hours 40 min 22 sec
CPU time 10 hours 22 min 52 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 5.25 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,061.60 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,370.56 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
73
  03:37:43 STEP 1004 H= 251:00 +CPU= 25.397
  03:38:08 STEP 1005 H= 251:15 +CPU= 25.242
  03:38:34 STEP 1006 H= 251:30 +CPU= 25.555
  03:38:59 STEP 1007 H= 251:45 +CPU= 24.409
  03:39:34 STEP 1008 H= 252:00 +CPU= 34.044
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001008
  03:39:59 STEP 1009 H= 252:15 +CPU= 24.575
  03:40:24 STEP 1010 H= 252:30 +CPU= 24.938
  03:40:49 STEP 1011 H= 252:45 +CPU= 24.708
  03:41:15 STEP 1012 H= 253:00 +CPU= 25.159
  03:41:40 STEP 1013 H= 253:15 +CPU= 24.774
  03:42:05 STEP 1014 H= 253:30 +CPU= 24.022
  03:42:30 STEP 1015 H= 253:45 +CPU= 24.286
  03:42:55 STEP 1016 H= 254:00 +CPU= 24.722
  03:43:21 STEP 1017 H= 254:15 +CPU= 25.810
  03:43:46 STEP 1018 H= 254:30 +CPU= 24.812
  03:44:11 STEP 1019 H= 254:45 +CPU= 24.811
  03:44:41 STEP 1020 H= 255:00 +CPU= 29.767
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001020
  03:45:04 STEP 1021 H= 255:15 +CPU= 23.559
  03:45:27 STEP 1022 H= 255:30 +CPU= 22.775
  03:45:52 STEP 1023 H= 255:45 +CPU= 24.295
  03:46:18 STEP 1024 H= 256:00 +CPU= 25.487
  03:46:43 STEP 1025 H= 256:15 +CPU= 24.891
  03:47:08 STEP 1026 H= 256:30 +CPU= 25.025
  03:47:33 STEP 1027 H= 256:45 +CPU= 24.783
  03:47:58 STEP 1028 H= 257:00 +CPU= 24.776
  03:48:22 STEP 1029 H= 257:15 +CPU= 24.020
  03:48:47 STEP 1030 H= 257:30 +CPU= 24.084
  03:49:12 STEP 1031 H= 257:45 +CPU= 24.016
  03:49:42 STEP 1032 H= 258:00 +CPU= 29.854
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001032
  03:50:07 STEP 1033 H= 258:15 +CPU= 24.673
  03:50:33 STEP 1034 H= 258:30 +CPU= 25.996
  03:50:59 STEP 1035 H= 258:45 +CPU= 26.472
  03:51:27 STEP 1036 H= 259:00 +CPU= 27.740
  03:51:54 STEP 1037 H= 259:15 +CPU= 26.906
  03:52:21 STEP 1038 H= 259:30 +CPU= 26.023
  03:52:47 STEP 1039 H= 259:45 +CPU= 26.178
  03:53:13 STEP 1040 H= 260:00 +CPU= 25.735
  03:53:38 STEP 1041 H= 260:15 +CPU= 25.033
  03:54:02 STEP 1042 H= 260:30 +CPU= 24.207
  03:54:27 STEP 1043 H= 260:45 +CPU= 24.252
  03:54:58 STEP 1044 H= 261:00 +CPU= 30.347
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001044
  03:55:22 STEP 1045 H= 261:15 +CPU= 24.414
  03:55:46 STEP 1046 H= 261:30 +CPU= 23.848
  03:56:11 STEP 1047 H= 261:45 +CPU= 24.139
  03:56:36 STEP 1048 H= 262:00 +CPU= 24.411
  03:57:00 STEP 1049 H= 262:15 +CPU= 24.116
  03:57:25 STEP 1050 H= 262:30 +CPU= 24.281
  03:57:50 STEP 1051 H= 262:45 +CPU= 24.399
  03:58:15 STEP 1052 H= 263:00 +CPU= 24.733
  03:58:40 STEP 1053 H= 263:15 +CPU= 25.005
  03:59:06 STEP 1054 H= 263:30 +CPU= 25.557
  03:59:32 STEP 1055 H= 263:45 +CPU= 26.370
  04:00:09 STEP 1056 H= 264:00 +CPU= 36.851
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373_10.zip
Uploading the intermediate file: upload_file_10.zip
  04:00:36 STEP 1057 H= 264:15 +CPU= 25.648
  04:01:01 STEP 1058 H= 264:30 +CPU= 24.626
  04:01:25 STEP 1059 H= 264:45 +CPU= 24.063
  04:01:49 STEP 1060 H= 265:00 +CPU= 24.434
  04:02:14 STEP 1061 H= 265:15 +CPU= 24.433
  04:02:38 STEP 1062 H= 265:30 +CPU= 24.314
  04:03:03 STEP 1063 H= 265:45 +CPU= 24.334
  04:03:29 STEP 1064 H= 266:00 +CPU= 24.710
  04:03:56 STEP 1065 H= 266:15 +CPU= 24.199
  04:04:22 STEP 1066 H= 266:30 +CPU= 24.416
  04:04:47 STEP 1067 H= 266:45 +CPU= 24.189
  04:05:19 STEP 1068 H= 267:00 +CPU= 30.055
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001068
  04:05:45 STEP 1069 H= 267:15 +CPU= 24.190
  04:06:12 STEP 1070 H= 267:30 +CPU= 24.901
  04:06:38 STEP 1071 H= 267:45 +CPU= 25.270
  04:07:06 STEP 1072 H= 268:00 +CPU= 25.554
  04:07:33 STEP 1073 H= 268:15 +CPU= 25.099
  04:08:00 STEP 1074 H= 268:30 +CPU= 25.290
  04:08:25 STEP 1075 H= 268:45 +CPU= 24.258
  04:08:49 STEP 1076 H= 269:00 +CPU= 24.815
  04:09:14 STEP 1077 H= 269:15 +CPU= 24.241
  04:09:38 STEP 1078 H= 269:30 +CPU= 24.009
  04:10:02 STEP 1079 H= 269:45 +CPU= 24.150
  04:10:33 STEP 1080 H= 270:00 +CPU= 30.781
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001080
  04:10:58 STEP 1081 H= 270:15 +CPU= 24.571
  04:11:23 STEP 1082 H= 270:30 +CPU= 24.403
  04:11:48 STEP 1083 H= 270:45 +CPU= 24.829
  04:12:13 STEP 1084 H= 271:00 +CPU= 25.168
  04:12:37 STEP 1085 H= 271:15 +CPU= 24.126
  04:13:02 STEP 1086 H= 271:30 +CPU= 24.431
  04:13:27 STEP 1087 H= 271:45 +CPU= 24.131
  04:13:51 STEP 1088 H= 272:00 +CPU= 24.443
  04:14:16 STEP 1089 H= 272:15 +CPU= 24.327
  04:14:40 STEP 1090 H= 272:30 +CPU= 24.099
  04:15:05 STEP 1091 H= 272:45 +CPU= 24.356
  04:15:36 STEP 1092 H= 273:00 +CPU= 30.602
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001092
  04:16:01 STEP 1093 H= 273:15 +CPU= 24.456
  04:16:26 STEP 1094 H= 273:30 +CPU= 24.587
  04:16:51 STEP 1095 H= 273:45 +CPU= 24.825
  04:17:16 STEP 1096 H= 274:00 +CPU= 24.900
  04:17:41 STEP 1097 H= 274:15 +CPU= 24.523
  04:18:06 STEP 1098 H= 274:30 +CPU= 24.207
  04:18:30 STEP 1099 H= 274:45 +CPU= 24.137
  04:18:54 STEP 1100 H= 275:00 +CPU= 24.402
  04:19:19 STEP 1101 H= 275:15 +CPU= 24.468
  04:19:44 STEP 1102 H= 275:30 +CPU= 24.482
  04:20:08 STEP 1103 H= 275:45 +CPU= 24.495
  04:20:43 STEP 1104 H= 276:00 +CPU= 33.705
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001104
  04:21:08 STEP 1105 H= 276:15 +CPU= 24.174
  04:21:33 STEP 1106 H= 276:30 +CPU= 24.437
  04:21:57 STEP 1107 H= 276:45 +CPU= 23.913
  04:22:22 STEP 1108 H= 277:00 +CPU= 25.007
  04:22:46 STEP 1109 H= 277:15 +CPU= 24.382
  04:23:11 STEP 1110 H= 277:30 +CPU= 24.260
  04:23:36 STEP 1111 H= 277:45 +CPU= 24.427
  04:24:01 STEP 1112 H= 278:00 +CPU= 24.853
  04:24:26 STEP 1113 H= 278:15 +CPU= 24.305
  04:24:50 STEP 1114 H= 278:30 +CPU= 24.270
  04:25:14 STEP 1115 H= 278:45 +CPU= 23.937
  04:25:44 STEP 1116 H= 279:00 +CPU= 29.592
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001116
  04:26:08 STEP 1117 H= 279:15 +CPU= 23.920
  04:26:32 STEP 1118 H= 279:30 +CPU= 24.426
  04:26:57 STEP 1119 H= 279:45 +CPU= 24.302
  04:27:21 STEP 1120 H= 280:00 +CPU= 24.503
  04:27:46 STEP 1121 H= 280:15 +CPU= 23.997
  04:28:10 STEP 1122 H= 280:30 +CPU= 23.898
  04:28:35 STEP 1123 H= 280:45 +CPU= 24.852
  04:29:00 STEP 1124 H= 281:00 +CPU= 25.138
  04:29:24 STEP 1125 H= 281:15 +CPU= 24.059
  04:29:49 STEP 1126 H= 281:30 +CPU= 24.438
  04:30:13 STEP 1127 H= 281:45 +CPU= 24.319
  04:30:44 STEP 1128 H= 282:00 +CPU= 30.320
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001128
  04:31:09 STEP 1129 H= 282:15 +CPU= 24.591
  04:31:42 STEP 1130 H= 282:30 +CPU= 30.609
  04:32:15 STEP 1131 H= 282:45 +CPU= 30.695
  04:32:47 STEP 1132 H= 283:00 +CPU= 30.412
  04:33:16 STEP 1133 H= 283:15 +CPU= 27.498
  04:33:40 STEP 1134 H= 283:30 +CPU= 23.249
  04:34:03 STEP 1135 H= 283:45 +CPU= 23.376
  04:34:27 STEP 1136 H= 284:00 +CPU= 23.924
  04:34:51 STEP 1137 H= 284:15 +CPU= 23.353
  04:35:15 STEP 1138 H= 284:30 +CPU= 23.556
  04:35:38 STEP 1139 H= 284:45 +CPU= 23.485
  04:36:08 STEP 1140 H= 285:00 +CPU= 29.146
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001140
  04:36:32 STEP 1141 H= 285:15 +CPU= 23.864
  04:36:56 STEP 1142 H= 285:30 +CPU= 23.492
  04:37:20 STEP 1143 H= 285:45 +CPU= 23.617
  04:37:45 STEP 1144 H= 286:00 +CPU= 24.344
  04:38:08 STEP 1145 H= 286:15 +CPU= 23.443
  04:38:32 STEP 1146 H= 286:30 +CPU= 23.809
  04:38:56 STEP 1147 H= 286:45 +CPU= 23.775
  04:39:21 STEP 1148 H= 287:00 +CPU= 24.482
  04:39:45 STEP 1149 H= 287:15 +CPU= 23.905
  04:40:09 STEP 1150 H= 287:30 +CPU= 23.893
  04:40:33 STEP 1151 H= 287:45 +CPU= 23.679
  04:41:05 STEP 1152 H= 288:00 +CPU= 32.624
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:41:30 STEP 1153 H= 288:15 +CPU= 23.419
  04:41:54 STEP 1154 H= 288:30 +CPU= 23.305
  04:42:17 STEP 1155 H= 288:45 +CPU= 23.793
  04:42:42 STEP 1156 H= 289:00 +CPU= 23.607
  04:43:05 STEP 1157 H= 289:15 +CPU= 23.379
  04:43:29 STEP 1158 H= 289:30 +CPU= 23.607
  04:43:53 STEP 1159 H= 289:45 +CPU= 23.604
  04:44:18 STEP 1160 H= 290:00 +CPU= 24.490
  04:44:42 STEP 1161 H= 290:15 +CPU= 23.747
  04:45:06 STEP 1162 H= 290:30 +CPU= 23.844
  04:45:30 STEP 1163 H= 290:45 +CPU= 23.864
  04:46:00 STEP 1164 H= 291:00 +CPU= 29.619
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001164
  04:46:29 STEP 1165 H= 291:15 +CPU= 27.853
  04:46:52 STEP 1166 H= 291:30 +CPU= 23.137
  04:47:16 STEP 1167 H= 291:45 +CPU= 23.346
  04:47:40 STEP 1168 H= 292:00 +CPU= 23.844
  04:48:03 STEP 1169 H= 292:15 +CPU= 23.169
  04:48:26 STEP 1170 H= 292:30 +CPU= 23.462
  04:48:50 STEP 1171 H= 292:45 +CPU= 23.422
  04:49:14 STEP 1172 H= 293:00 +CPU= 23.552
  04:49:37 STEP 1173 H= 293:15 +CPU= 23.154
  04:50:00 STEP 1174 H= 293:30 +CPU= 23.162
  04:50:23 STEP 1175 H= 293:45 +CPU= 23.226
  04:50:52 STEP 1176 H= 294:00 +CPU= 28.796
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001176
  04:51:16 STEP 1177 H= 294:15 +CPU= 23.244
  04:51:38 STEP 1178 H= 294:30 +CPU= 22.766
  04:52:01 STEP 1179 H= 294:45 +CPU= 22.318
  04:52:25 STEP 1180 H= 295:00 +CPU= 23.478
  04:52:49 STEP 1181 H= 295:15 +CPU= 23.171
  04:53:12 STEP 1182 H= 295:30 +CPU= 23.246
  04:53:35 STEP 1183 H= 295:45 +CPU= 23.037
  04:53:59 STEP 1184 H= 296:00 +CPU= 23.509
  04:54:23 STEP 1185 H= 296:15 +CPU= 23.214
  04:54:46 STEP 1186 H= 296:30 +CPU= 23.042
  04:55:10 STEP 1187 H= 296:45 +CPU= 23.263
  04:55:41 STEP 1188 H= 297:00 +CPU= 29.344
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001188
  04:56:07 STEP 1189 H= 297:15 +CPU= 23.585
  04:56:31 STEP 1190 H= 297:30 +CPU= 23.395
  04:56:56 STEP 1191 H= 297:45 +CPU= 23.600
  04:57:21 STEP 1192 H= 298:00 +CPU= 24.389
  04:57:45 STEP 1193 H= 298:15 +CPU= 23.598
  04:58:09 STEP 1194 H= 298:30 +CPU= 23.790
  04:58:33 STEP 1195 H= 298:45 +CPU= 23.581
  04:58:57 STEP 1196 H= 299:00 +CPU= 24.221
  04:59:21 STEP 1197 H= 299:15 +CPU= 23.527
  04:59:45 STEP 1198 H= 299:30 +CPU= 24.106
  05:00:12 STEP 1199 H= 299:45 +CPU= 26.012
  05:00:57 STEP 1200 H= 300:00 +CPU= 41.426
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001200
  05:01:29 STEP 1201 H= 300:15 +CPU= 30.250
  05:01:59 STEP 1202 H= 300:30 +CPU= 28.290
  05:02:22 STEP 1203 H= 300:45 +CPU= 23.224
  05:02:47 STEP 1204 H= 301:00 +CPU= 23.997
  05:03:13 STEP 1205 H= 301:15 +CPU= 23.584
  05:03:38 STEP 1206 H= 301:30 +CPU= 23.486
  05:04:03 STEP 1207 H= 301:45 +CPU= 23.726
  05:04:27 STEP 1208 H= 302:00 +CPU= 23.984
  05:04:52 STEP 1209 H= 302:15 +CPU= 23.864
  05:05:18 STEP 1210 H= 302:30 +CPU= 23.775
  05:05:42 STEP 1211 H= 302:45 +CPU= 23.424
  05:06:11 STEP 1212 H= 303:00 +CPU= 29.006
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001212
  05:06:35 STEP 1213 H= 303:15 +CPU= 23.831
  05:06:58 STEP 1214 H= 303:30 +CPU= 23.236
  05:07:22 STEP 1215 H= 303:45 +CPU= 23.478
  05:07:47 STEP 1216 H= 304:00 +CPU= 24.076
  05:08:12 STEP 1217 H= 304:15 +CPU= 23.544
  05:08:35 STEP 1218 H= 304:30 +CPU= 23.108
  05:08:59 STEP 1219 H= 304:45 +CPU= 23.595
  05:09:23 STEP 1220 H= 305:00 +CPU= 24.028
  05:09:46 STEP 1221 H= 305:15 +CPU= 23.504
  05:10:10 STEP 1222 H= 305:30 +CPU= 23.212
  05:10:33 STEP 1223 H= 305:45 +CPU= 23.130
  05:11:02 STEP 1224 H= 306:00 +CPU= 28.859
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001224
  05:11:25 STEP 1225 H= 306:15 +CPU= 23.150
  05:11:48 STEP 1226 H= 306:30 +CPU= 23.026
  05:12:11 STEP 1227 H= 306:45 +CPU= 23.245
  05:12:35 STEP 1228 H= 307:00 +CPU= 23.850
  05:12:59 STEP 1229 H= 307:15 +CPU= 23.628
  05:13:22 STEP 1230 H= 307:30 +CPU= 23.089
  05:13:46 STEP 1231 H= 307:45 +CPU= 23.129
  05:14:10 STEP 1232 H= 308:00 +CPU= 23.761
  05:14:33 STEP 1233 H= 308:15 +CPU= 23.404
  05:14:57 STEP 1234 H= 308:30 +CPU= 23.579
  05:15:20 STEP 1235 H= 308:45 +CPU= 23.303
  05:15:50 STEP 1236 H= 309:00 +CPU= 29.258
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001236
  05:16:13 STEP 1237 H= 309:15 +CPU= 23.635
  05:16:37 STEP 1238 H= 309:30 +CPU= 23.624
  05:17:01 STEP 1239 H= 309:45 +CPU= 23.931
  05:17:26 STEP 1240 H= 310:00 +CPU= 24.279
  05:17:49 STEP 1241 H= 310:15 +CPU= 23.695
  05:18:13 STEP 1242 H= 310:30 +CPU= 23.606
  05:18:37 STEP 1243 H= 310:45 +CPU= 23.662
  05:19:01 STEP 1244 H= 311:00 +CPU= 24.280
  05:19:25 STEP 1245 H= 311:15 +CPU= 23.419
  05:19:48 STEP 1246 H= 311:30 +CPU= 23.435
  05:20:13 STEP 1247 H= 311:45 +CPU= 23.416
  05:20:45 STEP 1248 H= 312:00 +CPU= 32.404
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:21:10 STEP 1249 H= 312:15 +CPU= 23.487
  05:21:33 STEP 1250 H= 312:30 +CPU= 23.308
  05:21:56 STEP 1251 H= 312:45 +CPU= 23.190
  05:22:20 STEP 1252 H= 313:00 +CPU= 23.871
  05:22:44 STEP 1253 H= 313:15 +CPU= 23.404
  05:23:08 STEP 1254 H= 313:30 +CPU= 23.265
  05:23:33 STEP 1255 H= 313:45 +CPU= 23.609
  05:23:58 STEP 1256 H= 314:00 +CPU= 24.005
  05:24:24 STEP 1257 H= 314:15 +CPU= 23.613
  05:24:49 STEP 1258 H= 314:30 +CPU= 23.547
  05:25:14 STEP 1259 H= 314:45 +CPU= 23.683
  05:25:45 STEP 1260 H= 315:00 +CPU= 29.312
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001260
  05:26:10 STEP 1261 H= 315:15 +CPU= 23.672
  05:26:35 STEP 1262 H= 315:30 +CPU= 23.482
  05:27:00 STEP 1263 H= 315:45 +CPU= 23.582
  05:27:25 STEP 1264 H= 316:00 +CPU= 24.004
  05:27:51 STEP 1265 H= 316:15 +CPU= 23.705
  05:28:16 STEP 1266 H= 316:30 +CPU= 23.680
  05:28:41 STEP 1267 H= 316:45 +CPU= 23.594
  05:29:06 STEP 1268 H= 317:00 +CPU= 23.938
  05:29:31 STEP 1269 H= 317:15 +CPU= 23.544
  05:29:56 STEP 1270 H= 317:30 +CPU= 23.523
  05:30:22 STEP 1271 H= 317:45 +CPU= 23.639
  05:30:53 STEP 1272 H= 318:00 +CPU= 29.338
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001272
  05:31:18 STEP 1273 H= 318:15 +CPU= 23.555
  05:31:43 STEP 1274 H= 318:30 +CPU= 23.499
  05:32:08 STEP 1275 H= 318:45 +CPU= 23.578
  05:32:34 STEP 1276 H= 319:00 +CPU= 24.019
  05:32:59 STEP 1277 H= 319:15 +CPU= 23.602
  05:33:23 STEP 1278 H= 319:30 +CPU= 23.405
  05:33:47 STEP 1279 H= 319:45 +CPU= 23.565
  05:34:12 STEP 1280 H= 320:00 +CPU= 24.015
  05:34:35 STEP 1281 H= 320:15 +CPU= 23.634
  05:34:59 STEP 1282 H= 320:30 +CPU= 23.253
  05:35:23 STEP 1283 H= 320:45 +CPU= 23.427
  05:35:52 STEP 1284 H= 321:00 +CPU= 29.541
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001284
  05:36:16 STEP 1285 H= 321:15 +CPU= 23.522
  05:36:40 STEP 1286 H= 321:30 +CPU= 23.891
  05:37:04 STEP 1287 H= 321:45 +CPU= 23.664
  05:37:27 STEP 1288 H= 322:00 +CPU= 23.632
  05:37:51 STEP 1289 H= 322:15 +CPU= 23.354
  05:38:14 STEP 1290 H= 322:30 +CPU= 23.233
  05:38:38 STEP 1291 H= 322:45 +CPU= 23.319
  05:39:02 STEP 1292 H= 323:00 +CPU= 23.950
  05:39:26 STEP 1293 H= 323:15 +CPU= 23.840
  05:39:51 STEP 1294 H= 323:30 +CPU= 23.761
  05:40:15 STEP 1295 H= 323:45 +CPU= 23.811
  05:40:47 STEP 1296 H= 324:00 +CPU= 32.083
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001296
  05:41:11 STEP 1297 H= 324:15 +CPU= 23.510
  05:41:35 STEP 1298 H= 324:30 +CPU= 23.794
  05:41:59 STEP 1299 H= 324:45 +CPU= 23.839
  05:42:23 STEP 1300 H= 325:00 +CPU= 24.304
  05:42:47 STEP 1301 H= 325:15 +CPU= 23.475
  05:43:10 STEP 1302 H= 325:30 +CPU= 23.780
  05:43:34 STEP 1303 H= 325:45 +CPU= 23.910
  05:43:59 STEP 1304 H= 326:00 +CPU= 24.128
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.351] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3940MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 3940 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CPG_GP 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                GPXX 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054401:1676349841:37097.352] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                 VERDER 
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054402:1676349842:37098.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:56729:56729] [20230214:054402:1676349842:37098.352] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000017820B8  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000014C72BC  verder_                   106  verder.F90
oifs_43r3_model.e  00000000014C57E9  gpxx_                     161  gpxx.F90
oifs_43r3_model.e  0000000001498B08  cpg_gp_                   923  cpg_gp.F90
oifs_43r3_model.e  000000000143514E  cpg_                      627  cpg.F90
oifs_43r3_model.e  0000000001433058  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000E5F4B8  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2nu
(argv4) batchid: 991
(argv5) wuid: 12210237
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/9
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_05b94d439f8712f01272148cecb0d63a to: /var/lib/boinc/slots/9/oifs_43r3_bl_a2nu_2016092300_15_991_12210237.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/9/oifs_43r3_bl_a2nu_2016092300_15_991_12210237.zip
ic_ancil_file: ic_ancil_12210237
ifsdata_file: ifsdata_12210237
climate_data_file: clim_data_12210237
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/9/ic_ancil_12210237.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/9/ic_ancil_12210237.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f642729fe86052c4c26bc7ff0e39b68b to: /var/lib/boinc/slots/9/ifsdata/ifsdata_12210237.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/9/ifsdata/ifsdata_12210237.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/9/159l_2/clim_data_12210237.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/9/159l_2/clim_data_12210237.zip
Checking for progress XML file: /var/lib/boinc/slots/9/progress_file_12210237.xml
Opened progress file ok : /var/lib/boinc/slots/9/progress_file_12210237.xml
-- Model is restarting --
Adjusting last_iter, 1304, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/9/progress_file_12210237.xml
last_cpu_time: 33832
upload_file_number: 13
last_iter: 1297
last_upload: 1123200
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373
The child process has been launched with process id: 2036
Executing the command: /var/lib/boinc/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2036:2036] [20230214:193053:1676399453:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  19:31:27 STEP 1296 H= 324:00 +CPU= 24.751
  19:31:53 STEP 1297 H= 324:15 +CPU= 23.654
  19:32:18 STEP 1298 H= 324:30 +CPU= 23.341
  19:32:43 STEP 1299 H= 324:45 +CPU= 23.226
  19:33:10 STEP 1300 H= 325:00 +CPU= 23.901
  19:33:37 STEP 1301 H= 325:15 +CPU= 23.378
  19:34:01 STEP 1302 H= 325:30 +CPU= 23.187
  19:34:26 STEP 1303 H= 325:45 +CPU= 23.682
  19:34:51 STEP 1304 H= 326:00 +CPU= 23.687
  19:35:15 STEP 1305 H= 326:15 +CPU= 23.385
  19:35:39 STEP 1306 H= 326:30 +CPU= 23.621
  19:36:04 STEP 1307 H= 326:45 +CPU= 23.349
  19:36:34 STEP 1308 H= 327:00 +CPU= 29.440
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001308
  19:36:59 STEP 1309 H= 327:15 +CPU= 23.712
  19:37:24 STEP 1310 H= 327:30 +CPU= 23.562
  19:37:48 STEP 1311 H= 327:45 +CPU= 23.594
  19:38:15 STEP 1312 H= 328:00 +CPU= 24.263
  19:38:42 STEP 1313 H= 328:15 +CPU= 24.040
  19:39:09 STEP 1314 H= 328:30 +CPU= 24.081
  19:39:35 STEP 1315 H= 328:45 +CPU= 23.946
  19:40:00 STEP 1316 H= 329:00 +CPU= 24.071
  19:40:25 STEP 1317 H= 329:15 +CPU= 23.717
  19:40:52 STEP 1318 H= 329:30 +CPU= 23.902
  19:41:18 STEP 1319 H= 329:45 +CPU= 24.043
  19:41:49 STEP 1320 H= 330:00 +CPU= 29.606
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001320
  19:42:16 STEP 1321 H= 330:15 +CPU= 23.806
  19:42:41 STEP 1322 H= 330:30 +CPU= 23.664
  19:43:06 STEP 1323 H= 330:45 +CPU= 23.737
  19:43:32 STEP 1324 H= 331:00 +CPU= 24.242
  19:43:58 STEP 1325 H= 331:15 +CPU= 24.080
  19:44:24 STEP 1326 H= 331:30 +CPU= 24.032
  19:44:49 STEP 1327 H= 331:45 +CPU= 23.762
  19:45:15 STEP 1328 H= 332:00 +CPU= 24.344
  19:45:39 STEP 1329 H= 332:15 +CPU= 23.809
  19:46:05 STEP 1330 H= 332:30 +CPU= 23.924
  19:46:30 STEP 1331 H= 332:45 +CPU= 23.814
  19:47:03 STEP 1332 H= 333:00 +CPU= 29.636
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001332
  19:47:27 STEP 1333 H= 333:15 +CPU= 23.597
  19:47:51 STEP 1334 H= 333:30 +CPU= 23.824
  19:48:15 STEP 1335 H= 333:45 +CPU= 23.565
  19:48:40 STEP 1336 H= 334:00 +CPU= 24.055
  19:49:05 STEP 1337 H= 334:15 +CPU= 23.593
  19:49:29 STEP 1338 H= 334:30 +CPU= 23.453
  19:49:53 STEP 1339 H= 334:45 +CPU= 23.609
  19:50:19 STEP 1340 H= 335:00 +CPU= 24.293
  19:50:44 STEP 1341 H= 335:15 +CPU= 23.498
  19:51:10 STEP 1342 H= 335:30 +CPU= 23.662
  19:51:36 STEP 1343 H= 335:45 +CPU= 23.687
  19:52:12 STEP 1344 H= 336:00 +CPU= 32.734
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373_13.zip
Uploading the intermediate file: upload_file_13.zip
  19:52:40 STEP 1345 H= 336:15 +CPU= 23.864
  19:53:05 STEP 1346 H= 336:30 +CPU= 23.805
  19:53:30 STEP 1347 H= 336:45 +CPU= 23.650
  19:53:55 STEP 1348 H= 337:00 +CPU= 24.113
  19:54:19 STEP 1349 H= 337:15 +CPU= 23.290
  19:54:44 STEP 1350 H= 337:30 +CPU= 23.440
  19:55:08 STEP 1351 H= 337:45 +CPU= 23.650
  19:55:34 STEP 1352 H= 338:00 +CPU= 24.083
  19:55:58 STEP 1353 H= 338:15 +CPU= 23.701
  19:56:24 STEP 1354 H= 338:30 +CPU= 23.693
  19:56:49 STEP 1355 H= 338:45 +CPU= 23.778
  19:57:22 STEP 1356 H= 339:00 +CPU= 29.953
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001356
  19:57:47 STEP 1357 H= 339:15 +CPU= 23.832
  19:58:13 STEP 1358 H= 339:30 +CPU= 23.924
  19:58:39 STEP 1359 H= 339:45 +CPU= 23.850
  19:59:08 STEP 1360 H= 340:00 +CPU= 24.425
  19:59:36 STEP 1361 H= 340:15 +CPU= 23.976
  20:00:04 STEP 1362 H= 340:30 +CPU= 23.731
  20:00:31 STEP 1363 H= 340:45 +CPU= 23.821
  20:01:00 STEP 1364 H= 341:00 +CPU= 24.435
  20:01:27 STEP 1365 H= 341:15 +CPU= 23.996
  20:01:53 STEP 1366 H= 341:30 +CPU= 23.771
  20:02:20 STEP 1367 H= 341:45 +CPU= 23.780
  20:02:50 STEP 1368 H= 342:00 +CPU= 29.329
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001368
  20:03:14 STEP 1369 H= 342:15 +CPU= 23.487
  20:03:42 STEP 1370 H= 342:30 +CPU= 23.907
  20:04:07 STEP 1371 H= 342:45 +CPU= 23.819
  20:04:31 STEP 1372 H= 343:00 +CPU= 24.142
  20:04:55 STEP 1373 H= 343:15 +CPU= 23.362
  20:05:19 STEP 1374 H= 343:30 +CPU= 23.268
  20:05:43 STEP 1375 H= 343:45 +CPU= 23.353
  20:06:07 STEP 1376 H= 344:00 +CPU= 24.063
  20:06:31 STEP 1377 H= 344:15 +CPU= 23.464
  20:06:55 STEP 1378 H= 344:30 +CPU= 23.479
  20:07:19 STEP 1379 H= 344:45 +CPU= 23.437
  20:07:49 STEP 1380 H= 345:00 +CPU= 29.361
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001380
  20:08:13 STEP 1381 H= 345:15 +CPU= 23.438
  20:08:36 STEP 1382 H= 345:30 +CPU= 23.344
  20:09:00 STEP 1383 H= 345:45 +CPU= 23.262
  20:09:25 STEP 1384 H= 346:00 +CPU= 24.222
  20:09:49 STEP 1385 H= 346:15 +CPU= 23.791
  20:10:14 STEP 1386 H= 346:30 +CPU= 23.909
  20:10:39 STEP 1387 H= 346:45 +CPU= 23.682
  20:11:05 STEP 1388 H= 347:00 +CPU= 24.305
  20:11:29 STEP 1389 H= 347:15 +CPU= 23.951
  20:11:54 STEP 1390 H= 347:30 +CPU= 24.015
  20:12:20 STEP 1391 H= 347:45 +CPU= 25.398
  20:13:05 STEP 1392 H= 348:00 +CPU= 40.564
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001392
  20:13:36 STEP 1393 H= 348:15 +CPU= 29.248
  20:14:07 STEP 1394 H= 348:30 +CPU= 28.050
  20:14:31 STEP 1395 H= 348:45 +CPU= 23.606
  20:14:56 STEP 1396 H= 349:00 +CPU= 24.278
  20:15:20 STEP 1397 H= 349:15 +CPU= 23.387
  20:15:44 STEP 1398 H= 349:30 +CPU= 23.375
  20:16:08 STEP 1399 H= 349:45 +CPU= 23.490
  20:16:33 STEP 1400 H= 350:00 +CPU= 24.117
  20:16:57 STEP 1401 H= 350:15 +CPU= 23.267
  20:17:21 STEP 1402 H= 350:30 +CPU= 23.366
  20:17:45 STEP 1403 H= 350:45 +CPU= 23.464
  20:18:16 STEP 1404 H= 351:00 +CPU= 29.530
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001404
  20:18:40 STEP 1405 H= 351:15 +CPU= 23.433
  20:19:04 STEP 1406 H= 351:30 +CPU= 23.546
  20:19:28 STEP 1407 H= 351:45 +CPU= 23.408
  20:19:52 STEP 1408 H= 352:00 +CPU= 24.082
  20:20:17 STEP 1409 H= 352:15 +CPU= 23.429
  20:20:41 STEP 1410 H= 352:30 +CPU= 23.455
  20:21:06 STEP 1411 H= 352:45 +CPU= 23.576
  20:21:31 STEP 1412 H= 353:00 +CPU= 24.046
  20:21:56 STEP 1413 H= 353:15 +CPU= 23.656
  20:22:21 STEP 1414 H= 353:30 +CPU= 23.433
  20:22:45 STEP 1415 H= 353:45 +CPU= 23.526
  20:23:15 STEP 1416 H= 354:00 +CPU= 29.248
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001416
  20:23:40 STEP 1417 H= 354:15 +CPU= 23.532
  20:24:04 STEP 1418 H= 354:30 +CPU= 23.784
  20:24:30 STEP 1419 H= 354:45 +CPU= 23.590
  20:24:56 STEP 1420 H= 355:00 +CPU= 24.080
  20:25:21 STEP 1421 H= 355:15 +CPU= 23.610
  20:25:47 STEP 1422 H= 355:30 +CPU= 23.701
  20:26:12 STEP 1423 H= 355:45 +CPU= 23.609
  20:26:38 STEP 1424 H= 356:00 +CPU= 24.108
  20:27:04 STEP 1425 H= 356:15 +CPU= 23.599
  20:27:30 STEP 1426 H= 356:30 +CPU= 23.648
  20:27:55 STEP 1427 H= 356:45 +CPU= 23.420
  20:28:27 STEP 1428 H= 357:00 +CPU= 29.331
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001428
  20:28:53 STEP 1429 H= 357:15 +CPU= 23.512
  20:29:18 STEP 1430 H= 357:30 +CPU= 23.532
  20:29:42 STEP 1431 H= 357:45 +CPU= 23.430
  20:30:08 STEP 1432 H= 358:00 +CPU= 23.998
  20:30:33 STEP 1433 H= 358:15 +CPU= 23.575
  20:30:57 STEP 1434 H= 358:30 +CPU= 23.464
  20:31:21 STEP 1435 H= 358:45 +CPU= 23.521
  20:31:46 STEP 1436 H= 359:00 +CPU= 23.824
  20:32:10 STEP 1437 H= 359:15 +CPU= 23.595
  20:32:35 STEP 1438 H= 359:30 +CPU= 23.686
  20:33:01 STEP 1439 H= 359:45 +CPU= 23.753
  20:33:35 STEP 1440 H= 360:00 +CPU= 30.713
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.6096522033E-21      I      -0.5584397093E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2234038721E-01      I
I  Relat. Hum. I      0.4557981181E+00      I       0.5092991440E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5470139062E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313179265 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS782948.2 Mbytes/s, TOTAL TIME=    0.0152( 2.6%)
 20:33:35 STEP 1440 H= 360:00 +CPU= 30.713
 END CNT3
 NSTEP =  1440 CNT0   000000000  22.385  22.385  24.491   0.914               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN         4254/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     78    0       34      1044068     4254 ************    10.0     2.4     7.6     3.4    15.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 3762056.3 3762056.3    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 3757345.9 3757345.9     99.87      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  157    4142.5    4142.5     17.29      0.00
   9 SPCM     - SPECTRAL COMP.                     144     724.6     724.6      2.77      0.00
  10 SCAN2M - PHYSICS                              145   12281.7   12281.7     47.34      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 12     881.3     881.3      0.28      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  7      26.8      26.8      0.00      0.00
  17 GRIDFPOS IN CNT4                               12      26.9      26.9      0.01      0.00
  27 RESTART FILES - WRITING                         3    3525.0    3525.0      0.28      0.00
  28 RESTART FILES - READING                         1    4122.3    4122.3      0.11      0.00
  29 SU4FPOS IN CNT4                                12       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                12    5544.9    5544.9      1.77      0.00
  31 POSDDH IN STEPO                                 1      10.8      10.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    145    5425.9    5425.9     20.91      0.00
  39 SU0YOMB                                         1     338.3     338.3      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    145      21.1      21.1      0.08      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              144     298.2     298.2      1.14      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              144      52.5      52.5      0.20      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  7       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      316     406.6     406.6      3.42      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       300     257.0     257.0      2.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        300      88.3      88.3      0.70      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       316     134.2     134.2      1.13      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      44.3      44.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            316      44.3      44.3      0.37      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            300      22.9      22.9      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            316      41.4      41.4      0.35      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            300      18.4      18.4      0.15      0.00
 400 GSTATS                                      17691       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 16413       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     3762.1 CPU TIME    3540.5 VECTOR TIME     3540.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      344.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/9/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/9/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/9/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/9/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/9/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12210237/ICMUAh7zg+001380
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0_r812912373_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
20:37:11 (1597): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:22 1494992 22310449 oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0 1,295,100 37,372 0.0289
09 May 2023 16:50:57 1494992 22310449 oifs_43r3_bl_a2nu_2016092300_15_991_12210237_0 864,000 25,272 0.0293


©2024 cpdn.org