climateprediction.net home page
Task 22285511

Task 22285511

Name oifs_43r3_ps_0702_2013050100_123_982_12199346_0
Workunit 12199346
Created 24 Dec 2022, 8:15:36 UTC
Sent 10 Jan 2023, 0:20:58 UTC
Report deadline 9 Feb 2023, 0:20:58 UTC
Received 10 Jan 2023, 6:17:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1521250
Run time 2 hours 38 min 8 sec
CPU time 2 hours 38 min 8 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.29 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 3,694.03 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,012.14 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1716:1716] [20230110:033344:1673321624:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1716:1716] [20230110:033344:1673321624:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1716:1716] [20230110:033344:1673321624:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1716:1716] [20230110:033344:1673321624:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1716:1716] [20230110:033344:1673321624:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:34:43 STEP  120 H= 120:00 +CPU= 42.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:35:13 STEP  121 H= 121:00 +CPU= 23.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:35:36 STEP  122 H= 122:00 +CPU= 21.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:36:13 STEP  123 H= 123:00 +CPU= 32.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:36:36 STEP  124 H= 124:00 +CPU= 21.307
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:37:01 STEP  125 H= 125:00 +CPU= 20.664
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:37:36 STEP  126 H= 126:00 +CPU= 33.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:38:01 STEP  127 H= 127:00 +CPU= 20.684
  03:38:22 STEP  128 H= 128:00 +CPU= 21.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:38:59 STEP  129 H= 129:00 +CPU= 32.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:39:23 STEP  130 H= 130:00 +CPU= 21.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:39:45 STEP  131 H= 131:00 +CPU= 20.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:40:26 STEP  132 H= 132:00 +CPU= 36.376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:40:49 STEP  133 H= 133:00 +CPU= 20.807
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:41:12 STEP  134 H= 134:00 +CPU= 21.320
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:41:49 STEP  135 H= 135:00 +CPU= 32.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:42:12 STEP  136 H= 136:00 +CPU= 21.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:42:35 STEP  137 H= 137:00 +CPU= 20.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:43:13 STEP  138 H= 138:00 +CPU= 33.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:43:35 STEP  139 H= 139:00 +CPU= 20.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:44:01 STEP  140 H= 140:00 +CPU= 21.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:44:36 STEP  141 H= 141:00 +CPU= 32.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:45:01 STEP  142 H= 142:00 +CPU= 21.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:45:25 STEP  143 H= 143:00 +CPU= 21.597
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:46:10 STEP  144 H= 144:00 +CPU= 38.420
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_5.zip
Uploading the intermediate file: upload_file_5.zip
  03:46:31 STEP  145 H= 145:00 +CPU= 20.839
  03:46:52 STEP  146 H= 146:00 +CPU= 21.295
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:47:29 STEP  147 H= 147:00 +CPU= 32.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:47:52 STEP  148 H= 148:00 +CPU= 21.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:48:15 STEP  149 H= 149:00 +CPU= 20.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:48:52 STEP  150 H= 150:00 +CPU= 33.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:49:15 STEP  151 H= 151:00 +CPU= 20.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:49:41 STEP  152 H= 152:00 +CPU= 21.419
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:50:16 STEP  153 H= 153:00 +CPU= 32.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:50:41 STEP  154 H= 154:00 +CPU= 21.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:51:04 STEP  155 H= 155:00 +CPU= 20.826
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:51:44 STEP  156 H= 156:00 +CPU= 36.064
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:52:07 STEP  157 H= 157:00 +CPU= 20.741
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:52:30 STEP  158 H= 158:00 +CPU= 21.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:53:07 STEP  159 H= 159:00 +CPU= 32.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:53:30 STEP  160 H= 160:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:53:53 STEP  161 H= 161:00 +CPU= 20.686
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:54:31 STEP  162 H= 162:00 +CPU= 33.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:54:53 STEP  163 H= 163:00 +CPU= 20.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:55:17 STEP  164 H= 164:00 +CPU= 21.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:55:53 STEP  165 H= 165:00 +CPU= 32.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:56:17 STEP  166 H= 166:00 +CPU= 21.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:56:42 STEP  167 H= 167:00 +CPU= 21.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:57:25 STEP  168 H= 168:00 +CPU= 38.032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_6.zip
Uploading the intermediate file: upload_file_6.zip
  03:57:46 STEP  169 H= 169:00 +CPU= 21.036
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:58:10 STEP  170 H= 170:00 +CPU= 21.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:58:47 STEP  171 H= 171:00 +CPU= 32.676
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:59:10 STEP  172 H= 172:00 +CPU= 21.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:59:33 STEP  173 H= 173:00 +CPU= 20.544
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:00:10 STEP  174 H= 174:00 +CPU= 33.484
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:00:33 STEP  175 H= 175:00 +CPU= 20.686
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:00:56 STEP  176 H= 176:00 +CPU= 21.199
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:01:33 STEP  177 H= 177:00 +CPU= 32.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:01:57 STEP  178 H= 178:00 +CPU= 21.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:02:22 STEP  179 H= 179:00 +CPU= 21.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:03:02 STEP  180 H= 180:00 +CPU= 36.202
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:03:25 STEP  181 H= 181:00 +CPU= 20.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:03:49 STEP  182 H= 182:00 +CPU= 21.343
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:04:26 STEP  183 H= 183:00 +CPU= 32.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:04:49 STEP  184 H= 184:00 +CPU= 21.690
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:05:12 STEP  185 H= 185:00 +CPU= 20.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:05:50 STEP  186 H= 186:00 +CPU= 33.675
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:06:13 STEP  187 H= 187:00 +CPU= 20.667
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:06:36 STEP  188 H= 188:00 +CPU= 21.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:07:13 STEP  189 H= 189:00 +CPU= 32.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:07:37 STEP  190 H= 190:00 +CPU= 21.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:08:02 STEP  191 H= 191:00 +CPU= 21.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:08:48 STEP  192 H= 192:00 +CPU= 38.543
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000180
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_7.zip
Uploading the intermediate file: upload_file_7.zip
  04:09:09 STEP  193 H= 193:00 +CPU= 20.966
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:09:32 STEP  194 H= 194:00 +CPU= 21.397
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:10:09 STEP  195 H= 195:00 +CPU= 32.708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:10:33 STEP  196 H= 196:00 +CPU= 21.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:10:55 STEP  197 H= 197:00 +CPU= 20.817
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:11:33 STEP  198 H= 198:00 +CPU= 33.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:11:56 STEP  199 H= 199:00 +CPU= 20.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:12:21 STEP  200 H= 200:00 +CPU= 21.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:12:56 STEP  201 H= 201:00 +CPU= 32.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:13:21 STEP  202 H= 202:00 +CPU= 21.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:13:44 STEP  203 H= 203:00 +CPU= 20.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:14:24 STEP  204 H= 204:00 +CPU= 35.984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:14:47 STEP  205 H= 205:00 +CPU= 20.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:15:11 STEP  206 H= 206:00 +CPU= 21.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:15:48 STEP  207 H= 207:00 +CPU= 32.801
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:16:11 STEP  208 H= 208:00 +CPU= 21.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:16:33 STEP  209 H= 209:00 +CPU= 20.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:17:11 STEP  210 H= 210:00 +CPU= 33.765
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:17:34 STEP  211 H= 211:00 +CPU= 20.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:17:57 STEP  212 H= 212:00 +CPU= 21.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:18:34 STEP  213 H= 213:00 +CPU= 32.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:19:00 STEP  214 H= 214:00 +CPU= 21.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:19:23 STEP  215 H= 215:00 +CPU= 21.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:20:06 STEP  216 H= 216:00 +CPU= 38.905
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000204
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_8.zip
Uploading the intermediate file: upload_file_8.zip
  04:20:30 STEP  217 H= 217:00 +CPU= 21.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:20:54 STEP  218 H= 218:00 +CPU= 21.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:21:32 STEP  219 H= 219:00 +CPU= 33.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:21:57 STEP  220 H= 220:00 +CPU= 22.112
  04:22:17 STEP  221 H= 221:00 +CPU= 20.496
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:22:56 STEP  222 H= 222:00 +CPU= 33.722
  04:23:16 STEP  223 H= 223:00 +CPU= 20.359
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:23:41 STEP  224 H= 224:00 +CPU= 21.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:24:16 STEP  225 H= 225:00 +CPU= 32.966
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:24:42 STEP  226 H= 226:00 +CPU= 21.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:25:05 STEP  227 H= 227:00 +CPU= 20.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:25:45 STEP  228 H= 228:00 +CPU= 35.969
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000228
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:26:07 STEP  229 H= 229:00 +CPU= 20.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:26:31 STEP  230 H= 230:00 +CPU= 21.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:27:08 STEP  231 H= 231:00 +CPU= 32.823
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:27:31 STEP  232 H= 232:00 +CPU= 21.336
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:27:54 STEP  233 H= 233:00 +CPU= 20.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:28:31 STEP  234 H= 234:00 +CPU= 33.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:28:54 STEP  235 H= 235:00 +CPU= 20.811
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:29:17 STEP  236 H= 236:00 +CPU= 21.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:29:54 STEP  237 H= 237:00 +CPU= 33.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:30:18 STEP  238 H= 238:00 +CPU= 21.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:30:43 STEP  239 H= 239:00 +CPU= 21.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:31:27 STEP  240 H= 240:00 +CPU= 39.360
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000228
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_9.zip
Uploading the intermediate file: upload_file_9.zip
  04:31:48 STEP  241 H= 241:00 +CPU= 20.934
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:32:12 STEP  242 H= 242:00 +CPU= 21.075
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:32:49 STEP  243 H= 243:00 +CPU= 33.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:33:13 STEP  244 H= 244:00 +CPU= 21.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:33:36 STEP  245 H= 245:00 +CPU= 20.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:34:13 STEP  246 H= 246:00 +CPU= 33.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:34:37 STEP  247 H= 247:00 +CPU= 21.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:35:02 STEP  248 H= 248:00 +CPU= 21.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:35:37 STEP  249 H= 249:00 +CPU= 32.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:36:03 STEP  250 H= 250:00 +CPU= 21.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:36:25 STEP  251 H= 251:00 +CPU= 20.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:37:06 STEP  252 H= 252:00 +CPU= 36.487
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:37:29 STEP  253 H= 253:00 +CPU= 21.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:37:52 STEP  254 H= 254:00 +CPU= 21.181
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:38:29 STEP  255 H= 255:00 +CPU= 33.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:38:53 STEP  256 H= 256:00 +CPU= 21.703
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:39:16 STEP  257 H= 257:00 +CPU= 20.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:39:53 STEP  258 H= 258:00 +CPU= 33.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:40:17 STEP  259 H= 259:00 +CPU= 21.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:40:42 STEP  260 H= 260:00 +CPU= 21.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:41:17 STEP  261 H= 261:00 +CPU= 33.154
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:41:43 STEP  262 H= 262:00 +CPU= 21.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:42:06 STEP  263 H= 263:00 +CPU= 21.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:42:51 STEP  264 H= 264:00 +CPU= 39.224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000252
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_10.zip
Uploading the intermediate file: upload_file_10.zip
  04:43:12 STEP  265 H= 265:00 +CPU= 20.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:43:36 STEP  266 H= 266:00 +CPU= 21.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:44:13 STEP  267 H= 267:00 +CPU= 33.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:44:37 STEP  268 H= 268:00 +CPU= 21.699
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:45:01 STEP  269 H= 269:00 +CPU= 20.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:45:37 STEP  270 H= 270:00 +CPU= 33.644
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:46:02 STEP  271 H= 271:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:46:26 STEP  272 H= 272:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:47:02 STEP  273 H= 273:00 +CPU= 32.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:47:26 STEP  274 H= 274:00 +CPU= 21.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:47:49 STEP  275 H= 275:00 +CPU= 20.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:48:30 STEP  276 H= 276:00 +CPU= 36.864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:48:54 STEP  277 H= 277:00 +CPU= 21.285
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:49:17 STEP  278 H= 278:00 +CPU= 21.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:49:54 STEP  279 H= 279:00 +CPU= 32.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:50:17 STEP  280 H= 280:00 +CPU= 21.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:50:42 STEP  281 H= 281:00 +CPU= 20.599
  04:51:15 STEP  282 H= 282:00 +CPU= 33.056
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:51:40 STEP  283 H= 283:00 +CPU= 20.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:52:03 STEP  284 H= 284:00 +CPU= 21.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:52:40 STEP  285 H= 285:00 +CPU= 32.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:53:04 STEP  286 H= 286:00 +CPU= 21.683
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:53:27 STEP  287 H= 287:00 +CPU= 21.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:54:12 STEP  288 H= 288:00 +CPU= 39.189
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2013050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0702
(argv4) batchid: 982
(argv5) wuid: 12199346
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_344bafc22d73843a052f0d35bcdacb5c to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0702_2013050100_123_982_12199346.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0702_2013050100_123_982_12199346.zip
ic_ancil_file: ic_ancil_12199346
ifsdata_file: ifsdata_12199346
climate_data_file: clim_data_12199346
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_8964f374aa26be52b0b5e0cf1ebd67cd to: /var/lib/boinc-client/slots/1/ic_ancil_12199346.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12199346.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_52aa832777852dbba5d20a8aa16ac3f3 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12199346.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12199346.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12199346.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12199346.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12199346.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12199346.xml
-- Model is restarting --
Adjusting last_iter, 288, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12199346.xml
last_cpu_time: 8071
upload_file_number: 11
last_iter: 287
last_upload: 950400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655
The child process has been launched with process id: 1698
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:RedWilts:1:1:1698:1698] [20230110:045540:1673326540:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:56:34 STEP  288 H= 288:00 +CPU= 40.141
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000276
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:57:11 STEP  289 H= 289:00 +CPU= 23.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:57:38 STEP  290 H= 290:00 +CPU= 22.112
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:58:16 STEP  291 H= 291:00 +CPU= 34.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:58:40 STEP  292 H= 292:00 +CPU= 21.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:59:03 STEP  293 H= 293:00 +CPU= 21.246
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:59:41 STEP  294 H= 294:00 +CPU= 33.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:00:04 STEP  295 H= 295:00 +CPU= 21.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:00:29 STEP  296 H= 296:00 +CPU= 22.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:01:06 STEP  297 H= 297:00 +CPU= 33.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:01:30 STEP  298 H= 298:00 +CPU= 21.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:14:08 STEP  299 H= 299:00 +CPU= 30.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:14:49 STEP  300 H= 300:00 +CPU= 36.535
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:15:12 STEP  301 H= 301:00 +CPU= 21.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:15:36 STEP  302 H= 302:00 +CPU= 21.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:16:13 STEP  303 H= 303:00 +CPU= 32.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:16:36 STEP  304 H= 304:00 +CPU= 21.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:17:02 STEP  305 H= 305:00 +CPU= 21.010
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:17:37 STEP  306 H= 306:00 +CPU= 33.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:18:02 STEP  307 H= 307:00 +CPU= 20.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:18:26 STEP  308 H= 308:00 +CPU= 21.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:19:03 STEP  309 H= 309:00 +CPU= 32.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:19:26 STEP  310 H= 310:00 +CPU= 21.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:19:50 STEP  311 H= 311:00 +CPU= 21.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:20:34 STEP  312 H= 312:00 +CPU= 38.556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:20:54 STEP  313 H= 313:00 +CPU= 20.731
  05:21:16 STEP  314 H= 314:00 +CPU= 21.508
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:21:52 STEP  315 H= 315:00 +CPU= 32.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:22:16 STEP  316 H= 316:00 +CPU= 21.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:22:42 STEP  317 H= 317:00 +CPU= 21.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:23:17 STEP  318 H= 318:00 +CPU= 33.200
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:23:42 STEP  319 H= 319:00 +CPU= 21.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:24:06 STEP  320 H= 320:00 +CPU= 21.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:24:42 STEP  321 H= 321:00 +CPU= 32.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:25:06 STEP  322 H= 322:00 +CPU= 21.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:25:29 STEP  323 H= 323:00 +CPU= 21.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:26:10 STEP  324 H= 324:00 +CPU= 36.751
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000324
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:26:33 STEP  325 H= 325:00 +CPU= 21.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:26:57 STEP  326 H= 326:00 +CPU= 21.673
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:27:33 STEP  327 H= 327:00 +CPU= 32.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:27:57 STEP  328 H= 328:00 +CPU= 21.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:28:22 STEP  329 H= 329:00 +CPU= 20.664
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:28:58 STEP  330 H= 330:00 +CPU= 33.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:29:23 STEP  331 H= 331:00 +CPU= 21.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:29:46 STEP  332 H= 332:00 +CPU= 21.598
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:30:23 STEP  333 H= 333:00 +CPU= 32.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:30:47 STEP  334 H= 334:00 +CPU= 21.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:31:11 STEP  335 H= 335:00 +CPU= 21.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:31:54 STEP  336 H= 336:00 +CPU= 38.508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12199346/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0702_2013050100_123_982_12199346_0_r1714902655_13.zip
Uploading the intermediate file: upload_file_13.zip
  05:32:15 STEP  337 H= 337:00 +CPU= 20.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:32:38 STEP  338 H= 338:00 +CPU= 21.734
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:33:14 STEP  339 H= 339:00 +CPU= 31.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:33:35 STEP  340 H= 340:00 +CPU= 19.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:33:56 STEP  341 H= 341:00 +CPU= 18.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net