<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
ar/lib/boinc-client/slots/17/oifs_43r3_ps_0176_2004050100_123_973_12189820.zip
ic_ancil_file: ic_ancil_12189820
ifsdata_file: ifsdata_12189820
climate_data_file: clim_data_12189820
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d14442a2ac0729ea0658608859f0b0d7 to: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d3fc13bc4d6c0b0f7887b5f448f0c128 to: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
Opened progress file ok : /var/lib/boinc-client/slots/17/progress_file_12189820.xml
-- Model is restarting --
Adjusting last_iter, 286, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
last_cpu_time: 12186
upload_file_number: 11
last_iter: 263
last_upload: 950400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512
The child process has been launched with process id: 1964721
Executing the command: /var/lib/boinc-client/slots/17/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1964721:1964721] [20230114:075726:1673650646:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
07:58:07 STEP 264 H= 264:00 +CPU= 36.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:00:40 STEP 265 H= 265:00 +CPU= 20.865
08:01:00 STEP 266 H= 266:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:03:54 STEP 267 H= 267:00 +CPU= 32.074
08:04:16 STEP 268 H= 268:00 +CPU= 21.864
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:06:47 STEP 269 H= 269:00 +CPU= 19.852
08:07:20 STEP 270 H= 270:00 +CPU= 32.974
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:09:56 STEP 271 H= 271:00 +CPU= 20.417
08:10:18 STEP 272 H= 272:00 +CPU= 21.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:12:41 STEP 273 H= 273:00 +CPU= 32.474
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:14:54 STEP 274 H= 274:00 +CPU= 21.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:16:58 STEP 275 H= 275:00 +CPU= 20.786
08:17:34 STEP 276 H= 276:00 +CPU= 35.522
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:19:55 STEP 277 H= 277:00 +CPU= 20.146
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:22:10 STEP 278 H= 278:00 +CPU= 21.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:24:03 STEP 279 H= 279:00 +CPU= 31.928
08:24:25 STEP 280 H= 280:00 +CPU= 22.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:26:36 STEP 281 H= 281:00 +CPU= 20.614
08:27:09 STEP 282 H= 282:00 +CPU= 32.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:29:51 STEP 283 H= 283:00 +CPU= 20.763
08:30:13 STEP 284 H= 284:00 +CPU= 21.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:33:56 STEP 285 H= 285:00 +CPU= 32.430
08:34:17 STEP 286 H= 286:00 +CPU= 20.605
08:34:38 STEP 287 H= 287:00 +CPU= 20.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:37:11 STEP 288 H= 288:00 +CPU= 38.195
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000276
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_11.zip
Uploading the intermediate file: upload_file_11.zip
08:37:32 STEP 289 H= 289:00 +CPU= 20.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:40:04 STEP 290 H= 290:00 +CPU= 18.623
08:40:36 STEP 291 H= 291:00 +CPU= 32.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:43:18 STEP 292 H= 292:00 +CPU= 21.022
08:43:39 STEP 293 H= 293:00 +CPU= 21.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:45:53 STEP 294 H= 294:00 +CPU= 32.774
08:46:14 STEP 295 H= 295:00 +CPU= 20.278
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:48:47 STEP 296 H= 296:00 +CPU= 21.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:51:22 STEP 297 H= 297:00 +CPU= 32.509
08:51:44 STEP 298 H= 298:00 +CPU= 21.191
08:52:04 STEP 299 H= 299:00 +CPU= 20.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:55:01 STEP 300 H= 300:00 +CPU= 35.717
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:57:23 STEP 301 H= 301:00 +CPU= 20.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:59:16 STEP 302 H= 302:00 +CPU= 20.950
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:02:20 STEP 303 H= 303:00 +CPU= 32.651
09:02:42 STEP 304 H= 304:00 +CPU= 21.803
09:03:02 STEP 305 H= 305:00 +CPU= 20.167
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:06:26 STEP 306 H= 306:00 +CPU= 32.754
09:06:47 STEP 307 H= 307:00 +CPU= 20.992
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:09:10 STEP 308 H= 308:00 +CPU= 21.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:11:24 STEP 309 H= 309:00 +CPU= 32.496
09:11:45 STEP 310 H= 310:00 +CPU= 21.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:14:07 STEP 311 H= 311:00 +CPU= 21.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:16:26 STEP 312 H= 312:00 +CPU= 37.690
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_12.zip
Uploading the intermediate file: upload_file_12.zip
09:16:46 STEP 313 H= 313:00 +CPU= 19.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:18:23 STEP 314 H= 314:00 +CPU= 19.733
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:20:57 STEP 315 H= 315:00 +CPU= 32.816
09:21:18 STEP 316 H= 316:00 +CPU= 21.154
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:23:50 STEP 317 H= 317:00 +CPU= 20.283
09:24:23 STEP 318 H= 318:00 +CPU= 33.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:26:45 STEP 319 H= 319:00 +CPU= 21.027
09:27:07 STEP 320 H= 320:00 +CPU= 21.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:29:32 STEP 321 H= 321:00 +CPU= 33.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:31:53 STEP 322 H= 322:00 +CPU= 20.500
09:32:15 STEP 323 H= 323:00 +CPU= 21.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:35:01 STEP 324 H= 324:00 +CPU= 35.466
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000324
09:35:22 STEP 325 H= 325:00 +CPU= 20.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:37:45 STEP 326 H= 326:00 +CPU= 21.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:39:49 STEP 327 H= 327:00 +CPU= 32.661
09:40:10 STEP 328 H= 328:00 +CPU= 20.734
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:42:12 STEP 329 H= 329:00 +CPU= 20.099
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:44:27 STEP 330 H= 330:00 +CPU= 33.466
09:44:48 STEP 331 H= 331:00 +CPU= 20.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:46:59 STEP 332 H= 332:00 +CPU= 21.053
09:47:31 STEP 333 H= 333:00 +CPU= 32.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:50:04 STEP 334 H= 334:00 +CPU= 21.565
09:50:25 STEP 335 H= 335:00 +CPU= 20.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:54:36 STEP 336 H= 336:00 +CPU= 38.862
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_13.zip
Uploading the intermediate file: upload_file_13.zip
09:54:57 STEP 337 H= 337:00 +CPU= 20.704
09:55:18 STEP 338 H= 338:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0176
(argv4) batchid: 973
(argv5) wuid: 12189820
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/17
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bf2e32465287a2c0600f81c21ae91dda to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0176_2004050100_123_973_12189820.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0176_2004050100_123_973_12189820.zip
ic_ancil_file: ic_ancil_12189820
ifsdata_file: ifsdata_12189820
climate_data_file: clim_data_12189820
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d14442a2ac0729ea0658608859f0b0d7 to: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d3fc13bc4d6c0b0f7887b5f448f0c128 to: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
Opened progress file ok : /var/lib/boinc-client/slots/17/progress_file_12189820.xml
-- Model is restarting --
Adjusting last_iter, 339, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
last_cpu_time: 14087
upload_file_number: 14
last_iter: 335
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512
The child process has been launched with process id: 1982427
Executing the command: /var/lib/boinc-client/slots/17/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1982427:1982427] [20230114:100000:1673658000:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
10:00:39 STEP 336 H= 336:00 +CPU= 36.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:05:31 STEP 337 H= 337:00 +CPU= 20.685
10:05:53 STEP 338 H= 338:00 +CPU= 21.286
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:08:36 STEP 339 H= 339:00 +CPU= 32.124
10:08:56 STEP 340 H= 340:00 +CPU= 20.127
10:09:16 STEP 341 H= 341:00 +CPU= 19.167
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:12:00 STEP 342 H= 342:00 +CPU= 33.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:14:22 STEP 343 H= 343:00 +CPU= 20.622
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:16:34 STEP 344 H= 344:00 +CPU= 21.184
10:17:07 STEP 345 H= 345:00 +CPU= 32.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:20:10 STEP 346 H= 346:00 +CPU= 21.034
10:20:31 STEP 347 H= 347:00 +CPU= 20.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:25:51 STEP 348 H= 348:00 +CPU= 35.910
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000348
10:26:11 STEP 349 H= 349:00 +CPU= 20.303
10:26:32 STEP 350 H= 350:00 +CPU= 20.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:29:47 STEP 351 H= 351:00 +CPU= 32.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:32:10 STEP 352 H= 352:00 +CPU= 21.090
10:32:30 STEP 353 H= 353:00 +CPU= 20.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:36:24 STEP 354 H= 354:00 +CPU= 33.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:39:26 STEP 355 H= 355:00 +CPU= 20.622
10:39:48 STEP 356 H= 356:00 +CPU= 21.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:45:04 STEP 357 H= 357:00 +CPU= 33.334
10:45:26 STEP 358 H= 358:00 +CPU= 22.037
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:48:08 STEP 359 H= 359:00 +CPU= 21.222
10:48:47 STEP 360 H= 360:00 +CPU= 38.177
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_14.zip
Uploading the intermediate file: upload_file_14.zip
10:49:06 STEP 361 H= 361:00 +CPU= 19.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:52:18 STEP 362 H= 362:00 +CPU= 20.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:55:13 STEP 363 H= 363:00 +CPU= 32.988
10:55:34 STEP 364 H= 364:00 +CPU= 20.923
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:58:46 STEP 365 H= 365:00 +CPU= 20.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:01:32 STEP 366 H= 366:00 +CPU= 33.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:04:13 STEP 367 H= 367:00 +CPU= 20.004
11:04:34 STEP 368 H= 368:00 +CPU= 20.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:08:19 STEP 369 H= 369:00 +CPU= 33.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:11:22 STEP 370 H= 370:00 +CPU= 20.791
11:11:42 STEP 371 H= 371:00 +CPU= 20.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:14:52 STEP 372 H= 372:00 +CPU= 37.080
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000372
11:17:34 STEP 373 H= 373:00 +CPU= 20.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:20:46 STEP 374 H= 374:00 +CPU= 21.178
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:23:51 STEP 375 H= 375:00 +CPU= 32.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:27:04 STEP 376 H= 376:00 +CPU= 21.168
11:27:24 STEP 377 H= 377:00 +CPU= 20.236
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:30:30 STEP 378 H= 378:00 +CPU= 33.433
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:34:02 STEP 379 H= 379:00 +CPU= 20.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:36:34 STEP 380 H= 380:00 +CPU= 21.103
11:37:07 STEP 381 H= 381:00 +CPU= 32.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:40:09 STEP 382 H= 382:00 +CPU= 20.550
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:42:52 STEP 383 H= 383:00 +CPU= 21.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:46:12 STEP 384 H= 384:00 +CPU= 38.698
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_15.zip
Uploading the intermediate file: upload_file_15.zip
11:46:33 STEP 385 H= 385:00 +CPU= 20.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:49:33 STEP 386 H= 386:00 +CPU= 20.904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:52:47 STEP 387 H= 387:00 +CPU= 32.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:55:19 STEP 388 H= 388:00 +CPU= 21.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:58:12 STEP 389 H= 389:00 +CPU= 20.996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:00:38 STEP 390 H= 390:00 +CPU= 34.314
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0176
(argv4) batchid: 973
(argv5) wuid: 12189820
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/17
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bf2e32465287a2c0600f81c21ae91dda to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0176_2004050100_123_973_12189820.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0176_2004050100_123_973_12189820.zip
ic_ancil_file: ic_ancil_12189820
ifsdata_file: ifsdata_12189820
climate_data_file: clim_data_12189820
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d14442a2ac0729ea0658608859f0b0d7 to: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/17/ic_ancil_12189820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d3fc13bc4d6c0b0f7887b5f448f0c128 to: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12189820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/17/159l_2/clim_data_12189820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
Opened progress file ok : /var/lib/boinc-client/slots/17/progress_file_12189820.xml
-- Model is restarting --
Adjusting last_iter, 390, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/17/progress_file_12189820.xml
last_cpu_time: 15481
upload_file_number: 16
last_iter: 383
last_upload: 1382400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512
The child process has been launched with process id: 2004505
Executing the command: /var/lib/boinc-client/slots/17/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2004505:2004505] [20230114:120713:1673665633:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:10:28 STEP 384 H= 384:00 +CPU= 37.817
12:10:48 STEP 385 H= 385:00 +CPU= 20.053
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:14:31 STEP 386 H= 386:00 +CPU= 21.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:17:15 STEP 387 H= 387:00 +CPU= 33.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:19:48 STEP 388 H= 388:00 +CPU= 21.435
12:20:08 STEP 389 H= 389:00 +CPU= 20.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:24:43 STEP 390 H= 390:00 +CPU= 33.585
12:25:03 STEP 391 H= 391:00 +CPU= 19.757
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:28:45 STEP 392 H= 392:00 +CPU= 21.511
12:29:17 STEP 393 H= 393:00 +CPU= 32.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:32:49 STEP 394 H= 394:00 +CPU= 20.581
12:33:09 STEP 395 H= 395:00 +CPU= 20.251
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:35:55 STEP 396 H= 396:00 +CPU= 35.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000396
12:38:26 STEP 397 H= 397:00 +CPU= 19.575
12:38:47 STEP 398 H= 398:00 +CPU= 20.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:41:40 STEP 399 H= 399:00 +CPU= 31.499
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:44:21 STEP 400 H= 400:00 +CPU= 20.613
12:44:41 STEP 401 H= 401:00 +CPU= 19.980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:47:25 STEP 402 H= 402:00 +CPU= 32.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:16 STEP 403 H= 403:00 +CPU= 19.694
12:50:37 STEP 404 H= 404:00 +CPU= 20.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:53:40 STEP 405 H= 405:00 +CPU= 31.772
12:54:01 STEP 406 H= 406:00 +CPU= 20.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:56:43 STEP 407 H= 407:00 +CPU= 21.044
12:57:21 STEP 408 H= 408:00 +CPU= 37.489
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_16.zip
Uploading the intermediate file: upload_file_16.zip
12:57:38 STEP 409 H= 409:00 +CPU= 17.616
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:00:23 STEP 410 H= 410:00 +CPU= 20.542
13:00:55 STEP 411 H= 411:00 +CPU= 31.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:04:07 STEP 412 H= 412:00 +CPU= 20.377
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:06:28 STEP 413 H= 413:00 +CPU= 20.265
13:07:02 STEP 414 H= 414:00 +CPU= 33.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:10:03 STEP 415 H= 415:00 +CPU= 20.464
13:10:24 STEP 416 H= 416:00 +CPU= 20.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:13:38 STEP 417 H= 417:00 +CPU= 32.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:16:11 STEP 418 H= 418:00 +CPU= 20.384
13:16:31 STEP 419 H= 419:00 +CPU= 19.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:19:38 STEP 420 H= 420:00 +CPU= 36.131
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:22:39 STEP 421 H= 421:00 +CPU= 20.600
13:23:00 STEP 422 H= 422:00 +CPU= 21.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:27:05 STEP 423 H= 423:00 +CPU= 31.950
13:27:25 STEP 424 H= 424:00 +CPU= 20.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:30:17 STEP 425 H= 425:00 +CPU= 20.289
13:30:51 STEP 426 H= 426:00 +CPU= 34.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:33:53 STEP 427 H= 427:00 +CPU= 20.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:36:25 STEP 428 H= 428:00 +CPU= 20.814
13:36:57 STEP 429 H= 429:00 +CPU= 32.299
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:58 STEP 430 H= 430:00 +CPU= 20.676
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:42:41 STEP 431 H= 431:00 +CPU= 21.368
13:43:19 STEP 432 H= 432:00 +CPU= 38.128
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_17.zip
Uploading the intermediate file: upload_file_17.zip
13:43:38 STEP 433 H= 433:00 +CPU= 18.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:46:27 STEP 434 H= 434:00 +CPU= 21.329
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:49:21 STEP 435 H= 435:00 +CPU= 32.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:24 STEP 436 H= 436:00 +CPU= 20.909
13:52:45 STEP 437 H= 437:00 +CPU= 21.025
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:59:12 STEP 438 H= 438:00 +CPU= 33.583
13:59:33 STEP 439 H= 439:00 +CPU= 20.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:50 STEP 440 H= 440:00 +CPU= 21.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:45 STEP 441 H= 441:00 +CPU= 33.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:16 STEP 442 H= 442:00 +CPU= 20.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:28:28 STEP 443 H= 443:00 +CPU= 19.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:35 STEP 444 H= 444:00 +CPU= 35.784
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000444
23:31:55 STEP 445 H= 445:00 +CPU= 20.660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:57 STEP 446 H= 446:00 +CPU= 20.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:36:41 STEP 447 H= 447:00 +CPU= 32.316
23:37:01 STEP 448 H= 448:00 +CPU= 20.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:39:33 STEP 449 H= 449:00 +CPU= 20.213
23:40:05 STEP 450 H= 450:00 +CPU= 32.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:07 STEP 451 H= 451:00 +CPU= 20.464
23:43:28 STEP 452 H= 452:00 +CPU= 20.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:21 STEP 453 H= 453:00 +CPU= 31.808
23:46:41 STEP 454 H= 454:00 +CPU= 20.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:42 STEP 455 H= 455:00 +CPU= 20.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:01 STEP 456 H= 456:00 +CPU= 37.452
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189820/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0176_2004050100_123_973_12189820_0_r1255580512_18.zip
Uploading the intermediate file: upload_file_18.zip
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 11 MAX ETADOT VERTICAL VEL.= 1.647295309272612E-007
LON = 11.2500000000000 degrees
LAT = -40.9343383242788 degrees
23:52:19 STEP 457 H= 457:00 +CPU= 18.356
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 13 MAX ETADOT VERTICAL VEL.= 1.804872680323478E-007
LON = 9.84375000000005 degrees
LAT = -42.0558239509352 degrees
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:27 STEP 458 H= 458:00 +CPU= 19.629
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 13 MAX ETADOT VERTICAL VEL.= 1.232093012962523E-007
LON = 9.84375000000005 degrees
LAT = -42.0558239509352 degrees
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:57:01 STEP 459 H= 459:00 +CPU= 32.192
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 14 MAX ETADOT VERTICAL VEL.= 4.907604682519945E-008
LON = 8.43750000000003 degrees
LAT = -42.0558239509352 degrees
23:57:22 STEP 460 H= 460:00 +CPU= 20.999
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 14 MAX ETADOT VERTICAL VEL.= 9.779841362852828E-008
LON = 8.43750000000003 degrees
LAT = -43.1773092288349 degrees
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:59:43 STEP 461 H= 461:00 +CPU= 20.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:02:57 STEP 462 H= 462:00 +CPU= 32.568
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 15 MAX ETADOT VERTICAL VEL.= 3.682795233134543E-007
LON = 7.03125000000001 degrees
LAT = -44.2987941306940 degrees
00:03:17 STEP 463 H= 463:00 +CPU= 20.467
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:29 STEP 464 H= 464:00 +CPU= 20.623
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 16 MAX ETADOT VERTICAL VEL.= 2.501885431475228E-007
LON = 5.62499999999998 degrees
LAT = -45.4202786265483 degrees
00:06:01 STEP 465 H= 465:00 +CPU= 32.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:04 STEP 466 H= 466:00 +CPU= 20.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:10:44 STEP 467 H= 467:00 +CPU= 19.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:21 STEP 468 H= 468:00 +CPU= 35.172
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+000468
00:13:41 STEP 469 H= 469:00 +CPU= 20.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:15:43 STEP 470 H= 470:00 +CPU= 21.192
Suspend request received from the BOINC client, suspending the child process
double free or corruption (out)
</stderr_txt>
]]>
