<core_client_version>7.22.0</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
ts/5/ic_ancil_12209442.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/5/ic_ancil_12209442.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_49cfdff6766dbade2d820da5ff4e09a4 to: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Checking for progress XML file: /var/lib/boinc/slots/5/progress_file_12209442.xml
Opened progress file ok : /var/lib/boinc/slots/5/progress_file_12209442.xml
-- Model is restarting --
Adjusting last_iter, 338, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/5/progress_file_12209442.xml
last_cpu_time: 8754
upload_file_number: 3
last_iter: 337
last_upload: 259200
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a21r_2016092300_15_991_12209442_0_r935592218
The child process has been launched with process id: 24339
Executing the command: /var/lib/boinc/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:24339:24339] [20230217:175121:1676652681:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
17:51:48 STEP 336 H= 84:00 +CPU= 22.224
17:52:09 STEP 337 H= 84:15 +CPU= 19.372
17:52:29 STEP 338 H= 84:30 +CPU= 18.379
17:52:47 STEP 339 H= 84:45 +CPU= 17.110
17:53:05 STEP 340 H= 85:00 +CPU= 17.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:53:43 STEP 341 H= 85:15 +CPU= 17.049
17:54:01 STEP 342 H= 85:30 +CPU= 16.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:54:40 STEP 343 H= 85:45 +CPU= 17.043
17:54:58 STEP 344 H= 86:00 +CPU= 17.601
17:55:16 STEP 345 H= 86:15 +CPU= 16.724
17:55:33 STEP 346 H= 86:30 +CPU= 16.988
17:55:51 STEP 347 H= 86:45 +CPU= 16.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:56:34 STEP 348 H= 87:00 +CPU= 21.206
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000348
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000348
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000348
17:56:51 STEP 349 H= 87:15 +CPU= 16.865
17:57:09 STEP 350 H= 87:30 +CPU= 16.869
17:57:27 STEP 351 H= 87:45 +CPU= 17.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:58:05 STEP 352 H= 88:00 +CPU= 16.719
17:58:23 STEP 353 H= 88:15 +CPU= 17.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:59:22 STEP 354 H= 88:30 +CPU= 16.171
17:59:39 STEP 355 H= 88:45 +CPU= 16.626
17:59:57 STEP 356 H= 89:00 +CPU= 17.024
18:00:15 STEP 357 H= 89:15 +CPU= 16.964
18:00:32 STEP 358 H= 89:30 +CPU= 17.060
18:00:50 STEP 359 H= 89:45 +CPU= 16.664
18:01:12 STEP 360 H= 90:00 +CPU= 21.496
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000360
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000360
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000360
18:01:30 STEP 361 H= 90:15 +CPU= 17.457
18:01:48 STEP 362 H= 90:30 +CPU= 17.112
18:02:06 STEP 363 H= 90:45 +CPU= 16.535
18:02:24 STEP 364 H= 91:00 +CPU= 17.433
18:02:42 STEP 365 H= 91:15 +CPU= 16.943
18:02:59 STEP 366 H= 91:30 +CPU= 16.320
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:03:38 STEP 367 H= 91:45 +CPU= 16.680
18:03:56 STEP 368 H= 92:00 +CPU= 17.290
18:04:14 STEP 369 H= 92:15 +CPU= 17.016
18:04:31 STEP 370 H= 92:30 +CPU= 16.729
18:04:49 STEP 371 H= 92:45 +CPU= 16.619
18:05:11 STEP 372 H= 93:00 +CPU= 21.569
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000372
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000372
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000372
18:05:29 STEP 373 H= 93:15 +CPU= 16.908
18:05:46 STEP 374 H= 93:30 +CPU= 16.815
18:06:04 STEP 375 H= 93:45 +CPU= 16.914
18:06:22 STEP 376 H= 94:00 +CPU= 16.840
18:06:39 STEP 377 H= 94:15 +CPU= 16.333
18:07:03 STEP 378 H= 94:30 +CPU= 17.374
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:10:19 STEP 379 H= 94:45 +CPU= 19.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:10:55 STEP 380 H= 95:00 +CPU= 15.131
18:11:10 STEP 381 H= 95:15 +CPU= 14.071
18:11:24 STEP 382 H= 95:30 +CPU= 14.340
18:11:40 STEP 383 H= 95:45 +CPU= 14.991
18:12:01 STEP 384 H= 96:00 +CPU= 20.856
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000384
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000384
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000300
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000300
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000300
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000324
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000324
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000324
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000348
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000348
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000348
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000372
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000372
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000372
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a21r_2016092300_15_991_12209442_0_r935592218_3.zip
Uploading the intermediate file: upload_file_3.zip
18:12:16 STEP 385 H= 96:15 +CPU= 14.569
18:12:31 STEP 386 H= 96:30 +CPU= 14.274
18:12:45 STEP 387 H= 96:45 +CPU= 14.280
18:13:01 STEP 388 H= 97:00 +CPU= 15.205
18:13:15 STEP 389 H= 97:15 +CPU= 14.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:13:50 STEP 390 H= 97:30 +CPU= 13.654
18:14:04 STEP 391 H= 97:45 +CPU= 13.043
18:14:17 STEP 392 H= 98:00 +CPU= 13.522
18:14:31 STEP 393 H= 98:15 +CPU= 13.082
18:14:45 STEP 394 H= 98:30 +CPU= 13.673
18:14:59 STEP 395 H= 98:45 +CPU= 13.881
18:15:18 STEP 396 H= 99:00 +CPU= 18.235
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000396
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000396
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000396
18:15:33 STEP 397 H= 99:15 +CPU= 14.974
18:15:48 STEP 398 H= 99:30 +CPU= 14.624
18:16:02 STEP 399 H= 99:45 +CPU= 13.293
18:16:17 STEP 400 H= 100:00 +CPU= 14.534
18:16:34 STEP 401 H= 100:15 +CPU= 16.049
18:16:54 STEP 402 H= 100:30 +CPU= 19.073
18:17:13 STEP 403 H= 100:45 +CPU= 18.606
18:17:33 STEP 404 H= 101:00 +CPU= 18.566
18:17:52 STEP 405 H= 101:15 +CPU= 17.918
18:18:11 STEP 406 H= 101:30 +CPU= 18.648
18:18:30 STEP 407 H= 101:45 +CPU= 17.888
18:18:55 STEP 408 H= 102:00 +CPU= 23.896
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000408
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000408
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000408
18:19:15 STEP 409 H= 102:15 +CPU= 18.634
18:19:35 STEP 410 H= 102:30 +CPU= 19.178
18:19:56 STEP 411 H= 102:45 +CPU= 19.534
18:20:17 STEP 412 H= 103:00 +CPU= 20.090
18:20:37 STEP 413 H= 103:15 +CPU= 18.812
18:20:53 STEP 414 H= 103:30 +CPU= 15.977
18:21:09 STEP 415 H= 103:45 +CPU= 15.476
18:21:26 STEP 416 H= 104:00 +CPU= 15.876
18:21:41 STEP 417 H= 104:15 +CPU= 15.436
18:21:57 STEP 418 H= 104:30 +CPU= 15.338
18:22:13 STEP 419 H= 104:45 +CPU= 15.391
18:22:33 STEP 420 H= 105:00 +CPU= 19.210
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000420
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000420
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000420
18:22:49 STEP 421 H= 105:15 +CPU= 15.429
18:23:04 STEP 422 H= 105:30 +CPU= 14.877
18:23:19 STEP 423 H= 105:45 +CPU= 15.075
18:23:35 STEP 424 H= 106:00 +CPU= 15.761
18:23:51 STEP 425 H= 106:15 +CPU= 15.102
18:24:06 STEP 426 H= 106:30 +CPU= 15.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:24:44 STEP 427 H= 106:45 +CPU= 16.335
18:25:02 STEP 428 H= 107:00 +CPU= 17.129
18:25:18 STEP 429 H= 107:15 +CPU= 15.343
18:25:33 STEP 430 H= 107:30 +CPU= 14.811
18:25:46 STEP 431 H= 107:45 +CPU= 13.315
18:26:08 STEP 432 H= 108:00 +CPU= 20.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a21r
(argv4) batchid: 991
(argv5) wuid: 12209442
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/5
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/5/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/5/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_017eddb4b74ca0a07105373d346872ed to: /var/lib/boinc/slots/5/oifs_43r3_bl_a21r_2016092300_15_991_12209442.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/5/oifs_43r3_bl_a21r_2016092300_15_991_12209442.zip
ic_ancil_file: ic_ancil_12209442
ifsdata_file: ifsdata_12209442
climate_data_file: clim_data_12209442
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/5/ic_ancil_12209442.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/5/ic_ancil_12209442.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_49cfdff6766dbade2d820da5ff4e09a4 to: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Checking for progress XML file: /var/lib/boinc/slots/5/progress_file_12209442.xml
Opened progress file ok : /var/lib/boinc/slots/5/progress_file_12209442.xml
-- Model is restarting --
Adjusting last_iter, 432, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/5/progress_file_12209442.xml
last_cpu_time: 10382
upload_file_number: 4
last_iter: 433
last_upload: 345600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a21r_2016092300_15_991_12209442_0_r935592218
The child process has been launched with process id: 1885408
Executing the command: /var/lib/boinc/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:1885408:1885408] [20230218:004603:1676677563:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
00:46:29 STEP 432 H= 108:00 +CPU= 20.854
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000432
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000432
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000432
00:46:47 STEP 433 H= 108:15 +CPU= 17.206
00:47:05 STEP 434 H= 108:30 +CPU= 17.061
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Mineral_Dust_bin1(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Mineral_Dust_bin2(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Mineral_Dust_bin3(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Sea_Salt_bin1(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Sea_Salt_bin2(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Sea_Salt_bin3(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading Sulfates(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
UPDTIM MACC AEROSOL CLIMATOLOGY IS LOADED
SUECAEC: INLEV,ISYEAR,IEYEAR= 0 1957 2010
suecaec NAERMACC = 1
UPDT RAESHDU = 2000.0
SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20160923
810 9.999999999999998E-005
NORMS AT NSTEP CNT4 432
SPECTRAL NORMS - LOG(PREHYDS) 0.115129254579134E+02 OROGRAPHY 0.000000000000000E+00
LEV VORTICITY DIVERGENCE TEMPERATURE KINETIC ENERGY
AVE 0.346207718937431E-05 0.503733020817961E-07 0.217751601019218E+03 0.192200484877558E+02
GPNORM HUMIDITY AVERAGE MINIMUM MAXIMUM
AVE 0.703527966621834E-03 0.100000000000000E-07 0.103235954264803E-01
GPNORM LIQUID WATER AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM
AVE 0.570615597015771E-09 0.000000000000000E+00 0.520970044293043E-07
GPNORM SNOW AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM RAIN AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM
AVE 0.104530424255240E-01 0.000000000000000E+00 0.100000000000000E+01
GPNORM CLW AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM CIW AVERAGE MINIMUM MAXIMUM
AVE 0.570623971663887E-09 0.000000000000000E+00 0.520973749219435E-07
GPNORM CC AVERAGE MINIMUM MAXIMUM
AVE 0.104902924292832E-01 0.000000000000000E+00 0.100000000000000E+01
GPNORM RFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.643387273941387E-12 0.000000000000000E+00 0.203974897814122E-10
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.830767076187752E-02 0.000000000000000E+00 0.100000000000000E+01
NSTEP = 432 STEPO 0AAA00AAA
00:46:29 STEP 432 H= 108:00 +CPU= 20.854
NSTEP = 433 STEPO 0AAA00AAA
00:46:47 STEP 433 H= 108:15 +CPU= 17.206
NSTEP = 434 STEPO 0AAA00AAA
00:47:05 STEP 434 H= 108:30 +CPU= 17.061
ISTEP= 435 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 435 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 435 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 5 lines from file: ifs.stat
00:46:04 000000000 CNT3 -999 0.364 0.364 0.390 0:00 0:00 0.00000000000000E+00 1GB 0MB
00:46:07 0AAA00AAA STEPO 432 3.336 3.336 3.604 0:03 0:03 0.50373302081796E-07 1GB 0MB
00:46:29 0AAA00AAA STEPO 433 20.683 20.683 22.039 0:24 0:25 0.50373302081796E-07 2GB 0MB
00:46:47 0AAA00AAA STEPO 434 17.206 17.206 18.183 0:41 0:43 0.50373302081796E-07 2GB 0MB
00:47:05 0AAA00AAA STEPO 435 17.061 17.061 18.006 0:58 1:01 0.50373302081796E-07 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 432",
CTIME = "00041200 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 420, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/5/progress_file_12209442.xml
<running_values>
<last_cpu_time>10447.280000</last_cpu_time>
<upload_file_number>4</upload_file_number>
<last_iter>435</last_iter>
<last_upload>345600</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a21r
(argv4) batchid: 991
(argv5) wuid: 12209442
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/5
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/5/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/5/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_017eddb4b74ca0a07105373d346872ed to: /var/lib/boinc/slots/5/oifs_43r3_bl_a21r_2016092300_15_991_12209442.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/5/oifs_43r3_bl_a21r_2016092300_15_991_12209442.zip
ic_ancil_file: ic_ancil_12209442
ifsdata_file: ifsdata_12209442
climate_data_file: clim_data_12209442
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/5/ic_ancil_12209442.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/5/ic_ancil_12209442.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_49cfdff6766dbade2d820da5ff4e09a4 to: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/5/ifsdata/ifsdata_12209442.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/5/159l_2/clim_data_12209442.zip
Checking for progress XML file: /var/lib/boinc/slots/5/progress_file_12209442.xml
Opened progress file ok : /var/lib/boinc/slots/5/progress_file_12209442.xml
-- Model is restarting --
Adjusting last_iter, 435, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/5/progress_file_12209442.xml
last_cpu_time: 10447
upload_file_number: 4
last_iter: 433
last_upload: 345600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a21r_2016092300_15_991_12209442_0_r935592218
The child process has been launched with process id: 33369
Executing the command: /var/lib/boinc/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:135649:1676725009:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
13:57:09 STEP 432 H= 108:00 +CPU= 16.003
13:57:25 STEP 433 H= 108:15 +CPU= 15.805
13:57:39 STEP 434 H= 108:30 +CPU= 13.748
13:57:53 STEP 435 H= 108:45 +CPU= 12.954
13:58:06 STEP 436 H= 109:00 +CPU= 13.199
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:48:21 STEP 437 H= 109:15 +CPU= 14.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:48:57 STEP 438 H= 109:30 +CPU= 14.618
14:49:12 STEP 439 H= 109:45 +CPU= 14.753
14:49:27 STEP 440 H= 110:00 +CPU= 14.310
14:49:41 STEP 441 H= 110:15 +CPU= 14.253
14:49:56 STEP 442 H= 110:30 +CPU= 14.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:33 STEP 443 H= 110:45 +CPU= 15.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:13 STEP 444 H= 111:00 +CPU= 18.621
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000444
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000444
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000444
14:51:27 STEP 445 H= 111:15 +CPU= 13.503
14:51:43 STEP 446 H= 111:30 +CPU= 15.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:52:19 STEP 447 H= 111:45 +CPU= 14.172
14:52:36 STEP 448 H= 112:00 +CPU= 16.151
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:10 STEP 449 H= 112:15 +CPU= 13.335
14:53:24 STEP 450 H= 112:30 +CPU= 13.285
14:53:39 STEP 451 H= 112:45 +CPU= 14.535
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:17 STEP 452 H= 113:00 +CPU= 16.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:00 STEP 453 H= 113:15 +CPU= 26.587
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:04:39 STEP 454 H= 113:30 +CPU= 20.036
15:05:02 STEP 455 H= 113:45 +CPU= 20.239
15:05:29 STEP 456 H= 114:00 +CPU= 25.183
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000456
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000456
15:06:10 STEP 457 H= 114:15 +CPU= 18.472
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:07:34 STEP 458 H= 114:30 +CPU= 20.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:08:18 STEP 459 H= 114:45 +CPU= 19.737
15:08:40 STEP 460 H= 115:00 +CPU= 20.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:09:47 STEP 461 H= 115:15 +CPU= 21.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:10:28 STEP 462 H= 115:30 +CPU= 18.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:11:11 STEP 463 H= 115:45 +CPU= 19.761
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:12:57 STEP 464 H= 116:00 +CPU= 21.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:14:03 STEP 465 H= 116:15 +CPU= 21.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:15:28 STEP 466 H= 116:30 +CPU= 20.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:16:34 STEP 467 H= 116:45 +CPU= 20.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:18:04 STEP 468 H= 117:00 +CPU= 25.482
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000468
15:18:23 STEP 469 H= 117:15 +CPU= 17.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:19:05 STEP 470 H= 117:30 +CPU= 19.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:19:48 STEP 471 H= 117:45 +CPU= 20.152
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:20:30 STEP 472 H= 118:00 +CPU= 18.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:21:54 STEP 473 H= 118:15 +CPU= 19.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:22:41 STEP 474 H= 118:30 +CPU= 23.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:23:25 STEP 475 H= 118:45 +CPU= 20.745
15:23:47 STEP 476 H= 119:00 +CPU= 20.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:24:52 STEP 477 H= 119:15 +CPU= 20.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:25:34 STEP 478 H= 119:30 +CPU= 19.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:26:18 STEP 479 H= 119:45 +CPU= 19.470
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:36:22 STEP 480 H= 120:00 +CPU= 27.916
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209442/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a21r_2016092300_15_991_12209442_0_r935592218_4.zip
Uploading the intermediate file: upload_file_4.zip
15:36:44 STEP 481 H= 120:15 +CPU= 20.217
15:37:05 STEP 482 H= 120:30 +CPU= 19.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:37:46 STEP 483 H= 120:45 +CPU= 18.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:38:28 STEP 484 H= 121:00 +CPU= 18.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:39:09 STEP 485 H= 121:15 +CPU= 19.092
15:39:25 STEP 486 H= 121:30 +CPU= 15.305
15:39:38 STEP 487 H= 121:45 +CPU= 12.027
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4057MB (heap), 5413MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4057 MB (maxheap), 5413 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-CPQTUV (1064)
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153950:1676731190:6180.159] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CPQTUV
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153951:1676731191:6181.160] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:YatagarasuDrive:1:1:33369:33369] [20230218:153951:1676731191:6181.160] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown
oifs_43r3_model.e 00000000010ACCE1 cpqtuv_ 129 cpqtuv.F90
oifs_43r3_model.e 00000000010A254D ec_phys_drv_ 676 ec_phys_drv.F90
oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90
oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90
oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown
oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown
</stderr_txt>
]]>
