<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0714
(argv4) batchid: 968
(argv5) wuid: 12185358
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/8
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd3d0fa52899abf2fa2b957edd896296 to: /var/lib/boinc/slots/8/oifs_43r3_ps_0714_1999050100_123_968_12185358.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/8/oifs_43r3_ps_0714_1999050100_123_968_12185358.zip
ic_ancil_file: ic_ancil_12185358
ifsdata_file: ifsdata_12185358
climate_data_file: clim_data_12185358
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ae18860f103ee5790e9b7db832619a54 to: /var/lib/boinc/slots/8/ic_ancil_12185358.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/8/ic_ancil_12185358.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5b5ede742d033d2835567b32551249e9 to: /var/lib/boinc/slots/8/ifsdata/ifsdata_12185358.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/8/ifsdata/ifsdata_12185358.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/8/159l_2/clim_data_12185358.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/8/159l_2/clim_data_12185358.zip
Checking for progress XML file: /var/lib/boinc/slots/8/progress_file_12185358.xml
Creating progress file: /var/lib/boinc/slots/8/progress_file_12185358.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0714_1999050100_123_968_12185358_0_r946156172
The child process has been launched with process id: 8367
Executing the command: /var/lib/boinc/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:8367:8367] [20230117:231248:1673971968:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:23 STEP 0 H= 0:00 +CPU= 30.765
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000000
23:13:43 STEP 1 H= 1:00 +CPU= 20.443
23:14:00 STEP 2 H= 2:00 +CPU= 17.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:30 STEP 3 H= 3:00 +CPU= 27.109
23:14:46 STEP 4 H= 4:00 +CPU= 16.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:15:06 STEP 5 H= 5:00 +CPU= 17.388
23:15:30 STEP 6 H= 6:00 +CPU= 24.817
23:15:46 STEP 7 H= 7:00 +CPU= 15.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:04 STEP 8 H= 8:00 +CPU= 15.989
23:16:31 STEP 9 H= 9:00 +CPU= 26.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:50 STEP 10 H= 10:00 +CPU= 17.045
23:17:04 STEP 11 H= 11:00 +CPU= 14.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:17:36 STEP 12 H= 12:00 +CPU= 29.856
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000012
23:17:51 STEP 13 H= 13:00 +CPU= 14.638
23:18:09 STEP 14 H= 14:00 +CPU= 18.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:43 STEP 15 H= 15:00 +CPU= 31.739
23:19:00 STEP 16 H= 16:00 +CPU= 17.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:18 STEP 17 H= 17:00 +CPU= 16.053
23:19:43 STEP 18 H= 18:00 +CPU= 24.790
23:19:58 STEP 19 H= 19:00 +CPU= 15.082
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:16 STEP 20 H= 20:00 +CPU= 15.668
23:20:42 STEP 21 H= 21:00 +CPU= 26.451
23:20:58 STEP 22 H= 22:00 +CPU= 15.705
23:21:12 STEP 23 H= 23:00 +CPU= 14.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:45 STEP 24 H= 24:00 +CPU= 30.515
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0714_1999050100_123_968_12185358_0_r946156172_0.zip
Uploading the intermediate file: upload_file_0.zip
23:22:00 STEP 25 H= 25:00 +CPU= 14.887
23:22:15 STEP 26 H= 26:00 +CPU= 15.190
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:42 STEP 27 H= 27:00 +CPU= 24.555
23:22:58 STEP 28 H= 28:00 +CPU= 16.131
23:23:12 STEP 29 H= 29:00 +CPU= 14.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:43 STEP 30 H= 30:00 +CPU= 28.183
23:23:58 STEP 31 H= 31:00 +CPU= 15.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:24:18 STEP 32 H= 32:00 +CPU= 18.527
23:24:45 STEP 33 H= 33:00 +CPU= 26.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:04 STEP 34 H= 34:00 +CPU= 17.415
23:25:20 STEP 35 H= 35:00 +CPU= 15.950
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:51 STEP 36 H= 36:00 +CPU= 29.048
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000036
23:26:07 STEP 37 H= 37:00 +CPU= 15.562
23:26:24 STEP 38 H= 38:00 +CPU= 17.280
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:26:53 STEP 39 H= 39:00 +CPU= 27.098
23:27:10 STEP 40 H= 40:00 +CPU= 16.916
23:27:27 STEP 41 H= 41:00 +CPU= 17.169
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:56 STEP 42 H= 42:00 +CPU= 26.436
23:28:11 STEP 43 H= 43:00 +CPU= 15.125
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:28:30 STEP 44 H= 44:00 +CPU= 17.219
23:28:55 STEP 45 H= 45:00 +CPU= 24.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:29:14 STEP 46 H= 46:00 +CPU= 17.509
23:29:31 STEP 47 H= 47:00 +CPU= 17.335
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:30:06 STEP 48 H= 48:00 +CPU= 33.059
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185358/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0714_1999050100_123_968_12185358_0_r946156172_1.zip
Uploading the intermediate file: upload_file_1.zip
23:30:24 STEP 49 H= 49:00 +CPU= 17.952
23:30:41 STEP 50 H= 50:00 +CPU= 16.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:12 STEP 51 H= 51:00 +CPU= 28.961
23:31:30 STEP 52 H= 52:00 +CPU= 18.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:49 STEP 53 H= 53:00 +CPU= 16.959
23:32:14 STEP 54 H= 54:00 +CPU= 24.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:32:32 STEP 55 H= 55:00 +CPU= 16.188
23:32:50 STEP 56 H= 56:00 +CPU= 18.377
23:33:17 STEP 57 H= 57:00 +CPU= 26.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:36 STEP 58 H= 58:00 +CPU= 17.429
23:33:53 STEP 59 H= 59:00 +CPU= 16.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:34:24 STEP 60 H= 60:00 +CPU= 28.898
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+000060
23:34:41 STEP 61 H= 61:00 +CPU= 17.520
23:34:58 STEP 62 H= 62:00 +CPU= 16.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:25 STEP 63 H= 63:00 +CPU= 25.465
23:35:42 STEP 64 H= 64:00 +CPU= 16.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:36:01 STEP 65 H= 65:00 +CPU= 16.502
23:36:27 STEP 66 H= 66:00 +CPU= 26.233
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:36:45 STEP 67 H= 67:00 +CPU= 16.127
23:37:04 STEP 68 H= 68:00 +CPU= 19.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:51 STEP 69 H= 69:00 +CPU= 32.298
23:39:06 STEP 70 H= 70:00 +CPU= 15.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully
</stderr_txt>
]]>
