<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0429
(argv4) batchid: 978
(argv5) wuid: 12195073
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/29
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_2eefef7aaffb8c7e1f6e37c5904d33bb to: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
ic_ancil_file: ic_ancil_12195073
ifsdata_file: ifsdata_12195073
climate_data_file: clim_data_12195073
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b369bef78a5ea85038f720d413c4a161 to: /var/lib/boinc/slots/29/ic_ancil_12195073.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/29/ic_ancil_12195073.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cef7464fecc89d302fe53337ddae2f36 to: /var/lib/boinc/slots/29/ifsdata/ifsdata_12195073.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/29/ifsdata/ifsdata_12195073.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/29/159l_2/clim_data_12195073.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/29/159l_2/clim_data_12195073.zip
Checking for progress XML file: /var/lib/boinc/slots/29/progress_file_12195073.xml
Creating progress file: /var/lib/boinc/slots/29/progress_file_12195073.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476
The child process has been launched with process id: 24475
Executing the command: /var/lib/boinc/slots/29/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24475:24475] [20230112:012242:1673461362:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:23:13 STEP 0 H= 0:00 +CPU= 26.881
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000000
01:23:31 STEP 1 H= 1:00 +CPU= 17.940
01:23:46 STEP 2 H= 2:00 +CPU= 15.946
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:24:13 STEP 3 H= 3:00 +CPU= 24.500
01:24:30 STEP 4 H= 4:00 +CPU= 15.830
01:24:45 STEP 5 H= 5:00 +CPU= 15.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:11 STEP 6 H= 6:00 +CPU= 24.021
01:25:26 STEP 7 H= 7:00 +CPU= 14.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:45 STEP 8 H= 8:00 +CPU= 16.651
01:26:11 STEP 9 H= 9:00 +CPU= 25.672
01:26:26 STEP 10 H= 10:00 +CPU= 15.300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:47 STEP 11 H= 11:00 +CPU= 18.104
01:27:13 STEP 12 H= 12:00 +CPU= 25.873
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:27:31 STEP 13 H= 13:00 +CPU= 15.954
01:27:46 STEP 14 H= 14:00 +CPU= 15.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:12 STEP 15 H= 15:00 +CPU= 23.835
01:28:27 STEP 16 H= 16:00 +CPU= 15.276
01:28:41 STEP 17 H= 17:00 +CPU= 14.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:29:09 STEP 18 H= 18:00 +CPU= 25.198
01:29:25 STEP 19 H= 19:00 +CPU= 16.008
01:29:40 STEP 20 H= 20:00 +CPU= 15.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:30:06 STEP 21 H= 21:00 +CPU= 24.060
01:30:21 STEP 22 H= 22:00 +CPU= 14.657
01:30:35 STEP 23 H= 23:00 +CPU= 14.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:06 STEP 24 H= 24:00 +CPU= 28.385
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_0.zip
Uploading the intermediate file: upload_file_0.zip
01:31:20 STEP 25 H= 25:00 +CPU= 14.158
01:31:36 STEP 26 H= 26:00 +CPU= 15.607
01:31:59 STEP 27 H= 27:00 +CPU= 23.534
01:32:14 STEP 28 H= 28:00 +CPU= 15.166
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:32:32 STEP 29 H= 29:00 +CPU= 15.017
01:32:55 STEP 30 H= 30:00 +CPU= 23.396
01:33:09 STEP 31 H= 31:00 +CPU= 13.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:33:28 STEP 32 H= 32:00 +CPU= 17.007
01:33:53 STEP 33 H= 33:00 +CPU= 25.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:11 STEP 34 H= 34:00 +CPU= 16.079
01:34:26 STEP 35 H= 35:00 +CPU= 14.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:54 STEP 36 H= 36:00 +CPU= 25.930
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000036
01:35:08 STEP 37 H= 37:00 +CPU= 14.172
01:35:25 STEP 38 H= 38:00 +CPU= 17.113
01:35:49 STEP 39 H= 39:00 +CPU= 24.041
01:36:05 STEP 40 H= 40:00 +CPU= 15.895
01:36:20 STEP 41 H= 41:00 +CPU= 14.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:36:45 STEP 42 H= 42:00 +CPU= 23.457
01:37:01 STEP 43 H= 43:00 +CPU= 15.907
01:37:15 STEP 44 H= 44:00 +CPU= 14.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:37:43 STEP 45 H= 45:00 +CPU= 25.907
01:38:01 STEP 46 H= 46:00 +CPU= 17.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:38:20 STEP 47 H= 47:00 +CPU= 16.542
01:38:50 STEP 48 H= 48:00 +CPU= 30.232
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_1.zip
Uploading the intermediate file: upload_file_1.zip
01:39:05 STEP 49 H= 49:00 +CPU= 15.643
01:39:22 STEP 50 H= 50:00 +CPU= 16.098
01:39:46 STEP 51 H= 51:00 +CPU= 24.182
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:40:05 STEP 52 H= 52:00 +CPU= 17.366
01:40:20 STEP 53 H= 53:00 +CPU= 15.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:40:46 STEP 54 H= 54:00 +CPU= 24.056
01:41:02 STEP 55 H= 55:00 +CPU= 15.271
01:41:18 STEP 56 H= 56:00 +CPU= 15.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:41:44 STEP 57 H= 57:00 +CPU= 24.852
01:41:59 STEP 58 H= 58:00 +CPU= 14.363
01:42:14 STEP 59 H= 59:00 +CPU= 14.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:42:44 STEP 60 H= 60:00 +CPU= 28.559
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000060
01:43:00 STEP 61 H= 61:00 +CPU= 15.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:43:18 STEP 62 H= 62:00 +CPU= 16.174
01:43:43 STEP 63 H= 63:00 +CPU= 24.968
01:43:59 STEP 64 H= 64:00 +CPU= 15.773
01:44:15 STEP 65 H= 65:00 +CPU= 16.029
01:44:41 STEP 66 H= 66:00 +CPU= 25.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:44:58 STEP 67 H= 67:00 +CPU= 15.067
01:45:14 STEP 68 H= 68:00 +CPU= 16.242
01:45:37 STEP 69 H= 69:00 +CPU= 22.986
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:45:54 STEP 70 H= 70:00 +CPU= 15.607
01:46:10 STEP 71 H= 71:00 +CPU= 15.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:46:40 STEP 72 H= 72:00 +CPU= 28.288
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_2.zip
Uploading the intermediate file: upload_file_2.zip
01:46:55 STEP 73 H= 73:00 +CPU= 14.397
01:47:10 STEP 74 H= 74:00 +CPU= 14.761
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:47:38 STEP 75 H= 75:00 +CPU= 26.359
01:47:53 STEP 76 H= 76:00 +CPU= 14.770
01:48:07 STEP 77 H= 77:00 +CPU= 14.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:48:34 STEP 78 H= 78:00 +CPU= 24.609
01:48:48 STEP 79 H= 79:00 +CPU= 14.384
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:06 STEP 80 H= 80:00 +CPU= 16.147
01:49:30 STEP 81 H= 81:00 +CPU= 23.722
01:49:45 STEP 82 H= 82:00 +CPU= 15.456
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:50:04 STEP 83 H= 83:00 +CPU= 16.144
01:50:32 STEP 84 H= 84:00 +CPU= 28.693
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000084
01:50:48 STEP 85 H= 85:00 +CPU= 15.804
01:51:04 STEP 86 H= 86:00 +CPU= 16.199
01:51:29 STEP 87 H= 87:00 +CPU= 24.335
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:51:45 STEP 88 H= 88:00 +CPU= 14.648
01:51:59 STEP 89 H= 89:00 +CPU= 13.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:52:25 STEP 90 H= 90:00 +CPU= 24.221
01:52:39 STEP 91 H= 91:00 +CPU= 13.979
01:52:55 STEP 92 H= 92:00 +CPU= 15.554
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:53:24 STEP 93 H= 93:00 +CPU= 26.745
01:53:38 STEP 94 H= 94:00 +CPU= 14.315
01:53:53 STEP 95 H= 95:00 +CPU= 15.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:54:26 STEP 96 H= 96:00 +CPU= 30.666
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_3.zip
Uploading the intermediate file: upload_file_3.zip
01:54:42 STEP 97 H= 97:00 +CPU= 16.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:55:00 STEP 98 H= 98:00 +CPU= 15.346
01:55:24 STEP 99 H= 99:00 +CPU= 23.828
01:55:38 STEP 100 H= 100:00 +CPU= 14.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:55:56 STEP 101 H= 101:00 +CPU= 16.024
01:56:21 STEP 102 H= 102:00 +CPU= 24.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:56:39 STEP 103 H= 103:00 +CPU= 16.418
01:56:54 STEP 104 H= 104:00 +CPU= 15.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:57:23 STEP 105 H= 105:00 +CPU= 26.538
01:57:40 STEP 106 H= 106:00 +CPU= 17.439
01:57:56 STEP 107 H= 107:00 +CPU= 15.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:58:29 STEP 108 H= 108:00 +CPU= 31.055
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000108
01:58:44 STEP 109 H= 109:00 +CPU= 14.991
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:59:04 STEP 110 H= 110:00 +CPU= 17.623
01:59:30 STEP 111 H= 111:00 +CPU= 26.319
01:59:44 STEP 112 H= 112:00 +CPU= 14.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:02 STEP 113 H= 113:00 +CPU= 15.557
02:00:26 STEP 114 H= 114:00 +CPU= 24.221
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:45 STEP 115 H= 115:00 +CPU= 16.968
02:01:00 STEP 116 H= 116:00 +CPU= 15.156
02:01:24 STEP 117 H= 117:00 +CPU= 23.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:01:41 STEP 118 H= 118:00 +CPU= 15.519
02:01:56 STEP 119 H= 119:00 +CPU= 14.531
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:26 STEP 120 H= 120:00 +CPU= 28.198
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_4.zip
Uploading the intermediate file: upload_file_4.zip
02:02:40 STEP 121 H= 121:00 +CPU= 13.958
02:02:55 STEP 122 H= 122:00 +CPU= 15.300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:03:21 STEP 123 H= 123:00 +CPU= 23.901
02:03:36 STEP 124 H= 124:00 +CPU= 14.743
02:03:50 STEP 125 H= 125:00 +CPU= 14.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:17 STEP 126 H= 126:00 +CPU= 24.693
02:04:31 STEP 127 H= 127:00 +CPU= 14.167
02:04:46 STEP 128 H= 128:00 +CPU= 15.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:12 STEP 129 H= 129:00 +CPU= 23.873
02:05:27 STEP 130 H= 130:00 +CPU= 15.053
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:44 STEP 131 H= 131:00 +CPU= 14.999
02:06:12 STEP 132 H= 132:00 +CPU= 27.277
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000132
02:06:27 STEP 133 H= 133:00 +CPU= 15.359
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:06:44 STEP 134 H= 134:00 +CPU= 15.301
02:07:07 STEP 135 H= 135:00 +CPU= 22.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:07:25 STEP 136 H= 136:00 +CPU= 15.138
02:07:38 STEP 137 H= 137:00 +CPU= 13.738
02:08:01 STEP 138 H= 138:00 +CPU= 23.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:08:19 STEP 139 H= 139:00 +CPU= 16.146
02:08:34 STEP 140 H= 140:00 +CPU= 14.806
02:08:57 STEP 141 H= 141:00 +CPU= 22.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:09:16 STEP 142 H= 142:00 +CPU= 16.627
02:09:31 STEP 143 H= 143:00 +CPU= 15.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:00 STEP 144 H= 144:00 +CPU= 27.793
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_5.zip
Uploading the intermediate file: upload_file_5.zip
02:10:15 STEP 145 H= 145:00 +CPU= 14.030
02:10:29 STEP 146 H= 146:00 +CPU= 14.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:55 STEP 147 H= 147:00 +CPU= 24.148
02:11:10 STEP 148 H= 148:00 +CPU= 14.851
02:11:26 STEP 149 H= 149:00 +CPU= 16.280
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:11:55 STEP 150 H= 150:00 +CPU= 26.339
02:12:10 STEP 151 H= 151:00 +CPU= 14.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:12:27 STEP 152 H= 152:00 +CPU= 15.785
02:12:50 STEP 153 H= 153:00 +CPU= 22.642
02:13:06 STEP 154 H= 154:00 +CPU= 15.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:13:24 STEP 155 H= 155:00 +CPU= 16.872
02:13:51 STEP 156 H= 156:00 +CPU= 26.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000156
02:14:09 STEP 157 H= 157:00 +CPU= 15.956
02:14:25 STEP 158 H= 158:00 +CPU= 15.752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:14:51 STEP 159 H= 159:00 +CPU= 24.230
02:15:07 STEP 160 H= 160:00 +CPU= 16.067
02:15:22 STEP 161 H= 161:00 +CPU= 14.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:49 STEP 162 H= 162:00 +CPU= 25.236
02:16:04 STEP 163 H= 163:00 +CPU= 14.729
02:16:19 STEP 164 H= 164:00 +CPU= 15.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:16:45 STEP 165 H= 165:00 +CPU= 24.278
02:17:01 STEP 166 H= 166:00 +CPU= 15.469
02:17:15 STEP 167 H= 167:00 +CPU= 14.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:17:47 STEP 168 H= 168:00 +CPU= 29.209
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0429_2009050100_123_978_12195073_1_r908883476_6.zip
Uploading the intermediate file: upload_file_6.zip
02:18:02 STEP 169 H= 169:00 +CPU= 15.112
02:18:17 STEP 170 H= 170:00 +CPU= 15.234
02:18:40 STEP 171 H= 171:00 +CPU= 23.027
02:18:55 STEP 172 H= 172:00 +CPU= 15.393
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:13 STEP 173 H= 173:00 +CPU= 15.619
02:19:40 STEP 174 H= 174:00 +CPU= 26.955
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:57 STEP 175 H= 175:00 +CPU= 14.909
02:20:12 STEP 176 H= 176:00 +CPU= 14.789
02:20:37 STEP 177 H= 177:00 +CPU= 24.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:20:55 STEP 178 H= 178:00 +CPU= 16.142
02:21:10 STEP 179 H= 179:00 +CPU= 15.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:21:40 STEP 180 H= 180:00 +CPU= 27.337
Moving to projects directory: /var/lib/boinc/slots/29/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc/slots/29/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc/slots/29/ICMUAhq0f+000180
02:21:55 STEP 181 H= 181:00 +CPU= 15.148
02:22:11 STEP 182 H= 182:00 +CPU= 15.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:22:37 STEP 183 H= 183:00 +CPU= 24.182
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:12:10 STEP 184 H= 184:00 +CPU= 30.189
03:12:26 STEP 185 H= 185:00 +CPU= 14.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0429
(argv4) batchid: 978
(argv5) wuid: 12195073
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/29
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
04:58:33 STEP 186 H= 186:00 +CPU= 95.180
05:14:57 STEP 187 H= 187:00 +CPU=126.088
05:15:12 STEP 188 H= 188:00 +CPU= 14.512
Copying the namelist files from: ../../projects/climateprediction.net/jf_2eefef7aaffb8c7e1f6e37c5904d33bb to: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
ic_ancil_file: ic_ancil_12195073
ifsdata_file: ifsdata_12195073
climate_data_file: clim_data_12195073
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b369bef78a5ea85038f720d413c4a161 to: /var/lib/boinc/slots/29/ic_ancil_12195073.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/29/ic_ancil_12195073.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0429
(argv4) batchid: 978
(argv5) wuid: 12195073
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/29
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12195073
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
15:34:00 STEP 189 H= 189:00 +CPU=662.426
15:34:15 STEP 190 H= 190:00 +CPU= 13.814
15:34:31 STEP 191 H= 191:00 +CPU= 14.666
Copying the namelist files from: ../../projects/climateprediction.net/jf_2eefef7aaffb8c7e1f6e37c5904d33bb to: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/29/oifs_43r3_ps_0429_2009050100_123_978_12195073.zip
ic_ancil_file: ic_ancil_12195073
ifsdata_file: ifsdata_12195073
climate_data_file: clim_data_12195073
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: }bØ4î¯ÙÓøe-§ òÐiÂÿ.«]ƒÿlȬ¬1ÕÁoÂÞYY­þ3ذᯬ: Z7’¶ÓT+L«— to: /var/lib/boinc/slots/29/ic_ancil_12195073.zip
..Copying the IC ancils to the working directory failed
</stderr_txt>
]]>
