<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0866
(argv4) batchid: 973
(argv5) wuid: 12190510
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/21
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_789787fb218aa24f33744c6bdd20b799 to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
ic_ancil_file: ic_ancil_12190510
ifsdata_file: ifsdata_12190510
climate_data_file: clim_data_12190510
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_27b817844710421480f75c19f86f137f to: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c7ef5bcd43402f986f6f4643e7630d05 to: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Checking for progress XML file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
Creating progress file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969
The child process has been launched with process id: 185488
Executing the command: /var/lib/boinc-client/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:185488:185488] [20230114:235917:1673708357:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
00:02:18 STEP 0 H= 0:00 +CPU= 25.418
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000000
00:02:39 STEP 1 H= 1:00 +CPU= 16.132
00:02:53 STEP 2 H= 2:00 +CPU= 13.704
00:03:14 STEP 3 H= 3:00 +CPU= 21.453
00:03:28 STEP 4 H= 4:00 +CPU= 13.558
00:03:41 STEP 5 H= 5:00 +CPU= 13.099
00:04:03 STEP 6 H= 6:00 +CPU= 21.399
00:04:16 STEP 7 H= 7:00 +CPU= 13.631
00:20:39 STEP 8 H= 8:00 +CPU= 22.601
00:21:24 STEP 9 H= 9:00 +CPU= 22.004
00:21:39 STEP 10 H= 10:00 +CPU= 15.457
00:21:54 STEP 11 H= 11:00 +CPU= 14.466
00:22:26 STEP 12 H= 12:00 +CPU= 25.771
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000012
00:22:40 STEP 13 H= 13:00 +CPU= 14.479
00:22:55 STEP 14 H= 14:00 +CPU= 15.016
00:23:18 STEP 15 H= 15:00 +CPU= 22.455
00:23:33 STEP 16 H= 16:00 +CPU= 15.094
00:23:48 STEP 17 H= 17:00 +CPU= 14.768
00:24:12 STEP 18 H= 18:00 +CPU= 23.058
00:24:26 STEP 19 H= 19:00 +CPU= 14.512
00:24:42 STEP 20 H= 20:00 +CPU= 15.399
00:25:05 STEP 21 H= 21:00 +CPU= 22.598
00:25:20 STEP 22 H= 22:00 +CPU= 14.848
00:25:35 STEP 23 H= 23:00 +CPU= 14.919
00:26:05 STEP 24 H= 24:00 +CPU= 27.055
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_0.zip
Uploading the intermediate file: upload_file_0.zip
00:26:20 STEP 25 H= 25:00 +CPU= 14.684
00:26:35 STEP 26 H= 26:00 +CPU= 15.246
00:26:58 STEP 27 H= 27:00 +CPU= 22.674
00:27:14 STEP 28 H= 28:00 +CPU= 15.744
00:27:29 STEP 29 H= 29:00 +CPU= 14.623
00:27:52 STEP 30 H= 30:00 +CPU= 23.158
00:28:07 STEP 31 H= 31:00 +CPU= 14.506
00:28:23 STEP 32 H= 32:00 +CPU= 15.074
00:28:45 STEP 33 H= 33:00 +CPU= 22.460
00:29:00 STEP 34 H= 34:00 +CPU= 14.882
00:29:15 STEP 35 H= 35:00 +CPU= 14.464
00:29:41 STEP 36 H= 36:00 +CPU= 25.438
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000036
00:29:55 STEP 37 H= 37:00 +CPU= 14.449
00:30:11 STEP 38 H= 38:00 +CPU= 15.307
00:30:34 STEP 39 H= 39:00 +CPU= 22.564
00:30:49 STEP 40 H= 40:00 +CPU= 14.936
00:31:03 STEP 41 H= 41:00 +CPU= 14.513
00:31:27 STEP 42 H= 42:00 +CPU= 23.652
00:31:42 STEP 43 H= 43:00 +CPU= 14.542
00:32:00 STEP 44 H= 44:00 +CPU= 17.506
00:32:23 STEP 45 H= 45:00 +CPU= 23.158
00:32:38 STEP 46 H= 46:00 +CPU= 14.921
00:32:53 STEP 47 H= 47:00 +CPU= 14.837
00:33:21 STEP 48 H= 48:00 +CPU= 27.536
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_1.zip
Uploading the intermediate file: upload_file_1.zip
00:33:36 STEP 49 H= 49:00 +CPU= 14.597
00:33:53 STEP 50 H= 50:00 +CPU= 16.700
00:34:17 STEP 51 H= 51:00 +CPU= 24.710
00:34:32 STEP 52 H= 52:00 +CPU= 14.858
00:34:47 STEP 53 H= 53:00 +CPU= 14.568
00:35:11 STEP 54 H= 54:00 +CPU= 23.911
00:35:26 STEP 55 H= 55:00 +CPU= 14.328
00:35:41 STEP 56 H= 56:00 +CPU= 14.850
00:36:04 STEP 57 H= 57:00 +CPU= 22.561
00:36:19 STEP 58 H= 58:00 +CPU= 14.946
00:36:34 STEP 59 H= 59:00 +CPU= 14.741
00:36:59 STEP 60 H= 60:00 +CPU= 25.261
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000060
00:37:14 STEP 61 H= 61:00 +CPU= 14.447
00:37:29 STEP 62 H= 62:00 +CPU= 14.833
The child process terminated with status: 0
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0866
(argv4) batchid: 973
(argv5) wuid: 12190510
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/21
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_789787fb218aa24f33744c6bdd20b799 to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
ic_ancil_file: ic_ancil_12190510
ifsdata_file: ifsdata_12190510
climate_data_file: clim_data_12190510
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_27b817844710421480f75c19f86f137f to: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c7ef5bcd43402f986f6f4643e7630d05 to: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Checking for progress XML file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
Opened progress file ok : /var/lib/boinc-client/slots/21/progress_file_12190510.xml
-- Model is restarting --
Adjusting last_iter, 63, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
last_cpu_time: 1144
upload_file_number: 2
last_iter: 47
last_upload: 172800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969
The child process has been launched with process id: 2191
Executing the command: /var/lib/boinc-client/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:2191:2191] [20230115:101127:1673745087:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
10:12:14 STEP 48 H= 48:00 +CPU= 29.835
10:12:30 STEP 49 H= 49:00 +CPU= 16.055
10:12:49 STEP 50 H= 50:00 +CPU= 18.251
10:13:17 STEP 51 H= 51:00 +CPU= 27.032
10:13:37 STEP 52 H= 52:00 +CPU= 18.812
10:13:53 STEP 53 H= 53:00 +CPU= 16.615
10:14:20 STEP 54 H= 54:00 +CPU= 26.123
10:14:37 STEP 55 H= 55:00 +CPU= 17.215
10:14:55 STEP 56 H= 56:00 +CPU= 18.172
10:15:23 STEP 57 H= 57:00 +CPU= 26.785
10:15:45 STEP 58 H= 58:00 +CPU= 18.696
10:16:05 STEP 59 H= 59:00 +CPU= 18.060
10:16:43 STEP 60 H= 60:00 +CPU= 30.723
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000060
10:17:03 STEP 61 H= 61:00 +CPU= 18.106
10:17:22 STEP 62 H= 62:00 +CPU= 17.983
10:17:52 STEP 63 H= 63:00 +CPU= 27.704
10:18:13 STEP 64 H= 64:00 +CPU= 18.372
10:18:33 STEP 65 H= 65:00 +CPU= 17.952
10:19:04 STEP 66 H= 66:00 +CPU= 28.200
10:19:23 STEP 67 H= 67:00 +CPU= 17.394
10:19:44 STEP 68 H= 68:00 +CPU= 18.490
10:20:14 STEP 69 H= 69:00 +CPU= 27.440
10:20:35 STEP 70 H= 70:00 +CPU= 18.727
10:20:56 STEP 71 H= 71:00 +CPU= 18.732
10:21:40 STEP 72 H= 72:00 +CPU= 32.116
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_2.zip
Uploading the intermediate file: upload_file_2.zip
10:22:00 STEP 73 H= 73:00 +CPU= 17.898
10:22:23 STEP 74 H= 74:00 +CPU= 18.712
10:23:00 STEP 75 H= 75:00 +CPU= 28.099
10:23:20 STEP 76 H= 76:00 +CPU= 18.623
10:23:44 STEP 77 H= 77:00 +CPU= 18.393
10:24:19 STEP 78 H= 78:00 +CPU= 29.530
10:24:41 STEP 79 H= 79:00 +CPU= 18.711
10:25:04 STEP 80 H= 80:00 +CPU= 19.264
10:25:36 STEP 81 H= 81:00 +CPU= 28.065
10:25:59 STEP 82 H= 82:00 +CPU= 18.814
10:26:20 STEP 83 H= 83:00 +CPU= 18.371
10:26:59 STEP 84 H= 84:00 +CPU= 31.170
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000084
10:27:21 STEP 85 H= 85:00 +CPU= 18.395
10:27:46 STEP 86 H= 86:00 +CPU= 18.819
10:28:23 STEP 87 H= 87:00 +CPU= 27.898
10:28:55 STEP 88 H= 88:00 +CPU= 18.322
10:29:16 STEP 89 H= 89:00 +CPU= 17.128
10:31:04 STEP 90 H= 90:00 +CPU= 28.851
10:31:26 STEP 91 H= 91:00 +CPU= 18.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:57:07 STEP 92 H= 92:00 +CPU= 19.860
10:57:50 STEP 93 H= 93:00 +CPU= 26.275
10:58:08 STEP 94 H= 94:00 +CPU= 16.914
10:58:26 STEP 95 H= 95:00 +CPU= 17.234
10:59:26 STEP 96 H= 96:00 +CPU= 33.050
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_3.zip
Uploading the intermediate file: upload_file_3.zip
10:59:43 STEP 97 H= 97:00 +CPU= 17.110
11:00:02 STEP 98 H= 98:00 +CPU= 18.416
11:00:28 STEP 99 H= 99:00 +CPU= 25.456
11:00:48 STEP 100 H= 100:00 +CPU= 18.967
11:01:05 STEP 101 H= 101:00 +CPU= 16.977
11:01:33 STEP 102 H= 102:00 +CPU= 27.572
11:01:52 STEP 103 H= 103:00 +CPU= 17.943
11:02:11 STEP 104 H= 104:00 +CPU= 18.222
11:02:41 STEP 105 H= 105:00 +CPU= 27.972
11:03:01 STEP 106 H= 106:00 +CPU= 18.933
11:03:20 STEP 107 H= 107:00 +CPU= 18.190
11:03:51 STEP 108 H= 108:00 +CPU= 30.442
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000108
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000108
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000108
11:04:09 STEP 109 H= 109:00 +CPU= 17.948
11:04:29 STEP 110 H= 110:00 +CPU= 18.559
11:04:56 STEP 111 H= 111:00 +CPU= 26.964
11:05:15 STEP 112 H= 112:00 +CPU= 17.736
11:06:25 STEP 113 H= 113:00 +CPU= 19.610
11:06:54 STEP 114 H= 114:00 +CPU= 28.223
11:07:13 STEP 115 H= 115:00 +CPU= 18.822
11:07:29 STEP 116 H= 116:00 +CPU= 15.265
11:07:54 STEP 117 H= 117:00 +CPU= 24.522
11:08:13 STEP 118 H= 118:00 +CPU= 18.262
11:08:33 STEP 119 H= 119:00 +CPU= 18.898
11:09:14 STEP 120 H= 120:00 +CPU= 33.146
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000120
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000120
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_4.zip
Uploading the intermediate file: upload_file_4.zip
11:09:33 STEP 121 H= 121:00 +CPU= 17.894
11:09:52 STEP 122 H= 122:00 +CPU= 18.712
11:10:21 STEP 123 H= 123:00 +CPU= 27.488
11:10:41 STEP 124 H= 124:00 +CPU= 18.646
11:10:59 STEP 125 H= 125:00 +CPU= 17.833
11:11:28 STEP 126 H= 126:00 +CPU= 27.830
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0866
(argv4) batchid: 973
(argv5) wuid: 12190510
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/21
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_789787fb218aa24f33744c6bdd20b799 to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
ic_ancil_file: ic_ancil_12190510
ifsdata_file: ifsdata_12190510
climate_data_file: clim_data_12190510
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_27b817844710421480f75c19f86f137f to: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c7ef5bcd43402f986f6f4643e7630d05 to: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Checking for progress XML file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
Opened progress file ok : /var/lib/boinc-client/slots/21/progress_file_12190510.xml
-- Model is restarting --
Adjusting last_iter, 127, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
last_cpu_time: 2868
upload_file_number: 5
last_iter: 119
last_upload: 432000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969
The child process has been launched with process id: 23673
Executing the command: /var/lib/boinc-client/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:23673:23673] [20230115:111243:1673748763:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:13:19 STEP 120 H= 120:00 +CPU= 31.622
11:13:38 STEP 121 H= 121:00 +CPU= 18.003
11:13:58 STEP 122 H= 122:00 +CPU= 18.618
11:14:27 STEP 123 H= 123:00 +CPU= 27.378
11:14:44 STEP 124 H= 124:00 +CPU= 16.918
11:15:00 STEP 125 H= 125:00 +CPU= 15.660
11:15:27 STEP 126 H= 126:00 +CPU= 26.309
11:15:44 STEP 127 H= 127:00 +CPU= 16.141
11:16:01 STEP 128 H= 128:00 +CPU= 16.929
11:16:26 STEP 129 H= 129:00 +CPU= 25.320
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0866
(argv4) batchid: 973
(argv5) wuid: 12190510
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/21
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_789787fb218aa24f33744c6bdd20b799 to: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/21/oifs_43r3_ps_0866_2004050100_123_973_12190510.zip
ic_ancil_file: ic_ancil_12190510
ifsdata_file: ifsdata_12190510
climate_data_file: clim_data_12190510
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_27b817844710421480f75c19f86f137f to: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/21/ic_ancil_12190510.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c7ef5bcd43402f986f6f4643e7630d05 to: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12190510.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/21/159l_2/clim_data_12190510.zip
Checking for progress XML file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
Opened progress file ok : /var/lib/boinc-client/slots/21/progress_file_12190510.xml
-- Model is restarting --
Adjusting last_iter, 129, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/21/progress_file_12190510.xml
last_cpu_time: 3079
upload_file_number: 5
last_iter: 119
last_upload: 432000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969
The child process has been launched with process id: 24866
Executing the command: /var/lib/boinc-client/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:24866:24866] [20230115:111756:1673749076:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:18:30 STEP 120 H= 120:00 +CPU= 29.684
11:18:48 STEP 121 H= 121:00 +CPU= 17.640
11:19:07 STEP 122 H= 122:00 +CPU= 18.432
11:19:35 STEP 123 H= 123:00 +CPU= 27.193
11:19:53 STEP 124 H= 124:00 +CPU= 17.704
11:20:10 STEP 125 H= 125:00 +CPU= 17.353
11:20:39 STEP 126 H= 126:00 +CPU= 28.351
11:20:56 STEP 127 H= 127:00 +CPU= 16.954
11:21:14 STEP 128 H= 128:00 +CPU= 17.388
11:21:42 STEP 129 H= 129:00 +CPU= 26.998
11:21:59 STEP 130 H= 130:00 +CPU= 16.678
11:22:22 STEP 131 H= 131:00 +CPU= 17.210
11:22:53 STEP 132 H= 132:00 +CPU= 29.896
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000132
11:23:11 STEP 133 H= 133:00 +CPU= 17.867
11:23:31 STEP 134 H= 134:00 +CPU= 18.577
11:23:55 STEP 135 H= 135:00 +CPU= 23.492
11:24:14 STEP 136 H= 136:00 +CPU= 18.889
11:24:32 STEP 137 H= 137:00 +CPU= 17.794
11:25:01 STEP 138 H= 138:00 +CPU= 28.643
11:25:19 STEP 139 H= 139:00 +CPU= 17.971
11:25:38 STEP 140 H= 140:00 +CPU= 18.464
11:26:06 STEP 141 H= 141:00 +CPU= 26.782
11:26:24 STEP 142 H= 142:00 +CPU= 18.443
11:26:40 STEP 143 H= 143:00 +CPU= 15.662
11:27:08 STEP 144 H= 144:00 +CPU= 26.150
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_5.zip
Uploading the intermediate file: upload_file_5.zip
11:27:24 STEP 145 H= 145:00 +CPU= 15.395
11:27:39 STEP 146 H= 146:00 +CPU= 15.144
11:28:00 STEP 147 H= 147:00 +CPU= 20.626
11:28:13 STEP 148 H= 148:00 +CPU= 12.852
11:28:26 STEP 149 H= 149:00 +CPU= 12.588
11:28:46 STEP 150 H= 150:00 +CPU= 19.830
11:28:58 STEP 151 H= 151:00 +CPU= 11.984
11:29:13 STEP 152 H= 152:00 +CPU= 14.687
11:29:36 STEP 153 H= 153:00 +CPU= 20.601
11:29:50 STEP 154 H= 154:00 +CPU= 14.162
11:30:04 STEP 155 H= 155:00 +CPU= 13.312
11:30:29 STEP 156 H= 156:00 +CPU= 24.912
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000156
11:30:44 STEP 157 H= 157:00 +CPU= 14.817
11:31:00 STEP 158 H= 158:00 +CPU= 14.765
11:31:21 STEP 159 H= 159:00 +CPU= 20.483
11:31:33 STEP 160 H= 160:00 +CPU= 12.581
11:31:47 STEP 161 H= 161:00 +CPU= 13.362
11:32:07 STEP 162 H= 162:00 +CPU= 20.073
11:32:20 STEP 163 H= 163:00 +CPU= 13.021
11:32:34 STEP 164 H= 164:00 +CPU= 13.840
11:32:58 STEP 165 H= 165:00 +CPU= 22.874
11:33:14 STEP 166 H= 166:00 +CPU= 13.568
11:33:27 STEP 167 H= 167:00 +CPU= 12.801
11:33:52 STEP 168 H= 168:00 +CPU= 24.812
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_6.zip
Uploading the intermediate file: upload_file_6.zip
11:34:07 STEP 169 H= 169:00 +CPU= 13.901
11:34:21 STEP 170 H= 170:00 +CPU= 14.259
11:34:42 STEP 171 H= 171:00 +CPU= 20.544
11:34:56 STEP 172 H= 172:00 +CPU= 13.219
11:35:10 STEP 173 H= 173:00 +CPU= 13.552
11:35:44 STEP 174 H= 174:00 +CPU= 20.755
11:35:56 STEP 175 H= 175:00 +CPU= 12.283
11:36:09 STEP 176 H= 176:00 +CPU= 12.938
11:36:29 STEP 177 H= 177:00 +CPU= 19.612
11:36:42 STEP 178 H= 178:00 +CPU= 12.632
11:36:54 STEP 179 H= 179:00 +CPU= 12.118
11:37:17 STEP 180 H= 180:00 +CPU= 22.224
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000180
11:37:33 STEP 181 H= 181:00 +CPU= 13.596
11:37:47 STEP 182 H= 182:00 +CPU= 13.927
11:38:07 STEP 183 H= 183:00 +CPU= 19.636
11:38:18 STEP 184 H= 184:00 +CPU= 11.110
11:38:30 STEP 185 H= 185:00 +CPU= 11.523
11:38:51 STEP 186 H= 186:00 +CPU= 21.047
11:39:08 STEP 187 H= 187:00 +CPU= 13.941
11:39:21 STEP 188 H= 188:00 +CPU= 12.556
11:39:40 STEP 189 H= 189:00 +CPU= 18.699
11:39:52 STEP 190 H= 190:00 +CPU= 12.313
11:40:07 STEP 191 H= 191:00 +CPU= 13.916
11:47:45 STEP 192 H= 192:00 +CPU= 28.805
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMGGhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMSHhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190510/ICMUAhq0f+000180
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0866_2004050100_123_973_12190510_2_r1734623969_7.zip
Uploading the intermediate file: upload_file_7.zip
11:49:15 STEP 193 H= 193:00 +CPU= 16.986
11:49:32 STEP 194 H= 194:00 +CPU= 15.705
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
