<core_client_version>7.16.17</core_client_version>
<![CDATA[
<stderr_txt>
--------------------------------------------------------------------------------------I
DDH----------------------------------------------------------------------------------------------------------------------------------
I - Mass balance (10**(-6) KG/M**2)
I INITIAL I HORIZ. FLUX I DYN. FLUX I DYN. FLUX I PHYS. FLUX I PHYS. FLUX I CURRENT I I I RESIDUAL I
I MASS I I TOA I SURFACE I TOA I SURFACE I MASS I I I I
---------------------------------------------------------------------------------------------------------- I ----------------
- - - - - - - - I - -
- 10341776742. I 0. . 0. . 0. . 0. . 0. I 10341808345. - I - 31603. -
- - - - - - - - I - -
---------------------------------------------------------------------------------------------------------- I ----------------
DDH------------------------------------------------------------------------
I I
I TIME = 420.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I 0.6295970195E-21 I 0.4956753372E-06 I
ICloud fractionI 0.0000000000E+00 I 0.2496637593E-01 I
I Relat. Hum. I 0.2228503029E+00 I 0.2631095560E+00 I
I PASS 01 I 0.0000000000E+00 I 0.1303215275E+03 I
DDH------------------------------------------------------------------------
21:14:56 STEP 1680 H= 420:00 +CPU= 16.698
NSTEP = 1681 STEPO 0AAA00AAA
21:15:11 STEP 1681 H= 420:15 +CPU= 14.545
NSTEP = 1682 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 4 lines from file: ifs.stat
21:14:36 000000000 CNT3 -999 0.474 0.474 0.658 0:00 0:00 0.00000000000000E+00 1GB 0MB
21:14:38 0AAA00AAA STEPO 1680 3.270 3.270 3.592 0:03 0:03 0.30187705237299E-06 1GB 0MB
21:14:56 0AAA00AAA STEPO 1681 16.562 16.562 17.805 0:19 0:21 0.30187705237299E-06 2GB 0MB
21:15:11 0AAA00AAA STEPO 1682 14.545 14.545 15.027 0:34 0:36 0.30187705237299E-06 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 1680",
CTIME = "00171200 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 1668, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/1/progress_file_12294610.xml
<running_values>
<last_cpu_time>135.880000</last_cpu_time>
<upload_file_number>1</upload_file_number>
<last_iter>1682</last_iter>
<last_upload>1512000</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4uj
(argv4) batchid: 1018
(argv5) wuid: 12294610
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_35282309ccec1fa6e87f177562aad307 to: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
ic_ancil_file: ic_ancil_12294610
ifsdata_file: ifsdata_12294610
climate_data_file: clim_data_12294610
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_123996f5d079362ce2175e70fd427520 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12294610.xml
Opened progress file ok : /var/lib/boinc/slots/1/progress_file_12294610.xml
-- Model is restarting --
Adjusting last_iter, 1682, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/1/progress_file_12294610.xml
last_cpu_time: 135
upload_file_number: 1
last_iter: 1681
last_upload: 1512000
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516
The child process has been launched with process id: 7575
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7575:7575] [20240616:215719:1718600239:0.002] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
21:57:38 STEP 1680 H= 420:00 +CPU= 15.303
21:57:52 STEP 1681 H= 420:15 +CPU= 14.013
21:58:06 STEP 1682 H= 420:30 +CPU= 14.571
21:58:20 STEP 1683 H= 420:45 +CPU= 14.085
21:58:35 STEP 1684 H= 421:00 +CPU= 14.897
21:58:49 STEP 1685 H= 421:15 +CPU= 14.035
21:59:04 STEP 1686 H= 421:30 +CPU= 14.106
21:59:18 STEP 1687 H= 421:45 +CPU= 14.230
21:59:32 STEP 1688 H= 422:00 +CPU= 14.503
21:59:47 STEP 1689 H= 422:15 +CPU= 14.332
22:00:01 STEP 1690 H= 422:30 +CPU= 14.022
22:00:15 STEP 1691 H= 422:45 +CPU= 14.257
22:00:34 STEP 1692 H= 423:00 +CPU= 18.624
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001692
22:00:48 STEP 1693 H= 423:15 +CPU= 14.363
22:01:02 STEP 1694 H= 423:30 +CPU= 14.114
22:01:16 STEP 1695 H= 423:45 +CPU= 13.990
22:01:31 STEP 1696 H= 424:00 +CPU= 14.807
22:01:45 STEP 1697 H= 424:15 +CPU= 14.179
22:02:00 STEP 1698 H= 424:30 +CPU= 14.446
22:02:14 STEP 1699 H= 424:45 +CPU= 14.153
22:02:29 STEP 1700 H= 425:00 +CPU= 14.786
22:02:43 STEP 1701 H= 425:15 +CPU= 14.142
22:02:57 STEP 1702 H= 425:30 +CPU= 14.276
22:03:11 STEP 1703 H= 425:45 +CPU= 14.217
22:03:30 STEP 1704 H= 426:00 +CPU= 18.670
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001704
22:03:44 STEP 1705 H= 426:15 +CPU= 14.201
22:03:58 STEP 1706 H= 426:30 +CPU= 14.135
22:04:13 STEP 1707 H= 426:45 +CPU= 14.609
22:04:28 STEP 1708 H= 427:00 +CPU= 14.604
22:04:42 STEP 1709 H= 427:15 +CPU= 14.464
22:04:56 STEP 1710 H= 427:30 +CPU= 14.136
22:05:10 STEP 1711 H= 427:45 +CPU= 14.114
22:05:25 STEP 1712 H= 428:00 +CPU= 14.793
22:05:39 STEP 1713 H= 428:15 +CPU= 14.113
22:05:54 STEP 1714 H= 428:30 +CPU= 14.411
22:06:08 STEP 1715 H= 428:45 +CPU= 14.133
22:06:27 STEP 1716 H= 429:00 +CPU= 18.986
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001716
22:06:41 STEP 1717 H= 429:15 +CPU= 14.067
22:06:55 STEP 1718 H= 429:30 +CPU= 14.379
22:07:09 STEP 1719 H= 429:45 +CPU= 14.141
22:07:25 STEP 1720 H= 430:00 +CPU= 15.555
22:07:42 STEP 1721 H= 430:15 +CPU= 15.814
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4uj
(argv4) batchid: 1018
(argv5) wuid: 12294610
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_35282309ccec1fa6e87f177562aad307 to: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
ic_ancil_file: ic_ancil_12294610
ifsdata_file: ifsdata_12294610
climate_data_file: clim_data_12294610
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_123996f5d079362ce2175e70fd427520 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12294610.xml
Opened progress file ok : /var/lib/boinc/slots/1/progress_file_12294610.xml
-- Model is restarting --
Adjusting last_iter, 1722, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/1/progress_file_12294610.xml
last_cpu_time: 762
upload_file_number: 1
last_iter: 1681
last_upload: 1512000
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516
The child process has been launched with process id: 7748
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:7748:7748] [20240616:223139:1718602299:0.002] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
22:31:59 STEP 1680 H= 420:00 +CPU= 15.860
22:32:14 STEP 1681 H= 420:15 +CPU= 14.946
22:32:32 STEP 1682 H= 420:30 +CPU= 15.666
22:32:47 STEP 1683 H= 420:45 +CPU= 15.184
22:33:02 STEP 1684 H= 421:00 +CPU= 15.523
22:33:17 STEP 1685 H= 421:15 +CPU= 15.125
22:33:32 STEP 1686 H= 421:30 +CPU= 14.242
22:33:46 STEP 1687 H= 421:45 +CPU= 14.042
22:34:01 STEP 1688 H= 422:00 +CPU= 14.818
22:34:16 STEP 1689 H= 422:15 +CPU= 14.464
22:34:31 STEP 1690 H= 422:30 +CPU= 15.068
22:34:46 STEP 1691 H= 422:45 +CPU= 14.947
22:35:05 STEP 1692 H= 423:00 +CPU= 19.470
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001692
22:35:20 STEP 1693 H= 423:15 +CPU= 15.046
22:35:36 STEP 1694 H= 423:30 +CPU= 15.354
22:35:50 STEP 1695 H= 423:45 +CPU= 14.427
22:36:06 STEP 1696 H= 424:00 +CPU= 15.681
22:36:21 STEP 1697 H= 424:15 +CPU= 15.055
22:36:36 STEP 1698 H= 424:30 +CPU= 14.896
22:36:51 STEP 1699 H= 424:45 +CPU= 14.938
22:37:07 STEP 1700 H= 425:00 +CPU= 15.431
22:37:22 STEP 1701 H= 425:15 +CPU= 14.769
22:37:36 STEP 1702 H= 425:30 +CPU= 14.001
22:37:50 STEP 1703 H= 425:45 +CPU= 14.253
22:38:08 STEP 1704 H= 426:00 +CPU= 18.497
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001704
22:38:23 STEP 1705 H= 426:15 +CPU= 14.169
22:38:37 STEP 1706 H= 426:30 +CPU= 14.622
22:38:52 STEP 1707 H= 426:45 +CPU= 14.535
22:39:09 STEP 1708 H= 427:00 +CPU= 15.567
22:39:25 STEP 1709 H= 427:15 +CPU= 14.798
22:39:39 STEP 1710 H= 427:30 +CPU= 14.043
22:39:53 STEP 1711 H= 427:45 +CPU= 14.592
22:40:08 STEP 1712 H= 428:00 +CPU= 15.012
22:40:23 STEP 1713 H= 428:15 +CPU= 14.848
22:40:39 STEP 1714 H= 428:30 +CPU= 15.159
22:40:54 STEP 1715 H= 428:45 +CPU= 15.082
22:41:13 STEP 1716 H= 429:00 +CPU= 18.675
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001716
22:41:27 STEP 1717 H= 429:15 +CPU= 14.038
22:41:42 STEP 1718 H= 429:30 +CPU= 14.524
22:41:57 STEP 1719 H= 429:45 +CPU= 15.013
22:42:13 STEP 1720 H= 430:00 +CPU= 15.246
22:42:27 STEP 1721 H= 430:15 +CPU= 14.055
22:42:41 STEP 1722 H= 430:30 +CPU= 14.131
22:42:55 STEP 1723 H= 430:45 +CPU= 14.056
22:43:10 STEP 1724 H= 431:00 +CPU= 14.594
22:43:24 STEP 1725 H= 431:15 +CPU= 14.453
22:43:39 STEP 1726 H= 431:30 +CPU= 14.142
22:43:53 STEP 1727 H= 431:45 +CPU= 14.186
22:44:19 STEP 1728 H= 432:00 +CPU= 22.673
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001728
22:44:34 STEP 1729 H= 432:15 +CPU= 14.674
22:44:49 STEP 1730 H= 432:30 +CPU= 14.976
22:45:04 STEP 1731 H= 432:45 +CPU= 15.137
22:45:20 STEP 1732 H= 433:00 +CPU= 15.412
22:45:34 STEP 1733 H= 433:15 +CPU= 14.207
22:45:48 STEP 1734 H= 433:30 +CPU= 14.066
22:46:02 STEP 1735 H= 433:45 +CPU= 14.128
22:46:17 STEP 1736 H= 434:00 +CPU= 14.492
22:46:32 STEP 1737 H= 434:15 +CPU= 14.001
22:46:46 STEP 1738 H= 434:30 +CPU= 14.182
22:47:01 STEP 1739 H= 434:45 +CPU= 14.011
22:47:20 STEP 1740 H= 435:00 +CPU= 19.106
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001740
22:47:34 STEP 1741 H= 435:15 +CPU= 14.141
22:47:49 STEP 1742 H= 435:30 +CPU= 14.203
22:48:04 STEP 1743 H= 435:45 +CPU= 14.098
22:48:19 STEP 1744 H= 436:00 +CPU= 14.830
22:48:33 STEP 1745 H= 436:15 +CPU= 14.251
22:48:49 STEP 1746 H= 436:30 +CPU= 14.883
22:49:04 STEP 1747 H= 436:45 +CPU= 14.650
22:49:18 STEP 1748 H= 437:00 +CPU= 14.553
22:49:33 STEP 1749 H= 437:15 +CPU= 14.524
22:49:48 STEP 1750 H= 437:30 +CPU= 14.147
22:50:02 STEP 1751 H= 437:45 +CPU= 14.480
22:50:21 STEP 1752 H= 438:00 +CPU= 18.479
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001752
22:50:35 STEP 1753 H= 438:15 +CPU= 14.207
22:50:50 STEP 1754 H= 438:30 +CPU= 14.129
22:51:04 STEP 1755 H= 438:45 +CPU= 14.187
22:51:19 STEP 1756 H= 439:00 +CPU= 14.629
22:51:33 STEP 1757 H= 439:15 +CPU= 14.119
22:51:47 STEP 1758 H= 439:30 +CPU= 14.192
22:52:01 STEP 1759 H= 439:45 +CPU= 14.167
22:52:16 STEP 1760 H= 440:00 +CPU= 14.747
22:52:31 STEP 1761 H= 440:15 +CPU= 14.638
22:52:46 STEP 1762 H= 440:30 +CPU= 15.164
22:53:01 STEP 1763 H= 440:45 +CPU= 14.977
22:53:21 STEP 1764 H= 441:00 +CPU= 19.518
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001764
22:53:36 STEP 1765 H= 441:15 +CPU= 14.482
22:53:50 STEP 1766 H= 441:30 +CPU= 14.146
22:54:04 STEP 1767 H= 441:45 +CPU= 13.965
22:54:18 STEP 1768 H= 442:00 +CPU= 14.512
22:54:33 STEP 1769 H= 442:15 +CPU= 14.228
22:54:47 STEP 1770 H= 442:30 +CPU= 14.097
22:55:01 STEP 1771 H= 442:45 +CPU= 14.178
22:55:16 STEP 1772 H= 443:00 +CPU= 15.004
22:55:32 STEP 1773 H= 443:15 +CPU= 15.096
22:55:46 STEP 1774 H= 443:30 +CPU= 14.911
22:56:02 STEP 1775 H= 443:45 +CPU= 15.114
22:56:24 STEP 1776 H= 444:00 +CPU= 21.050
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001680
22:56:38 STEP 1777 H= 444:15 +CPU= 14.182
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001764
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_1.zip
22:56:53 STEP 1778 H= 444:30 +CPU= 14.715
22:57:08 STEP 1779 H= 444:45 +CPU= 14.337
22:57:24 STEP 1780 H= 445:00 +CPU= 14.789
Uploading the intermediate file: upload_file_1.zip
22:57:39 STEP 1781 H= 445:15 +CPU= 14.816
22:57:53 STEP 1782 H= 445:30 +CPU= 14.120
22:58:08 STEP 1783 H= 445:45 +CPU= 14.224
22:58:23 STEP 1784 H= 446:00 +CPU= 14.679
22:58:37 STEP 1785 H= 446:15 +CPU= 13.988
22:58:51 STEP 1786 H= 446:30 +CPU= 14.348
22:59:06 STEP 1787 H= 446:45 +CPU= 14.444
22:59:27 STEP 1788 H= 447:00 +CPU= 19.688
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001788
22:59:42 STEP 1789 H= 447:15 +CPU= 14.874
22:59:56 STEP 1790 H= 447:30 +CPU= 14.046
23:00:10 STEP 1791 H= 447:45 +CPU= 13.985
23:00:24 STEP 1792 H= 448:00 +CPU= 14.521
23:00:38 STEP 1793 H= 448:15 +CPU= 14.094
23:00:53 STEP 1794 H= 448:30 +CPU= 14.352
23:01:08 STEP 1795 H= 448:45 +CPU= 15.156
23:01:24 STEP 1796 H= 449:00 +CPU= 15.537
23:01:39 STEP 1797 H= 449:15 +CPU= 15.201
23:01:54 STEP 1798 H= 449:30 +CPU= 15.079
23:02:09 STEP 1799 H= 449:45 +CPU= 14.608
23:02:27 STEP 1800 H= 450:00 +CPU= 18.527
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001800
23:02:41 STEP 1801 H= 450:15 +CPU= 14.168
23:02:56 STEP 1802 H= 450:30 +CPU= 14.658
23:03:11 STEP 1803 H= 450:45 +CPU= 15.106
23:03:26 STEP 1804 H= 451:00 +CPU= 15.040
23:03:40 STEP 1805 H= 451:15 +CPU= 14.046
23:03:55 STEP 1806 H= 451:30 +CPU= 14.337
23:04:11 STEP 1807 H= 451:45 +CPU= 14.904
23:04:27 STEP 1808 H= 452:00 +CPU= 15.226
23:04:41 STEP 1809 H= 452:15 +CPU= 14.147
23:04:55 STEP 1810 H= 452:30 +CPU= 14.213
23:05:09 STEP 1811 H= 452:45 +CPU= 14.051
23:05:28 STEP 1812 H= 453:00 +CPU= 18.527
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001812
23:05:42 STEP 1813 H= 453:15 +CPU= 14.136
23:05:56 STEP 1814 H= 453:30 +CPU= 14.085
23:06:11 STEP 1815 H= 453:45 +CPU= 14.416
23:06:26 STEP 1816 H= 454:00 +CPU= 15.080
23:06:40 STEP 1817 H= 454:15 +CPU= 14.556
23:06:55 STEP 1818 H= 454:30 +CPU= 14.017
23:07:09 STEP 1819 H= 454:45 +CPU= 14.363
23:07:25 STEP 1820 H= 455:00 +CPU= 14.950
23:07:39 STEP 1821 H= 455:15 +CPU= 13.992
23:07:53 STEP 1822 H= 455:30 +CPU= 14.316
23:08:07 STEP 1823 H= 455:45 +CPU= 14.047
23:08:29 STEP 1824 H= 456:00 +CPU= 20.517
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001824
23:08:43 STEP 1825 H= 456:15 +CPU= 14.176
23:08:58 STEP 1826 H= 456:30 +CPU= 14.881
23:09:14 STEP 1827 H= 456:45 +CPU= 14.852
23:09:29 STEP 1828 H= 457:00 +CPU= 14.930
23:09:43 STEP 1829 H= 457:15 +CPU= 14.018
23:09:57 STEP 1830 H= 457:30 +CPU= 14.132
23:10:11 STEP 1831 H= 457:45 +CPU= 14.008
23:10:26 STEP 1832 H= 458:00 +CPU= 14.505
23:10:40 STEP 1833 H= 458:15 +CPU= 14.148
23:10:55 STEP 1834 H= 458:30 +CPU= 14.555
23:11:11 STEP 1835 H= 458:45 +CPU= 15.338
23:11:32 STEP 1836 H= 459:00 +CPU= 19.957
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001836
23:11:47 STEP 1837 H= 459:15 +CPU= 15.059
23:12:02 STEP 1838 H= 459:30 +CPU= 15.174
23:12:18 STEP 1839 H= 459:45 +CPU= 16.036
23:12:35 STEP 1840 H= 460:00 +CPU= 16.305
23:12:50 STEP 1841 H= 460:15 +CPU= 15.330
23:13:05 STEP 1842 H= 460:30 +CPU= 15.263
23:13:20 STEP 1843 H= 460:45 +CPU= 15.078
23:13:36 STEP 1844 H= 461:00 +CPU= 15.594
23:13:51 STEP 1845 H= 461:15 +CPU= 15.084
23:14:07 STEP 1846 H= 461:30 +CPU= 15.255
23:14:23 STEP 1847 H= 461:45 +CPU= 15.161
23:14:43 STEP 1848 H= 462:00 +CPU= 19.883
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001848
23:15:00 STEP 1849 H= 462:15 +CPU= 16.025
23:15:15 STEP 1850 H= 462:30 +CPU= 15.317
23:15:30 STEP 1851 H= 462:45 +CPU= 15.439
23:15:46 STEP 1852 H= 463:00 +CPU= 16.000
23:16:02 STEP 1853 H= 463:15 +CPU= 15.219
23:16:16 STEP 1854 H= 463:30 +CPU= 14.098
23:16:30 STEP 1855 H= 463:45 +CPU= 14.051
23:16:45 STEP 1856 H= 464:00 +CPU= 15.178
23:17:00 STEP 1857 H= 464:15 +CPU= 14.940
23:17:16 STEP 1858 H= 464:30 +CPU= 15.364
23:17:31 STEP 1859 H= 464:45 +CPU= 14.911
23:17:51 STEP 1860 H= 465:00 +CPU= 19.718
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001860
23:18:06 STEP 1861 H= 465:15 +CPU= 14.757
23:18:20 STEP 1862 H= 465:30 +CPU= 14.252
23:18:36 STEP 1863 H= 465:45 +CPU= 14.704
23:18:52 STEP 1864 H= 466:00 +CPU= 15.514
23:19:09 STEP 1865 H= 466:15 +CPU= 15.051
23:19:27 STEP 1866 H= 466:30 +CPU= 15.554
23:19:46 STEP 1867 H= 466:45 +CPU= 15.773
23:20:04 STEP 1868 H= 467:00 +CPU= 16.622
23:20:22 STEP 1869 H= 467:15 +CPU= 16.503
23:20:39 STEP 1870 H= 467:30 +CPU= 16.848
23:20:59 STEP 1871 H= 467:45 +CPU= 16.713
23:21:24 STEP 1872 H= 468:00 +CPU= 22.352
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001860
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_2.zip
23:21:42 STEP 1873 H= 468:15 +CPU= 15.769
Uploading the intermediate file: upload_file_2.zip
23:22:01 STEP 1874 H= 468:30 +CPU= 16.163
23:22:17 STEP 1875 H= 468:45 +CPU= 15.907
23:22:33 STEP 1876 H= 469:00 +CPU= 16.210
23:22:54 STEP 1877 H= 469:15 +CPU= 16.527
23:23:10 STEP 1878 H= 469:30 +CPU= 15.768
23:23:26 STEP 1879 H= 469:45 +CPU= 16.103
23:23:42 STEP 1880 H= 470:00 +CPU= 16.507
23:23:58 STEP 1881 H= 470:15 +CPU= 15.201
23:24:14 STEP 1882 H= 470:30 +CPU= 14.805
23:24:30 STEP 1883 H= 470:45 +CPU= 15.856
23:24:56 STEP 1884 H= 471:00 +CPU= 21.448
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001884
23:25:13 STEP 1885 H= 471:15 +CPU= 15.956
23:25:28 STEP 1886 H= 471:30 +CPU= 15.088
23:25:43 STEP 1887 H= 471:45 +CPU= 14.214
23:25:59 STEP 1888 H= 472:00 +CPU= 16.472
23:26:15 STEP 1889 H= 472:15 +CPU= 15.803
23:26:31 STEP 1890 H= 472:30 +CPU= 15.880
23:26:47 STEP 1891 H= 472:45 +CPU= 16.038
23:27:04 STEP 1892 H= 473:00 +CPU= 16.630
23:27:21 STEP 1893 H= 473:15 +CPU= 15.876
23:27:37 STEP 1894 H= 473:30 +CPU= 15.960
23:27:52 STEP 1895 H= 473:45 +CPU= 15.867
23:28:19 STEP 1896 H= 474:00 +CPU= 21.325
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001896
23:28:35 STEP 1897 H= 474:15 +CPU= 15.989
23:28:51 STEP 1898 H= 474:30 +CPU= 16.079
23:29:07 STEP 1899 H= 474:45 +CPU= 16.119
23:29:24 STEP 1900 H= 475:00 +CPU= 16.704
23:29:40 STEP 1901 H= 475:15 +CPU= 16.168
23:29:56 STEP 1902 H= 475:30 +CPU= 15.995
23:30:12 STEP 1903 H= 475:45 +CPU= 16.075
23:30:29 STEP 1904 H= 476:00 +CPU= 16.398
23:30:45 STEP 1905 H= 476:15 +CPU= 15.919
23:31:00 STEP 1906 H= 476:30 +CPU= 15.906
23:31:17 STEP 1907 H= 476:45 +CPU= 16.144
23:31:37 STEP 1908 H= 477:00 +CPU= 20.644
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAh7zg+001908
23:31:53 STEP 1909 H= 477:15 +CPU= 16.120
23:32:10 STEP 1910 H= 477:30 +CPU= 16.167
23:32:27 STEP 1911 H= 477:45 +CPU= 16.229
23:32:43 STEP 1912 H= 478:00 +CPU= 16.554
23:32:59 STEP 1913 H= 478:15 +CPU= 16.067
23:33:16 STEP 1914 H= 478:30 +CPU= 15.592
23:33:31 STEP 1915 H= 478:45 +CPU= 14.282
23:33:46 STEP 1916 H= 479:00 +CPU= 15.217
23:34:02 STEP 1917 H= 479:15 +CPU= 15.918
23:34:16 STEP 1918 H= 479:30 +CPU= 14.257
23:34:31 STEP 1919 H= 479:45 +CPU= 14.213
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01
23:33:31 STEP 1915 H= 478:45 +CPU= 14.282
NSTEP = 1916 STEPO 0AAA00AAA
23:33:46 STEP 1916 H= 479:00 +CPU= 15.217
NSTEP = 1917 STEPO 0AAA00AAA
23:34:02 STEP 1917 H= 479:15 +CPU= 15.918
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4uj
(argv4) batchid: 1018
(argv5) wuid: 12294610
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_35282309ccec1fa6e87f177562aad307 to: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610.zip
ic_ancil_file: ic_ancil_12294610
ifsdata_file: ifsdata_12294610
climate_data_file: clim_data_12294610
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12294610.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_123996f5d079362ce2175e70fd427520 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12294610.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12294610.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12294610.xml
Opened progress file ok : /var/lib/boinc/slots/1/progress_file_12294610.xml
-- Model is restarting --
Adjusting last_iter, 1920, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/1/progress_file_12294610.xml
last_cpu_time: 4452
upload_file_number: 3
last_iter: 1921
last_upload: 1684800
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516
The child process has been launched with process id: 8050
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Pikachu:1:1:8050:8050] [20240617:011612:1718612172:0.003] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
01:16:31 STEP 1920 H= 480:00 +CPU= 15.225
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
I I Hor. Flux of PEII -0.00000 I I I I I
I I Vert.Flux of PEII 0.00000 I I I I I
I I Work Pres.G.F II I 0.02020 I I I I
I I Conv. Ad.-Int. II -0.02020 I I I I I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux II 0.00106 I -0.00076 I 0.01642 I 0.00003 I 0.00005 I
I I Vertical Flux II 0.00000 I 0.00000 I 0.00000 I 0.00000 I 0.00000 I
DDH--------------------------------------------------------------------------------------------------I
DDH----------------------------------------------------------------------------------------------------------------------------------
I - Mass balance (10**(-6) KG/M**2)
I INITIAL I HORIZ. FLUX I DYN. FLUX I DYN. FLUX I PHYS. FLUX I PHYS. FLUX I CURRENT I I I RESIDUAL I
I MASS I I TOA I SURFACE I TOA I SURFACE I MASS I I I I
---------------------------------------------------------------------------------------------------------- I ----------------
- - - - - - - - I - -
- 10341776742. I 0. . 0. . 0. . 0. . 0. I 10341835525. - I - 58783. -
- - - - - - - - I - -
---------------------------------------------------------------------------------------------------------- I ----------------
DDH------------------------------------------------------------------------
I I
I TIME = 480.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I 0.6295970195E-21 I 0.3897423600E-06 I
ICloud fractionI 0.0000000000E+00 I 0.2644136929E-01 I
I Relat. Hum. I 0.2228503029E+00 I 0.2670079876E+00 I
I PASS 01 I 0.0000000000E+00 I 0.1625880883E+03 I
DDH------------------------------------------------------------------------
01:16:31 STEP 1920 H= 480:00 +CPU= 15.225
END CNT3
NSTEP = 1920 CNT0 000000000 15.161 15.161 15.205 0.997 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 0/ 0
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 3 0 46 1044068 0 0 1.8 1.8 0.0 2.5 0.0
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 19373.2 19373.2 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 15287.4 15287.4 78.91 0.00
8 SCAN2M - GRID-POINT DYNAMICS 1 2918.6 2918.6 15.07 0.00
10 SCAN2M - PHYSICS 1 7866.1 7866.1 40.60 0.00
12 SPNORM - SPECTRAL NORM COMP. 1 32.8 32.8 0.17 0.00
28 RESTART FILES - READING 1 3235.5 3235.5 16.70 0.00
31 POSDDH IN STEPO 1 7.6 7.6 0.04 0.00
37 CPGLAG - SL COMPUTATIONS 1 3429.5 3429.5 17.70 0.00
39 SU0YOMB 1 498.7 498.7 2.57 0.00
51 SCAN2M - SL COMM. PART 1 1 13.4 13.4 0.07 0.00
56 SPNORM - SPECTRAL NORM COMM. 1 0.1 0.1 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 4 102.1 102.1 2.11 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 4 39.6 39.6 0.82 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 28.6 28.6 0.15 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 4 23.1 23.1 0.48 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 4 46.0 46.0 0.95 0.00
400 GSTATS 1119 0.0 0.0 0.00 0.00
401 GSTATS HOOK 987 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 19.4 CPU TIME 18.5 VECTOR TIME 18.5
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 113034.3
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12294610/ICMGGh7zg+001920
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_3.zip
Uploading the final file: upload_file_3.zip
Uploading trickle at timestep: 1728900
01:19:58 (8041): called boinc_finish(0)
</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_17.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_18.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a4uj_2016092300_20_1018_12294610_0_r479560516_19.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
