climateprediction.net home page
Task 22314984

Task 22314984

Name oifs_43r3_005k_2019110100_123_993_12213638_0
Workunit 12213638
Created 24 Feb 2023, 12:10:57 UTC
Sent 24 Feb 2023, 19:15:22 UTC
Report deadline 25 Apr 2023, 19:15:22 UTC
Received 27 Feb 2023, 18:18:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1519251
Run time 21 hours 35 min 47 sec
CPU time 21 hours 3 min 47 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.98 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,415.75 MB
Peak swap size 4,984.14 MB
Peak disk usage 1,933.01 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
,
 IPRTRVRES       =           1,
 GMASS0  =   98326.4569256114     ,
 GMASSI  =   98326.1666474518     
 /
------------------------------------------------
>>> Printing last 17 lines from file: waminfo

PARAM=10U/10V,                                                          
REPRES=GG,                                                              
ANALYSIS PERIOD =       0                                               
FORECAST PERIOD =   10281600                                            
WIND TIME STEP IN SECONDS =    3600                                     
ANALYSIS FROM 20191101000000 TO 20191101000000                          
ASSIMILATION NO                                                         
NEW FORECAST NO                                                         
STATUS STORM1= UNFINISHED                                               
STATUS STORM2= UNFINISHED                                               
STATUS STORM3= UNFINISHED                                               
DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000                  
LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000                      
BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000                   
PARALLEL RESTART = YES                                                  
NUMBER OF MPI TASKS USED =          1                                   
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/0/progress_file_12213638.xml

<running_values>
  <last_cpu_time>71051.450000</last_cpu_time>
  <upload_file_number>114</upload_file_number>
  <last_iter>2760</last_iter>
  <last_upload>9853200</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 005k
(argv4) batchid: 993
(argv5) wuid: 12213638
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_905b25a4bb11f2a495bc20906ec4759d to: /var/lib/boinc-client/slots/0/oifs_43r3_005k_2019110100_123_993_12213638.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_005k_2019110100_123_993_12213638.zip
ic_ancil_file: ic_ancil_12213638
ifsdata_file: ifsdata_12213638
climate_data_file: clim_data_12213638
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_12c8a8568ca04bee36ba04f33476bdb4 to: /var/lib/boinc-client/slots/0/ic_ancil_12213638.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12213638.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8ee5035b50ef3c975ddfa95e9303772 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12213638.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12213638.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12213638.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12213638.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12213638.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12213638.xml
-- Model is restarting --
Adjusting last_iter, 2760, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12213638.xml
last_cpu_time: 71051
upload_file_number: 114
last_iter: 2761
last_upload: 9853200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970
The child process has been launched with process id: 1677708
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1677708:1677708] [20230227:224501:1677505501:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_114.zip
Uploading the intermediate file: upload_file_114.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:46:54 STEP 2760 H=2760:00 +CPU= 34.396
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002760
  22:47:14 STEP 2761 H=2761:00 +CPU= 20.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:48:36 STEP 2762 H=2762:00 +CPU= 21.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:50:30 STEP 2763 H=2763:00 +CPU= 32.522
  22:50:50 STEP 2764 H=2764:00 +CPU= 20.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:52:40 STEP 2765 H=2765:00 +CPU= 20.032
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:34 STEP 2766 H=2766:00 +CPU= 32.505
  22:54:54 STEP 2767 H=2767:00 +CPU= 20.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:56:27 STEP 2768 H=2768:00 +CPU= 21.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:58:20 STEP 2769 H=2769:00 +CPU= 31.899
  22:58:42 STEP 2770 H=2770:00 +CPU= 21.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:00:53 STEP 2771 H=2771:00 +CPU= 19.967
  23:01:27 STEP 2772 H=2772:00 +CPU= 34.827
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002772
  23:01:47 STEP 2773 H=2773:00 +CPU= 19.738
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:04:20 STEP 2774 H=2774:00 +CPU= 21.932
  23:04:52 STEP 2775 H=2775:00 +CPU= 31.644
  23:05:13 STEP 2776 H=2776:00 +CPU= 20.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:07:06 STEP 2777 H=2777:00 +CPU= 21.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:08:50 STEP 2778 H=2778:00 +CPU= 33.617
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:10:32 STEP 2779 H=2779:00 +CPU= 20.889
  23:10:53 STEP 2780 H=2780:00 +CPU= 20.972
  23:11:25 STEP 2781 H=2781:00 +CPU= 31.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:13:06 STEP 2782 H=2782:00 +CPU= 20.667
  23:13:27 STEP 2783 H=2783:00 +CPU= 20.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:15:25 STEP 2784 H=2784:00 +CPU= 36.581
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002784
  23:15:44 STEP 2785 H=2785:00 +CPU= 19.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002784
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_115.zip
Uploading the intermediate file: upload_file_115.zip
  23:17:27 STEP 2786 H=2786:00 +CPU= 21.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:18:55 STEP 2787 H=2787:00 +CPU= 30.638
  23:19:14 STEP 2788 H=2788:00 +CPU= 19.645
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:20:55 STEP 2789 H=2789:00 +CPU= 19.805
  23:21:29 STEP 2790 H=2790:00 +CPU= 33.512
  23:21:49 STEP 2791 H=2791:00 +CPU= 19.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:23:31 STEP 2792 H=2792:00 +CPU= 21.074
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:25:04 STEP 2793 H=2793:00 +CPU= 32.355
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:26:55 STEP 2794 H=2794:00 +CPU= 20.300
  23:27:15 STEP 2795 H=2795:00 +CPU= 20.626
  23:27:49 STEP 2796 H=2796:00 +CPU= 34.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002796
  23:29:31 STEP 2797 H=2797:00 +CPU= 20.934
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:31:33 STEP 2798 H=2798:00 +CPU= 20.371
  23:32:05 STEP 2799 H=2799:00 +CPU= 31.813
  23:32:25 STEP 2800 H=2800:00 +CPU= 19.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:34:16 STEP 2801 H=2801:00 +CPU= 20.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:36:00 STEP 2802 H=2802:00 +CPU= 31.905
  23:36:20 STEP 2803 H=2803:00 +CPU= 19.955
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:38:22 STEP 2804 H=2804:00 +CPU= 21.072
  23:38:54 STEP 2805 H=2805:00 +CPU= 31.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:40:27 STEP 2806 H=2806:00 +CPU= 21.217
  23:40:47 STEP 2807 H=2807:00 +CPU= 20.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:43:54 STEP 2808 H=2808:00 +CPU= 36.299
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002808
  23:44:15 STEP 2809 H=2809:00 +CPU= 20.628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002808
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_116.zip
Uploading the intermediate file: upload_file_116.zip
  23:44:35 STEP 2810 H=2810:00 +CPU= 20.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:46:15 STEP 2811 H=2811:00 +CPU= 30.273
  23:46:36 STEP 2812 H=2812:00 +CPU= 20.190
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:48:18 STEP 2813 H=2813:00 +CPU= 20.063
  23:48:50 STEP 2814 H=2814:00 +CPU= 32.037
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:50:42 STEP 2815 H=2815:00 +CPU= 20.992
  23:51:02 STEP 2816 H=2816:00 +CPU= 20.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:52:45 STEP 2817 H=2817:00 +CPU= 31.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:54:37 STEP 2818 H=2818:00 +CPU= 20.513
  23:54:57 STEP 2819 H=2819:00 +CPU= 20.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:56:33 STEP 2820 H=2820:00 +CPU= 34.226
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:58:04 STEP 2821 H=2821:00 +CPU= 19.768
  23:58:25 STEP 2822 H=2822:00 +CPU= 20.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:00:18 STEP 2823 H=2823:00 +CPU= 32.219
  00:00:38 STEP 2824 H=2824:00 +CPU= 20.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:02:30 STEP 2825 H=2825:00 +CPU= 19.723
  00:03:03 STEP 2826 H=2826:00 +CPU= 32.629
  00:03:23 STEP 2827 H=2827:00 +CPU= 19.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:05:04 STEP 2828 H=2828:00 +CPU= 20.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:06:47 STEP 2829 H=2829:00 +CPU= 31.888
  00:07:08 STEP 2830 H=2830:00 +CPU= 21.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:08:39 STEP 2831 H=2831:00 +CPU= 20.113
  00:09:16 STEP 2832 H=2832:00 +CPU= 37.453
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002832
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:10:57 STEP 2833 H=2833:00 +CPU= 19.833
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002832
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_117.zip
Uploading the intermediate file: upload_file_117.zip
  00:11:18 STEP 2834 H=2834:00 +CPU= 20.294
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:12:34 STEP 2835 H=2835:00 +CPU= 30.927
  00:12:55 STEP 2836 H=2836:00 +CPU= 21.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:14:35 STEP 2837 H=2837:00 +CPU= 20.032
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:16:19 STEP 2838 H=2838:00 +CPU= 31.898
  00:16:40 STEP 2839 H=2839:00 +CPU= 20.848
  00:17:01 STEP 2840 H=2840:00 +CPU= 20.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:18:55 STEP 2841 H=2841:00 +CPU= 32.989
  00:19:15 STEP 2842 H=2842:00 +CPU= 20.257
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:20:57 STEP 2843 H=2843:00 +CPU= 20.937
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:22:53 STEP 2844 H=2844:00 +CPU= 34.414
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002844
  00:23:14 STEP 2845 H=2845:00 +CPU= 21.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:24:47 STEP 2846 H=2846:00 +CPU= 20.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:26:40 STEP 2847 H=2847:00 +CPU= 31.780
  00:27:01 STEP 2848 H=2848:00 +CPU= 21.160
  00:27:21 STEP 2849 H=2849:00 +CPU= 20.025
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:29:05 STEP 2850 H=2850:00 +CPU= 32.614
  00:29:24 STEP 2851 H=2851:00 +CPU= 19.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:31:06 STEP 2852 H=2852:00 +CPU= 21.080
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:33:10 STEP 2853 H=2853:00 +CPU= 32.112
  00:33:31 STEP 2854 H=2854:00 +CPU= 20.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:35:12 STEP 2855 H=2855:00 +CPU= 20.608
  00:35:50 STEP 2856 H=2856:00 +CPU= 37.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002856
  00:37:31 STEP 2857 H=2857:00 +CPU= 20.038
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002856
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_118.zip
Uploading the intermediate file: upload_file_118.zip
  00:37:51 STEP 2858 H=2858:00 +CPU= 19.676
  00:38:22 STEP 2859 H=2859:00 +CPU= 31.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:40:04 STEP 2860 H=2860:00 +CPU= 20.612
  00:40:24 STEP 2861 H=2861:00 +CPU= 20.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:41:59 STEP 2862 H=2862:00 +CPU= 33.162
  00:42:19 STEP 2863 H=2863:00 +CPU= 20.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:43:51 STEP 2864 H=2864:00 +CPU= 20.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:45:25 STEP 2865 H=2865:00 +CPU= 33.588
  00:45:45 STEP 2866 H=2866:00 +CPU= 20.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:47:27 STEP 2867 H=2867:00 +CPU= 20.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:49:01 STEP 2868 H=2868:00 +CPU= 33.905
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002868
  00:49:22 STEP 2869 H=2869:00 +CPU= 20.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:50:54 STEP 2870 H=2870:00 +CPU= 19.912
  00:51:27 STEP 2871 H=2871:00 +CPU= 32.916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:52:48 STEP 2872 H=2872:00 +CPU= 21.150
  00:53:09 STEP 2873 H=2873:00 +CPU= 20.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:55:03 STEP 2874 H=2874:00 +CPU= 33.670
  00:55:23 STEP 2875 H=2875:00 +CPU= 19.838
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:57:06 STEP 2876 H=2876:00 +CPU= 21.576
  00:57:38 STEP 2877 H=2877:00 +CPU= 31.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:09 STEP 2878 H=2878:00 +CPU= 20.129
  00:59:30 STEP 2879 H=2879:00 +CPU= 20.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 005k
(argv4) batchid: 993
(argv5) wuid: 12213638
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_905b25a4bb11f2a495bc20906ec4759d to: /var/lib/boinc-client/slots/0/oifs_43r3_005k_2019110100_123_993_12213638.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_005k_2019110100_123_993_12213638.zip
ic_ancil_file: ic_ancil_12213638
ifsdata_file: ifsdata_12213638
climate_data_file: clim_data_12213638
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_12c8a8568ca04bee36ba04f33476bdb4 to: /var/lib/boinc-client/slots/0/ic_ancil_12213638.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12213638.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a8ee5035b50ef3c975ddfa95e9303772 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12213638.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12213638.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12213638.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12213638.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12213638.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12213638.xml
-- Model is restarting --
Adjusting last_iter, 2880, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12213638.xml
last_cpu_time: 74011
upload_file_number: 119
last_iter: 2881
last_upload: 10285200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970
The child process has been launched with process id: 1697801
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1697801:1697801] [20230228:010257:1677513777:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_119.zip
Uploading the intermediate file: upload_file_119.zip
  01:03:36 STEP 2880 H=2880:00 +CPU= 36.489
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002880
  01:03:56 STEP 2881 H=2881:00 +CPU= 19.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:05:27 STEP 2882 H=2882:00 +CPU= 20.989
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:06:59 STEP 2883 H=2883:00 +CPU= 30.907
  01:07:20 STEP 2884 H=2884:00 +CPU= 21.196
  01:07:40 STEP 2885 H=2885:00 +CPU= 19.706
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:10:08 STEP 2886 H=2886:00 +CPU= 33.917
  01:10:28 STEP 2887 H=2887:00 +CPU= 20.086
  01:10:49 STEP 2888 H=2888:00 +CPU= 20.280
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:12:51 STEP 2889 H=2889:00 +CPU= 32.133
  01:13:11 STEP 2890 H=2890:00 +CPU= 20.181
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:14:52 STEP 2891 H=2891:00 +CPU= 20.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:16:29 STEP 2892 H=2892:00 +CPU= 36.166
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002892
  01:16:49 STEP 2893 H=2893:00 +CPU= 20.233
  01:17:10 STEP 2894 H=2894:00 +CPU= 20.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:19:03 STEP 2895 H=2895:00 +CPU= 32.187
  01:19:24 STEP 2896 H=2896:00 +CPU= 20.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:21:15 STEP 2897 H=2897:00 +CPU= 20.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:23:08 STEP 2898 H=2898:00 +CPU= 33.052
  01:23:30 STEP 2899 H=2899:00 +CPU= 21.358
  01:23:50 STEP 2900 H=2900:00 +CPU= 20.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:25:53 STEP 2901 H=2901:00 +CPU= 31.847
  01:26:15 STEP 2902 H=2902:00 +CPU= 21.289
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:27:36 STEP 2903 H=2903:00 +CPU= 20.491
  01:28:14 STEP 2904 H=2904:00 +CPU= 37.937
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:29:56 STEP 2905 H=2905:00 +CPU= 20.112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002904
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_120.zip
Uploading the intermediate file: upload_file_120.zip
  01:30:17 STEP 2906 H=2906:00 +CPU= 21.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:32:00 STEP 2907 H=2907:00 +CPU= 31.880
  01:32:21 STEP 2908 H=2908:00 +CPU= 20.688
  01:32:41 STEP 2909 H=2909:00 +CPU= 19.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:34:23 STEP 2910 H=2910:00 +CPU= 32.666
  01:34:44 STEP 2911 H=2911:00 +CPU= 20.259
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:36:17 STEP 2912 H=2912:00 +CPU= 21.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:38:11 STEP 2913 H=2913:00 +CPU= 31.951
  01:38:33 STEP 2914 H=2914:00 +CPU= 21.968
  01:38:52 STEP 2915 H=2915:00 +CPU= 19.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:40:38 STEP 2916 H=2916:00 +CPU= 34.130
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002916
  01:40:58 STEP 2917 H=2917:00 +CPU= 19.811
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:42:40 STEP 2918 H=2918:00 +CPU= 21.690
  01:43:12 STEP 2919 H=2919:00 +CPU= 31.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:44:44 STEP 2920 H=2920:00 +CPU= 20.581
  01:45:04 STEP 2921 H=2921:00 +CPU= 19.708
  01:45:35 STEP 2922 H=2922:00 +CPU= 31.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:47:07 STEP 2923 H=2923:00 +CPU= 20.948
  01:47:28 STEP 2924 H=2924:00 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:49:12 STEP 2925 H=2925:00 +CPU= 31.520
  01:49:33 STEP 2926 H=2926:00 +CPU= 20.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:51:06 STEP 2927 H=2927:00 +CPU= 20.616
  01:51:42 STEP 2928 H=2928:00 +CPU= 36.480
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:53:23 STEP 2929 H=2929:00 +CPU= 19.824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002928
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_121.zip
Uploading the intermediate file: upload_file_121.zip
  01:53:44 STEP 2930 H=2930:00 +CPU= 20.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:55:26 STEP 2931 H=2931:00 +CPU= 30.929
  01:55:47 STEP 2932 H=2932:00 +CPU= 20.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:57:19 STEP 2933 H=2933:00 +CPU= 21.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:58:44 STEP 2934 H=2934:00 +CPU= 32.480
  01:59:04 STEP 2935 H=2935:00 +CPU= 20.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:00:47 STEP 2936 H=2936:00 +CPU= 21.254
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:02:31 STEP 2937 H=2937:00 +CPU= 32.208
  02:02:52 STEP 2938 H=2938:00 +CPU= 21.159
  02:03:12 STEP 2939 H=2939:00 +CPU= 19.996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:05:09 STEP 2940 H=2940:00 +CPU= 34.804
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002940
  02:05:30 STEP 2941 H=2941:00 +CPU= 20.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:07:11 STEP 2942 H=2942:00 +CPU= 20.405
  02:07:42 STEP 2943 H=2943:00 +CPU= 31.390
  02:08:02 STEP 2944 H=2944:00 +CPU= 20.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:09:33 STEP 2945 H=2945:00 +CPU= 19.531
  02:10:06 STEP 2946 H=2946:00 +CPU= 32.821
  02:10:26 STEP 2947 H=2947:00 +CPU= 19.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:12:08 STEP 2948 H=2948:00 +CPU= 20.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:13:40 STEP 2949 H=2949:00 +CPU= 31.593
  02:14:01 STEP 2950 H=2950:00 +CPU= 20.928
  02:14:22 STEP 2951 H=2951:00 +CPU= 20.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:16:20 STEP 2952 H=2952:00 +CPU= 35.600
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.01755335467495     
  MAXGPFV : MAX. VALUE =   0.725013635355773     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    317170314 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS792925.8 Mbytes/s, TOTAL TIME=    0.0083( 4.8%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 02:16:20 STEP 2952 H=2952:00 +CPU= 35.600
 END CNT3
 NSTEP =  2952 CNT0   000000000  31.336  31.336 113.462   0.276               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN         1119/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     30    0       35       786125     1119 ************     5.4     1.1     4.3     1.7     6.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4402665.4 4402665.4    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4400052.0 4400052.0     99.94      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                   79    3032.8    3032.8      5.44      0.00
   9 SPCM     - SPECTRAL COMP.                      72     354.4     354.4      0.58      0.00
  10 SCAN2M - PHYSICS                               73   25300.2   25300.2     41.95      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  6    1100.0    1100.0      0.15      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  4      18.8      18.8      0.00      0.00
  13 SCAN2M - RADIATION CALC.                       25   26711.7   26711.7     15.17      0.00
  17 GRIDFPOS IN CNT4                                6      39.1      39.1      0.01      0.00
  27 RESTART FILES - WRITING                         3    2199.9    2199.9      0.15      0.00
  28 RESTART FILES - READING                         1    2197.4    2197.4      0.05      0.00
  29 SU4FPOS IN CNT4                                 6       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                 6   13844.4   13844.4      1.89      0.00
  31 POSDDH IN STEPO                                 1       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     73   10048.0   10048.0     16.66      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL            73    7572.5    7572.5     12.56      0.00
  39 SU0YOMB                                         1     261.3     261.3      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                     73      27.2      27.2      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               72     200.1     200.1      0.33      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               72      33.7      33.7      0.06      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  4       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      252     423.1     423.1      2.42      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       150     601.6     601.6      2.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        150      54.7      54.7      0.19      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       252      50.8      50.8      0.29      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      17.1      17.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            252      20.0      20.0      0.11      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            150      16.6      16.6      0.06      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            252     267.0     267.0      1.53      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            150      11.6      11.6      0.04      0.00
 400 GSTATS                                      15575       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 14849       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4402.7 CPU TIME    1816.5 VECTOR TIME     1816.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY     2415.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMSHhnw4+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMGGhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213638/ICMUAhnw4+002448
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_005k_2019110100_123_993_12213638_0_r288230970_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
02:19:52 (1697772): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:50 1519251 22314984 oifs_43r3_005k_2019110100_123_993_12213638_0 10,623,600 75,827 0.0071


©2024 climateprediction.net