climateprediction.net home page
Task 22315752

Task 22315752

Name oifs_43r3_00q8_2019110100_123_993_12214382_0
Workunit 12214382
Created 24 Feb 2023, 14:48:30 UTC
Sent 24 Feb 2023, 19:15:22 UTC
Report deadline 25 Apr 2023, 19:15:22 UTC
Received 27 Feb 2023, 18:18:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1519251
Run time 21 hours 35 min 58 sec
CPU time 21 hours 3 min 28 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.98 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,420.92 MB
Peak swap size 4,984.14 MB
Peak disk usage 1,776.09 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
end request received from the BOINC client, suspending the child process
Resuming the child process
  22:36:46 STEP 2751 H=2751:00 +CPU= 32.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:38:19 STEP 2752 H=2752:00 +CPU= 21.207
  22:38:40 STEP 2753 H=2753:00 +CPU= 21.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:40:25 STEP 2754 H=2754:00 +CPU= 32.790
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:41:57 STEP 2755 H=2755:00 +CPU= 20.631
  22:42:18 STEP 2756 H=2756:00 +CPU= 21.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:45:01 STEP 2757 H=2757:00 +CPU= 32.534
  22:45:22 STEP 2758 H=2758:00 +CPU= 20.495
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:47:04 STEP 2759 H=2759:00 +CPU= 21.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 00q8
(argv4) batchid: 993
(argv5) wuid: 12214382
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_02bc9c76be063b5ea3d4a4480ef68574 to: /var/lib/boinc-client/slots/5/oifs_43r3_00q8_2019110100_123_993_12214382.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_00q8_2019110100_123_993_12214382.zip
ic_ancil_file: ic_ancil_12214382
ifsdata_file: ifsdata_12214382
climate_data_file: clim_data_12214382
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_eff2239040c7c5277e6ba37ad0f35f64 to: /var/lib/boinc-client/slots/5/ic_ancil_12214382.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12214382.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d96f2721e81c20e9da713612d40287dd to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12214382.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12214382.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12214382.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12214382.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12214382.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12214382.xml
-- Model is restarting --
Adjusting last_iter, 2760, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12214382.xml
last_cpu_time: 71016
upload_file_number: 114
last_iter: 2761
last_upload: 9853200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805
The child process has been launched with process id: 1678433
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1678433:1678433] [20230227:225012:1677505812:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_114.zip
Uploading the intermediate file: upload_file_114.zip
  22:50:51 STEP 2760 H=2760:00 +CPU= 36.554
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002760
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:52:43 STEP 2761 H=2761:00 +CPU= 20.755
  22:53:04 STEP 2762 H=2762:00 +CPU= 20.849
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:56:09 STEP 2763 H=2763:00 +CPU= 32.542
  22:56:31 STEP 2764 H=2764:00 +CPU= 22.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:58:13 STEP 2765 H=2765:00 +CPU= 19.673
  22:58:47 STEP 2766 H=2766:00 +CPU= 33.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:00:58 STEP 2767 H=2767:00 +CPU= 20.232
  23:01:19 STEP 2768 H=2768:00 +CPU= 20.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:03:00 STEP 2769 H=2769:00 +CPU= 30.836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:04:23 STEP 2770 H=2770:00 +CPU= 21.918
  23:04:43 STEP 2771 H=2771:00 +CPU= 20.033
  23:05:17 STEP 2772 H=2772:00 +CPU= 33.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002772
  23:07:10 STEP 2773 H=2773:00 +CPU= 21.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:08:42 STEP 2774 H=2774:00 +CPU= 20.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:10:35 STEP 2775 H=2775:00 +CPU= 32.359
  23:10:57 STEP 2776 H=2776:00 +CPU= 21.190
  23:11:16 STEP 2777 H=2777:00 +CPU= 19.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:13:10 STEP 2778 H=2778:00 +CPU= 33.101
  23:13:30 STEP 2779 H=2779:00 +CPU= 19.597
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:15:10 STEP 2780 H=2780:00 +CPU= 20.250
  23:15:42 STEP 2781 H=2781:00 +CPU= 31.366
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:17:24 STEP 2782 H=2782:00 +CPU= 21.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:18:46 STEP 2783 H=2783:00 +CPU= 20.200
  23:19:23 STEP 2784 H=2784:00 +CPU= 36.055
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002784
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:21:04 STEP 2785 H=2785:00 +CPU= 20.062
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002784
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_115.zip
Uploading the intermediate file: upload_file_115.zip
  23:21:24 STEP 2786 H=2786:00 +CPU= 20.422
  23:21:55 STEP 2787 H=2787:00 +CPU= 30.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:23:38 STEP 2788 H=2788:00 +CPU= 21.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:24:59 STEP 2789 H=2789:00 +CPU= 20.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:27:03 STEP 2790 H=2790:00 +CPU= 32.626
  23:27:23 STEP 2791 H=2791:00 +CPU= 19.972
  23:27:43 STEP 2792 H=2792:00 +CPU= 20.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:29:36 STEP 2793 H=2793:00 +CPU= 32.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:31:38 STEP 2794 H=2794:00 +CPU= 20.535
  23:31:58 STEP 2795 H=2795:00 +CPU= 20.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:34:03 STEP 2796 H=2796:00 +CPU= 33.657
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002796
  23:34:24 STEP 2797 H=2797:00 +CPU= 20.803
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:35:56 STEP 2798 H=2798:00 +CPU= 20.771
  23:36:27 STEP 2799 H=2799:00 +CPU= 31.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:38:31 STEP 2800 H=2800:00 +CPU= 21.214
  23:38:50 STEP 2801 H=2801:00 +CPU= 19.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:40:35 STEP 2802 H=2802:00 +CPU= 33.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:42:15 STEP 2803 H=2803:00 +CPU= 19.619
  23:42:36 STEP 2804 H=2804:00 +CPU= 21.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:44:18 STEP 2805 H=2805:00 +CPU= 31.611
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:45:59 STEP 2806 H=2806:00 +CPU= 20.478
  23:46:20 STEP 2807 H=2807:00 +CPU= 21.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:48:20 STEP 2808 H=2808:00 +CPU= 37.067
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002808
  23:48:39 STEP 2809 H=2809:00 +CPU= 19.479
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002808
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_116.zip
Uploading the intermediate file: upload_file_116.zip
  23:48:58 STEP 2810 H=2810:00 +CPU= 19.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:50:48 STEP 2811 H=2811:00 +CPU= 31.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:52:19 STEP 2812 H=2812:00 +CPU= 20.491
  23:52:40 STEP 2813 H=2813:00 +CPU= 21.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:54:45 STEP 2814 H=2814:00 +CPU= 33.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:56:06 STEP 2815 H=2815:00 +CPU= 19.491
  23:56:27 STEP 2816 H=2816:00 +CPU= 20.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:58:11 STEP 2817 H=2817:00 +CPU= 32.852
  23:58:31 STEP 2818 H=2818:00 +CPU= 20.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:00:12 STEP 2819 H=2819:00 +CPU= 19.847
  00:00:47 STEP 2820 H=2820:00 +CPU= 34.291
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:02:39 STEP 2821 H=2821:00 +CPU= 20.328
  00:03:00 STEP 2822 H=2822:00 +CPU= 20.306
  00:03:32 STEP 2823 H=2823:00 +CPU= 31.894
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:05:14 STEP 2824 H=2824:00 +CPU= 21.232
  00:05:34 STEP 2825 H=2825:00 +CPU= 19.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:07:18 STEP 2826 H=2826:00 +CPU= 33.278
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:08:48 STEP 2827 H=2827:00 +CPU= 20.294
  00:09:10 STEP 2828 H=2828:00 +CPU= 21.110
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:11:03 STEP 2829 H=2829:00 +CPU= 32.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:12:14 STEP 2830 H=2830:00 +CPU= 20.792
  00:12:35 STEP 2831 H=2831:00 +CPU= 20.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:14:34 STEP 2832 H=2832:00 +CPU= 37.216
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002832
  00:14:53 STEP 2833 H=2833:00 +CPU= 19.247
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002832
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_117.zip
Uploading the intermediate file: upload_file_117.zip
  00:15:12 STEP 2834 H=2834:00 +CPU= 18.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:16:44 STEP 2835 H=2835:00 +CPU= 31.951
  00:17:04 STEP 2836 H=2836:00 +CPU= 20.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:18:46 STEP 2837 H=2837:00 +CPU= 21.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:20:41 STEP 2838 H=2838:00 +CPU= 33.928
  00:21:03 STEP 2839 H=2839:00 +CPU= 21.457
  00:21:23 STEP 2840 H=2840:00 +CPU= 20.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:23:17 STEP 2841 H=2841:00 +CPU= 32.228
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:24:50 STEP 2842 H=2842:00 +CPU= 21.582
  00:25:10 STEP 2843 H=2843:00 +CPU= 19.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:27:07 STEP 2844 H=2844:00 +CPU= 35.960
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:28:39 STEP 2845 H=2845:00 +CPU= 20.034
  00:29:00 STEP 2846 H=2846:00 +CPU= 21.190
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:30:53 STEP 2847 H=2847:00 +CPU= 31.701
  00:31:14 STEP 2848 H=2848:00 +CPU= 21.411
  00:31:33 STEP 2849 H=2849:00 +CPU= 19.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:33:38 STEP 2850 H=2850:00 +CPU= 33.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:35:19 STEP 2851 H=2851:00 +CPU= 20.528
  00:35:40 STEP 2852 H=2852:00 +CPU= 21.460
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:37:33 STEP 2853 H=2853:00 +CPU= 32.050
  00:37:53 STEP 2854 H=2854:00 +CPU= 19.832
  00:38:13 STEP 2855 H=2855:00 +CPU= 19.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:40:12 STEP 2856 H=2856:00 +CPU= 37.587
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:41:33 STEP 2857 H=2857:00 +CPU= 19.547
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002856
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_118.zip
Uploading the intermediate file: upload_file_118.zip
  00:41:55 STEP 2858 H=2858:00 +CPU= 21.405
  00:42:26 STEP 2859 H=2859:00 +CPU= 31.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:43:59 STEP 2860 H=2860:00 +CPU= 20.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:45:18 STEP 2861 H=2861:00 +CPU= 19.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:47:13 STEP 2862 H=2862:00 +CPU= 33.049
  00:47:34 STEP 2863 H=2863:00 +CPU= 21.059
  00:47:54 STEP 2864 H=2864:00 +CPU= 20.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:49:25 STEP 2865 H=2865:00 +CPU= 31.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:50:59 STEP 2866 H=2866:00 +CPU= 21.089
  00:51:19 STEP 2867 H=2867:00 +CPU= 20.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:52:56 STEP 2868 H=2868:00 +CPU= 36.042
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002868
  00:53:16 STEP 2869 H=2869:00 +CPU= 19.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:54:59 STEP 2870 H=2870:00 +CPU= 21.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:56:51 STEP 2871 H=2871:00 +CPU= 31.546
  00:57:13 STEP 2872 H=2872:00 +CPU= 21.164
  00:57:33 STEP 2873 H=2873:00 +CPU= 20.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:17 STEP 2874 H=2874:00 +CPU= 33.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:00:48 STEP 2875 H=2875:00 +CPU= 19.815
  01:01:09 STEP 2876 H=2876:00 +CPU= 21.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:03:13 STEP 2877 H=2877:00 +CPU= 32.209
  01:03:34 STEP 2878 H=2878:00 +CPU= 20.000
  01:03:54 STEP 2879 H=2879:00 +CPU= 20.568
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 00q8
(argv4) batchid: 993
(argv5) wuid: 12214382
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_02bc9c76be063b5ea3d4a4480ef68574 to: /var/lib/boinc-client/slots/5/oifs_43r3_00q8_2019110100_123_993_12214382.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_00q8_2019110100_123_993_12214382.zip
ic_ancil_file: ic_ancil_12214382
ifsdata_file: ifsdata_12214382
climate_data_file: clim_data_12214382
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_eff2239040c7c5277e6ba37ad0f35f64 to: /var/lib/boinc-client/slots/5/ic_ancil_12214382.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12214382.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d96f2721e81c20e9da713612d40287dd to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12214382.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12214382.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12214382.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12214382.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12214382.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12214382.xml
-- Model is restarting --
Adjusting last_iter, 2880, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12214382.xml
last_cpu_time: 73986
upload_file_number: 119
last_iter: 2881
last_upload: 10285200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805
The child process has been launched with process id: 1698368
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:p500:1:1:1698368:1698368] [20230228:010657:1677514017:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_119.zip
Uploading the intermediate file: upload_file_119.zip
  01:07:37 STEP 2880 H=2880:00 +CPU= 36.852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:08:59 STEP 2881 H=2881:00 +CPU= 20.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:10:12 STEP 2882 H=2882:00 +CPU= 21.101
  01:10:44 STEP 2883 H=2883:00 +CPU= 31.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:12:35 STEP 2884 H=2884:00 +CPU= 21.125
  01:12:55 STEP 2885 H=2885:00 +CPU= 19.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:14:47 STEP 2886 H=2886:00 +CPU= 31.771
  01:15:08 STEP 2887 H=2887:00 +CPU= 21.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:16:30 STEP 2888 H=2888:00 +CPU= 20.212
  01:17:01 STEP 2889 H=2889:00 +CPU= 31.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:18:43 STEP 2890 H=2890:00 +CPU= 20.953
  01:19:04 STEP 2891 H=2891:00 +CPU= 20.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:21:09 STEP 2892 H=2892:00 +CPU= 34.488
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002892
  01:21:31 STEP 2893 H=2893:00 +CPU= 21.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:23:13 STEP 2894 H=2894:00 +CPU= 21.102
  01:23:45 STEP 2895 H=2895:00 +CPU= 31.868
  01:24:06 STEP 2896 H=2896:00 +CPU= 20.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:25:57 STEP 2897 H=2897:00 +CPU= 20.155
  01:26:30 STEP 2898 H=2898:00 +CPU= 32.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:27:52 STEP 2899 H=2899:00 +CPU= 21.132
  01:28:13 STEP 2900 H=2900:00 +CPU= 20.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:30:06 STEP 2901 H=2901:00 +CPU= 31.974
  01:30:27 STEP 2902 H=2902:00 +CPU= 21.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:32:00 STEP 2903 H=2903:00 +CPU= 20.864
  01:32:37 STEP 2904 H=2904:00 +CPU= 36.298
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:34:07 STEP 2905 H=2905:00 +CPU= 20.310
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002904
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_120.zip
Uploading the intermediate file: upload_file_120.zip
  01:34:28 STEP 2906 H=2906:00 +CPU= 21.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:36:12 STEP 2907 H=2907:00 +CPU= 31.888
  01:36:34 STEP 2908 H=2908:00 +CPU= 21.417
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:38:17 STEP 2909 H=2909:00 +CPU= 20.848
  01:38:50 STEP 2910 H=2910:00 +CPU= 33.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:40:22 STEP 2911 H=2911:00 +CPU= 20.701
  01:40:42 STEP 2912 H=2912:00 +CPU= 20.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:42:34 STEP 2913 H=2913:00 +CPU= 31.654
  01:42:56 STEP 2914 H=2914:00 +CPU= 21.337
  01:43:15 STEP 2915 H=2915:00 +CPU= 19.822
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:45:02 STEP 2916 H=2916:00 +CPU= 34.158
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002916
  01:45:21 STEP 2917 H=2917:00 +CPU= 19.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:46:51 STEP 2918 H=2918:00 +CPU= 19.677
  01:47:23 STEP 2919 H=2919:00 +CPU= 32.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:48:57 STEP 2920 H=2920:00 +CPU= 21.203
  01:49:18 STEP 2921 H=2921:00 +CPU= 21.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:51:02 STEP 2922 H=2922:00 +CPU= 32.693
  01:51:21 STEP 2923 H=2923:00 +CPU= 19.601
  01:51:42 STEP 2924 H=2924:00 +CPU= 20.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:53:34 STEP 2925 H=2925:00 +CPU= 31.283
  01:53:55 STEP 2926 H=2926:00 +CPU= 20.848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:55:26 STEP 2927 H=2927:00 +CPU= 20.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:57:15 STEP 2928 H=2928:00 +CPU= 37.491
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:58:26 STEP 2929 H=2929:00 +CPU= 20.383
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002928
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_121.zip
Uploading the intermediate file: upload_file_121.zip
  01:58:48 STEP 2930 H=2930:00 +CPU= 21.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:00:42 STEP 2931 H=2931:00 +CPU= 33.099
  02:01:03 STEP 2932 H=2932:00 +CPU= 21.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:02:36 STEP 2933 H=2933:00 +CPU= 20.449
  02:03:08 STEP 2934 H=2934:00 +CPU= 32.448
  02:03:28 STEP 2935 H=2935:00 +CPU= 19.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:05:11 STEP 2936 H=2936:00 +CPU= 21.058
  02:05:44 STEP 2937 H=2937:00 +CPU= 32.561
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:07:25 STEP 2938 H=2938:00 +CPU= 20.300
  02:07:46 STEP 2939 H=2939:00 +CPU= 20.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:09:31 STEP 2940 H=2940:00 +CPU= 34.583
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002940
  02:09:51 STEP 2941 H=2941:00 +CPU= 20.121
  02:10:12 STEP 2942 H=2942:00 +CPU= 20.871
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:12:05 STEP 2943 H=2943:00 +CPU= 32.022
  02:12:26 STEP 2944 H=2944:00 +CPU= 20.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:13:47 STEP 2945 H=2945:00 +CPU= 19.861
  02:14:20 STEP 2946 H=2946:00 +CPU= 33.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:16:02 STEP 2947 H=2947:00 +CPU= 19.886
  02:16:24 STEP 2948 H=2948:00 +CPU= 21.923
  02:16:56 STEP 2949 H=2949:00 +CPU= 31.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:18:37 STEP 2950 H=2950:00 +CPU= 21.476
  02:18:58 STEP 2951 H=2951:00 +CPU= 20.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:20:35 STEP 2952 H=2952:00 +CPU= 35.606
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.20203682342844     
  MAXGPFV : MAX. VALUE =   0.729847491779898     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    298676874 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS746692.2 Mbytes/s, TOTAL TIME=    0.0086( 4.7%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 02:20:35 STEP 2952 H=2952:00 +CPU= 35.606
 END CNT3
 NSTEP =  2952 CNT0   000000000  31.301  31.301  92.436   0.339               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN         1119/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     30    0       35       786125     1119 ************     5.3     1.0     4.3     1.6     7.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4417826.3 4417826.3    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4415259.9 4415259.9     99.94      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                   79    2674.7    2674.7      4.78      0.00
   9 SPCM     - SPECTRAL COMP.                      72     352.3     352.3      0.57      0.00
  10 SCAN2M - PHYSICS                               73   33524.8   33524.8     55.40      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  6    1097.2    1097.2      0.15      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  4      16.9      16.9      0.00      0.00
  13 SCAN2M - RADIATION CALC.                       25   20227.0   20227.0     11.45      0.00
  17 GRIDFPOS IN CNT4                                6      38.9      38.9      0.01      0.00
  27 RESTART FILES - WRITING                         3    2194.3    2194.3      0.15      0.00
  28 RESTART FILES - READING                         1    2059.6    2059.6      0.05      0.00
  29 SU4FPOS IN CNT4                                 6       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                 6    1999.0    1999.0      0.27      0.00
  31 POSDDH IN STEPO                                 1       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     73    9224.7    9224.7     15.24      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL            73    5776.8    5776.8      9.55      0.00
  39 SU0YOMB                                         1     322.3     322.3      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                     73      26.4      26.4      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               72     203.8     203.8      0.33      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               72      34.0      34.0      0.06      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  4       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      252     141.4     141.4      0.81      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       150     129.3     129.3      0.44      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        150      54.7      54.7      0.19      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       252      51.1      51.1      0.29      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      25.7      25.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            252      20.2      20.2      0.12      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            150      16.4      16.4      0.06      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            252      21.4      21.4      0.12      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            150      11.7      11.7      0.04      0.00
 400 GSTATS                                      15575       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 14849       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4417.8 CPU TIME    1822.7 VECTOR TIME     1822.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY     2406.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMUAhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214382/ICMGGhnw4+001488
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q8_2019110100_123_993_12214382_0_r1677958805_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
02:24:09 (1698337): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:51 1519251 22315752 oifs_43r3_00q8_2019110100_123_993_12214382_0 10,623,600 75,808 0.0071


©2024 climateprediction.net