climateprediction.net home page
Task 22309727

Task 22309727

Name oifs_43r3_bl_a246_2016092300_15_991_12209529_0
Workunit 12209529
Created 13 Feb 2023, 17:03:33 UTC
Sent 13 Feb 2023, 17:09:45 UTC
Report deadline 14 Apr 2023, 17:09:45 UTC
Received 13 Feb 2023, 18:59:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537623
Run time 13 min 15 sec
CPU time 12 min 16 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7.68 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,974.42 MB
Peak swap size 5,930.79 MB
Peak disk usage 257.20 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a246
(argv4) batchid: 991
(argv5) wuid: 12209529
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /home/galfridian/slots/37
Project directory is: /home/galfridian/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /home/galfridian/projects/climateprediction.net/oifs_43r3_bl_12209529
Copying: /home/galfridian/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /home/galfridian/slots/37/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/galfridian/slots/37/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d362ccc6ddfefd86837d4d24d556d30d to: /home/galfridian/slots/37/oifs_43r3_bl_a246_2016092300_15_991_12209529.zip
Unzipping the namelist zip file: /home/galfridian/slots/37/oifs_43r3_bl_a246_2016092300_15_991_12209529.zip
ic_ancil_file: ic_ancil_12209529
ifsdata_file: ifsdata_12209529
climate_data_file: clim_data_12209529
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/galfridian/slots/37/ic_ancil_12209529.zip
Unzipping the IC ancils zip file: /home/galfridian/slots/37/ic_ancil_12209529.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_10cfa4b721e70fc8a71d6557e187c135 to: /home/galfridian/slots/37/ifsdata/ifsdata_12209529.zip
Unzipping the ifsdata_zip file: /home/galfridian/slots/37/ifsdata/ifsdata_12209529.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/galfridian/slots/37/159l_2/clim_data_12209529.zip
Unzipping the climate data zip file: /home/galfridian/slots/37/159l_2/clim_data_12209529.zip
Checking for progress XML file: /home/galfridian/slots/37/progress_file_12209529.xml
Creating progress file: /home/galfridian/slots/37/progress_file_12209529.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a246_2016092300_15_991_12209529_0_r513609180
The child process has been launched with process id: 4400
Executing the command: /home/galfridian/slots/37/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4400:4400] [20230213:181620:1676308580:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:16:42 STEP    0 H=   0:00 +CPU= 19.844
Moving to projects directory: /home/galfridian/slots/37/ICMGGh7zg+000000
Moving to projects directory: /home/galfridian/slots/37/ICMSHh7zg+000000
Moving to projects directory: /home/galfridian/slots/37/ICMUAh7zg+000000
  18:16:58 STEP    1 H=   0:15 +CPU= 15.918
  18:17:14 STEP    2 H=   0:30 +CPU= 15.122
  18:17:29 STEP    3 H=   0:45 +CPU= 15.635
  18:17:46 STEP    4 H=   1:00 +CPU= 15.974
  18:18:01 STEP    5 H=   1:15 +CPU= 15.463
  18:18:16 STEP    6 H=   1:30 +CPU= 14.881
  18:18:31 STEP    7 H=   1:45 +CPU= 14.990
  18:18:47 STEP    8 H=   2:00 +CPU= 15.461
  18:19:03 STEP    9 H=   2:15 +CPU= 15.926
  18:19:19 STEP   10 H=   2:30 +CPU= 16.155
  18:19:35 STEP   11 H=   2:45 +CPU= 15.335
  18:19:55 STEP   12 H=   3:00 +CPU= 19.933
Moving to projects directory: /home/galfridian/slots/37/ICMGGh7zg+000012
Moving to projects directory: /home/galfridian/slots/37/ICMSHh7zg+000012
Moving to projects directory: /home/galfridian/slots/37/ICMUAh7zg+000012
  18:20:09 STEP   13 H=   3:15 +CPU= 14.642
  18:20:24 STEP   14 H=   3:30 +CPU= 14.368
  18:20:38 STEP   15 H=   3:45 +CPU= 14.080
  18:20:52 STEP   16 H=   4:00 +CPU= 13.838
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:31:13 STEP   17 H=   4:15 +CPU= 14.008
  18:31:28 STEP   18 H=   4:30 +CPU= 15.155
  18:31:43 STEP   19 H=   4:45 +CPU= 15.032
  18:31:59 STEP   20 H=   5:00 +CPU= 15.993
  18:32:16 STEP   21 H=   5:15 +CPU= 16.083
  18:32:33 STEP   22 H=   5:30 +CPU= 16.143
  18:32:49 STEP   23 H=   5:45 +CPU= 15.909
  18:33:10 STEP   24 H=   6:00 +CPU= 20.943
Moving to projects directory: /home/galfridian/slots/37/ICMGGh7zg+000024
Moving to projects directory: /home/galfridian/slots/37/ICMSHh7zg+000024
Moving to projects directory: /home/galfridian/slots/37/ICMUAh7zg+000024
  18:33:27 STEP   25 H=   6:15 +CPU= 16.638
  18:33:43 STEP   26 H=   6:30 +CPU= 15.988
  18:33:59 STEP   27 H=   6:45 +CPU= 16.040
  18:34:15 STEP   28 H=   7:00 +CPU= 15.957
  18:34:30 STEP   29 H=   7:15 +CPU= 14.985
  18:34:48 STEP   30 H=   7:30 +CPU= 16.218
  18:35:04 STEP   31 H=   7:45 +CPU= 15.784
  18:35:20 STEP   32 H=   8:00 +CPU= 15.990
  18:35:36 STEP   33 H=   8:15 +CPU= 15.841
  18:35:51 STEP   34 H=   8:30 +CPU= 15.402
  18:37:27 STEP   35 H=   8:45 +CPU= 18.599
  18:37:47 STEP   36 H=   9:00 +CPU= 20.028
Moving to projects directory: /home/galfridian/slots/37/ICMGGh7zg+000036
Moving to projects directory: /home/galfridian/slots/37/ICMSHh7zg+000036
Moving to projects directory: /home/galfridian/slots/37/ICMUAh7zg+000036
  18:38:03 STEP   37 H=   9:15 +CPU= 15.984
  18:38:18 STEP   38 H=   9:30 +CPU= 15.031
  18:38:34 STEP   39 H=   9:45 +CPU= 15.037
  18:38:50 STEP   40 H=  10:00 +CPU= 16.820
  18:39:07 STEP   41 H=  10:15 +CPU= 16.087
  18:39:23 STEP   42 H=  10:30 +CPU= 16.029
  18:39:39 STEP   43 H=  10:45 +CPU= 15.876
  18:39:55 STEP   44 H=  11:00 +CPU= 16.504
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.784966902746288E-02 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.518100866880703E-12 0.000000000000000E+00 0.200406816033050E-10
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.598495488688107E-02 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    36 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    36 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000036 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000036
 MPI-TASK:   1 -    325664778 BYTES IN      6 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0131( 2.3%)
 NSTEP =    36 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000036 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000036
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0062 SECONDS114155.7 Mbytes/s, TOTAL TIME=    0.1699( 3.6%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000036 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000036
 MPI-TASK:   1 -   5210636439 BYTES IN    125 RECORDS TRANSFERRED IN    0.0024 SECONDS******** Mbytes/s, TOTAL TIME=    0.0864( 2.8%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000036 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000036
 MPI-TASK:   1 -    317091145 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0027( 3.7%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000036 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000036
 MPI-TASK:   1 -    325664778 BYTES IN      4 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0033( 3.0%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    36 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    36 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000036 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000036
 MPI-TASK:   1 -    325664769 BYTES IN      7 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0048( 4.2%)
 18:37:47 STEP   36 H=   9:00 +CPU= 20.028
 NSTEP =    37 STEPO   0AAA00AAA
 18:38:03 STEP   37 H=   9:15 +CPU= 15.984
 NSTEP =    38 STEPO   0AAA00AAA
 18:38:18 STEP   38 H=   9:30 +CPU= 15.031
 NSTEP =    39 STEPO   0AAA00AAA
 18:38:34 STEP   39 H=   9:45 +CPU= 15.037
ISTEP=      40 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      40 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    40 STEPO   0AAA00AAA
 18:38:50 STEP   40 H=  10:00 +CPU= 16.820
 NSTEP =    41 STEPO   0AAA00AAA
 18:39:07 STEP   41 H=  10:15 +CPU= 16.087
 NSTEP =    42 STEPO   0AAA00AAA
 18:39:23 STEP   42 H=  10:30 +CPU= 16.029
 NSTEP =    43 STEPO   0AAA00AAA
 18:39:39 STEP   43 H=  10:45 +CPU= 15.876
 NSTEP =    44 STEPO   0AAA00AAA
 18:39:55 STEP   44 H=  11:00 +CPU= 16.504
ISTEP=      45 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      45 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    45 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 18:38:18 0AAA00AAA STEPO       39    15.031   15.031   15.078     10:27     21:58 0.33510954773144E-07       2GB       0MB
 18:38:34 0AAA00AAA STEPO       40    15.037   15.037   15.077     10:42     22:13 0.33510954773144E-07       2GB       0MB
 18:38:50 0AAA00AAA STEPO       41    16.821   16.821   16.862     10:59     22:30 0.33510954773144E-07       2GB       0MB
 18:39:07 0AAA00AAA STEPO       42    16.087   16.087   16.157     11:15     22:46 0.33510954773144E-07       2GB       0MB
 18:39:23 0AAA00AAA STEPO       43    16.029   16.029   16.063     11:31     23:02 0.33510954773144E-07       2GB       0MB
 18:39:39 0AAA00AAA STEPO       44    15.876   15.876   15.941     11:47     23:18 0.33510954773144E-07       2GB       0MB
 18:39:55 0AAA00AAA STEPO       45    16.505   16.505   16.656     12:03     23:35 0.33510954773144E-07       2GB       0MB
------------------------------------------------
>>> Printing last 8 lines from file: /home/galfridian/slots/37/progress_file_12209529.xml

<running_values>
  <last_cpu_time>736.150000</last_cpu_time>
  <upload_file_number>0</upload_file_number>
  <last_iter>45</last_iter>
  <last_upload>0</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net