climateprediction.net home page
Task 22246793

Task 22246793

Name oifs_43r3_ps_0200_2021050100_123_945_12163289_1
Workunit 12163289
Created 29 Nov 2022, 12:05:55 UTC
Sent 30 Nov 2022, 14:56:00 UTC
Report deadline 30 Dec 2022, 14:56:00 UTC
Received 1 Dec 2022, 13:11:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1496413
Run time 29 min 43 sec
CPU time 29 min 43 sec
Validate state Invalid
Credit 241.92
Device peak FLOPS 4.35 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,615.98 MB
Peak swap size 4,974.11 MB
Peak disk usage 1,220.92 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0200
(argv4) batchid: 945
(argv5) wuid: 12163289
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_80814c4bda6b629f1003a8fbb3b629a9 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0200_2021050100_123_945_12163289.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0200_2021050100_123_945_12163289.zip
ic_ancil_file: ic_ancil_12163289
ifsdata_file: ifsdata_12163289
climate_data_file: clim_data_12163289
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_f6b249c1bbdd8b0b2d9b7cfe1d7f36ce to: /var/lib/boinc-client/slots/4/ic_ancil_12163289.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12163289.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b7a3e8f25e2056db56778d444913b07c to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12163289.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12163289.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12163289.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12163289.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0200_2021050100_123_945_12163289_1_r590457523
The child process has been launched with process id: 23850
Executing the command: /var/lib/boinc-client/slots/4/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:rocinante:1:1:23850:23850] [20221201:230553:1669896353:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:06:33 STEP    0 H=   0:00 +CPU= 38.258
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000000
  23:07:00 STEP    1 H=   1:00 +CPU= 27.005
  23:07:24 STEP    2 H=   2:00 +CPU= 23.947
  23:08:01 STEP    3 H=   3:00 +CPU= 37.011
  23:08:25 STEP    4 H=   4:00 +CPU= 23.509
  23:08:47 STEP    5 H=   5:00 +CPU= 22.233
  23:09:25 STEP    6 H=   6:00 +CPU= 37.663
  23:09:50 STEP    7 H=   7:00 +CPU= 25.044
  23:10:12 STEP    8 H=   8:00 +CPU= 22.441
  23:10:48 STEP    9 H=   9:00 +CPU= 35.761
  23:11:09 STEP   10 H=  10:00 +CPU= 20.850
  23:11:29 STEP   11 H=  11:00 +CPU= 19.925
  23:12:07 STEP   12 H=  12:00 +CPU= 37.650
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000012
  23:12:29 STEP   13 H=  13:00 +CPU= 22.497
  23:12:53 STEP   14 H=  14:00 +CPU= 23.537
  23:13:29 STEP   15 H=  15:00 +CPU= 36.434
  23:13:52 STEP   16 H=  16:00 +CPU= 22.424
  23:14:14 STEP   17 H=  17:00 +CPU= 22.163
  23:15:06 STEP   18 H=  18:00 +CPU= 34.886
  23:15:26 STEP   19 H=  19:00 +CPU= 19.985
  23:15:48 STEP   20 H=  20:00 +CPU= 22.087
  23:16:23 STEP   21 H=  21:00 +CPU= 33.912
  23:16:45 STEP   22 H=  22:00 +CPU= 21.733
  23:17:08 STEP   23 H=  23:00 +CPU= 23.077
  23:18:05 STEP   24 H=  24:00 +CPU= 40.207
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0200_2021050100_123_945_12163289_1_r590457523_0.zip
Uploading the intermediate file: upload_file_0.zip
  23:18:28 STEP   25 H=  25:00 +CPU= 23.003
Uploading trickle at timestep: 86400
  23:19:13 STEP   26 H=  26:00 +CPU= 21.350
  23:19:48 STEP   27 H=  27:00 +CPU= 30.513
  23:20:10 STEP   28 H=  28:00 +CPU= 22.432
  23:20:33 STEP   29 H=  29:00 +CPU= 22.626
  23:21:09 STEP   30 H=  30:00 +CPU= 36.397
  23:21:32 STEP   31 H=  31:00 +CPU= 23.160
  23:21:56 STEP   32 H=  32:00 +CPU= 23.916
  23:22:32 STEP   33 H=  33:00 +CPU= 35.618
  23:22:56 STEP   34 H=  34:00 +CPU= 23.735
  23:23:19 STEP   35 H=  35:00 +CPU= 22.998
  23:23:58 STEP   36 H=  36:00 +CPU= 39.074
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000036
  23:24:21 STEP   37 H=  37:00 +CPU= 23.099
  23:24:44 STEP   38 H=  38:00 +CPU= 23.209
  23:25:20 STEP   39 H=  39:00 +CPU= 36.108
  23:25:44 STEP   40 H=  40:00 +CPU= 23.299
  23:26:06 STEP   41 H=  41:00 +CPU= 22.474
  23:26:42 STEP   42 H=  42:00 +CPU= 36.013
  23:27:05 STEP   43 H=  43:00 +CPU= 22.588
  23:27:28 STEP   44 H=  44:00 +CPU= 23.705
  23:28:05 STEP   45 H=  45:00 +CPU= 36.626
  23:28:28 STEP   46 H=  46:00 +CPU= 22.949
  23:28:52 STEP   47 H=  47:00 +CPU= 23.401
  23:29:44 STEP   48 H=  48:00 +CPU= 41.353
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163289/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0200_2021050100_123_945_12163289_1_r590457523_1.zip
Uploading the intermediate file: upload_file_1.zip
  23:30:07 STEP   49 H=  49:00 +CPU= 22.344
Uploading trickle at timestep: 172800
  23:30:30 STEP   50 H=  50:00 +CPU= 23.562
  23:31:06 STEP   51 H=  51:00 +CPU= 35.780
  23:31:30 STEP   52 H=  52:00 +CPU= 23.696
  23:31:52 STEP   53 H=  53:00 +CPU= 22.729
  23:32:29 STEP   54 H=  54:00 +CPU= 36.633
  23:32:52 STEP   55 H=  55:00 +CPU= 23.121
  23:33:16 STEP   56 H=  56:00 +CPU= 23.954
  23:33:52 STEP   57 H=  57:00 +CPU= 35.930
  23:34:14 STEP   58 H=  58:00 +CPU= 22.325
  23:34:34 STEP   59 H=  59:00 +CPU= 19.898
  23:35:08 STEP   60 H=  60:00 +CPU= 34.037
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000060
  23:35:27 STEP   61 H=  61:00 +CPU= 18.614
  23:35:47 STEP   62 H=  62:00 +CPU= 20.079
  23:36:22 STEP   63 H=  63:00 +CPU= 35.112
  23:36:46 STEP   64 H=  64:00 +CPU= 22.855
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:21:52 1496413 22246793 oifs_43r3_ps_0200_2021050100_123_945_12163289_1 172,800 1,363 0.0079
09 May 2023 15:21:52 1496413 22246793 oifs_43r3_ps_0200_2021050100_123_945_12163289_1 86,400 700 0.0081


©2024 cpdn.org