climateprediction.net home page
Task 22254541

Task 22254541

Name oifs_43r3_ps_0581_1984050100_123_953_12170225_0
Workunit 12170225
Created 21 Dec 2022, 3:46:21 UTC
Sent 11 Jan 2023, 18:38:14 UTC
Report deadline 10 Feb 2023, 18:38:14 UTC
Received 12 Jan 2023, 23:10:54 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1519251
Run time 4 hours 44 min 58 sec
CPU time 4 hours 37 min 24 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.94 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,416.43 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,802.48 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
b/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_15.zip
Uploading the intermediate file: upload_file_15.zip
  00:53:46 STEP  385 H= 385:00 +CPU= 20.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:55:56 STEP  386 H= 386:00 +CPU= 20.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:57:40 STEP  387 H= 387:00 +CPU= 32.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:31 STEP  388 H= 388:00 +CPU= 20.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:01:33 STEP  389 H= 389:00 +CPU= 21.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:03:27 STEP  390 H= 390:00 +CPU= 32.697
  01:03:46 STEP  391 H= 391:00 +CPU= 19.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:05:29 STEP  392 H= 392:00 +CPU= 21.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:07:23 STEP  393 H= 393:00 +CPU= 32.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:09:15 STEP  394 H= 394:00 +CPU= 20.897
  01:09:35 STEP  395 H= 395:00 +CPU= 20.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:13:03 STEP  396 H= 396:00 +CPU= 35.584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:14:24 STEP  397 H= 397:00 +CPU= 20.933
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:15:58 STEP  398 H= 398:00 +CPU= 21.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:17:32 STEP  399 H= 399:00 +CPU= 32.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:19:35 STEP  400 H= 400:00 +CPU= 21.194
  01:19:56 STEP  401 H= 401:00 +CPU= 21.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:22:00 STEP  402 H= 402:00 +CPU= 32.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0581
(argv4) batchid: 953
(argv5) wuid: 12170225
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d164b1b21e425615664bf1045c512ad5 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
ic_ancil_file: ic_ancil_12170225
ifsdata_file: ifsdata_12170225
climate_data_file: clim_data_12170225
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c10c65852759933b774d9357bf56efab to: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a21d1512d3670bb04bbf27a44baee7 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170225.xml
-- Model is restarting --
Adjusting last_iter, 403, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
last_cpu_time: 11775
upload_file_number: 16
last_iter: 383
last_upload: 1382400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055
The child process has been launched with process id: 1633687
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1633687:1633687] [20230113:012505:1673540705:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:26:57 STEP  384 H= 384:00 +CPU= 37.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:28:49 STEP  385 H= 385:00 +CPU= 20.997
  01:29:10 STEP  386 H= 386:00 +CPU= 21.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:32:46 STEP  387 H= 387:00 +CPU= 32.003
  01:33:08 STEP  388 H= 388:00 +CPU= 22.404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:35:00 STEP  389 H= 389:00 +CPU= 20.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:36:54 STEP  390 H= 390:00 +CPU= 33.418
  01:37:14 STEP  391 H= 391:00 +CPU= 20.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:38:45 STEP  392 H= 392:00 +CPU= 20.623
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:40:28 STEP  393 H= 393:00 +CPU= 31.716
  01:40:49 STEP  394 H= 394:00 +CPU= 20.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:42:39 STEP  395 H= 395:00 +CPU= 20.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:44:35 STEP  396 H= 396:00 +CPU= 35.258
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:46:16 STEP  397 H= 397:00 +CPU= 20.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:47:58 STEP  398 H= 398:00 +CPU= 20.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:49:52 STEP  399 H= 399:00 +CPU= 32.622
  01:50:14 STEP  400 H= 400:00 +CPU= 21.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:52:04 STEP  401 H= 401:00 +CPU= 20.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:54:09 STEP  402 H= 402:00 +CPU= 33.144
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:55:51 STEP  403 H= 403:00 +CPU= 20.390
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:57:34 STEP  404 H= 404:00 +CPU= 21.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:59:38 STEP  405 H= 405:00 +CPU= 32.020
  01:59:59 STEP  406 H= 406:00 +CPU= 21.231
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:02:12 STEP  407 H= 407:00 +CPU= 21.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:04:21 STEP  408 H= 408:00 +CPU= 37.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_16.zip
Uploading the intermediate file: upload_file_16.zip
  02:05:42 STEP  409 H= 409:00 +CPU= 20.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:07:45 STEP  410 H= 410:00 +CPU= 21.214
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:09:28 STEP  411 H= 411:00 +CPU= 32.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:10:50 STEP  412 H= 412:00 +CPU= 20.797
  02:11:12 STEP  413 H= 413:00 +CPU= 21.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:13:17 STEP  414 H= 414:00 +CPU= 33.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:15:09 STEP  415 H= 415:00 +CPU= 21.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:17:11 STEP  416 H= 416:00 +CPU= 21.266
  02:17:43 STEP  417 H= 417:00 +CPU= 31.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:19:36 STEP  418 H= 418:00 +CPU= 21.539
  02:19:56 STEP  419 H= 419:00 +CPU= 20.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:23:06 STEP  420 H= 420:00 +CPU= 36.271
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000420
  02:23:27 STEP  421 H= 421:00 +CPU= 21.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:25:19 STEP  422 H= 422:00 +CPU= 20.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:27:13 STEP  423 H= 423:00 +CPU= 32.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:29:06 STEP  424 H= 424:00 +CPU= 21.501
  02:29:26 STEP  425 H= 425:00 +CPU= 20.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:31:30 STEP  426 H= 426:00 +CPU= 32.697
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:33:51 STEP  427 H= 427:00 +CPU= 20.319
  02:34:12 STEP  428 H= 428:00 +CPU= 21.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:36:26 STEP  429 H= 429:00 +CPU= 32.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:38:09 STEP  430 H= 430:00 +CPU= 20.875
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:39:51 STEP  431 H= 431:00 +CPU= 21.463
  02:40:28 STEP  432 H= 432:00 +CPU= 36.971
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_17.zip
Uploading the intermediate file: upload_file_17.zip
  02:40:47 STEP  433 H= 433:00 +CPU= 18.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:42:46 STEP  434 H= 434:00 +CPU= 20.596
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:44:49 STEP  435 H= 435:00 +CPU= 32.300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:46:33 STEP  436 H= 436:00 +CPU= 21.259
  02:46:54 STEP  437 H= 437:00 +CPU= 20.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:48:48 STEP  438 H= 438:00 +CPU= 33.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:50:29 STEP  439 H= 439:00 +CPU= 20.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:52:11 STEP  440 H= 440:00 +CPU= 21.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:54:24 STEP  441 H= 441:00 +CPU= 31.525
  02:54:44 STEP  442 H= 442:00 +CPU= 20.075
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:56:35 STEP  443 H= 443:00 +CPU= 19.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:58:33 STEP  444 H= 444:00 +CPU= 35.972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000444
  02:58:53 STEP  445 H= 445:00 +CPU= 20.050
  02:59:14 STEP  446 H= 446:00 +CPU= 20.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:01:27 STEP  447 H= 447:00 +CPU= 32.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:03:39 STEP  448 H= 448:00 +CPU= 20.754
  03:04:00 STEP  449 H= 449:00 +CPU= 20.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:05:54 STEP  450 H= 450:00 +CPU= 32.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:08:15 STEP  451 H= 451:00 +CPU= 20.651
  03:08:36 STEP  452 H= 452:00 +CPU= 21.056
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:10:39 STEP  453 H= 453:00 +CPU= 32.086
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:13:02 STEP  454 H= 454:00 +CPU= 21.045
  03:13:24 STEP  455 H= 455:00 +CPU= 21.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:15:24 STEP  456 H= 456:00 +CPU= 38.659
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_18.zip
Uploading the intermediate file: upload_file_18.zip
  03:15:43 STEP  457 H= 457:00 +CPU= 18.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:17:17 STEP  458 H= 458:00 +CPU= 20.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:19:30 STEP  459 H= 459:00 +CPU= 31.981
  03:19:52 STEP  460 H= 460:00 +CPU= 21.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:21:22 STEP  461 H= 461:00 +CPU= 20.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:23:18 STEP  462 H= 462:00 +CPU= 33.772
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:24:29 STEP  463 H= 463:00 +CPU= 20.193
  03:24:50 STEP  464 H= 464:00 +CPU= 21.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0581
(argv4) batchid: 953
(argv5) wuid: 12170225
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d164b1b21e425615664bf1045c512ad5 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
ic_ancil_file: ic_ancil_12170225
ifsdata_file: ifsdata_12170225
climate_data_file: clim_data_12170225
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c10c65852759933b774d9357bf56efab to: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a21d1512d3670bb04bbf27a44baee7 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170225.xml
-- Model is restarting --
Adjusting last_iter, 465, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
last_cpu_time: 13834
upload_file_number: 19
last_iter: 455
last_upload: 1641600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055
The child process has been launched with process id: 1651364
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1651364:1651364] [20230113:032828:1673548108:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:30:38 STEP  456 H= 456:00 +CPU= 36.301
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:32:10 STEP  457 H= 457:00 +CPU= 21.025
  03:32:31 STEP  458 H= 458:00 +CPU= 20.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:34:05 STEP  459 H= 459:00 +CPU= 32.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:35:36 STEP  460 H= 460:00 +CPU= 20.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:37:07 STEP  461 H= 461:00 +CPU= 20.760
  03:37:41 STEP  462 H= 462:00 +CPU= 33.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:39:32 STEP  463 H= 463:00 +CPU= 20.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:41:15 STEP  464 H= 464:00 +CPU= 21.259
  03:41:47 STEP  465 H= 465:00 +CPU= 32.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:43:40 STEP  466 H= 466:00 +CPU= 21.109
  03:44:00 STEP  467 H= 467:00 +CPU= 20.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:46:08 STEP  468 H= 468:00 +CPU= 36.628
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:47:58 STEP  469 H= 469:00 +CPU= 20.327
  03:48:20 STEP  470 H= 470:00 +CPU= 21.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:50:14 STEP  471 H= 471:00 +CPU= 32.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:51:46 STEP  472 H= 472:00 +CPU= 21.585
  03:52:07 STEP  473 H= 473:00 +CPU= 20.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:54:42 STEP  474 H= 474:00 +CPU= 33.986
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:56:44 STEP  475 H= 475:00 +CPU= 21.135
  03:57:06 STEP  476 H= 476:00 +CPU= 21.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:59:00 STEP  477 H= 477:00 +CPU= 33.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:00:43 STEP  478 H= 478:00 +CPU= 21.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:02:25 STEP  479 H= 479:00 +CPU= 21.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:04:25 STEP  480 H= 480:00 +CPU= 38.818
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_19.zip
Uploading the intermediate file: upload_file_19.zip
  04:04:45 STEP  481 H= 481:00 +CPU= 20.274
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:06:48 STEP  482 H= 482:00 +CPU= 21.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:08:53 STEP  483 H= 483:00 +CPU= 33.177
  04:09:14 STEP  484 H= 484:00 +CPU= 21.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:11:16 STEP  485 H= 485:00 +CPU= 21.024
  04:11:49 STEP  486 H= 486:00 +CPU= 32.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:13:31 STEP  487 H= 487:00 +CPU= 20.817
  04:13:52 STEP  488 H= 488:00 +CPU= 20.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:15:55 STEP  489 H= 489:00 +CPU= 32.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:17:47 STEP  490 H= 490:00 +CPU= 20.776
  04:18:07 STEP  491 H= 491:00 +CPU= 20.557
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:20:25 STEP  492 H= 492:00 +CPU= 36.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000492
  04:21:55 STEP  493 H= 493:00 +CPU= 20.100
  04:22:16 STEP  494 H= 494:00 +CPU= 21.526
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:24:21 STEP  495 H= 495:00 +CPU= 32.980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:25:54 STEP  496 H= 496:00 +CPU= 20.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:27:24 STEP  497 H= 497:00 +CPU= 20.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:29:08 STEP  498 H= 498:00 +CPU= 32.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:30:30 STEP  499 H= 499:00 +CPU= 19.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:32:03 STEP  500 H= 500:00 +CPU= 21.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:33:38 STEP  501 H= 501:00 +CPU= 32.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:35:20 STEP  502 H= 502:00 +CPU= 21.111
  04:35:42 STEP  503 H= 503:00 +CPU= 21.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:38:02 STEP  504 H= 504:00 +CPU= 39.236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_20.zip
Uploading the intermediate file: upload_file_20.zip
  04:38:23 STEP  505 H= 505:00 +CPU= 20.330
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:40:59 STEP  506 H= 506:00 +CPU= 21.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:43:04 STEP  507 H= 507:00 +CPU= 33.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:47:08 STEP  508 H= 508:00 +CPU= 22.289
  04:47:30 STEP  509 H= 509:00 +CPU= 21.506
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:49:55 STEP  510 H= 510:00 +CPU= 33.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:51:37 STEP  511 H= 511:00 +CPU= 20.933
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:54:11 STEP  512 H= 512:00 +CPU= 22.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:56:56 STEP  513 H= 513:00 +CPU= 33.689
  04:57:17 STEP  514 H= 514:00 +CPU= 21.706
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:59:51 STEP  515 H= 515:00 +CPU= 21.164
  05:00:28 STEP  516 H= 516:00 +CPU= 37.244
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:03:00 STEP  517 H= 517:00 +CPU= 20.760
  05:03:22 STEP  518 H= 518:00 +CPU= 21.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:06:27 STEP  519 H= 519:00 +CPU= 33.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:09:11 STEP  520 H= 520:00 +CPU= 21.594
  05:09:32 STEP  521 H= 521:00 +CPU= 21.360
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:12:30 STEP  522 H= 522:00 +CPU= 35.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:15:02 STEP  523 H= 523:00 +CPU= 21.160
  05:15:24 STEP  524 H= 524:00 +CPU= 22.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:20:22 STEP  525 H= 525:00 +CPU= 34.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:22:26 STEP  526 H= 526:00 +CPU= 22.743
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:24:30 STEP  527 H= 527:00 +CPU= 22.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:26:51 STEP  528 H= 528:00 +CPU= 39.352
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_21.zip
Uploading the intermediate file: upload_file_21.zip
  05:27:11 STEP  529 H= 529:00 +CPU= 20.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:29:05 STEP  530 H= 530:00 +CPU= 21.302
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0581
(argv4) batchid: 953
(argv5) wuid: 12170225
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d164b1b21e425615664bf1045c512ad5 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0581_1984050100_123_953_12170225.zip
ic_ancil_file: ic_ancil_12170225
ifsdata_file: ifsdata_12170225
climate_data_file: clim_data_12170225
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c10c65852759933b774d9357bf56efab to: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170225.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a21d1512d3670bb04bbf27a44baee7 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170225.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170225.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170225.xml
-- Model is restarting --
Adjusting last_iter, 531, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170225.xml
last_cpu_time: 15758
upload_file_number: 22
last_iter: 527
last_upload: 1900800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055
The child process has been launched with process id: 1672906
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1672906:1672906] [20230113:053111:1673555471:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:33:13 STEP  528 H= 528:00 +CPU= 37.875
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:34:46 STEP  529 H= 529:00 +CPU= 21.508
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:36:28 STEP  530 H= 530:00 +CPU= 21.334
  05:37:02 STEP  531 H= 531:00 +CPU= 33.364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:39:05 STEP  532 H= 532:00 +CPU= 21.228
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:41:28 STEP  533 H= 533:00 +CPU= 21.665
  05:42:02 STEP  534 H= 534:00 +CPU= 33.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:44:24 STEP  535 H= 535:00 +CPU= 21.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:46:17 STEP  536 H= 536:00 +CPU= 21.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:48:12 STEP  537 H= 537:00 +CPU= 32.696
  05:48:33 STEP  538 H= 538:00 +CPU= 21.125
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:50:16 STEP  539 H= 539:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:53:15 STEP  540 H= 540:00 +CPU= 36.373
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000540
  05:53:36 STEP  541 H= 541:00 +CPU= 20.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:55:29 STEP  542 H= 542:00 +CPU= 21.424
  05:56:01 STEP  543 H= 543:00 +CPU= 32.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:57:53 STEP  544 H= 544:00 +CPU= 20.631
  05:58:14 STEP  545 H= 545:00 +CPU= 21.080
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:00:00 STEP  546 H= 546:00 +CPU= 33.325
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:01:53 STEP  547 H= 547:00 +CPU= 21.107
  06:02:14 STEP  548 H= 548:00 +CPU= 21.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:04:18 STEP  549 H= 549:00 +CPU= 33.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:05:42 STEP  550 H= 550:00 +CPU= 21.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:07:25 STEP  551 H= 551:00 +CPU= 21.557
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:09:34 STEP  552 H= 552:00 +CPU= 38.254
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170225/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0581_1984050100_123_953_12170225_0_r575580055_22.zip
Uploading the intermediate file: upload_file_22.zip
  06:09:55 STEP  553 H= 553:00 +CPU= 20.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:11:48 STEP  554 H= 554:00 +CPU= 21.456
  06:12:21 STEP  555 H= 555:00 +CPU= 33.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:14:23 STEP  556 H= 556:00 +CPU= 20.726
  06:14:43 STEP  557 H= 557:00 +CPU= 20.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:16:48 STEP  558 H= 558:00 +CPU= 32.966
  06:17:10 STEP  559 H= 559:00 +CPU= 21.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:19:12 STEP  560 H= 560:00 +CPU= 21.614
  06:19:45 STEP  561 H= 561:00 +CPU= 32.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org