climateprediction.net home page
Task 22286497

Task 22286497

Name oifs_43r3_ps_0634_2014050100_123_983_12200278_0
Workunit 12200278
Created 24 Dec 2022, 10:41:10 UTC
Sent 11 Jan 2023, 18:38:14 UTC
Report deadline 10 Feb 2023, 18:38:14 UTC
Received 12 Jan 2023, 23:10:54 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1519251
Run time 4 hours 43 min 4 sec
CPU time 4 hours 33 min 29 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.94 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.75 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,802.30 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
ntermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_14.zip
Uploading the intermediate file: upload_file_14.zip
  00:51:32 STEP  361 H= 361:00 +CPU= 20.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:53:14 STEP  362 H= 362:00 +CPU= 20.404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:55:39 STEP  363 H= 363:00 +CPU= 32.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:57:13 STEP  364 H= 364:00 +CPU= 21.516
  00:57:33 STEP  365 H= 365:00 +CPU= 19.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:36 STEP  366 H= 366:00 +CPU= 33.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:01:38 STEP  367 H= 367:00 +CPU= 20.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:03:20 STEP  368 H= 368:00 +CPU= 21.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:05:13 STEP  369 H= 369:00 +CPU= 31.562
  01:05:35 STEP  370 H= 370:00 +CPU= 22.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:07:17 STEP  371 H= 371:00 +CPU= 20.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:09:24 STEP  372 H= 372:00 +CPU= 36.258
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:11:06 STEP  373 H= 373:00 +CPU= 20.212
  01:11:27 STEP  374 H= 374:00 +CPU= 20.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:14:31 STEP  375 H= 375:00 +CPU= 32.991
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:16:04 STEP  376 H= 376:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 377, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 11462
upload_file_number: 15
last_iter: 359
last_upload: 1296000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1632921
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:21:44 STEP  360 H= 360:00 +CPU= 36.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:23:47 STEP  361 H= 361:00 +CPU= 20.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:25:10 STEP  362 H= 362:00 +CPU= 21.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:26:55 STEP  363 H= 363:00 +CPU= 32.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:28:47 STEP  364 H= 364:00 +CPU= 21.380
  01:29:09 STEP  365 H= 365:00 +CPU= 21.701
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:32:45 STEP  366 H= 366:00 +CPU= 32.743
  01:33:07 STEP  367 H= 367:00 +CPU= 21.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:34:58 STEP  368 H= 368:00 +CPU= 20.966
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:36:50 STEP  369 H= 369:00 +CPU= 31.828
  01:37:11 STEP  370 H= 370:00 +CPU= 20.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:38:42 STEP  371 H= 371:00 +CPU= 20.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:40:29 STEP  372 H= 372:00 +CPU= 35.479
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000372
  01:40:50 STEP  373 H= 373:00 +CPU= 20.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:42:42 STEP  374 H= 374:00 +CPU= 21.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:44:36 STEP  375 H= 375:00 +CPU= 32.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:46:19 STEP  376 H= 376:00 +CPU= 20.999
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:48:01 STEP  377 H= 377:00 +CPU= 20.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:49:54 STEP  378 H= 378:00 +CPU= 33.676
  01:50:15 STEP  379 H= 379:00 +CPU= 20.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:52:07 STEP  380 H= 380:00 +CPU= 21.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:54:10 STEP  381 H= 381:00 +CPU= 32.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:55:53 STEP  382 H= 382:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:57:36 STEP  383 H= 383:00 +CPU= 22.160
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:59:45 STEP  384 H= 384:00 +CPU= 37.051
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_15.zip
Uploading the intermediate file: upload_file_15.zip
  02:00:06 STEP  385 H= 385:00 +CPU= 20.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:02:10 STEP  386 H= 386:00 +CPU= 19.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:04:13 STEP  387 H= 387:00 +CPU= 32.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:05:34 STEP  388 H= 388:00 +CPU= 21.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:07:36 STEP  389 H= 389:00 +CPU= 20.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:09:21 STEP  390 H= 390:00 +CPU= 32.470
  02:09:41 STEP  391 H= 391:00 +CPU= 20.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:11:04 STEP  392 H= 392:00 +CPU= 20.992
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:13:08 STEP  393 H= 393:00 +CPU= 32.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:14:59 STEP  394 H= 394:00 +CPU= 20.861
  02:15:20 STEP  395 H= 395:00 +CPU= 20.961
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:17:38 STEP  396 H= 396:00 +CPU= 36.147
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:19:30 STEP  397 H= 397:00 +CPU= 21.093
  02:19:51 STEP  398 H= 398:00 +CPU= 21.356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:21:55 STEP  399 H= 399:00 +CPU= 32.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:23:17 STEP  400 H= 400:00 +CPU= 21.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:25:11 STEP  401 H= 401:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:27:06 STEP  402 H= 402:00 +CPU= 33.106
  02:27:26 STEP  403 H= 403:00 +CPU= 20.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:29:18 STEP  404 H= 404:00 +CPU= 21.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:31:21 STEP  405 H= 405:00 +CPU= 32.231
  02:31:42 STEP  406 H= 406:00 +CPU= 20.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:34:03 STEP  407 H= 407:00 +CPU= 21.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:36:22 STEP  408 H= 408:00 +CPU= 37.498
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_16.zip
Uploading the intermediate file: upload_file_16.zip
  02:36:42 STEP  409 H= 409:00 +CPU= 19.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:38:16 STEP  410 H= 410:00 +CPU= 20.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:40:08 STEP  411 H= 411:00 +CPU= 31.466
  02:40:28 STEP  412 H= 412:00 +CPU= 20.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:42:39 STEP  413 H= 413:00 +CPU= 19.937
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:44:45 STEP  414 H= 414:00 +CPU= 33.402
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:46:28 STEP  415 H= 415:00 +CPU= 20.959
  02:46:49 STEP  416 H= 416:00 +CPU= 21.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:48:41 STEP  417 H= 417:00 +CPU= 31.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:50:24 STEP  418 H= 418:00 +CPU= 21.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:52:05 STEP  419 H= 419:00 +CPU= 20.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:54:22 STEP  420 H= 420:00 +CPU= 35.854
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000420
  02:54:42 STEP  421 H= 421:00 +CPU= 19.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:56:34 STEP  422 H= 422:00 +CPU= 21.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:58:27 STEP  423 H= 423:00 +CPU= 31.916
  02:58:48 STEP  424 H= 424:00 +CPU= 20.930
  02:59:09 STEP  425 H= 425:00 +CPU= 20.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:01:22 STEP  426 H= 426:00 +CPU= 31.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:03:33 STEP  427 H= 427:00 +CPU= 20.014
  03:03:55 STEP  428 H= 428:00 +CPU= 21.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:05:47 STEP  429 H= 429:00 +CPU= 31.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:08:08 STEP  430 H= 430:00 +CPU= 21.185
  03:08:30 STEP  431 H= 431:00 +CPU= 20.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:10:38 STEP  432 H= 432:00 +CPU= 37.793
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_17.zip
Uploading the intermediate file: upload_file_17.zip
  03:10:57 STEP  433 H= 433:00 +CPU= 18.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:13:03 STEP  434 H= 434:00 +CPU= 19.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:14:58 STEP  435 H= 435:00 +CPU= 33.120
  03:15:19 STEP  436 H= 436:00 +CPU= 21.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:17:11 STEP  437 H= 437:00 +CPU= 20.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:19:25 STEP  438 H= 438:00 +CPU= 32.643
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 439, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 13461
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1650335
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:23:08 STEP  432 H= 432:00 +CPU= 36.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:24:22 STEP  433 H= 433:00 +CPU= 21.562
  03:24:43 STEP  434 H= 434:00 +CPU= 21.095
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:26:45 STEP  435 H= 435:00 +CPU= 31.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:28:27 STEP  436 H= 436:00 +CPU= 21.023
  03:28:48 STEP  437 H= 437:00 +CPU= 20.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:30:53 STEP  438 H= 438:00 +CPU= 33.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:32:25 STEP  439 H= 439:00 +CPU= 20.969
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:33:47 STEP  440 H= 440:00 +CPU= 21.403
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:35:29 STEP  441 H= 441:00 +CPU= 31.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:37:01 STEP  442 H= 442:00 +CPU= 21.530
  03:37:21 STEP  443 H= 443:00 +CPU= 20.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:39:28 STEP  444 H= 444:00 +CPU= 35.835
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:41:10 STEP  445 H= 445:00 +CPU= 20.504
  03:41:31 STEP  446 H= 446:00 +CPU= 20.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:43:34 STEP  447 H= 447:00 +CPU= 32.158
  03:43:56 STEP  448 H= 448:00 +CPU= 21.343
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:45:48 STEP  449 H= 449:00 +CPU= 20.780
  03:46:21 STEP  450 H= 450:00 +CPU= 33.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:48:12 STEP  451 H= 451:00 +CPU= 20.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:49:55 STEP  452 H= 452:00 +CPU= 21.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:51:39 STEP  453 H= 453:00 +CPU= 32.601
  03:52:00 STEP  454 H= 454:00 +CPU= 21.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:54:22 STEP  455 H= 455:00 +CPU= 20.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:56:42 STEP  456 H= 456:00 +CPU= 38.382
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_18.zip
Uploading the intermediate file: upload_file_18.zip
  03:57:02 STEP  457 H= 457:00 +CPU= 20.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:58:45 STEP  458 H= 458:00 +CPU= 21.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:00:37 STEP  459 H= 459:00 +CPU= 32.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:02:20 STEP  460 H= 460:00 +CPU= 21.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:04:01 STEP  461 H= 461:00 +CPU= 20.543
  04:04:35 STEP  462 H= 462:00 +CPU= 33.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:06:37 STEP  463 H= 463:00 +CPU= 20.683
  04:06:58 STEP  464 H= 464:00 +CPU= 21.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:09:02 STEP  465 H= 465:00 +CPU= 32.537
  04:09:23 STEP  466 H= 466:00 +CPU= 21.648
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:11:25 STEP  467 H= 467:00 +CPU= 20.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:13:22 STEP  468 H= 468:00 +CPU= 35.915
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000468
  04:13:43 STEP  469 H= 469:00 +CPU= 20.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:15:35 STEP  470 H= 470:00 +CPU= 20.726
  04:16:07 STEP  471 H= 471:00 +CPU= 32.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:18:00 STEP  472 H= 472:00 +CPU= 21.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:20:01 STEP  473 H= 473:00 +CPU= 20.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:21:46 STEP  474 H= 474:00 +CPU= 33.347
  04:22:07 STEP  475 H= 475:00 +CPU= 21.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:23:59 STEP  476 H= 476:00 +CPU= 21.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:25:43 STEP  477 H= 477:00 +CPU= 32.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:27:16 STEP  478 H= 478:00 +CPU= 21.900
  04:27:37 STEP  479 H= 479:00 +CPU= 21.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:30:27 STEP  480 H= 480:00 +CPU= 37.758
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_19.zip
Uploading the intermediate file: upload_file_19.zip
  04:30:47 STEP  481 H= 481:00 +CPU= 19.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:32:03 STEP  482 H= 482:00 +CPU= 19.352
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:33:38 STEP  483 H= 483:00 +CPU= 32.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:35:20 STEP  484 H= 484:00 +CPU= 21.280
  04:35:41 STEP  485 H= 485:00 +CPU= 21.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:37:56 STEP  486 H= 486:00 +CPU= 33.509
  04:38:16 STEP  487 H= 487:00 +CPU= 20.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:41:00 STEP  488 H= 488:00 +CPU= 22.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:43:05 STEP  489 H= 489:00 +CPU= 33.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:47:09 STEP  490 H= 490:00 +CPU= 21.979
  04:47:30 STEP  491 H= 491:00 +CPU= 21.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:49:58 STEP  492 H= 492:00 +CPU= 36.994
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:51:42 STEP  493 H= 493:00 +CPU= 21.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:54:15 STEP  494 H= 494:00 +CPU= 21.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:57:00 STEP  495 H= 495:00 +CPU= 33.642
  04:57:21 STEP  496 H= 496:00 +CPU= 21.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  04:59:54 STEP  497 H= 497:00 +CPU= 21.021
  05:00:28 STEP  498 H= 498:00 +CPU= 34.074
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:03:00 STEP  499 H= 499:00 +CPU= 20.894
  05:03:22 STEP  500 H= 500:00 +CPU= 21.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:06:27 STEP  501 H= 501:00 +CPU= 33.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:09:09 STEP  502 H= 502:00 +CPU= 20.825
  05:09:31 STEP  503 H= 503:00 +CPU= 21.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:12:34 STEP  504 H= 504:00 +CPU= 40.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_20.zip
Uploading the intermediate file: upload_file_20.zip
  05:15:07 STEP  505 H= 505:00 +CPU= 21.323
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:17:40 STEP  506 H= 506:00 +CPU= 21.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:20:26 STEP  507 H= 507:00 +CPU= 34.982
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:22:30 STEP  508 H= 508:00 +CPU= 22.811
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 508, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 15426
upload_file_number: 21
last_iter: 503
last_upload: 1814400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1671300
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:26:52 STEP  504 H= 504:00 +CPU= 37.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:28:55 STEP  505 H= 505:00 +CPU= 20.738
  05:29:17 STEP  506 H= 506:00 +CPU= 22.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:31:34 STEP  507 H= 507:00 +CPU= 33.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:33:17 STEP  508 H= 508:00 +CPU= 21.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:34:48 STEP  509 H= 509:00 +CPU= 20.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:36:43 STEP  510 H= 510:00 +CPU= 33.938
  05:37:05 STEP  511 H= 511:00 +CPU= 21.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:39:08 STEP  512 H= 512:00 +CPU= 21.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:41:43 STEP  513 H= 513:00 +CPU= 33.406
  05:42:05 STEP  514 H= 514:00 +CPU= 21.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:44:28 STEP  515 H= 515:00 +CPU= 21.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:46:36 STEP  516 H= 516:00 +CPU= 36.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000516
  05:48:18 STEP  517 H= 517:00 +CPU= 20.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:50:01 STEP  518 H= 518:00 +CPU= 21.001
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:51:36 STEP  519 H= 519:00 +CPU= 33.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:53:20 STEP  520 H= 520:00 +CPU= 21.805
  05:53:41 STEP  521 H= 521:00 +CPU= 21.200
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:55:46 STEP  522 H= 522:00 +CPU= 33.798
  05:56:06 STEP  523 H= 523:00 +CPU= 19.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:57:58 STEP  524 H= 524:00 +CPU= 20.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:59:43 STEP  525 H= 525:00 +CPU= 32.858
  06:00:04 STEP  526 H= 526:00 +CPU= 21.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:01:57 STEP  527 H= 527:00 +CPU= 21.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:04:06 STEP  528 H= 528:00 +CPU= 37.971
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_21.zip
Uploading the intermediate file: upload_file_21.zip
  06:04:27 STEP  529 H= 529:00 +CPU= 21.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:05:50 STEP  530 H= 530:00 +CPU= 21.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:07:43 STEP  531 H= 531:00 +CPU= 32.386
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:09:36 STEP  532 H= 532:00 +CPU= 20.993
  06:09:56 STEP  533 H= 533:00 +CPU= 20.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:12:01 STEP  534 H= 534:00 +CPU= 33.681
  06:12:21 STEP  535 H= 535:00 +CPU= 20.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:14:24 STEP  536 H= 536:00 +CPU= 21.472
  06:14:57 STEP  537 H= 537:00 +CPU= 32.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:16:50 STEP  538 H= 538:00 +CPU= 20.714
  06:17:11 STEP  539 H= 539:00 +CPU= 21.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:19:29 STEP  540 H= 540:00 +CPU= 36.218
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000540
  06:19:49 STEP  541 H= 541:00 +CPU= 20.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net