<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
555:00 +CPU= 34.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:08:18 STEP 556 H= 556:00 +CPU= 21.928
11:08:39 STEP 557 H= 557:00 +CPU= 20.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:11:24 STEP 558 H= 558:00 +CPU= 33.958
11:11:44 STEP 559 H= 559:00 +CPU= 19.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 951
(argv5) wuid: 12168583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6fdea50370cb66c844861a2a76a3e850 to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
ic_ancil_file: ic_ancil_12168583
ifsdata_file: ifsdata_12168583
climate_data_file: clim_data_12168583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_76a67d44f3f663566dea3b04ae58410c to: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c3ba684ee563c76442b6f13dc12f9624 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12168583.xml
-- Model is restarting --
Adjusting last_iter, 560, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
last_cpu_time: 23321
upload_file_number: 23
last_iter: 551
last_upload: 1987200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081
The child process has been launched with process id: 216592
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:216592:216592] [20230120:111639:1674180999:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:17:19 STEP 552 H= 552:00 +CPU= 36.606
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:19:51 STEP 553 H= 553:00 +CPU= 20.838
11:20:11 STEP 554 H= 554:00 +CPU= 20.644
11:20:44 STEP 555 H= 555:00 +CPU= 32.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:23:16 STEP 556 H= 556:00 +CPU= 21.148
11:23:36 STEP 557 H= 557:00 +CPU= 20.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:26:01 STEP 558 H= 558:00 +CPU= 33.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:28:44 STEP 559 H= 559:00 +CPU= 20.468
11:29:05 STEP 560 H= 560:00 +CPU= 21.082
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:31:09 STEP 561 H= 561:00 +CPU= 33.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:33:23 STEP 562 H= 562:00 +CPU= 21.591
11:33:44 STEP 563 H= 563:00 +CPU= 20.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:36:01 STEP 564 H= 564:00 +CPU= 35.987
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:38:13 STEP 565 H= 565:00 +CPU= 20.556
11:38:34 STEP 566 H= 566:00 +CPU= 21.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:41:08 STEP 567 H= 567:00 +CPU= 32.701
11:41:30 STEP 568 H= 568:00 +CPU= 21.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:43:52 STEP 569 H= 569:00 +CPU= 20.825
11:44:26 STEP 570 H= 570:00 +CPU= 33.733
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:46:27 STEP 571 H= 571:00 +CPU= 20.569
11:46:49 STEP 572 H= 572:00 +CPU= 21.011
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:49:23 STEP 573 H= 573:00 +CPU= 33.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:51:45 STEP 574 H= 574:00 +CPU= 20.931
11:52:07 STEP 575 H= 575:00 +CPU= 21.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:54:36 STEP 576 H= 576:00 +CPU= 37.921
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_23.zip
Uploading the intermediate file: upload_file_23.zip
11:54:56 STEP 577 H= 577:00 +CPU= 20.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:57:29 STEP 578 H= 578:00 +CPU= 21.364
11:58:01 STEP 579 H= 579:00 +CPU= 31.977
11:58:22 STEP 580 H= 580:00 +CPU= 20.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:01:25 STEP 581 H= 581:00 +CPU= 21.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:50 STEP 582 H= 582:00 +CPU= 33.530
12:04:11 STEP 583 H= 583:00 +CPU= 20.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:06:23 STEP 584 H= 584:00 +CPU= 21.242
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:56 STEP 585 H= 585:00 +CPU= 33.067
12:08:18 STEP 586 H= 586:00 +CPU= 21.656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:10:21 STEP 587 H= 587:00 +CPU= 21.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:12:59 STEP 588 H= 588:00 +CPU= 36.332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:15:21 STEP 589 H= 589:00 +CPU= 20.379
12:15:43 STEP 590 H= 590:00 +CPU= 21.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:18:16 STEP 591 H= 591:00 +CPU= 32.715
12:18:39 STEP 592 H= 592:00 +CPU= 22.047
12:18:59 STEP 593 H= 593:00 +CPU= 20.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:21:36 STEP 594 H= 594:00 +CPU= 33.950
12:21:56 STEP 595 H= 595:00 +CPU= 20.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:24:18 STEP 596 H= 596:00 +CPU= 21.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:26:42 STEP 597 H= 597:00 +CPU= 32.509
12:27:03 STEP 598 H= 598:00 +CPU= 20.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:29:46 STEP 599 H= 599:00 +CPU= 21.106
12:30:25 STEP 600 H= 600:00 +CPU= 38.034
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_24.zip
Uploading the intermediate file: upload_file_24.zip
12:30:44 STEP 601 H= 601:00 +CPU= 18.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:33:22 STEP 602 H= 602:00 +CPU= 21.038
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:35:26 STEP 603 H= 603:00 +CPU= 32.434
12:35:47 STEP 604 H= 604:00 +CPU= 20.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:38:19 STEP 605 H= 605:00 +CPU= 20.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:40:45 STEP 606 H= 606:00 +CPU= 34.299
12:41:06 STEP 607 H= 607:00 +CPU= 20.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:43:48 STEP 608 H= 608:00 +CPU= 21.148
12:44:21 STEP 609 H= 609:00 +CPU= 32.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:46:54 STEP 610 H= 610:00 +CPU= 21.136
12:47:15 STEP 611 H= 611:00 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:49:52 STEP 612 H= 612:00 +CPU= 35.956
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000612
12:50:12 STEP 613 H= 613:00 +CPU= 20.170
12:50:33 STEP 614 H= 614:00 +CPU= 21.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:54:19 STEP 615 H= 615:00 +CPU= 33.098
12:54:41 STEP 616 H= 616:00 +CPU= 22.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:00:15 STEP 617 H= 617:00 +CPU= 22.697
13:00:52 STEP 618 H= 618:00 +CPU= 36.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:08:14 STEP 619 H= 619:00 +CPU= 22.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:21:51 STEP 620 H= 620:00 +CPU= 23.092
20:22:26 STEP 621 H= 621:00 +CPU= 34.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:31:33 STEP 622 H= 622:00 +CPU= 23.503
20:31:57 STEP 623 H= 623:00 +CPU= 24.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:37:02 STEP 624 H= 624:00 +CPU= 42.912
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_25.zip
Uploading the intermediate file: upload_file_25.zip
20:37:24 STEP 625 H= 625:00 +CPU= 21.545
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:43:28 STEP 626 H= 626:00 +CPU= 22.429
20:44:05 STEP 627 H= 627:00 +CPU= 35.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:49:18 STEP 628 H= 628:00 +CPU= 21.814
20:49:40 STEP 629 H= 629:00 +CPU= 21.730
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:57 STEP 630 H= 630:00 +CPU= 34.973
20:53:18 STEP 631 H= 631:00 +CPU= 20.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:59:24 STEP 632 H= 632:00 +CPU= 23.245
21:00:02 STEP 633 H= 633:00 +CPU= 37.119
21:00:26 STEP 634 H= 634:00 +CPU= 23.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:32 STEP 635 H= 635:00 +CPU= 23.390
21:08:14 STEP 636 H= 636:00 +CPU= 41.155
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000636
21:08:38 STEP 637 H= 637:00 +CPU= 22.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:14:33 STEP 638 H= 638:00 +CPU= 23.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:54 STEP 639 H= 639:00 +CPU= 37.267
21:20:18 STEP 640 H= 640:00 +CPU= 23.976
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:25:04 STEP 641 H= 641:00 +CPU= 22.726
21:25:43 STEP 642 H= 642:00 +CPU= 38.564
21:26:06 STEP 643 H= 643:00 +CPU= 22.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:31:12 STEP 644 H= 644:00 +CPU= 23.674
21:31:50 STEP 645 H= 645:00 +CPU= 36.870
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:25 STEP 646 H= 646:00 +CPU= 23.538
21:37:49 STEP 647 H= 647:00 +CPU= 24.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:42:35 STEP 648 H= 648:00 +CPU= 43.316
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_26.zip
Uploading the intermediate file: upload_file_26.zip
21:42:59 STEP 649 H= 649:00 +CPU= 23.075
21:43:23 STEP 650 H= 650:00 +CPU= 23.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:42 STEP 651 H= 651:00 +CPU= 37.320
21:50:06 STEP 652 H= 652:00 +CPU= 23.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:51 STEP 653 H= 653:00 +CPU= 22.837
21:55:28 STEP 654 H= 654:00 +CPU= 37.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:00:53 STEP 655 H= 655:00 +CPU= 22.917
22:01:18 STEP 656 H= 656:00 +CPU= 23.847
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:05:25 STEP 657 H= 657:00 +CPU= 36.635
22:05:49 STEP 658 H= 658:00 +CPU= 23.255
22:06:12 STEP 659 H= 659:00 +CPU= 22.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:14:25 STEP 660 H= 660:00 +CPU= 40.453
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:51 STEP 661 H= 661:00 +CPU= 23.393
22:18:16 STEP 662 H= 662:00 +CPU= 23.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 951
(argv5) wuid: 12168583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6fdea50370cb66c844861a2a76a3e850 to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
ic_ancil_file: ic_ancil_12168583
ifsdata_file: ifsdata_12168583
climate_data_file: clim_data_12168583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_76a67d44f3f663566dea3b04ae58410c to: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c3ba684ee563c76442b6f13dc12f9624 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12168583.xml
-- Model is restarting --
Adjusting last_iter, 663, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
last_cpu_time: 26280
upload_file_number: 27
last_iter: 647
last_upload: 2332800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081
The child process has been launched with process id: 334600
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:334600:334600] [20230120:222832:1674221312:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
22:29:17 STEP 648 H= 648:00 +CPU= 41.526
22:29:40 STEP 649 H= 649:00 +CPU= 23.133
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:16 STEP 650 H= 650:00 +CPU= 23.752
22:35:52 STEP 651 H= 651:00 +CPU= 35.961
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:44:39 STEP 652 H= 652:00 +CPU= 24.066
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:14 STEP 653 H= 653:00 +CPU= 21.752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:09 STEP 654 H= 654:00 +CPU= 33.571
22:53:29 STEP 655 H= 655:00 +CPU= 20.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:11 STEP 656 H= 656:00 +CPU= 20.823
22:55:42 STEP 657 H= 657:00 +CPU= 31.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:35 STEP 658 H= 658:00 +CPU= 20.513
22:57:54 STEP 659 H= 659:00 +CPU= 19.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:43 STEP 660 H= 660:00 +CPU= 35.273
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000660
23:01:03 STEP 661 H= 661:00 +CPU= 20.014
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:16 STEP 662 H= 662:00 +CPU= 20.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:47 STEP 663 H= 663:00 +CPU= 31.600
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:58 STEP 664 H= 664:00 +CPU= 20.148
23:05:18 STEP 665 H= 665:00 +CPU= 19.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:03 STEP 666 H= 666:00 +CPU= 32.837
23:08:23 STEP 667 H= 667:00 +CPU= 19.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:54 STEP 668 H= 668:00 +CPU= 20.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:27 STEP 669 H= 669:00 +CPU= 31.915
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:12:49 STEP 670 H= 670:00 +CPU= 20.814
23:13:09 STEP 671 H= 671:00 +CPU= 20.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:59 STEP 672 H= 672:00 +CPU= 37.997
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_27.zip
Uploading the intermediate file: upload_file_27.zip
23:16:51 STEP 673 H= 673:00 +CPU= 19.973
23:17:11 STEP 674 H= 674:00 +CPU= 19.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:56 STEP 675 H= 675:00 +CPU= 32.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:27 STEP 676 H= 676:00 +CPU= 20.507
23:20:47 STEP 677 H= 677:00 +CPU= 19.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:23 STEP 678 H= 678:00 +CPU= 32.810
23:23:43 STEP 679 H= 679:00 +CPU= 19.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:25 STEP 680 H= 680:00 +CPU= 21.249
23:25:57 STEP 681 H= 681:00 +CPU= 31.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:39 STEP 682 H= 682:00 +CPU= 20.652
23:27:58 STEP 683 H= 683:00 +CPU= 19.492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:30:04 STEP 684 H= 684:00 +CPU= 35.872
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:25 STEP 685 H= 685:00 +CPU= 20.537
23:31:46 STEP 686 H= 686:00 +CPU= 20.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:30 STEP 687 H= 687:00 +CPU= 31.963
23:33:51 STEP 688 H= 688:00 +CPU= 21.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:23 STEP 689 H= 689:00 +CPU= 20.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:37:18 STEP 690 H= 690:00 +CPU= 32.931
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:30 STEP 691 H= 691:00 +CPU= 21.162
23:38:50 STEP 692 H= 692:00 +CPU= 20.358
23:39:22 STEP 693 H= 693:00 +CPU= 31.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:25 STEP 694 H= 694:00 +CPU= 21.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:06 STEP 695 H= 695:00 +CPU= 20.543
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:44:56 STEP 696 H= 696:00 +CPU= 37.893
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_28.zip
Uploading the intermediate file: upload_file_28.zip
23:45:15 STEP 697 H= 697:00 +CPU= 19.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:56 STEP 698 H= 698:00 +CPU= 20.644
23:47:28 STEP 699 H= 699:00 +CPU= 31.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:10 STEP 700 H= 700:00 +CPU= 19.879
23:49:31 STEP 701 H= 701:00 +CPU= 21.366
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:51:14 STEP 702 H= 702:00 +CPU= 32.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:35 STEP 703 H= 703:00 +CPU= 19.973
23:52:55 STEP 704 H= 704:00 +CPU= 20.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:47 STEP 705 H= 705:00 +CPU= 31.584
23:55:08 STEP 706 H= 706:00 +CPU= 21.046
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:56:39 STEP 707 H= 707:00 +CPU= 20.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:58:26 STEP 708 H= 708:00 +CPU= 35.332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000708
23:58:46 STEP 709 H= 709:00 +CPU= 19.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:00:08 STEP 710 H= 710:00 +CPU= 20.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:51 STEP 711 H= 711:00 +CPU= 31.590
00:02:12 STEP 712 H= 712:00 +CPU= 20.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:03:24 STEP 713 H= 713:00 +CPU= 20.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:08 STEP 714 H= 714:00 +CPU= 33.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:06:38 STEP 715 H= 715:00 +CPU= 20.146
00:06:59 STEP 716 H= 716:00 +CPU= 20.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:13 STEP 717 H= 717:00 +CPU= 31.879
00:09:34 STEP 718 H= 718:00 +CPU= 20.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:26 STEP 719 H= 719:00 +CPU= 21.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:36 STEP 720 H= 720:00 +CPU= 38.325
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_29.zip
Uploading the intermediate file: upload_file_29.zip
00:13:56 STEP 721 H= 721:00 +CPU= 19.921
Suspend request received from the BOINC client, suspending the child process
malloc(): corrupted top size
Resuming the child process
00:15:28 STEP 722 H= 722:00 +CPU= 20.442
00:16:00 STEP 723 H= 723:00 +CPU= 32.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:17:42 STEP 724 H= 724:00 +CPU= 20.377
00:18:01 STEP 725 H= 725:00 +CPU= 19.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:19:54 STEP 726 H= 726:00 +CPU= 32.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:21:16 STEP 727 H= 727:00 +CPU= 20.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:22:18 STEP 728 H= 728:00 +CPU= 21.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:23:40 STEP 729 H= 729:00 +CPU= 31.894
00:24:01 STEP 730 H= 730:00 +CPU= 20.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:25:42 STEP 731 H= 731:00 +CPU= 20.549
00:26:17 STEP 732 H= 732:00 +CPU= 35.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000732
00:27:59 STEP 733 H= 733:00 +CPU= 20.539
00:28:20 STEP 734 H= 734:00 +CPU= 20.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 951
(argv5) wuid: 12168583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6fdea50370cb66c844861a2a76a3e850 to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0939_1982050100_123_951_12168583.zip
ic_ancil_file: ic_ancil_12168583
ifsdata_file: ifsdata_12168583
climate_data_file: clim_data_12168583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_76a67d44f3f663566dea3b04ae58410c to: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12168583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c3ba684ee563c76442b6f13dc12f9624 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12168583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12168583.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12168583.xml
-- Model is restarting --
Adjusting last_iter, 735, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12168583.xml
last_cpu_time: 28465
upload_file_number: 30
last_iter: 719
last_upload: 2592000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081
The child process has been launched with process id: 352639
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:352639:352639] [20230121:003254:1674228774:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
00:33:32 STEP 720 H= 720:00 +CPU= 35.343
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:35:02 STEP 721 H= 721:00 +CPU= 19.069
00:35:22 STEP 722 H= 722:00 +CPU= 20.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:37:05 STEP 723 H= 723:00 +CPU= 31.113
00:37:25 STEP 724 H= 724:00 +CPU= 20.413
00:37:45 STEP 725 H= 725:00 +CPU= 19.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:39:48 STEP 726 H= 726:00 +CPU= 32.383
00:40:08 STEP 727 H= 727:00 +CPU= 19.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:41:38 STEP 728 H= 728:00 +CPU= 20.069
00:42:11 STEP 729 H= 729:00 +CPU= 32.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:43:44 STEP 730 H= 730:00 +CPU= 21.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:45:25 STEP 731 H= 731:00 +CPU= 20.352
00:46:00 STEP 732 H= 732:00 +CPU= 35.086
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:47:33 STEP 733 H= 733:00 +CPU= 20.249
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:48:56 STEP 734 H= 734:00 +CPU= 20.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:50:39 STEP 735 H= 735:00 +CPU= 32.672
00:51:00 STEP 736 H= 736:00 +CPU= 20.945
00:51:20 STEP 737 H= 737:00 +CPU= 19.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:14 STEP 738 H= 738:00 +CPU= 33.230
00:53:34 STEP 739 H= 739:00 +CPU= 19.604
00:53:54 STEP 740 H= 740:00 +CPU= 20.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:56:09 STEP 741 H= 741:00 +CPU= 32.079
00:56:29 STEP 742 H= 742:00 +CPU= 20.382
00:56:49 STEP 743 H= 743:00 +CPU= 20.295
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:49 STEP 744 H= 744:00 +CPU= 37.381
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168583/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0939_1982050100_123_951_12168583_0_r1593119081_30.zip
Uploading the intermediate file: upload_file_30.zip
01:00:08 STEP 745 H= 745:00 +CPU= 19.520
01:00:28 STEP 746 H= 746:00 +CPU= 19.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:02:22 STEP 747 H= 747:00 +CPU= 31.924
01:02:43 STEP 748 H= 748:00 +CPU= 20.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
