<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
gv5) wuid: 12167331
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/15
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_089d7eb8d133174122ec12d3ffbec67f to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
ic_ancil_file: ic_ancil_12167331
ifsdata_file: ifsdata_12167331
climate_data_file: clim_data_12167331
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5f479246cbb7ff06f4a2d97111f8192f to: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0aca6ddce5b9e1c56929cbbcad5d6bc to: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Checking for progress XML file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
Opened progress file ok : /var/lib/boinc-client/slots/15/progress_file_12167331.xml
-- Model is restarting --
Adjusting last_iter, 569, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
last_cpu_time: 15572
upload_file_number: 23
last_iter: 551
last_upload: 1987200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674
The child process has been launched with process id: 333114
Executing the command: /var/lib/boinc-client/slots/15/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333114:333114] [20230120:221750:1674220670:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
22:18:36 STEP 552 H= 552:00 +CPU= 41.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:41 STEP 553 H= 553:00 +CPU= 23.016
22:24:05 STEP 554 H= 554:00 +CPU= 23.221
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:54 STEP 555 H= 555:00 +CPU= 36.289
22:29:18 STEP 556 H= 556:00 +CPU= 23.381
22:29:41 STEP 557 H= 557:00 +CPU= 22.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:30 STEP 558 H= 558:00 +CPU= 36.975
22:35:53 STEP 559 H= 559:00 +CPU= 22.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:44:40 STEP 560 H= 560:00 +CPU= 23.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:26 STEP 561 H= 561:00 +CPU= 34.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:08 STEP 562 H= 562:00 +CPU= 21.383
22:53:29 STEP 563 H= 563:00 +CPU= 20.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:25 STEP 564 H= 564:00 +CPU= 35.563
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000564
22:55:45 STEP 565 H= 565:00 +CPU= 19.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:36 STEP 566 H= 566:00 +CPU= 20.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:59:19 STEP 567 H= 567:00 +CPU= 31.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:41 STEP 568 H= 568:00 +CPU= 20.932
23:01:01 STEP 569 H= 569:00 +CPU= 19.674
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:24 STEP 570 H= 570:00 +CPU= 32.034
23:03:44 STEP 571 H= 571:00 +CPU= 20.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:57 STEP 572 H= 572:00 +CPU= 20.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:40 STEP 573 H= 573:00 +CPU= 31.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:03 STEP 574 H= 574:00 +CPU= 21.200
23:08:23 STEP 575 H= 575:00 +CPU= 20.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:13 STEP 576 H= 576:00 +CPU= 37.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_23.zip
Uploading the intermediate file: upload_file_23.zip
23:11:33 STEP 577 H= 577:00 +CPU= 19.979
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:12:52 STEP 578 H= 578:00 +CPU= 19.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:34 STEP 579 H= 579:00 +CPU= 31.363
23:14:55 STEP 580 H= 580:00 +CPU= 21.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:47 STEP 581 H= 581:00 +CPU= 20.065
23:17:19 STEP 582 H= 582:00 +CPU= 32.046
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:51 STEP 583 H= 583:00 +CPU= 20.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:22 STEP 584 H= 584:00 +CPU= 20.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:54 STEP 585 H= 585:00 +CPU= 32.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:16 STEP 586 H= 586:00 +CPU= 20.706
23:23:36 STEP 587 H= 587:00 +CPU= 20.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:33 STEP 588 H= 588:00 +CPU= 35.754
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000588
23:25:53 STEP 589 H= 589:00 +CPU= 19.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:34 STEP 590 H= 590:00 +CPU= 20.280
23:28:06 STEP 591 H= 591:00 +CPU= 32.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:29:58 STEP 592 H= 592:00 +CPU= 20.404
23:30:18 STEP 593 H= 593:00 +CPU= 20.299
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:52 STEP 594 H= 594:00 +CPU= 32.442
23:32:11 STEP 595 H= 595:00 +CPU= 19.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:45 STEP 596 H= 596:00 +CPU= 21.025
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:28 STEP 597 H= 597:00 +CPU= 32.180
23:35:48 STEP 598 H= 598:00 +CPU= 20.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:37:29 STEP 599 H= 599:00 +CPU= 20.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:57 STEP 600 H= 600:00 +CPU= 37.365
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_24.zip
Uploading the intermediate file: upload_file_24.zip
23:39:17 STEP 601 H= 601:00 +CPU= 19.649
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:16 STEP 602 H= 602:00 +CPU= 20.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:10 STEP 603 H= 603:00 +CPU= 32.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:44:40 STEP 604 H= 604:00 +CPU= 19.675
23:45:00 STEP 605 H= 605:00 +CPU= 20.110
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:54 STEP 606 H= 606:00 +CPU= 32.612
23:47:14 STEP 607 H= 607:00 +CPU= 20.285
23:47:34 STEP 608 H= 608:00 +CPU= 20.144
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:27 STEP 609 H= 609:00 +CPU= 31.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:50:59 STEP 610 H= 610:00 +CPU= 20.618
23:51:19 STEP 611 H= 611:00 +CPU= 20.330
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:55 STEP 612 H= 612:00 +CPU= 35.243
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000612
23:53:15 STEP 613 H= 613:00 +CPU= 19.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:57 STEP 614 H= 614:00 +CPU= 21.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:56:42 STEP 615 H= 615:00 +CPU= 31.939
23:57:02 STEP 616 H= 616:00 +CPU= 20.356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:58:33 STEP 617 H= 617:00 +CPU= 19.750
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:00:06 STEP 618 H= 618:00 +CPU= 31.986
00:00:26 STEP 619 H= 619:00 +CPU= 19.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:57 STEP 620 H= 620:00 +CPU= 20.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:03:21 STEP 621 H= 621:00 +CPU= 32.600
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:04:54 STEP 622 H= 622:00 +CPU= 20.266
00:05:14 STEP 623 H= 623:00 +CPU= 20.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:07:03 STEP 624 H= 624:00 +CPU= 37.800
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_25.zip
Uploading the intermediate file: upload_file_25.zip
00:07:22 STEP 625 H= 625:00 +CPU= 19.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:06 STEP 626 H= 626:00 +CPU= 18.856
00:09:38 STEP 627 H= 627:00 +CPU= 31.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:29 STEP 628 H= 628:00 +CPU= 21.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:22 STEP 629 H= 629:00 +CPU= 20.420
00:13:55 STEP 630 H= 630:00 +CPU= 33.189
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:15:27 STEP 631 H= 631:00 +CPU= 20.548
00:15:47 STEP 632 H= 632:00 +CPU= 20.661
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:17:39 STEP 633 H= 633:00 +CPU= 31.786
00:17:59 STEP 634 H= 634:00 +CPU= 20.266
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0687
(argv4) batchid: 950
(argv5) wuid: 12167331
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/15
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_089d7eb8d133174122ec12d3ffbec67f to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
ic_ancil_file: ic_ancil_12167331
ifsdata_file: ifsdata_12167331
climate_data_file: clim_data_12167331
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5f479246cbb7ff06f4a2d97111f8192f to: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0aca6ddce5b9e1c56929cbbcad5d6bc to: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Checking for progress XML file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
Opened progress file ok : /var/lib/boinc-client/slots/15/progress_file_12167331.xml
-- Model is restarting --
Adjusting last_iter, 635, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
last_cpu_time: 17655
upload_file_number: 26
last_iter: 623
last_upload: 2246400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674
The child process has been launched with process id: 350823
Executing the command: /var/lib/boinc-client/slots/15/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350823:350823] [20230121:001932:1674227972:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:21:11 STEP 624 H= 624:00 +CPU= 35.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:22:14 STEP 625 H= 625:00 +CPU= 20.165
00:22:34 STEP 626 H= 626:00 +CPU= 20.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:23:57 STEP 627 H= 627:00 +CPU= 31.541
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:25:39 STEP 628 H= 628:00 +CPU= 20.746
00:25:59 STEP 629 H= 629:00 +CPU= 20.338
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:27:52 STEP 630 H= 630:00 +CPU= 33.123
00:28:13 STEP 631 H= 631:00 +CPU= 20.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:30:15 STEP 632 H= 632:00 +CPU= 20.600
00:30:47 STEP 633 H= 633:00 +CPU= 31.824
00:31:08 STEP 634 H= 634:00 +CPU= 20.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:32:58 STEP 635 H= 635:00 +CPU= 20.433
00:33:34 STEP 636 H= 636:00 +CPU= 35.541
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000636
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:35:05 STEP 637 H= 637:00 +CPU= 20.013
00:35:25 STEP 638 H= 638:00 +CPU= 20.154
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:37:10 STEP 639 H= 639:00 +CPU= 32.107
00:37:31 STEP 640 H= 640:00 +CPU= 20.974
00:37:50 STEP 641 H= 641:00 +CPU= 19.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:39:54 STEP 642 H= 642:00 +CPU= 32.505
00:40:13 STEP 643 H= 643:00 +CPU= 19.127
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:41:45 STEP 644 H= 644:00 +CPU= 20.380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:43:27 STEP 645 H= 645:00 +CPU= 32.175
00:43:48 STEP 646 H= 646:00 +CPU= 20.949
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:45:30 STEP 647 H= 647:00 +CPU= 20.622
00:46:07 STEP 648 H= 648:00 +CPU= 37.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_26.zip
Uploading the intermediate file: upload_file_26.zip
00:47:40 STEP 649 H= 649:00 +CPU= 20.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:49:02 STEP 650 H= 650:00 +CPU= 20.869
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:50:45 STEP 651 H= 651:00 +CPU= 32.293
00:51:06 STEP 652 H= 652:00 +CPU= 20.703
00:51:26 STEP 653 H= 653:00 +CPU= 20.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:21 STEP 654 H= 654:00 +CPU= 32.766
00:53:41 STEP 655 H= 655:00 +CPU= 19.872
00:54:02 STEP 656 H= 656:00 +CPU= 21.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:56:15 STEP 657 H= 657:00 +CPU= 31.519
00:56:36 STEP 658 H= 658:00 +CPU= 20.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:58:26 STEP 659 H= 659:00 +CPU= 19.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:52 STEP 660 H= 660:00 +CPU= 35.733
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000660
01:00:12 STEP 661 H= 661:00 +CPU= 19.884
01:00:33 STEP 662 H= 662:00 +CPU= 20.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:02:26 STEP 663 H= 663:00 +CPU= 31.808
01:02:46 STEP 664 H= 664:00 +CPU= 20.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:04:08 STEP 665 H= 665:00 +CPU= 20.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:05:52 STEP 666 H= 666:00 +CPU= 32.747
01:06:13 STEP 667 H= 667:00 +CPU= 20.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:07:35 STEP 668 H= 668:00 +CPU= 20.346
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:08:59 STEP 669 H= 669:00 +CPU= 31.652
01:09:20 STEP 670 H= 670:00 +CPU= 21.043
01:09:40 STEP 671 H= 671:00 +CPU= 20.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:11:38 STEP 672 H= 672:00 +CPU= 37.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_27.zip
Uploading the intermediate file: upload_file_27.zip
01:13:10 STEP 673 H= 673:00 +CPU= 20.100
01:13:30 STEP 674 H= 674:00 +CPU= 20.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:15:21 STEP 675 H= 675:00 +CPU= 30.921
01:15:41 STEP 676 H= 676:00 +CPU= 20.411
01:16:01 STEP 677 H= 677:00 +CPU= 19.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:17:44 STEP 678 H= 678:00 +CPU= 31.886
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:19:16 STEP 679 H= 679:00 +CPU= 20.348
01:19:36 STEP 680 H= 680:00 +CPU= 20.281
01:20:07 STEP 681 H= 681:00 +CPU= 31.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:49 STEP 682 H= 682:00 +CPU= 20.480
01:22:09 STEP 683 H= 683:00 +CPU= 20.391
01:22:44 STEP 684 H= 684:00 +CPU= 34.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000684
01:24:15 STEP 685 H= 685:00 +CPU= 19.786
01:24:35 STEP 686 H= 686:00 +CPU= 20.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:19 STEP 687 H= 687:00 +CPU= 31.603
01:26:39 STEP 688 H= 688:00 +CPU= 20.146
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:30 STEP 689 H= 689:00 +CPU= 20.223
01:29:02 STEP 690 H= 690:00 +CPU= 32.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:30:23 STEP 691 H= 691:00 +CPU= 20.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:43 STEP 692 H= 692:00 +CPU= 20.230
01:32:15 STEP 693 H= 693:00 +CPU= 31.845
01:32:35 STEP 694 H= 694:00 +CPU= 20.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:05 STEP 695 H= 695:00 +CPU= 19.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:35:53 STEP 696 H= 696:00 +CPU= 37.208
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_28.zip
Uploading the intermediate file: upload_file_28.zip
01:36:13 STEP 697 H= 697:00 +CPU= 19.231
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:37:41 STEP 698 H= 698:00 +CPU= 19.561
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:39:14 STEP 699 H= 699:00 +CPU= 31.868
01:39:35 STEP 700 H= 700:00 +CPU= 20.459
01:39:55 STEP 701 H= 701:00 +CPU= 19.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:41:48 STEP 702 H= 702:00 +CPU= 32.449
01:42:09 STEP 703 H= 703:00 +CPU= 20.142
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:43:40 STEP 704 H= 704:00 +CPU= 20.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:45:22 STEP 705 H= 705:00 +CPU= 31.981
01:45:43 STEP 706 H= 706:00 +CPU= 20.301
01:46:03 STEP 707 H= 707:00 +CPU= 19.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:47:48 STEP 708 H= 708:00 +CPU= 35.148
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000708
01:48:08 STEP 709 H= 709:00 +CPU= 19.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:28 STEP 710 H= 710:00 +CPU= 20.550
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:51:10 STEP 711 H= 711:00 +CPU= 31.512
01:51:30 STEP 712 H= 712:00 +CPU= 20.246
01:51:50 STEP 713 H= 713:00 +CPU= 19.848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:53:54 STEP 714 H= 714:00 +CPU= 32.370
01:54:14 STEP 715 H= 715:00 +CPU= 20.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:56:05 STEP 716 H= 716:00 +CPU= 20.350
01:56:36 STEP 717 H= 717:00 +CPU= 31.526
01:56:56 STEP 718 H= 718:00 +CPU= 20.270
01:57:17 STEP 719 H= 719:00 +CPU= 20.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:59:15 STEP 720 H= 720:00 +CPU= 37.069
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_29.zip
Uploading the intermediate file: upload_file_29.zip
02:00:36 STEP 721 H= 721:00 +CPU= 19.921
02:00:57 STEP 722 H= 722:00 +CPU= 20.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:41 STEP 723 H= 723:00 +CPU= 31.908
02:03:01 STEP 724 H= 724:00 +CPU= 20.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:43 STEP 725 H= 725:00 +CPU= 20.231
02:05:16 STEP 726 H= 726:00 +CPU= 33.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:06:46 STEP 727 H= 727:00 +CPU= 19.984
02:07:06 STEP 728 H= 728:00 +CPU= 20.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:08:39 STEP 729 H= 729:00 +CPU= 31.772
02:09:00 STEP 730 H= 730:00 +CPU= 20.508
02:09:20 STEP 731 H= 731:00 +CPU= 20.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:11:07 STEP 732 H= 732:00 +CPU= 34.913
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000732
02:11:27 STEP 733 H= 733:00 +CPU= 19.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:12:50 STEP 734 H= 734:00 +CPU= 20.336
02:13:21 STEP 735 H= 735:00 +CPU= 31.337
02:13:41 STEP 736 H= 736:00 +CPU= 20.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:22 STEP 737 H= 737:00 +CPU= 19.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:16:45 STEP 738 H= 738:00 +CPU= 31.835
02:17:04 STEP 739 H= 739:00 +CPU= 19.436
02:17:25 STEP 740 H= 740:00 +CPU= 20.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:19 STEP 741 H= 741:00 +CPU= 31.816
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:20:30 STEP 742 H= 742:00 +CPU= 20.362
02:20:51 STEP 743 H= 743:00 +CPU= 20.295
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:22:20 STEP 744 H= 744:00 +CPU= 37.356
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_30.zip
Uploading the intermediate file: upload_file_30.zip
02:22:40 STEP 745 H= 745:00 +CPU= 19.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:24:19 STEP 746 H= 746:00 +CPU= 20.156
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0687
(argv4) batchid: 950
(argv5) wuid: 12167331
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/15
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_089d7eb8d133174122ec12d3ffbec67f to: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/15/oifs_43r3_ps_0687_1981050100_123_950_12167331.zip
ic_ancil_file: ic_ancil_12167331
ifsdata_file: ifsdata_12167331
climate_data_file: clim_data_12167331
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5f479246cbb7ff06f4a2d97111f8192f to: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/15/ic_ancil_12167331.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0aca6ddce5b9e1c56929cbbcad5d6bc to: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/15/ifsdata/ifsdata_12167331.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/15/159l_2/clim_data_12167331.zip
Checking for progress XML file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
Opened progress file ok : /var/lib/boinc-client/slots/15/progress_file_12167331.xml
-- Model is restarting --
Adjusting last_iter, 747, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/15/progress_file_12167331.xml
last_cpu_time: 20685
upload_file_number: 31
last_iter: 743
last_upload: 2678400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674
The child process has been launched with process id: 368570
Executing the command: /var/lib/boinc-client/slots/15/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368570:368570] [20230121:022626:1674235586:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:27:55 STEP 744 H= 744:00 +CPU= 36.791
02:28:15 STEP 745 H= 745:00 +CPU= 19.707
02:28:35 STEP 746 H= 746:00 +CPU= 20.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:30:18 STEP 747 H= 747:00 +CPU= 32.502
02:30:39 STEP 748 H= 748:00 +CPU= 20.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:32:01 STEP 749 H= 749:00 +CPU= 20.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:33:35 STEP 750 H= 750:00 +CPU= 32.797
02:33:54 STEP 751 H= 751:00 +CPU= 19.435
02:34:14 STEP 752 H= 752:00 +CPU= 20.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:36:09 STEP 753 H= 753:00 +CPU= 32.050
02:36:29 STEP 754 H= 754:00 +CPU= 20.430
02:36:49 STEP 755 H= 755:00 +CPU= 19.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:38:24 STEP 756 H= 756:00 +CPU= 34.119
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:39:35 STEP 757 H= 757:00 +CPU= 19.641
02:39:56 STEP 758 H= 758:00 +CPU= 20.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:41:28 STEP 759 H= 759:00 +CPU= 31.383
02:41:48 STEP 760 H= 760:00 +CPU= 20.058
02:42:08 STEP 761 H= 761:00 +CPU= 19.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:44:01 STEP 762 H= 762:00 +CPU= 32.667
02:44:21 STEP 763 H= 763:00 +CPU= 19.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:46:03 STEP 764 H= 764:00 +CPU= 20.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:47:27 STEP 765 H= 765:00 +CPU= 32.209
02:47:48 STEP 766 H= 766:00 +CPU= 20.376
02:48:08 STEP 767 H= 767:00 +CPU= 20.346
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:49:58 STEP 768 H= 768:00 +CPU= 37.461
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMGGhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMSHhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167331/ICMUAhq0f+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0687_1981050100_123_950_12167331_0_r314310674_31.zip
Uploading the intermediate file: upload_file_31.zip
02:50:18 STEP 769 H= 769:00 +CPU= 19.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:51:49 STEP 770 H= 770:00 +CPU= 20.385
02:52:21 STEP 771 H= 771:00 +CPU= 31.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:53:41 STEP 772 H= 772:00 +CPU= 20.098
02:54:01 STEP 773 H= 773:00 +CPU= 19.934
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
