<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
rgv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56435e71a077fe9b66cece1d0898629b to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
ic_ancil_file: ic_ancil_12178714
ifsdata_file: ifsdata_12178714
climate_data_file: clim_data_12178714
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5aa645fb931939c92f4159ccf1c5f718 to: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4509268e533680c53f92685772cbe318 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12178714.xml
-- Model is restarting --
Adjusting last_iter, 568, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
last_cpu_time: 15500
upload_file_number: 23
last_iter: 551
last_upload: 1987200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204
The child process has been launched with process id: 332624
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:332624:332624] [20230120:221420:1674220460:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:18:08 STEP 552 H= 552:00 +CPU= 41.628
22:18:32 STEP 553 H= 553:00 +CPU= 23.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:37 STEP 554 H= 554:00 +CPU= 24.002
22:24:15 STEP 555 H= 555:00 +CPU= 36.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:51 STEP 556 H= 556:00 +CPU= 23.361
22:29:14 STEP 557 H= 557:00 +CPU= 23.103
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:05 STEP 558 H= 558:00 +CPU= 38.116
22:35:28 STEP 559 H= 559:00 +CPU= 22.748
22:35:52 STEP 560 H= 560:00 +CPU= 23.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:04 STEP 561 H= 561:00 +CPU= 36.915
22:51:25 STEP 562 H= 562:00 +CPU= 20.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:08 STEP 563 H= 563:00 +CPU= 21.152
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:04 STEP 564 H= 564:00 +CPU= 35.423
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000564
22:55:25 STEP 565 H= 565:00 +CPU= 20.737
22:55:46 STEP 566 H= 566:00 +CPU= 20.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:49 STEP 567 H= 567:00 +CPU= 31.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:59:21 STEP 568 H= 568:00 +CPU= 20.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:43 STEP 569 H= 569:00 +CPU= 19.998
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:07 STEP 570 H= 570:00 +CPU= 32.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:27 STEP 571 H= 571:00 +CPU= 20.179
23:03:47 STEP 572 H= 572:00 +CPU= 20.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:10 STEP 573 H= 573:00 +CPU= 31.562
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:43 STEP 574 H= 574:00 +CPU= 21.342
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:05 STEP 575 H= 575:00 +CPU= 20.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:55 STEP 576 H= 576:00 +CPU= 37.941
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_23.zip
Uploading the intermediate file: upload_file_23.zip
23:10:15 STEP 577 H= 577:00 +CPU= 19.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:37 STEP 578 H= 578:00 +CPU= 20.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:09 STEP 579 H= 579:00 +CPU= 31.182
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:41 STEP 580 H= 580:00 +CPU= 20.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:34 STEP 581 H= 581:00 +CPU= 20.672
23:17:06 STEP 582 H= 582:00 +CPU= 32.242
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:36 STEP 583 H= 583:00 +CPU= 19.554
23:18:57 STEP 584 H= 584:00 +CPU= 21.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:39 STEP 585 H= 585:00 +CPU= 31.877
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:00 STEP 586 H= 586:00 +CPU= 20.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:22 STEP 587 H= 587:00 +CPU= 20.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:18 STEP 588 H= 588:00 +CPU= 34.754
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000588
23:25:38 STEP 589 H= 589:00 +CPU= 20.394
23:25:59 STEP 590 H= 590:00 +CPU= 20.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:51 STEP 591 H= 591:00 +CPU= 31.888
23:28:11 STEP 592 H= 592:00 +CPU= 20.600
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:30:03 STEP 593 H= 593:00 +CPU= 20.329
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:37 STEP 594 H= 594:00 +CPU= 33.258
23:31:57 STEP 595 H= 595:00 +CPU= 19.996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:30 STEP 596 H= 596:00 +CPU= 20.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:13 STEP 597 H= 597:00 +CPU= 32.094
23:35:34 STEP 598 H= 598:00 +CPU= 21.124
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:37:16 STEP 599 H= 599:00 +CPU= 20.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:45 STEP 600 H= 600:00 +CPU= 38.488
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_24.zip
Uploading the intermediate file: upload_file_24.zip
23:39:05 STEP 601 H= 601:00 +CPU= 19.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:06 STEP 602 H= 602:00 +CPU= 20.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:00 STEP 603 H= 603:00 +CPU= 31.951
23:43:21 STEP 604 H= 604:00 +CPU= 20.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:44:52 STEP 605 H= 605:00 +CPU= 19.875
23:45:24 STEP 606 H= 606:00 +CPU= 32.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:47:06 STEP 607 H= 607:00 +CPU= 21.032
23:47:26 STEP 608 H= 608:00 +CPU= 20.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:19 STEP 609 H= 609:00 +CPU= 31.585
23:49:40 STEP 610 H= 610:00 +CPU= 21.050
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:51:11 STEP 611 H= 611:00 +CPU= 19.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:48 STEP 612 H= 612:00 +CPU= 35.050
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000612
23:53:08 STEP 613 H= 613:00 +CPU= 19.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:51 STEP 614 H= 614:00 +CPU= 21.136
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:56:35 STEP 615 H= 615:00 +CPU= 31.866
23:56:56 STEP 616 H= 616:00 +CPU= 21.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:58:27 STEP 617 H= 617:00 +CPU= 19.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:59:59 STEP 618 H= 618:00 +CPU= 31.916
00:00:20 STEP 619 H= 619:00 +CPU= 20.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:51 STEP 620 H= 620:00 +CPU= 20.821
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:03:14 STEP 621 H= 621:00 +CPU= 32.627
00:03:35 STEP 622 H= 622:00 +CPU= 20.299
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:08 STEP 623 H= 623:00 +CPU= 21.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:06:57 STEP 624 H= 624:00 +CPU= 37.453
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_25.zip
Uploading the intermediate file: upload_file_25.zip
00:07:17 STEP 625 H= 625:00 +CPU= 19.894
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:14 STEP 626 H= 626:00 +CPU= 20.655
00:09:46 STEP 627 H= 627:00 +CPU= 31.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:39 STEP 628 H= 628:00 +CPU= 21.135
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:31 STEP 629 H= 629:00 +CPU= 19.953
00:14:04 STEP 630 H= 630:00 +CPU= 33.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:15:35 STEP 631 H= 631:00 +CPU= 20.488
00:15:54 STEP 632 H= 632:00 +CPU= 19.740
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1993050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0070
(argv4) batchid: 962
(argv5) wuid: 12178714
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56435e71a077fe9b66cece1d0898629b to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
ic_ancil_file: ic_ancil_12178714
ifsdata_file: ifsdata_12178714
climate_data_file: clim_data_12178714
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5aa645fb931939c92f4159ccf1c5f718 to: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4509268e533680c53f92685772cbe318 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12178714.xml
-- Model is restarting --
Adjusting last_iter, 633, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
last_cpu_time: 17552
upload_file_number: 26
last_iter: 623
last_upload: 2246400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204
The child process has been launched with process id: 350552
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:350552:350552] [20230121:001732:1674227852:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:19:32 STEP 624 H= 624:00 +CPU= 36.313
00:19:53 STEP 625 H= 625:00 +CPU= 20.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:21:14 STEP 626 H= 626:00 +CPU= 20.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:22:28 STEP 627 H= 627:00 +CPU= 32.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:23:40 STEP 628 H= 628:00 +CPU= 21.296
00:24:00 STEP 629 H= 629:00 +CPU= 19.904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:25:53 STEP 630 H= 630:00 +CPU= 32.332
00:26:12 STEP 631 H= 631:00 +CPU= 19.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:27:53 STEP 632 H= 632:00 +CPU= 20.765
00:28:25 STEP 633 H= 633:00 +CPU= 31.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:30:28 STEP 634 H= 634:00 +CPU= 21.019
00:30:49 STEP 635 H= 635:00 +CPU= 20.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:32:54 STEP 636 H= 636:00 +CPU= 34.730
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000636
00:33:15 STEP 637 H= 637:00 +CPU= 20.364
00:33:36 STEP 638 H= 638:00 +CPU= 20.900
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:35:18 STEP 639 H= 639:00 +CPU= 31.163
00:35:38 STEP 640 H= 640:00 +CPU= 20.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:37:10 STEP 641 H= 641:00 +CPU= 20.883
00:37:42 STEP 642 H= 642:00 +CPU= 32.001
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:39:34 STEP 643 H= 643:00 +CPU= 20.047
00:39:54 STEP 644 H= 644:00 +CPU= 20.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:41:35 STEP 645 H= 645:00 +CPU= 31.206
00:41:57 STEP 646 H= 646:00 +CPU= 21.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:43:29 STEP 647 H= 647:00 +CPU= 20.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:45:28 STEP 648 H= 648:00 +CPU= 37.813
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_26.zip
Uploading the intermediate file: upload_file_26.zip
00:45:48 STEP 649 H= 649:00 +CPU= 19.551
00:46:09 STEP 650 H= 650:00 +CPU= 20.796
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:48:55 STEP 651 H= 651:00 +CPU= 32.164
00:49:16 STEP 652 H= 652:00 +CPU= 21.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:50:48 STEP 653 H= 653:00 +CPU= 20.664
00:51:21 STEP 654 H= 654:00 +CPU= 32.359
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:02 STEP 655 H= 655:00 +CPU= 19.984
00:53:23 STEP 656 H= 656:00 +CPU= 20.792
00:53:54 STEP 657 H= 657:00 +CPU= 31.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:55:57 STEP 658 H= 658:00 +CPU= 20.813
00:56:17 STEP 659 H= 659:00 +CPU= 20.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:58:24 STEP 660 H= 660:00 +CPU= 35.283
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:35 STEP 661 H= 661:00 +CPU= 20.609
00:59:55 STEP 662 H= 662:00 +CPU= 20.013
01:00:27 STEP 663 H= 663:00 +CPU= 31.124
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:02:09 STEP 664 H= 664:00 +CPU= 20.297
01:02:29 STEP 665 H= 665:00 +CPU= 20.352
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:04:04 STEP 666 H= 666:00 +CPU= 32.429
01:04:24 STEP 667 H= 667:00 +CPU= 19.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:05:57 STEP 668 H= 668:00 +CPU= 20.462
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:07:31 STEP 669 H= 669:00 +CPU= 31.983
01:07:52 STEP 670 H= 670:00 +CPU= 20.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:09:04 STEP 671 H= 671:00 +CPU= 20.457
01:09:41 STEP 672 H= 672:00 +CPU= 37.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_27.zip
Uploading the intermediate file: upload_file_27.zip
01:11:22 STEP 673 H= 673:00 +CPU= 19.568
01:11:43 STEP 674 H= 674:00 +CPU= 20.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:13:26 STEP 675 H= 675:00 +CPU= 32.009
01:13:47 STEP 676 H= 676:00 +CPU= 21.010
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:15:27 STEP 677 H= 677:00 +CPU= 19.363
01:16:00 STEP 678 H= 678:00 +CPU= 31.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:17:30 STEP 679 H= 679:00 +CPU= 19.450
01:17:50 STEP 680 H= 680:00 +CPU= 20.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:19:33 STEP 681 H= 681:00 +CPU= 31.691
01:19:53 STEP 682 H= 682:00 +CPU= 19.979
01:20:13 STEP 683 H= 683:00 +CPU= 19.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:22:11 STEP 684 H= 684:00 +CPU= 35.916
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000684
01:22:30 STEP 685 H= 685:00 +CPU= 19.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:24:02 STEP 686 H= 686:00 +CPU= 20.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:47 STEP 687 H= 687:00 +CPU= 32.343
01:26:07 STEP 688 H= 688:00 +CPU= 20.035
01:26:27 STEP 689 H= 689:00 +CPU= 20.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:31 STEP 690 H= 690:00 +CPU= 32.174
01:28:50 STEP 691 H= 691:00 +CPU= 19.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:30:12 STEP 692 H= 692:00 +CPU= 20.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:45 STEP 693 H= 693:00 +CPU= 31.710
01:32:05 STEP 694 H= 694:00 +CPU= 20.524
01:32:26 STEP 695 H= 695:00 +CPU= 20.980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:15 STEP 696 H= 696:00 +CPU= 37.325
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_28.zip
Uploading the intermediate file: upload_file_28.zip
01:34:32 STEP 697 H= 697:00 +CPU= 16.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:35:42 STEP 698 H= 698:00 +CPU= 19.121
01:36:13 STEP 699 H= 699:00 +CPU= 31.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:37:46 STEP 700 H= 700:00 +CPU= 20.515
01:38:05 STEP 701 H= 701:00 +CPU= 18.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:39:40 STEP 702 H= 702:00 +CPU= 32.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:41:20 STEP 703 H= 703:00 +CPU= 19.804
01:41:40 STEP 704 H= 704:00 +CPU= 20.530
01:42:11 STEP 705 H= 705:00 +CPU= 30.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:43:43 STEP 706 H= 706:00 +CPU= 20.424
01:44:02 STEP 707 H= 707:00 +CPU= 19.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:45:49 STEP 708 H= 708:00 +CPU= 35.029
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000708
01:46:08 STEP 709 H= 709:00 +CPU= 19.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:47:40 STEP 710 H= 710:00 +CPU= 20.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:13 STEP 711 H= 711:00 +CPU= 31.690
01:49:33 STEP 712 H= 712:00 +CPU= 20.674
01:49:53 STEP 713 H= 713:00 +CPU= 19.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:51:36 STEP 714 H= 714:00 +CPU= 32.248
01:51:56 STEP 715 H= 715:00 +CPU= 19.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:53:46 STEP 716 H= 716:00 +CPU= 20.172
01:54:17 STEP 717 H= 717:00 +CPU= 31.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:56:09 STEP 718 H= 718:00 +CPU= 20.236
01:56:29 STEP 719 H= 719:00 +CPU= 20.118
01:57:06 STEP 720 H= 720:00 +CPU= 37.549
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_29.zip
Uploading the intermediate file: upload_file_29.zip
01:57:25 STEP 721 H= 721:00 +CPU= 19.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:58:56 STEP 722 H= 722:00 +CPU= 19.914
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:29 STEP 723 H= 723:00 +CPU= 31.483
02:00:49 STEP 724 H= 724:00 +CPU= 20.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:21 STEP 725 H= 725:00 +CPU= 20.373
02:02:53 STEP 726 H= 726:00 +CPU= 31.960
02:03:13 STEP 727 H= 727:00 +CPU= 20.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:55 STEP 728 H= 728:00 +CPU= 20.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:06:38 STEP 729 H= 729:00 +CPU= 31.378
02:06:59 STEP 730 H= 730:00 +CPU= 21.319
02:07:19 STEP 731 H= 731:00 +CPU= 19.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:08:54 STEP 732 H= 732:00 +CPU= 35.081
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000732
02:09:14 STEP 733 H= 733:00 +CPU= 20.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:46 STEP 734 H= 734:00 +CPU= 20.372
02:11:17 STEP 735 H= 735:00 +CPU= 31.835
02:11:38 STEP 736 H= 736:00 +CPU= 20.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:13:00 STEP 737 H= 737:00 +CPU= 20.243
02:13:32 STEP 738 H= 738:00 +CPU= 32.069
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:14 STEP 739 H= 739:00 +CPU= 20.114
02:15:35 STEP 740 H= 740:00 +CPU= 20.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:16:59 STEP 741 H= 741:00 +CPU= 31.816
02:17:19 STEP 742 H= 742:00 +CPU= 20.339
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:02 STEP 743 H= 743:00 +CPU= 20.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:20:29 STEP 744 H= 744:00 +CPU= 36.616
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_30.zip
Uploading the intermediate file: upload_file_30.zip
02:20:49 STEP 745 H= 745:00 +CPU= 20.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1993050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0070
(argv4) batchid: 962
(argv5) wuid: 12178714
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56435e71a077fe9b66cece1d0898629b to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0070_1993050100_123_962_12178714.zip
ic_ancil_file: ic_ancil_12178714
ifsdata_file: ifsdata_12178714
climate_data_file: clim_data_12178714
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5aa645fb931939c92f4159ccf1c5f718 to: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12178714.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4509268e533680c53f92685772cbe318 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12178714.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12178714.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12178714.xml
-- Model is restarting --
Adjusting last_iter, 745, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12178714.xml
last_cpu_time: 20531
upload_file_number: 31
last_iter: 743
last_upload: 2678400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204
The child process has been launched with process id: 368109
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:368109:368109] [20230121:022405:1674235445:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
02:24:44 STEP 744 H= 744:00 +CPU= 36.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:26:25 STEP 745 H= 745:00 +CPU= 19.954
02:26:46 STEP 746 H= 746:00 +CPU= 21.031
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:28:09 STEP 747 H= 747:00 +CPU= 32.054
02:28:30 STEP 748 H= 748:00 +CPU= 20.894
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:30:01 STEP 749 H= 749:00 +CPU= 19.841
02:30:33 STEP 750 H= 750:00 +CPU= 32.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:31:55 STEP 751 H= 751:00 +CPU= 20.456
02:32:16 STEP 752 H= 752:00 +CPU= 21.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:33:48 STEP 753 H= 753:00 +CPU= 31.749
02:34:08 STEP 754 H= 754:00 +CPU= 20.037
02:34:28 STEP 755 H= 755:00 +CPU= 19.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:36:24 STEP 756 H= 756:00 +CPU= 35.044
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000756
02:36:44 STEP 757 H= 757:00 +CPU= 19.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:38:06 STEP 758 H= 758:00 +CPU= 20.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:39:30 STEP 759 H= 759:00 +CPU= 31.865
02:39:51 STEP 760 H= 760:00 +CPU= 20.434
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:41:12 STEP 761 H= 761:00 +CPU= 19.868
02:41:44 STEP 762 H= 762:00 +CPU= 32.173
02:42:04 STEP 763 H= 763:00 +CPU= 19.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:43:46 STEP 764 H= 764:00 +CPU= 20.328
02:44:17 STEP 765 H= 765:00 +CPU= 31.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:45:59 STEP 766 H= 766:00 +CPU= 20.229
02:46:19 STEP 767 H= 767:00 +CPU= 20.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:47:48 STEP 768 H= 768:00 +CPU= 37.227
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMGGhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMSHhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178714/ICMUAhq0f+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0070_1993050100_123_962_12178714_2_r1883353204_31.zip
Uploading the intermediate file: upload_file_31.zip
02:48:08 STEP 769 H= 769:00 +CPU= 19.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:49:40 STEP 770 H= 770:00 +CPU= 20.425
02:50:12 STEP 771 H= 771:00 +CPU= 31.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:51:45 STEP 772 H= 772:00 +CPU= 21.184
02:52:06 STEP 773 H= 773:00 +CPU= 20.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:53:38 STEP 774 H= 774:00 +CPU= 32.431
02:53:58 STEP 775 H= 775:00 +CPU= 19.862
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>