<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
c-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1ed5a5bab9392edfc196a58bc84c433a to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
ic_ancil_file: ic_ancil_12186217
ifsdata_file: ifsdata_12186217
climate_data_file: clim_data_12186217
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ff19c299220776cf38e5721b539e029d to: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_deb32b9b48678c5012f65e5e5fcbc1a3 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12186217.xml
-- Model is restarting --
Adjusting last_iter, 568, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
last_cpu_time: 15920
upload_file_number: 23
last_iter: 551
last_upload: 1987200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600
The child process has been launched with process id: 333892
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:333892:333892] [20230120:222331:1674221011:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:28 STEP 552 H= 552:00 +CPU= 41.434
22:28:52 STEP 553 H= 553:00 +CPU= 22.907
22:29:16 STEP 554 H= 554:00 +CPU= 23.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:06 STEP 555 H= 555:00 +CPU= 36.961
22:35:30 STEP 556 H= 556:00 +CPU= 23.319
22:35:53 STEP 557 H= 557:00 +CPU= 22.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:05 STEP 558 H= 558:00 +CPU= 37.678
22:51:26 STEP 559 H= 559:00 +CPU= 20.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:09 STEP 560 H= 560:00 +CPU= 21.731
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:03 STEP 561 H= 561:00 +CPU= 33.166
22:55:24 STEP 562 H= 562:00 +CPU= 20.759
22:55:44 STEP 563 H= 563:00 +CPU= 20.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:51 STEP 564 H= 564:00 +CPU= 34.976
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:59:22 STEP 565 H= 565:00 +CPU= 19.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:43 STEP 566 H= 566:00 +CPU= 20.349
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:07 STEP 567 H= 567:00 +CPU= 31.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:29 STEP 568 H= 568:00 +CPU= 20.781
23:03:49 STEP 569 H= 569:00 +CPU= 20.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:14 STEP 570 H= 570:00 +CPU= 33.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:45 STEP 571 H= 571:00 +CPU= 20.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:07 STEP 572 H= 572:00 +CPU= 20.259
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:50 STEP 573 H= 573:00 +CPU= 31.751
23:10:10 STEP 574 H= 574:00 +CPU= 20.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:32 STEP 575 H= 575:00 +CPU= 20.691
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:11 STEP 576 H= 576:00 +CPU= 37.775
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_23.zip
Uploading the intermediate file: upload_file_23.zip
23:13:30 STEP 577 H= 577:00 +CPU= 18.963
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:46 STEP 578 H= 578:00 +CPU= 20.208
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:51 STEP 579 H= 579:00 +CPU= 32.653
23:17:12 STEP 580 H= 580:00 +CPU= 20.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:44 STEP 581 H= 581:00 +CPU= 20.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:28 STEP 582 H= 582:00 +CPU= 33.121
23:20:47 STEP 583 H= 583:00 +CPU= 19.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:09 STEP 584 H= 584:00 +CPU= 20.660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:44 STEP 585 H= 585:00 +CPU= 32.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:26 STEP 586 H= 586:00 +CPU= 20.572
23:25:46 STEP 587 H= 587:00 +CPU= 19.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:42 STEP 588 H= 588:00 +CPU= 35.108
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000588
23:28:02 STEP 589 H= 589:00 +CPU= 19.688
23:28:22 STEP 590 H= 590:00 +CPU= 20.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:25 STEP 591 H= 591:00 +CPU= 32.749
23:31:46 STEP 592 H= 592:00 +CPU= 20.903
23:32:06 STEP 593 H= 593:00 +CPU= 20.185
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:51 STEP 594 H= 594:00 +CPU= 32.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:22 STEP 595 H= 595:00 +CPU= 20.400
23:35:42 STEP 596 H= 596:00 +CPU= 20.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:28 STEP 597 H= 597:00 +CPU= 32.400
23:38:49 STEP 598 H= 598:00 +CPU= 20.743
23:39:09 STEP 599 H= 599:00 +CPU= 20.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:28 STEP 600 H= 600:00 +CPU= 37.645
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_24.zip
Uploading the intermediate file: upload_file_24.zip
23:41:47 STEP 601 H= 601:00 +CPU= 18.555
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:12 STEP 602 H= 602:00 +CPU= 19.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:44:55 STEP 603 H= 603:00 +CPU= 32.097
23:45:16 STEP 604 H= 604:00 +CPU= 20.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:56 STEP 605 H= 605:00 +CPU= 20.165
23:47:28 STEP 606 H= 606:00 +CPU= 32.069
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:10 STEP 607 H= 607:00 +CPU= 19.631
23:49:31 STEP 608 H= 608:00 +CPU= 21.443
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:51:13 STEP 609 H= 609:00 +CPU= 31.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:34 STEP 610 H= 610:00 +CPU= 20.233
23:52:55 STEP 611 H= 611:00 +CPU= 20.379
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:50 STEP 612 H= 612:00 +CPU= 35.061
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000612
23:55:10 STEP 613 H= 613:00 +CPU= 20.376
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:56:42 STEP 614 H= 614:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:58:24 STEP 615 H= 615:00 +CPU= 31.897
23:58:45 STEP 616 H= 616:00 +CPU= 21.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:00:06 STEP 617 H= 617:00 +CPU= 19.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:50 STEP 618 H= 618:00 +CPU= 33.010
00:02:11 STEP 619 H= 619:00 +CPU= 20.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:03:24 STEP 620 H= 620:00 +CPU= 20.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:07 STEP 621 H= 621:00 +CPU= 31.999
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:06:38 STEP 622 H= 622:00 +CPU= 20.710
00:06:58 STEP 623 H= 623:00 +CPU= 20.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:18 STEP 624 H= 624:00 +CPU= 37.764
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_25.zip
Uploading the intermediate file: upload_file_25.zip
00:09:38 STEP 625 H= 625:00 +CPU= 19.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:29 STEP 626 H= 626:00 +CPU= 20.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:34 STEP 627 H= 627:00 +CPU= 32.482
00:13:54 STEP 628 H= 628:00 +CPU= 19.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:15:24 STEP 629 H= 629:00 +CPU= 19.728
00:15:56 STEP 630 H= 630:00 +CPU= 31.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:17:38 STEP 631 H= 631:00 +CPU= 21.069
00:17:59 STEP 632 H= 632:00 +CPU= 20.777
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:19:51 STEP 633 H= 633:00 +CPU= 31.989
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:21:12 STEP 634 H= 634:00 +CPU= 20.434
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:22:14 STEP 635 H= 635:00 +CPU= 20.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:23:39 STEP 636 H= 636:00 +CPU= 34.980
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000636
00:23:59 STEP 637 H= 637:00 +CPU= 20.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:25:40 STEP 638 H= 638:00 +CPU= 20.869
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0573
(argv4) batchid: 969
(argv5) wuid: 12186217
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1ed5a5bab9392edfc196a58bc84c433a to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
ic_ancil_file: ic_ancil_12186217
ifsdata_file: ifsdata_12186217
climate_data_file: clim_data_12186217
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ff19c299220776cf38e5721b539e029d to: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_deb32b9b48678c5012f65e5e5fcbc1a3 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12186217.xml
-- Model is restarting --
Adjusting last_iter, 639, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
last_cpu_time: 18104
upload_file_number: 26
last_iter: 623
last_upload: 2246400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600
The child process has been launched with process id: 351939
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:351939:351939] [20230121:002743:1674228463:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
00:28:21 STEP 624 H= 624:00 +CPU= 35.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:30:24 STEP 625 H= 625:00 +CPU= 20.375
00:30:45 STEP 626 H= 626:00 +CPU= 20.870
00:31:16 STEP 627 H= 627:00 +CPU= 31.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:33:08 STEP 628 H= 628:00 +CPU= 21.388
00:33:27 STEP 629 H= 629:00 +CPU= 19.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:35:11 STEP 630 H= 630:00 +CPU= 32.853
00:35:31 STEP 631 H= 631:00 +CPU= 19.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:37:04 STEP 632 H= 632:00 +CPU= 20.663
00:37:36 STEP 633 H= 633:00 +CPU= 32.207
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:39:27 STEP 634 H= 634:00 +CPU= 20.875
00:39:47 STEP 635 H= 635:00 +CPU= 19.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:41:33 STEP 636 H= 636:00 +CPU= 34.597
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000636
00:41:53 STEP 637 H= 637:00 +CPU= 20.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:43:25 STEP 638 H= 638:00 +CPU= 20.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:45:17 STEP 639 H= 639:00 +CPU= 31.367
00:45:39 STEP 640 H= 640:00 +CPU= 21.027
00:45:58 STEP 641 H= 641:00 +CPU= 19.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:47:43 STEP 642 H= 642:00 +CPU= 33.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:49:04 STEP 643 H= 643:00 +CPU= 19.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:50:34 STEP 644 H= 644:00 +CPU= 20.622
00:51:06 STEP 645 H= 645:00 +CPU= 31.595
00:51:26 STEP 646 H= 646:00 +CPU= 20.036
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:09 STEP 647 H= 647:00 +CPU= 20.582
00:53:46 STEP 648 H= 648:00 +CPU= 37.144
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_26.zip
Uploading the intermediate file: upload_file_26.zip
00:54:06 STEP 649 H= 649:00 +CPU= 19.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:56:02 STEP 650 H= 650:00 +CPU= 20.707
00:56:33 STEP 651 H= 651:00 +CPU= 30.980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:58:25 STEP 652 H= 652:00 +CPU= 20.207
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:36 STEP 653 H= 653:00 +CPU= 20.694
01:00:08 STEP 654 H= 654:00 +CPU= 32.284
01:00:28 STEP 655 H= 655:00 +CPU= 19.885
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:02:10 STEP 656 H= 656:00 +CPU= 21.415
01:02:42 STEP 657 H= 657:00 +CPU= 31.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:04:04 STEP 658 H= 658:00 +CPU= 20.709
01:04:24 STEP 659 H= 659:00 +CPU= 20.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:06:11 STEP 660 H= 660:00 +CPU= 35.028
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:07:33 STEP 661 H= 661:00 +CPU= 19.836
01:07:54 STEP 662 H= 662:00 +CPU= 20.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:09:17 STEP 663 H= 663:00 +CPU= 31.850
01:09:37 STEP 664 H= 664:00 +CPU= 20.086
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:11:17 STEP 665 H= 665:00 +CPU= 20.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:13:02 STEP 666 H= 666:00 +CPU= 32.916
01:13:22 STEP 667 H= 667:00 +CPU= 19.851
01:13:43 STEP 668 H= 668:00 +CPU= 20.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:15:36 STEP 669 H= 669:00 +CPU= 31.716
01:15:56 STEP 670 H= 670:00 +CPU= 20.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:17:26 STEP 671 H= 671:00 +CPU= 20.068
01:18:03 STEP 672 H= 672:00 +CPU= 37.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_27.zip
Uploading the intermediate file: upload_file_27.zip
01:19:34 STEP 673 H= 673:00 +CPU= 19.125
01:19:54 STEP 674 H= 674:00 +CPU= 19.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:47 STEP 675 H= 675:00 +CPU= 31.762
01:22:07 STEP 676 H= 676:00 +CPU= 20.114
01:22:27 STEP 677 H= 677:00 +CPU= 19.731
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:24:10 STEP 678 H= 678:00 +CPU= 32.230
01:24:30 STEP 679 H= 679:00 +CPU= 19.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:02 STEP 680 H= 680:00 +CPU= 20.405
01:26:34 STEP 681 H= 681:00 +CPU= 31.914
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:26 STEP 682 H= 682:00 +CPU= 20.367
01:28:46 STEP 683 H= 683:00 +CPU= 20.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:30:21 STEP 684 H= 684:00 +CPU= 35.445
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:43 STEP 685 H= 685:00 +CPU= 20.049
01:32:03 STEP 686 H= 686:00 +CPU= 20.260
01:32:36 STEP 687 H= 687:00 +CPU= 32.535
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:06 STEP 688 H= 688:00 +CPU= 20.082
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:35:37 STEP 689 H= 689:00 +CPU= 19.861
01:36:10 STEP 690 H= 690:00 +CPU= 32.871
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:37:41 STEP 691 H= 691:00 +CPU= 19.694
01:38:01 STEP 692 H= 692:00 +CPU= 19.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:39:34 STEP 693 H= 693:00 +CPU= 31.596
01:39:54 STEP 694 H= 694:00 +CPU= 20.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:41:36 STEP 695 H= 695:00 +CPU= 20.685
01:42:14 STEP 696 H= 696:00 +CPU= 37.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_28.zip
Uploading the intermediate file: upload_file_28.zip
01:43:44 STEP 697 H= 697:00 +CPU= 19.757
01:44:04 STEP 698 H= 698:00 +CPU= 19.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:45:46 STEP 699 H= 699:00 +CPU= 31.430
01:46:06 STEP 700 H= 700:00 +CPU= 20.301
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:47:36 STEP 701 H= 701:00 +CPU= 19.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:09 STEP 702 H= 702:00 +CPU= 32.765
01:49:29 STEP 703 H= 703:00 +CPU= 20.071
01:49:50 STEP 704 H= 704:00 +CPU= 21.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:51:32 STEP 705 H= 705:00 +CPU= 31.883
01:51:52 STEP 706 H= 706:00 +CPU= 19.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:53:43 STEP 707 H= 707:00 +CPU= 19.922
01:54:18 STEP 708 H= 708:00 +CPU= 34.878
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:56:10 STEP 709 H= 709:00 +CPU= 20.392
01:56:30 STEP 710 H= 710:00 +CPU= 20.605
01:57:02 STEP 711 H= 711:00 +CPU= 31.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:58:44 STEP 712 H= 712:00 +CPU= 20.277
01:59:03 STEP 713 H= 713:00 +CPU= 19.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:37 STEP 714 H= 714:00 +CPU= 32.535
02:00:57 STEP 715 H= 715:00 +CPU= 20.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:29 STEP 716 H= 716:00 +CPU= 20.190
02:03:01 STEP 717 H= 717:00 +CPU= 31.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:43 STEP 718 H= 718:00 +CPU= 20.739
02:05:03 STEP 719 H= 719:00 +CPU= 20.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:06:51 STEP 720 H= 720:00 +CPU= 37.649
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_29.zip
Uploading the intermediate file: upload_file_29.zip
02:07:11 STEP 721 H= 721:00 +CPU= 19.660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:08:32 STEP 722 H= 722:00 +CPU= 20.402
02:09:04 STEP 723 H= 723:00 +CPU= 31.436
02:09:24 STEP 724 H= 724:00 +CPU= 20.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:56 STEP 725 H= 725:00 +CPU= 19.788
02:11:28 STEP 726 H= 726:00 +CPU= 32.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:12:50 STEP 727 H= 727:00 +CPU= 20.038
02:13:10 STEP 728 H= 728:00 +CPU= 20.649
02:13:41 STEP 729 H= 729:00 +CPU= 30.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:24 STEP 730 H= 730:00 +CPU= 20.305
02:15:43 STEP 731 H= 731:00 +CPU= 19.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:17:09 STEP 732 H= 732:00 +CPU= 35.363
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000732
02:17:29 STEP 733 H= 733:00 +CPU= 20.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:12 STEP 734 H= 734:00 +CPU= 19.934
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:20:34 STEP 735 H= 735:00 +CPU= 31.764
02:20:55 STEP 736 H= 736:00 +CPU= 20.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:22:07 STEP 737 H= 737:00 +CPU= 19.722
02:22:40 STEP 738 H= 738:00 +CPU= 32.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:24:21 STEP 739 H= 739:00 +CPU= 20.467
02:24:41 STEP 740 H= 740:00 +CPU= 19.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:26:35 STEP 741 H= 741:00 +CPU= 32.137
02:26:56 STEP 742 H= 742:00 +CPU= 20.821
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:28:06 STEP 743 H= 743:00 +CPU= 20.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:29:55 STEP 744 H= 744:00 +CPU= 37.332
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_30.zip
Uploading the intermediate file: upload_file_30.zip
02:30:15 STEP 745 H= 745:00 +CPU= 20.100
02:30:35 STEP 746 H= 746:00 +CPU= 20.195
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:32:10 STEP 747 H= 747:00 +CPU= 32.630
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0573
(argv4) batchid: 969
(argv5) wuid: 12186217
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1ed5a5bab9392edfc196a58bc84c433a to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0573_2000050100_123_969_12186217.zip
ic_ancil_file: ic_ancil_12186217
ifsdata_file: ifsdata_12186217
climate_data_file: clim_data_12186217
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ff19c299220776cf38e5721b539e029d to: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12186217.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_deb32b9b48678c5012f65e5e5fcbc1a3 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12186217.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12186217.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12186217.xml
-- Model is restarting --
Adjusting last_iter, 748, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12186217.xml
last_cpu_time: 21164
upload_file_number: 31
last_iter: 743
last_upload: 2678400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600
The child process has been launched with process id: 369518
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:369518:369518] [20230121:023336:1674236016:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
02:34:14 STEP 744 H= 744:00 +CPU= 35.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:35:56 STEP 745 H= 745:00 +CPU= 19.811
02:36:17 STEP 746 H= 746:00 +CPU= 20.499
02:36:48 STEP 747 H= 747:00 +CPU= 31.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:38:10 STEP 748 H= 748:00 +CPU= 20.569
02:38:30 STEP 749 H= 749:00 +CPU= 19.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:39:53 STEP 750 H= 750:00 +CPU= 32.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:41:14 STEP 751 H= 751:00 +CPU= 19.973
02:41:34 STEP 752 H= 752:00 +CPU= 20.345
02:42:06 STEP 753 H= 753:00 +CPU= 31.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:43:46 STEP 754 H= 754:00 +CPU= 20.173
02:44:06 STEP 755 H= 755:00 +CPU= 19.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:46:04 STEP 756 H= 756:00 +CPU= 35.344
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000756
02:46:24 STEP 757 H= 757:00 +CPU= 20.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:47:35 STEP 758 H= 758:00 +CPU= 20.054
02:48:07 STEP 759 H= 759:00 +CPU= 31.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:49:39 STEP 760 H= 760:00 +CPU= 19.861
02:49:58 STEP 761 H= 761:00 +CPU= 19.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:51:43 STEP 762 H= 762:00 +CPU= 32.735
02:52:03 STEP 763 H= 763:00 +CPU= 19.765
02:52:24 STEP 764 H= 764:00 +CPU= 20.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:53:57 STEP 765 H= 765:00 +CPU= 32.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:55:28 STEP 766 H= 766:00 +CPU= 20.424
02:55:48 STEP 767 H= 767:00 +CPU= 19.496
02:56:23 STEP 768 H= 768:00 +CPU= 35.633
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMGGhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMSHhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186217/ICMUAhq0f+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0573_2000050100_123_969_12186217_0_r1099335600_31.zip
Uploading the intermediate file: upload_file_31.zip
02:56:43 STEP 769 H= 769:00 +CPU= 19.094
02:57:02 STEP 770 H= 770:00 +CPU= 19.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:58:44 STEP 771 H= 771:00 +CPU= 30.386
02:59:03 STEP 772 H= 772:00 +CPU= 19.485
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
