<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
oinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ab8a9a2585c1e66802045e9e7a887060 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
ic_ancil_file: ic_ancil_12290686
ifsdata_file: ifsdata_12290686
climate_data_file: clim_data_12290686
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1699efeda3cfa83a238efe5659dd892a to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12290686.xml
-- Model is restarting --
Adjusting last_iter, 1719, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
last_cpu_time: 65258
upload_file_number: 17
last_iter: 1681
last_upload: 1469700
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640
The child process has been launched with process id: 70386
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:70386:70386] [20240614:061847:1718363927:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:19:37 STEP 1680 H= 420:00 +CPU= 24.618
06:20:02 STEP 1681 H= 420:15 +CPU= 24.962
06:20:27 STEP 1682 H= 420:30 +CPU= 25.294
06:20:52 STEP 1683 H= 420:45 +CPU= 24.025
06:21:17 STEP 1684 H= 421:00 +CPU= 25.125
06:21:41 STEP 1685 H= 421:15 +CPU= 23.635
06:22:07 STEP 1686 H= 421:30 +CPU= 25.076
06:22:32 STEP 1687 H= 421:45 +CPU= 24.919
06:22:57 STEP 1688 H= 422:00 +CPU= 24.943
06:23:22 STEP 1689 H= 422:15 +CPU= 24.328
06:23:46 STEP 1690 H= 422:30 +CPU= 24.244
06:24:11 STEP 1691 H= 422:45 +CPU= 24.457
06:24:42 STEP 1692 H= 423:00 +CPU= 30.465
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001692
06:25:07 STEP 1693 H= 423:15 +CPU= 24.540
06:25:32 STEP 1694 H= 423:30 +CPU= 24.527
06:25:58 STEP 1695 H= 423:45 +CPU= 25.258
06:26:23 STEP 1696 H= 424:00 +CPU= 24.570
06:26:47 STEP 1697 H= 424:15 +CPU= 24.305
06:27:12 STEP 1698 H= 424:30 +CPU= 24.344
06:27:37 STEP 1699 H= 424:45 +CPU= 25.237
06:28:03 STEP 1700 H= 425:00 +CPU= 25.181
06:28:28 STEP 1701 H= 425:15 +CPU= 24.351
06:28:53 STEP 1702 H= 425:30 +CPU= 24.702
06:29:18 STEP 1703 H= 425:45 +CPU= 24.455
06:29:48 STEP 1704 H= 426:00 +CPU= 30.105
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001704
06:30:13 STEP 1705 H= 426:15 +CPU= 24.358
06:30:38 STEP 1706 H= 426:30 +CPU= 24.491
06:31:02 STEP 1707 H= 426:45 +CPU= 23.634
06:31:27 STEP 1708 H= 427:00 +CPU= 25.396
06:31:52 STEP 1709 H= 427:15 +CPU= 24.341
06:32:16 STEP 1710 H= 427:30 +CPU= 23.813
06:32:41 STEP 1711 H= 427:45 +CPU= 24.432
06:33:07 STEP 1712 H= 428:00 +CPU= 25.576
06:33:31 STEP 1713 H= 428:15 +CPU= 23.594
06:33:56 STEP 1714 H= 428:30 +CPU= 24.467
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:34:41 STEP 1715 H= 428:45 +CPU= 24.317
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:36:00 STEP 1716 H= 429:00 +CPU= 34.631
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001716
06:36:29 STEP 1717 H= 429:15 +CPU= 28.224
06:36:57 STEP 1718 H= 429:30 +CPU= 28.260
06:37:26 STEP 1719 H= 429:45 +CPU= 28.210
06:37:55 STEP 1720 H= 430:00 +CPU= 28.601
06:38:23 STEP 1721 H= 430:15 +CPU= 27.871
06:38:52 STEP 1722 H= 430:30 +CPU= 27.989
06:39:20 STEP 1723 H= 430:45 +CPU= 27.659
06:39:49 STEP 1724 H= 431:00 +CPU= 28.628
06:40:18 STEP 1725 H= 431:15 +CPU= 28.352
06:40:46 STEP 1726 H= 431:30 +CPU= 27.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:41:34 STEP 1727 H= 431:45 +CPU= 27.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:42:34 STEP 1728 H= 432:00 +CPU= 38.232
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001728
06:43:05 STEP 1729 H= 432:15 +CPU= 29.554
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640_17.zip
Uploading the intermediate file: upload_file_17.zip
06:43:36 STEP 1730 H= 432:30 +CPU= 29.893
06:44:06 STEP 1731 H= 432:45 +CPU= 29.016
06:44:36 STEP 1732 H= 433:00 +CPU= 30.075
06:45:06 STEP 1733 H= 433:15 +CPU= 29.714
06:45:37 STEP 1734 H= 433:30 +CPU= 30.232
06:46:08 STEP 1735 H= 433:45 +CPU= 30.091
06:46:37 STEP 1736 H= 434:00 +CPU= 29.433
06:47:08 STEP 1737 H= 434:15 +CPU= 30.322
06:47:39 STEP 1738 H= 434:30 +CPU= 30.390
06:48:09 STEP 1739 H= 434:45 +CPU= 29.793
06:48:47 STEP 1740 H= 435:00 +CPU= 36.502
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001740
06:49:17 STEP 1741 H= 435:15 +CPU= 29.959
06:49:47 STEP 1742 H= 435:30 +CPU= 29.599
06:50:17 STEP 1743 H= 435:45 +CPU= 29.196
06:50:48 STEP 1744 H= 436:00 +CPU= 30.327
06:51:18 STEP 1745 H= 436:15 +CPU= 29.535
06:51:47 STEP 1746 H= 436:30 +CPU= 29.221
06:52:18 STEP 1747 H= 436:45 +CPU= 29.816
06:52:48 STEP 1748 H= 437:00 +CPU= 30.130
06:53:19 STEP 1749 H= 437:15 +CPU= 30.111
06:53:49 STEP 1750 H= 437:30 +CPU= 29.824
06:54:20 STEP 1751 H= 437:45 +CPU= 29.786
06:54:57 STEP 1752 H= 438:00 +CPU= 36.617
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001752
06:55:27 STEP 1753 H= 438:15 +CPU= 30.142
06:55:57 STEP 1754 H= 438:30 +CPU= 29.305
06:56:29 STEP 1755 H= 438:45 +CPU= 30.745
06:56:59 STEP 1756 H= 439:00 +CPU= 30.049
06:57:29 STEP 1757 H= 439:15 +CPU= 29.577
06:58:00 STEP 1758 H= 439:30 +CPU= 29.769
06:58:30 STEP 1759 H= 439:45 +CPU= 29.981
06:59:01 STEP 1760 H= 440:00 +CPU= 30.151
06:59:31 STEP 1761 H= 440:15 +CPU= 30.161
07:00:02 STEP 1762 H= 440:30 +CPU= 29.968
07:00:32 STEP 1763 H= 440:45 +CPU= 29.518
07:01:09 STEP 1764 H= 441:00 +CPU= 37.014
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001764
07:01:40 STEP 1765 H= 441:15 +CPU= 30.256
07:02:11 STEP 1766 H= 441:30 +CPU= 29.919
07:02:41 STEP 1767 H= 441:45 +CPU= 29.591
07:03:12 STEP 1768 H= 442:00 +CPU= 30.418
07:03:42 STEP 1769 H= 442:15 +CPU= 29.471
07:04:13 STEP 1770 H= 442:30 +CPU= 30.279
07:04:43 STEP 1771 H= 442:45 +CPU= 29.787
07:05:14 STEP 1772 H= 443:00 +CPU= 30.359
07:05:44 STEP 1773 H= 443:15 +CPU= 29.550
07:06:14 STEP 1774 H= 443:30 +CPU= 29.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1tj
(argv4) batchid: 1018
(argv5) wuid: 12290686
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ab8a9a2585c1e66802045e9e7a887060 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
ic_ancil_file: ic_ancil_12290686
ifsdata_file: ifsdata_12290686
climate_data_file: clim_data_12290686
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1699efeda3cfa83a238efe5659dd892a to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12290686.xml
-- Model is restarting --
Adjusting last_iter, 1775, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
last_cpu_time: 67950
upload_file_number: 18
last_iter: 1729
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640
The child process has been launched with process id: 71007
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71007:71007] [20240614:071308:1718367188:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:14:02 STEP 1728 H= 432:00 +CPU= 28.469
07:14:29 STEP 1729 H= 432:15 +CPU= 26.468
07:14:57 STEP 1730 H= 432:30 +CPU= 27.161
07:15:24 STEP 1731 H= 432:45 +CPU= 26.418
07:15:52 STEP 1732 H= 433:00 +CPU= 27.705
07:16:19 STEP 1733 H= 433:15 +CPU= 27.365
07:16:46 STEP 1734 H= 433:30 +CPU= 26.417
07:17:14 STEP 1735 H= 433:45 +CPU= 27.024
07:17:41 STEP 1736 H= 434:00 +CPU= 27.273
07:18:09 STEP 1737 H= 434:15 +CPU= 27.593
07:18:37 STEP 1738 H= 434:30 +CPU= 26.739
07:19:04 STEP 1739 H= 434:45 +CPU= 27.273
07:19:39 STEP 1740 H= 435:00 +CPU= 33.807
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001740
07:20:06 STEP 1741 H= 435:15 +CPU= 26.573
07:20:33 STEP 1742 H= 435:30 +CPU= 27.298
07:21:01 STEP 1743 H= 435:45 +CPU= 27.085
07:21:29 STEP 1744 H= 436:00 +CPU= 27.769
07:21:56 STEP 1745 H= 436:15 +CPU= 26.892
07:22:24 STEP 1746 H= 436:30 +CPU= 27.174
07:22:52 STEP 1747 H= 436:45 +CPU= 27.640
07:23:19 STEP 1748 H= 437:00 +CPU= 26.873
07:23:47 STEP 1749 H= 437:15 +CPU= 27.017
07:24:15 STEP 1750 H= 437:30 +CPU= 27.636
07:24:42 STEP 1751 H= 437:45 +CPU= 26.880
07:25:17 STEP 1752 H= 438:00 +CPU= 33.779
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001752
07:25:44 STEP 1753 H= 438:15 +CPU= 27.250
07:26:11 STEP 1754 H= 438:30 +CPU= 26.720
07:26:40 STEP 1755 H= 438:45 +CPU= 27.813
07:27:08 STEP 1756 H= 439:00 +CPU= 27.677
07:27:35 STEP 1757 H= 439:15 +CPU= 26.653
07:28:01 STEP 1758 H= 439:30 +CPU= 26.168
07:28:29 STEP 1759 H= 439:45 +CPU= 27.155
07:28:57 STEP 1760 H= 440:00 +CPU= 27.851
07:29:25 STEP 1761 H= 440:15 +CPU= 27.229
07:29:52 STEP 1762 H= 440:30 +CPU= 27.204
07:30:20 STEP 1763 H= 440:45 +CPU= 26.748
07:30:53 STEP 1764 H= 441:00 +CPU= 33.238
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001764
07:31:21 STEP 1765 H= 441:15 +CPU= 27.346
07:31:48 STEP 1766 H= 441:30 +CPU= 26.355
07:32:16 STEP 1767 H= 441:45 +CPU= 27.309
07:32:44 STEP 1768 H= 442:00 +CPU= 27.694
07:33:11 STEP 1769 H= 442:15 +CPU= 27.077
07:33:38 STEP 1770 H= 442:30 +CPU= 26.578
07:34:05 STEP 1771 H= 442:45 +CPU= 26.534
07:34:33 STEP 1772 H= 443:00 +CPU= 27.393
07:35:01 STEP 1773 H= 443:15 +CPU= 27.653
07:35:29 STEP 1774 H= 443:30 +CPU= 27.136
07:35:56 STEP 1775 H= 443:45 +CPU= 27.221
07:36:33 STEP 1776 H= 444:00 +CPU= 36.577
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001776
07:37:01 STEP 1777 H= 444:15 +CPU= 26.756
07:37:28 STEP 1778 H= 444:30 +CPU= 27.125
07:37:56 STEP 1779 H= 444:45 +CPU= 26.878
07:38:23 STEP 1780 H= 445:00 +CPU= 27.212
07:38:51 STEP 1781 H= 445:15 +CPU= 27.508
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1tj
(argv4) batchid: 1018
(argv5) wuid: 12290686
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ab8a9a2585c1e66802045e9e7a887060 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686.zip
ic_ancil_file: ic_ancil_12290686
ifsdata_file: ifsdata_12290686
climate_data_file: clim_data_12290686
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12290686.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1699efeda3cfa83a238efe5659dd892a to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12290686.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12290686.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12290686.xml
-- Model is restarting --
Adjusting last_iter, 1782, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12290686.xml
last_cpu_time: 69451
upload_file_number: 18
last_iter: 1777
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640
The child process has been launched with process id: 71249
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Gary:1:1:71249:71249] [20240614:074546:1718369146:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:46:41 STEP 1776 H= 444:00 +CPU= 28.535
07:47:08 STEP 1777 H= 444:15 +CPU= 27.216
07:47:36 STEP 1778 H= 444:30 +CPU= 27.369
07:48:04 STEP 1779 H= 444:45 +CPU= 27.229
07:48:32 STEP 1780 H= 445:00 +CPU= 27.807
07:48:59 STEP 1781 H= 445:15 +CPU= 26.772
07:49:27 STEP 1782 H= 445:30 +CPU= 26.974
07:49:54 STEP 1783 H= 445:45 +CPU= 27.116
07:50:22 STEP 1784 H= 446:00 +CPU= 27.910
07:50:50 STEP 1785 H= 446:15 +CPU= 27.165
07:51:17 STEP 1786 H= 446:30 +CPU= 27.044
07:51:44 STEP 1787 H= 446:45 +CPU= 26.602
07:52:18 STEP 1788 H= 447:00 +CPU= 33.324
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001788
07:52:46 STEP 1789 H= 447:15 +CPU= 27.127
07:53:14 STEP 1790 H= 447:30 +CPU= 27.607
07:53:41 STEP 1791 H= 447:45 +CPU= 26.954
07:54:09 STEP 1792 H= 448:00 +CPU= 27.229
07:54:36 STEP 1793 H= 448:15 +CPU= 27.030
07:55:04 STEP 1794 H= 448:30 +CPU= 27.502
07:55:31 STEP 1795 H= 448:45 +CPU= 26.034
07:55:59 STEP 1796 H= 449:00 +CPU= 27.856
07:56:26 STEP 1797 H= 449:15 +CPU= 26.981
07:56:54 STEP 1798 H= 449:30 +CPU= 27.299
07:57:21 STEP 1799 H= 449:45 +CPU= 26.765
07:57:56 STEP 1800 H= 450:00 +CPU= 34.429
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001800
07:58:24 STEP 1801 H= 450:15 +CPU= 27.238
07:58:52 STEP 1802 H= 450:30 +CPU= 27.192
07:59:19 STEP 1803 H= 450:45 +CPU= 27.125
07:59:47 STEP 1804 H= 451:00 +CPU= 27.249
08:00:14 STEP 1805 H= 451:15 +CPU= 26.782
08:00:41 STEP 1806 H= 451:30 +CPU= 26.508
08:01:08 STEP 1807 H= 451:45 +CPU= 26.835
08:01:36 STEP 1808 H= 452:00 +CPU= 27.360
08:02:04 STEP 1809 H= 452:15 +CPU= 27.769
08:02:31 STEP 1810 H= 452:30 +CPU= 26.728
08:02:59 STEP 1811 H= 452:45 +CPU= 27.095
08:03:32 STEP 1812 H= 453:00 +CPU= 33.140
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001812
08:04:00 STEP 1813 H= 453:15 +CPU= 27.592
08:04:28 STEP 1814 H= 453:30 +CPU= 27.533
08:04:55 STEP 1815 H= 453:45 +CPU= 26.738
08:05:23 STEP 1816 H= 454:00 +CPU= 27.580
08:05:51 STEP 1817 H= 454:15 +CPU= 27.133
08:06:18 STEP 1818 H= 454:30 +CPU= 26.623
08:06:45 STEP 1819 H= 454:45 +CPU= 26.821
08:07:13 STEP 1820 H= 455:00 +CPU= 27.176
08:07:41 STEP 1821 H= 455:15 +CPU= 27.735
08:08:09 STEP 1822 H= 455:30 +CPU= 27.594
08:08:36 STEP 1823 H= 455:45 +CPU= 26.379
08:09:14 STEP 1824 H= 456:00 +CPU= 37.082
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:10:00 STEP 1825 H= 456:15 +CPU= 24.182
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001824
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640_18.zip
Uploading the intermediate file: upload_file_18.zip
08:10:27 STEP 1826 H= 456:30 +CPU= 25.964
08:10:52 STEP 1827 H= 456:45 +CPU= 25.436
08:11:19 STEP 1828 H= 457:00 +CPU= 26.450
08:11:46 STEP 1829 H= 457:15 +CPU= 26.040
08:12:12 STEP 1830 H= 457:30 +CPU= 26.084
08:12:38 STEP 1831 H= 457:45 +CPU= 25.336
08:13:05 STEP 1832 H= 458:00 +CPU= 26.712
08:13:31 STEP 1833 H= 458:15 +CPU= 26.131
08:13:58 STEP 1834 H= 458:30 +CPU= 26.365
08:14:25 STEP 1835 H= 458:45 +CPU= 26.443
08:14:58 STEP 1836 H= 459:00 +CPU= 32.786
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001836
08:15:24 STEP 1837 H= 459:15 +CPU= 26.000
08:15:51 STEP 1838 H= 459:30 +CPU= 26.132
08:16:18 STEP 1839 H= 459:45 +CPU= 26.456
08:16:44 STEP 1840 H= 460:00 +CPU= 26.324
08:17:11 STEP 1841 H= 460:15 +CPU= 25.640
08:17:37 STEP 1842 H= 460:30 +CPU= 25.867
08:18:03 STEP 1843 H= 460:45 +CPU= 25.458
08:18:29 STEP 1844 H= 461:00 +CPU= 26.319
08:18:56 STEP 1845 H= 461:15 +CPU= 26.285
08:19:22 STEP 1846 H= 461:30 +CPU= 25.694
08:19:48 STEP 1847 H= 461:45 +CPU= 25.095
08:20:21 STEP 1848 H= 462:00 +CPU= 32.589
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001848
08:20:47 STEP 1849 H= 462:15 +CPU= 26.072
08:21:13 STEP 1850 H= 462:30 +CPU= 25.485
08:21:39 STEP 1851 H= 462:45 +CPU= 25.866
08:22:05 STEP 1852 H= 463:00 +CPU= 25.650
08:22:32 STEP 1853 H= 463:15 +CPU= 25.937
08:22:58 STEP 1854 H= 463:30 +CPU= 25.968
08:23:24 STEP 1855 H= 463:45 +CPU= 25.809
08:23:50 STEP 1856 H= 464:00 +CPU= 25.883
08:24:16 STEP 1857 H= 464:15 +CPU= 25.338
08:24:43 STEP 1858 H= 464:30 +CPU= 26.079
08:25:09 STEP 1859 H= 464:45 +CPU= 25.762
08:25:42 STEP 1860 H= 465:00 +CPU= 32.429
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001860
08:26:08 STEP 1861 H= 465:15 +CPU= 25.632
08:26:34 STEP 1862 H= 465:30 +CPU= 26.140
08:27:00 STEP 1863 H= 465:45 +CPU= 25.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:27:47 STEP 1864 H= 466:00 +CPU= 25.794
08:28:14 STEP 1865 H= 466:15 +CPU= 25.804
08:28:40 STEP 1866 H= 466:30 +CPU= 26.270
08:29:07 STEP 1867 H= 466:45 +CPU= 25.984
08:29:34 STEP 1868 H= 467:00 +CPU= 26.681
08:30:00 STEP 1869 H= 467:15 +CPU= 26.549
08:30:27 STEP 1870 H= 467:30 +CPU= 26.076
08:30:53 STEP 1871 H= 467:45 +CPU= 26.068
08:31:31 STEP 1872 H= 468:00 +CPU= 36.786
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001872
08:31:57 STEP 1873 H= 468:15 +CPU= 25.787
08:32:24 STEP 1874 H= 468:30 +CPU= 26.170
08:32:50 STEP 1875 H= 468:45 +CPU= 26.052
08:33:17 STEP 1876 H= 469:00 +CPU= 26.439
08:33:43 STEP 1877 H= 469:15 +CPU= 25.955
08:34:10 STEP 1878 H= 469:30 +CPU= 26.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:34:57 STEP 1879 H= 469:45 +CPU= 25.880
08:35:24 STEP 1880 H= 470:00 +CPU= 26.465
08:35:51 STEP 1881 H= 470:15 +CPU= 26.737
08:36:17 STEP 1882 H= 470:30 +CPU= 26.082
08:36:44 STEP 1883 H= 470:45 +CPU= 26.298
08:37:17 STEP 1884 H= 471:00 +CPU= 32.110
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001884
08:37:42 STEP 1885 H= 471:15 +CPU= 25.444
08:38:09 STEP 1886 H= 471:30 +CPU= 26.432
08:38:36 STEP 1887 H= 471:45 +CPU= 26.656
08:39:04 STEP 1888 H= 472:00 +CPU= 27.365
08:39:31 STEP 1889 H= 472:15 +CPU= 26.109
08:39:56 STEP 1890 H= 472:30 +CPU= 25.342
08:40:23 STEP 1891 H= 472:45 +CPU= 26.393
08:40:50 STEP 1892 H= 473:00 +CPU= 26.811
08:41:17 STEP 1893 H= 473:15 +CPU= 25.924
08:41:43 STEP 1894 H= 473:30 +CPU= 26.196
08:42:09 STEP 1895 H= 473:45 +CPU= 25.764
08:42:43 STEP 1896 H= 474:00 +CPU= 33.166
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001896
08:43:10 STEP 1897 H= 474:15 +CPU= 26.507
08:43:36 STEP 1898 H= 474:30 +CPU= 26.291
08:44:03 STEP 1899 H= 474:45 +CPU= 26.261
08:44:30 STEP 1900 H= 475:00 +CPU= 26.425
08:44:57 STEP 1901 H= 475:15 +CPU= 26.182
08:45:23 STEP 1902 H= 475:30 +CPU= 26.341
08:45:50 STEP 1903 H= 475:45 +CPU= 26.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:46:33 STEP 1904 H= 476:00 +CPU= 21.617
08:46:56 STEP 1905 H= 476:15 +CPU= 22.911
08:47:20 STEP 1906 H= 476:30 +CPU= 23.309
08:47:43 STEP 1907 H= 476:45 +CPU= 23.385
08:48:13 STEP 1908 H= 477:00 +CPU= 29.360
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001908
08:48:36 STEP 1909 H= 477:15 +CPU= 23.106
08:49:00 STEP 1910 H= 477:30 +CPU= 23.515
08:49:24 STEP 1911 H= 477:45 +CPU= 23.755
08:49:49 STEP 1912 H= 478:00 +CPU= 24.083
08:50:12 STEP 1913 H= 478:15 +CPU= 22.889
08:50:36 STEP 1914 H= 478:30 +CPU= 23.563
08:51:00 STEP 1915 H= 478:45 +CPU= 23.455
08:51:24 STEP 1916 H= 479:00 +CPU= 23.644
08:51:47 STEP 1917 H= 479:15 +CPU= 23.448
08:52:11 STEP 1918 H= 479:30 +CPU= 22.817
08:52:35 STEP 1919 H= 479:45 +CPU= 23.408
08:53:06 STEP 1920 H= 480:00 +CPU= 30.821
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 480.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.3576425322E-21 I 0.9072693797E-07 I
ICloud fractionI 0.0000000000E+00 I 0.2014114905E-01 I
I Relat. Hum. I 0.2303540940E+00 I 0.2917035114E+00 I
I PASS 01 I 0.0000000000E+00 I 0.1191580914E+03 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1920 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001920 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001920
MPI-TASK: 1 - 324568452 BYTES IN 7 RECORDS TRANSFERRED IN 0.0005 SECONDS649136.9 Mbytes/s, TOTAL TIME= 0.0087( 5.7%)
08:53:06 STEP 1920 H= 480:00 +CPU= 30.821
END CNT3
NSTEP = 1920 CNT0 000000000 22.218 22.218 22.577 0.984 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 4290/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 78 0 46 1044068 4290 ************ 8.5 1.4 7.1 2.5 14.5
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 4039639.9 4039639.9 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 4035358.7 4035358.7 99.89 0.00
8 SCAN2M - GRID-POINT DYNAMICS 157 5147.3 5147.3 20.00 0.00
9 SPCM - SPECTRAL COMP. 144 831.1 831.1 2.96 0.00
10 SCAN2M - PHYSICS 145 11956.1 11956.1 42.92 0.00
11 IOPACK - OUTPUT P.P. RESULTS 12 890.4 890.4 0.26 0.00
12 SPNORM - SPECTRAL NORM COMP. 7 64.5 64.5 0.01 0.00
17 GRIDFPOS IN CNT4 12 27.0 27.0 0.01 0.00
27 RESTART FILES - WRITING 3 3561.8 3561.8 0.26 0.00
28 RESTART FILES - READING 1 3641.3 3641.3 0.09 0.00
29 SU4FPOS IN CNT4 12 0.0 0.0 0.00 0.00
30 DYNFPOS IN CNT4 12 5555.0 5555.0 1.65 0.00
31 POSDDH IN STEPO 1 0.8 0.8 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 145 5865.7 5865.7 21.05 0.00
39 SU0YOMB 1 400.3 400.3 0.01 0.00
51 SCAN2M - SL COMM. PART 1 145 27.6 27.6 0.10 0.00
54 SPCM - M TO S/S TO M TRANSP. 144 434.9 434.9 1.55 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 144 66.4 66.4 0.24 0.00
56 SPNORM - SPECTRAL NORM COMM. 7 0.2 0.2 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 316 386.3 386.3 3.02 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 300 221.6 221.6 1.65 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 300 153.0 153.0 1.14 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 316 117.0 117.0 0.92 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 39.3 39.3 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 316 68.6 68.6 0.54 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 300 37.0 37.0 0.27 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 316 106.9 106.9 0.84 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 300 52.1 52.1 0.39 0.00
400 GSTATS 17763 0.0 0.0 0.00 0.00
401 GSTATS HOOK 16473 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 4039.6 CPU TIME 3875.7 VECTOR TIME 3875.7
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 428.2
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/10/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/10/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290686/ICMGGh7zg+001884
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1tj_2016092300_20_1018_12290686_0_r1389027640_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
08:56:35 (71214): called boinc_finish(0)
</stderr_txt>
]]>
