Name | oifs_43r3_ps_0959_2007050100_123_976_12193603_0 |
Workunit | 12193603 |
Created | 23 Dec 2022, 17:10:09 UTC |
Sent | 13 Jan 2023, 2:54:53 UTC |
Report deadline | 12 Feb 2023, 2:54:53 UTC |
Received | 14 Jan 2023, 7:12:34 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED |
Computer ID | 1533732 |
Run time | 13 hours 34 min 5 sec |
CPU time | 4 hours 36 min 18 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 5.28 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,416.40 MB |
Peak swap size | 4,978.08 MB |
Peak disk usage | 7,809.49 MB |
Stderr | <core_client_version>7.16.16</core_client_version> <![CDATA[ <message> Disk usage limit exceeded</message> <stderr_txt> nding the child process Resuming the child process 07:44:21 STEP 363 H= 363:00 +CPU= 29.804 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:44:47 STEP 364 H= 364:00 +CPU= 21.588 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:45:12 STEP 365 H= 365:00 +CPU= 18.667 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:45:48 STEP 366 H= 366:00 +CPU= 30.183 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:46:18 STEP 367 H= 367:00 +CPU= 18.696 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:46:38 STEP 368 H= 368:00 +CPU= 17.517 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:47:13 STEP 369 H= 369:00 +CPU= 28.439 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:47:43 STEP 370 H= 370:00 +CPU= 23.600 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:48:10 STEP 371 H= 371:00 +CPU= 18.244 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:48:50 STEP 372 H= 372:00 +CPU= 30.570 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000372 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000372 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000372 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:49:17 STEP 373 H= 373:00 +CPU= 20.376 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:49:44 STEP 374 H= 374:00 +CPU= 20.755 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:50:21 STEP 375 H= 375:00 +CPU= 28.197 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0959 (argv4) batchid: 976 (argv5) wuid: 12193603 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_243726fe9e858de9d2cb9d2777627b6a to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip ic_ancil_file: ic_ancil_12193603 ifsdata_file: ifsdata_12193603 climate_data_file: clim_data_12193603 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_a0b4ec0c04171ae9375958f7e893bb2e to: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bf2eabb8c388a1a6c37d8a9cde361bd6 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12193603.xml -- Model is restarting -- Adjusting last_iter, 376, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml last_cpu_time: 15996 upload_file_number: 15 last_iter: 359 last_upload: 1296000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340 The child process has been launched with process id: 18039 Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18039:18039] [20230114:075133:1673679093:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0959 (argv4) batchid: 976 (argv5) wuid: 12193603 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_243726fe9e858de9d2cb9d2777627b6a to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip ic_ancil_file: ic_ancil_12193603 ifsdata_file: ifsdata_12193603 climate_data_file: clim_data_12193603 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_a0b4ec0c04171ae9375958f7e893bb2e to: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bf2eabb8c388a1a6c37d8a9cde361bd6 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12193603.xml -- Model is restarting -- Adjusting last_iter, 360, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml last_cpu_time: 16005 upload_file_number: 15 last_iter: 359 last_upload: 1296000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340 The child process has been launched with process id: 18047 Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18047:18047] [20230114:075318:1673679198:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0959 (argv4) batchid: 976 (argv5) wuid: 12193603 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_243726fe9e858de9d2cb9d2777627b6a to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip ic_ancil_file: ic_ancil_12193603 ifsdata_file: ifsdata_12193603 climate_data_file: clim_data_12193603 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_a0b4ec0c04171ae9375958f7e893bb2e to: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bf2eabb8c388a1a6c37d8a9cde361bd6 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12193603.xml -- Model is restarting -- Adjusting last_iter, 360, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml last_cpu_time: 16015 upload_file_number: 15 last_iter: 359 last_upload: 1296000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340 The child process has been launched with process id: 18059 Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18059:18059] [20230114:075452:1673679292:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0959 (argv4) batchid: 976 (argv5) wuid: 12193603 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_243726fe9e858de9d2cb9d2777627b6a to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip ic_ancil_file: ic_ancil_12193603 ifsdata_file: ifsdata_12193603 climate_data_file: clim_data_12193603 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_a0b4ec0c04171ae9375958f7e893bb2e to: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bf2eabb8c388a1a6c37d8a9cde361bd6 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12193603.xml -- Model is restarting -- Adjusting last_iter, 360, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml last_cpu_time: 16025 upload_file_number: 15 last_iter: 359 last_upload: 1296000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340 The child process has been launched with process id: 18067 Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18067:18067] [20230114:075643:1673679403:0.028] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0959 (argv4) batchid: 976 (argv5) wuid: 12193603 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/2 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_243726fe9e858de9d2cb9d2777627b6a to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0959_2007050100_123_976_12193603.zip ic_ancil_file: ic_ancil_12193603 ifsdata_file: ifsdata_12193603 climate_data_file: clim_data_12193603 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_a0b4ec0c04171ae9375958f7e893bb2e to: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12193603.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bf2eabb8c388a1a6c37d8a9cde361bd6 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12193603.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12193603.zip Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12193603.xml -- Model is restarting -- Adjusting last_iter, -999, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12193603.xml last_cpu_time: 16027 upload_file_number: 15 last_iter: -985 last_upload: 1296000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340 The child process has been launched with process id: 18075 Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:S525-MDL01:1:1:18075:18075] [20230114:075831:1673679511:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:59:46 STEP 360 H= 360:00 +CPU= 28.807 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:00:06 STEP 361 H= 361:00 +CPU= 15.709 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:00:25 STEP 362 H= 362:00 +CPU= 15.606 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:00:59 STEP 363 H= 363:00 +CPU= 24.652 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:01:26 STEP 364 H= 364:00 +CPU= 17.297 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:01:46 STEP 365 H= 365:00 +CPU= 15.332 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:02:11 STEP 366 H= 366:00 +CPU= 23.071 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:02:30 STEP 367 H= 367:00 +CPU= 14.705 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:02:49 STEP 368 H= 368:00 +CPU= 15.482 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:03:17 STEP 369 H= 369:00 +CPU= 24.298 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:03:36 STEP 370 H= 370:00 +CPU= 15.760 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:03:55 STEP 371 H= 371:00 +CPU= 15.296 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:04:36 STEP 372 H= 372:00 +CPU= 27.521 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000372 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000372 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000372 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:04:55 STEP 373 H= 373:00 +CPU= 15.174 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:05:15 STEP 374 H= 374:00 +CPU= 15.844 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:05:48 STEP 375 H= 375:00 +CPU= 25.854 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:06:08 STEP 376 H= 376:00 +CPU= 15.953 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:06:28 STEP 377 H= 377:00 +CPU= 16.048 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:07:07 STEP 378 H= 378:00 +CPU= 27.391 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:07:37 STEP 379 H= 379:00 +CPU= 16.483 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:07:58 STEP 380 H= 380:00 +CPU= 16.010 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:08:28 STEP 381 H= 381:00 +CPU= 23.855 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:08:47 STEP 382 H= 382:00 +CPU= 15.519 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:09:07 STEP 383 H= 383:00 +CPU= 15.631 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:10:05 STEP 384 H= 384:00 +CPU= 31.138 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000384 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000384 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMGGhq0f+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMSHhq0f+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMUAhq0f+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMGGhq0f+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMSHhq0f+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193603/ICMUAhq0f+000372 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0959_2007050100_123_976_12193603_0_r1859846340_15.zip Uploading the intermediate file: upload_file_15.zip 08:10:23 STEP 385 H= 385:00 +CPU= 16.031 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:10:42 STEP 386 H= 386:00 +CPU= 17.074 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:11:26 STEP 387 H= 387:00 +CPU= 26.370 Abort request received from BOINC client, ending the child process </stderr_txt> ]]> |
No trickles! |
---|
©2024 climateprediction.net