climateprediction.net home page
Task 22283182

Task 22283182

Name oifs_43r3_ps_0514_2011050100_123_980_12197158_0
Workunit 12197158
Created 24 Dec 2022, 2:33:17 UTC
Sent 18 Jan 2023, 13:43:34 UTC
Report deadline 19 Mar 2023, 13:43:34 UTC
Received 25 Jan 2023, 13:53:26 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1496140
Run time 16 hours 34 min 20 sec
CPU time 16 hours 24 min 47 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.84 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.47 MB
Peak swap size 4,978.07 MB
Peak disk usage 5,525.03 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
s/4/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:50:03 STEP 2521 H=2521:00 +CPU= 15.903
  01:50:20 STEP 2522 H=2522:00 +CPU= 16.354
  01:50:45 STEP 2523 H=2523:00 +CPU= 25.512
  01:51:02 STEP 2524 H=2524:00 +CPU= 16.462
  01:51:18 STEP 2525 H=2525:00 +CPU= 15.994
  01:51:44 STEP 2526 H=2526:00 +CPU= 26.134
  01:52:00 STEP 2527 H=2527:00 +CPU= 16.045
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2011050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0514
(argv4) batchid: 980
(argv5) wuid: 12197158
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56cf61c1e57f20f94c3832044fdca085 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0514_2011050100_123_980_12197158.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0514_2011050100_123_980_12197158.zip
ic_ancil_file: ic_ancil_12197158
ifsdata_file: ifsdata_12197158
climate_data_file: clim_data_12197158
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5cd3c376439cd65cda6f01664a86bed0 to: /var/lib/boinc-client/slots/4/ic_ancil_12197158.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12197158.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0d59bb80166b7cec361b5e52e035687 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12197158.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12197158.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12197158.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12197158.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12197158.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12197158.xml
-- Model is restarting --
Adjusting last_iter, 2527, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12197158.xml
last_cpu_time: 50520
upload_file_number: 105
last_iter: 2519
last_upload: 9072000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848
The child process has been launched with process id: 222325
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:222325:222325] [20230125:025215:1674595335:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  02:52:45 STEP 2520 H=2520:00 +CPU= 28.407
  02:53:01 STEP 2521 H=2521:00 +CPU= 15.523
  02:53:17 STEP 2522 H=2522:00 +CPU= 16.070
  02:53:42 STEP 2523 H=2523:00 +CPU= 25.227
  02:53:58 STEP 2524 H=2524:00 +CPU= 15.977
  02:54:14 STEP 2525 H=2525:00 +CPU= 15.655
  02:54:40 STEP 2526 H=2526:00 +CPU= 25.841
  02:54:56 STEP 2527 H=2527:00 +CPU= 15.742
  02:55:12 STEP 2528 H=2528:00 +CPU= 16.122
  02:55:37 STEP 2529 H=2529:00 +CPU= 25.531
  02:55:54 STEP 2530 H=2530:00 +CPU= 16.185
  02:56:09 STEP 2531 H=2531:00 +CPU= 15.551
  02:56:37 STEP 2532 H=2532:00 +CPU= 27.940
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002532
  02:56:53 STEP 2533 H=2533:00 +CPU= 15.756
  02:57:10 STEP 2534 H=2534:00 +CPU= 16.353
  02:57:35 STEP 2535 H=2535:00 +CPU= 25.136
  02:57:51 STEP 2536 H=2536:00 +CPU= 16.151
  02:58:07 STEP 2537 H=2537:00 +CPU= 15.541
  02:58:32 STEP 2538 H=2538:00 +CPU= 25.450
  02:58:48 STEP 2539 H=2539:00 +CPU= 15.649
  02:59:04 STEP 2540 H=2540:00 +CPU= 16.242
  02:59:29 STEP 2541 H=2541:00 +CPU= 25.253
  02:59:46 STEP 2542 H=2542:00 +CPU= 16.194
  03:00:02 STEP 2543 H=2543:00 +CPU= 16.101
  03:00:31 STEP 2544 H=2544:00 +CPU= 29.581
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_105.zip
Uploading the intermediate file: upload_file_105.zip
  03:00:47 STEP 2545 H=2545:00 +CPU= 15.727
  03:01:03 STEP 2546 H=2546:00 +CPU= 16.146
  03:01:29 STEP 2547 H=2547:00 +CPU= 25.069
  03:01:45 STEP 2548 H=2548:00 +CPU= 16.106
  03:02:00 STEP 2549 H=2549:00 +CPU= 15.500
  03:02:26 STEP 2550 H=2550:00 +CPU= 25.717
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2011050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0514
(argv4) batchid: 980
(argv5) wuid: 12197158
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_56cf61c1e57f20f94c3832044fdca085 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0514_2011050100_123_980_12197158.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0514_2011050100_123_980_12197158.zip
ic_ancil_file: ic_ancil_12197158
ifsdata_file: ifsdata_12197158
climate_data_file: clim_data_12197158
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5cd3c376439cd65cda6f01664a86bed0 to: /var/lib/boinc-client/slots/4/ic_ancil_12197158.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12197158.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0d59bb80166b7cec361b5e52e035687 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12197158.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12197158.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12197158.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12197158.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12197158.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12197158.xml
-- Model is restarting --
Adjusting last_iter, 2551, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12197158.xml
last_cpu_time: 51138
upload_file_number: 106
last_iter: 2543
last_upload: 9158400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848
The child process has been launched with process id: 287564
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:turing:1:1:287564:287564] [20230125:040648:1674599808:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  04:07:18 STEP 2544 H=2544:00 +CPU= 28.708
  04:07:34 STEP 2545 H=2545:00 +CPU= 15.575
  04:07:50 STEP 2546 H=2546:00 +CPU= 15.970
  04:08:15 STEP 2547 H=2547:00 +CPU= 25.040
  04:08:31 STEP 2548 H=2548:00 +CPU= 16.016
  04:08:47 STEP 2549 H=2549:00 +CPU= 15.473
  04:09:13 STEP 2550 H=2550:00 +CPU= 25.806
  04:09:29 STEP 2551 H=2551:00 +CPU= 15.843
  04:09:45 STEP 2552 H=2552:00 +CPU= 16.265
  04:10:10 STEP 2553 H=2553:00 +CPU= 25.142
  04:10:26 STEP 2554 H=2554:00 +CPU= 16.212
  04:10:42 STEP 2555 H=2555:00 +CPU= 15.601
  04:11:10 STEP 2556 H=2556:00 +CPU= 27.938
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002556
  04:11:26 STEP 2557 H=2557:00 +CPU= 15.527
  04:11:42 STEP 2558 H=2558:00 +CPU= 16.119
  04:12:07 STEP 2559 H=2559:00 +CPU= 25.318
  04:12:23 STEP 2560 H=2560:00 +CPU= 16.175
  04:12:39 STEP 2561 H=2561:00 +CPU= 15.685
  04:13:05 STEP 2562 H=2562:00 +CPU= 25.802
  04:13:21 STEP 2563 H=2563:00 +CPU= 15.763
  04:13:37 STEP 2564 H=2564:00 +CPU= 16.077
  04:14:03 STEP 2565 H=2565:00 +CPU= 25.523
  04:14:19 STEP 2566 H=2566:00 +CPU= 16.437
  04:14:36 STEP 2567 H=2567:00 +CPU= 16.388
  04:15:06 STEP 2568 H=2568:00 +CPU= 29.854
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_106.zip
Uploading the intermediate file: upload_file_106.zip
  04:15:21 STEP 2569 H=2569:00 +CPU= 15.742
  04:15:38 STEP 2570 H=2570:00 +CPU= 16.203
  04:16:03 STEP 2571 H=2571:00 +CPU= 25.212
  04:16:19 STEP 2572 H=2572:00 +CPU= 16.263
  04:16:35 STEP 2573 H=2573:00 +CPU= 15.611
  04:17:01 STEP 2574 H=2574:00 +CPU= 25.737
  04:17:16 STEP 2575 H=2575:00 +CPU= 15.737
  04:17:33 STEP 2576 H=2576:00 +CPU= 16.357
  04:17:58 STEP 2577 H=2577:00 +CPU= 25.257
  04:18:14 STEP 2578 H=2578:00 +CPU= 16.180
  04:18:30 STEP 2579 H=2579:00 +CPU= 15.860
  04:18:58 STEP 2580 H=2580:00 +CPU= 27.875
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002580
  04:19:14 STEP 2581 H=2581:00 +CPU= 15.590
  04:19:30 STEP 2582 H=2582:00 +CPU= 16.314
  04:19:56 STEP 2583 H=2583:00 +CPU= 25.202
  04:20:12 STEP 2584 H=2584:00 +CPU= 16.185
  04:20:27 STEP 2585 H=2585:00 +CPU= 15.525
  04:20:53 STEP 2586 H=2586:00 +CPU= 25.587
  04:21:09 STEP 2587 H=2587:00 +CPU= 15.859
  04:21:25 STEP 2588 H=2588:00 +CPU= 16.336
  04:21:51 STEP 2589 H=2589:00 +CPU= 25.264
  04:22:07 STEP 2590 H=2590:00 +CPU= 16.172
  04:22:23 STEP 2591 H=2591:00 +CPU= 16.098
  04:22:53 STEP 2592 H=2592:00 +CPU= 29.746
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_107.zip
Uploading the intermediate file: upload_file_107.zip
  04:23:09 STEP 2593 H=2593:00 +CPU= 15.699
  04:23:25 STEP 2594 H=2594:00 +CPU= 16.228
  04:23:50 STEP 2595 H=2595:00 +CPU= 25.266
  04:24:07 STEP 2596 H=2596:00 +CPU= 16.275
  04:24:22 STEP 2597 H=2597:00 +CPU= 15.475
  04:24:48 STEP 2598 H=2598:00 +CPU= 25.812
  04:25:04 STEP 2599 H=2599:00 +CPU= 15.689
  04:25:20 STEP 2600 H=2600:00 +CPU= 16.115
  04:25:45 STEP 2601 H=2601:00 +CPU= 25.231
  04:26:01 STEP 2602 H=2602:00 +CPU= 16.123
  04:26:17 STEP 2603 H=2603:00 +CPU= 15.753
  04:26:45 STEP 2604 H=2604:00 +CPU= 27.990
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002604
  04:27:01 STEP 2605 H=2605:00 +CPU= 15.651
  04:27:17 STEP 2606 H=2606:00 +CPU= 16.284
  04:27:43 STEP 2607 H=2607:00 +CPU= 25.363
  04:27:59 STEP 2608 H=2608:00 +CPU= 16.211
  04:28:15 STEP 2609 H=2609:00 +CPU= 15.581
  04:28:40 STEP 2610 H=2610:00 +CPU= 25.537
  04:28:56 STEP 2611 H=2611:00 +CPU= 15.587
  04:29:12 STEP 2612 H=2612:00 +CPU= 16.071
  04:29:37 STEP 2613 H=2613:00 +CPU= 25.152
  04:29:53 STEP 2614 H=2614:00 +CPU= 16.088
  04:30:10 STEP 2615 H=2615:00 +CPU= 16.289
  04:30:39 STEP 2616 H=2616:00 +CPU= 29.472
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_108.zip
Uploading the intermediate file: upload_file_108.zip
  04:30:55 STEP 2617 H=2617:00 +CPU= 15.595
  04:31:12 STEP 2618 H=2618:00 +CPU= 16.615
  04:31:37 STEP 2619 H=2619:00 +CPU= 25.139
  04:31:53 STEP 2620 H=2620:00 +CPU= 16.172
  04:32:09 STEP 2621 H=2621:00 +CPU= 15.781
  04:32:35 STEP 2622 H=2622:00 +CPU= 25.687
  04:32:51 STEP 2623 H=2623:00 +CPU= 15.672
  04:33:07 STEP 2624 H=2624:00 +CPU= 16.172
  04:33:32 STEP 2625 H=2625:00 +CPU= 25.224
  04:33:48 STEP 2626 H=2626:00 +CPU= 16.318
  04:34:04 STEP 2627 H=2627:00 +CPU= 15.980
  04:34:32 STEP 2628 H=2628:00 +CPU= 27.872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002628
  04:34:48 STEP 2629 H=2629:00 +CPU= 15.952
  04:35:05 STEP 2630 H=2630:00 +CPU= 16.222
  04:35:30 STEP 2631 H=2631:00 +CPU= 25.094
  04:35:46 STEP 2632 H=2632:00 +CPU= 16.259
  04:36:02 STEP 2633 H=2633:00 +CPU= 15.652
  04:36:28 STEP 2634 H=2634:00 +CPU= 25.732
  04:36:43 STEP 2635 H=2635:00 +CPU= 15.660
  04:37:00 STEP 2636 H=2636:00 +CPU= 16.169
  04:37:25 STEP 2637 H=2637:00 +CPU= 25.192
  04:37:41 STEP 2638 H=2638:00 +CPU= 16.082
  04:37:57 STEP 2639 H=2639:00 +CPU= 16.227
  04:38:27 STEP 2640 H=2640:00 +CPU= 29.824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_109.zip
Uploading the intermediate file: upload_file_109.zip
  04:38:43 STEP 2641 H=2641:00 +CPU= 15.637
  04:38:59 STEP 2642 H=2642:00 +CPU= 16.030
  04:39:24 STEP 2643 H=2643:00 +CPU= 25.294
  04:39:41 STEP 2644 H=2644:00 +CPU= 16.323
  04:39:57 STEP 2645 H=2645:00 +CPU= 15.661
  04:40:23 STEP 2646 H=2646:00 +CPU= 25.974
  04:40:38 STEP 2647 H=2647:00 +CPU= 15.715
  04:40:55 STEP 2648 H=2648:00 +CPU= 16.177
  04:41:20 STEP 2649 H=2649:00 +CPU= 25.248
  04:41:36 STEP 2650 H=2650:00 +CPU= 16.128
  04:41:52 STEP 2651 H=2651:00 +CPU= 15.756
  04:42:20 STEP 2652 H=2652:00 +CPU= 27.859
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002652
  04:42:36 STEP 2653 H=2653:00 +CPU= 15.685
  04:42:52 STEP 2654 H=2654:00 +CPU= 16.172
  04:43:17 STEP 2655 H=2655:00 +CPU= 25.485
  04:43:33 STEP 2656 H=2656:00 +CPU= 16.043
  04:43:49 STEP 2657 H=2657:00 +CPU= 15.596
  04:44:15 STEP 2658 H=2658:00 +CPU= 25.866
  04:44:31 STEP 2659 H=2659:00 +CPU= 15.619
  04:44:47 STEP 2660 H=2660:00 +CPU= 16.198
  04:45:12 STEP 2661 H=2661:00 +CPU= 25.229
  04:45:28 STEP 2662 H=2662:00 +CPU= 16.049
  04:45:45 STEP 2663 H=2663:00 +CPU= 16.199
  04:46:14 STEP 2664 H=2664:00 +CPU= 29.417
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_110.zip
Uploading the intermediate file: upload_file_110.zip
  04:46:30 STEP 2665 H=2665:00 +CPU= 15.727
  04:46:46 STEP 2666 H=2666:00 +CPU= 16.212
  04:47:11 STEP 2667 H=2667:00 +CPU= 25.229
  04:47:28 STEP 2668 H=2668:00 +CPU= 16.217
  04:47:43 STEP 2669 H=2669:00 +CPU= 15.669
  04:48:09 STEP 2670 H=2670:00 +CPU= 25.575
  04:48:25 STEP 2671 H=2671:00 +CPU= 15.638
  04:48:41 STEP 2672 H=2672:00 +CPU= 16.091
  04:49:06 STEP 2673 H=2673:00 +CPU= 24.995
  04:49:22 STEP 2674 H=2674:00 +CPU= 16.138
  04:49:38 STEP 2675 H=2675:00 +CPU= 15.814
  04:50:06 STEP 2676 H=2676:00 +CPU= 27.771
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002676
  04:50:22 STEP 2677 H=2677:00 +CPU= 15.875
  04:50:38 STEP 2678 H=2678:00 +CPU= 16.251
  04:51:04 STEP 2679 H=2679:00 +CPU= 25.337
  04:51:20 STEP 2680 H=2680:00 +CPU= 16.163
  04:51:36 STEP 2681 H=2681:00 +CPU= 15.939
  04:52:02 STEP 2682 H=2682:00 +CPU= 25.684
  04:52:17 STEP 2683 H=2683:00 +CPU= 15.721
  04:52:34 STEP 2684 H=2684:00 +CPU= 16.188
  04:52:59 STEP 2685 H=2685:00 +CPU= 25.050
  04:53:15 STEP 2686 H=2686:00 +CPU= 16.528
  04:53:32 STEP 2687 H=2687:00 +CPU= 16.295
  04:54:01 STEP 2688 H=2688:00 +CPU= 29.658
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_111.zip
Uploading the intermediate file: upload_file_111.zip
  04:54:17 STEP 2689 H=2689:00 +CPU= 15.620
  04:54:33 STEP 2690 H=2690:00 +CPU= 16.168
  04:54:58 STEP 2691 H=2691:00 +CPU= 25.084
  04:55:15 STEP 2692 H=2692:00 +CPU= 16.215
  04:55:30 STEP 2693 H=2693:00 +CPU= 15.673
  04:55:56 STEP 2694 H=2694:00 +CPU= 25.860
  04:56:12 STEP 2695 H=2695:00 +CPU= 15.922
  04:56:29 STEP 2696 H=2696:00 +CPU= 16.283
  04:56:54 STEP 2697 H=2697:00 +CPU= 25.317
  04:57:10 STEP 2698 H=2698:00 +CPU= 16.177
  04:57:26 STEP 2699 H=2699:00 +CPU= 15.740
  04:57:54 STEP 2700 H=2700:00 +CPU= 27.808
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002700
  04:58:10 STEP 2701 H=2701:00 +CPU= 15.572
  04:58:26 STEP 2702 H=2702:00 +CPU= 16.264
  04:58:51 STEP 2703 H=2703:00 +CPU= 25.151
  04:59:07 STEP 2704 H=2704:00 +CPU= 16.255
  04:59:23 STEP 2705 H=2705:00 +CPU= 15.650
  04:59:49 STEP 2706 H=2706:00 +CPU= 26.025
  05:00:05 STEP 2707 H=2707:00 +CPU= 15.436
  05:00:21 STEP 2708 H=2708:00 +CPU= 16.229
  05:00:46 STEP 2709 H=2709:00 +CPU= 25.051
  05:01:02 STEP 2710 H=2710:00 +CPU= 16.192
  05:01:18 STEP 2711 H=2711:00 +CPU= 16.026
  05:01:48 STEP 2712 H=2712:00 +CPU= 29.548
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_112.zip
Uploading the intermediate file: upload_file_112.zip
  05:02:04 STEP 2713 H=2713:00 +CPU= 15.686
  05:02:20 STEP 2714 H=2714:00 +CPU= 16.321
  05:02:46 STEP 2715 H=2715:00 +CPU= 25.297
  05:03:02 STEP 2716 H=2716:00 +CPU= 16.108
  05:03:18 STEP 2717 H=2717:00 +CPU= 15.856
  05:03:44 STEP 2718 H=2718:00 +CPU= 25.811
  05:03:59 STEP 2719 H=2719:00 +CPU= 15.580
  05:04:16 STEP 2720 H=2720:00 +CPU= 16.400
  05:04:41 STEP 2721 H=2721:00 +CPU= 25.407
  05:04:57 STEP 2722 H=2722:00 +CPU= 16.126
  05:05:13 STEP 2723 H=2723:00 +CPU= 15.883
  05:05:41 STEP 2724 H=2724:00 +CPU= 27.639
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002724
  05:05:57 STEP 2725 H=2725:00 +CPU= 15.660
  05:06:13 STEP 2726 H=2726:00 +CPU= 16.148
  05:06:38 STEP 2727 H=2727:00 +CPU= 25.255
  05:06:54 STEP 2728 H=2728:00 +CPU= 16.111
  05:07:10 STEP 2729 H=2729:00 +CPU= 15.633
  05:07:36 STEP 2730 H=2730:00 +CPU= 25.984
  05:07:52 STEP 2731 H=2731:00 +CPU= 15.640
  05:08:08 STEP 2732 H=2732:00 +CPU= 16.130
  05:08:33 STEP 2733 H=2733:00 +CPU= 25.157
  05:08:49 STEP 2734 H=2734:00 +CPU= 16.132
  05:09:06 STEP 2735 H=2735:00 +CPU= 16.216
  05:09:36 STEP 2736 H=2736:00 +CPU= 30.035
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_113.zip
Uploading the intermediate file: upload_file_113.zip
  05:09:52 STEP 2737 H=2737:00 +CPU= 15.732
  05:10:08 STEP 2738 H=2738:00 +CPU= 16.336
  05:10:33 STEP 2739 H=2739:00 +CPU= 25.217
  05:10:50 STEP 2740 H=2740:00 +CPU= 16.298
  05:11:05 STEP 2741 H=2741:00 +CPU= 15.563
  05:11:31 STEP 2742 H=2742:00 +CPU= 25.587
  05:11:47 STEP 2743 H=2743:00 +CPU= 15.863
  05:12:03 STEP 2744 H=2744:00 +CPU= 16.161
  05:12:28 STEP 2745 H=2745:00 +CPU= 25.198
  05:12:45 STEP 2746 H=2746:00 +CPU= 16.265
  05:13:00 STEP 2747 H=2747:00 +CPU= 15.688
  05:13:28 STEP 2748 H=2748:00 +CPU= 28.052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002748
  05:13:44 STEP 2749 H=2749:00 +CPU= 15.661
  05:14:00 STEP 2750 H=2750:00 +CPU= 16.039
  05:14:26 STEP 2751 H=2751:00 +CPU= 25.309
  05:14:42 STEP 2752 H=2752:00 +CPU= 16.277
  05:14:58 STEP 2753 H=2753:00 +CPU= 15.757
  05:15:24 STEP 2754 H=2754:00 +CPU= 25.656
  05:15:39 STEP 2755 H=2755:00 +CPU= 15.817
  05:15:56 STEP 2756 H=2756:00 +CPU= 16.115
  05:16:21 STEP 2757 H=2757:00 +CPU= 25.301
  05:16:37 STEP 2758 H=2758:00 +CPU= 16.258
  05:16:54 STEP 2759 H=2759:00 +CPU= 16.276
  05:17:23 STEP 2760 H=2760:00 +CPU= 29.795
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_114.zip
Uploading the intermediate file: upload_file_114.zip
  05:17:39 STEP 2761 H=2761:00 +CPU= 15.623
  05:17:55 STEP 2762 H=2762:00 +CPU= 16.117
  05:18:21 STEP 2763 H=2763:00 +CPU= 25.238
  05:18:37 STEP 2764 H=2764:00 +CPU= 16.196
  05:18:53 STEP 2765 H=2765:00 +CPU= 15.616
  05:19:19 STEP 2766 H=2766:00 +CPU= 25.944
  05:19:35 STEP 2767 H=2767:00 +CPU= 15.961
  05:19:51 STEP 2768 H=2768:00 +CPU= 16.227
  05:20:16 STEP 2769 H=2769:00 +CPU= 25.335
  05:20:33 STEP 2770 H=2770:00 +CPU= 16.194
  05:20:49 STEP 2771 H=2771:00 +CPU= 15.932
  05:21:17 STEP 2772 H=2772:00 +CPU= 27.963
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002772
  05:21:32 STEP 2773 H=2773:00 +CPU= 15.730
  05:21:49 STEP 2774 H=2774:00 +CPU= 16.220
  05:22:14 STEP 2775 H=2775:00 +CPU= 24.935
  05:22:30 STEP 2776 H=2776:00 +CPU= 16.111
  05:22:46 STEP 2777 H=2777:00 +CPU= 15.735
  05:23:11 STEP 2778 H=2778:00 +CPU= 25.755
  05:23:27 STEP 2779 H=2779:00 +CPU= 15.752
  05:23:43 STEP 2780 H=2780:00 +CPU= 16.119
  05:24:09 STEP 2781 H=2781:00 +CPU= 25.226
  05:24:25 STEP 2782 H=2782:00 +CPU= 16.326
  05:24:41 STEP 2783 H=2783:00 +CPU= 16.198
  05:25:11 STEP 2784 H=2784:00 +CPU= 29.779
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_115.zip
Uploading the intermediate file: upload_file_115.zip
  05:25:27 STEP 2785 H=2785:00 +CPU= 15.733
Uploading trickle at timestep: 10022400
  05:25:43 STEP 2786 H=2786:00 +CPU= 16.227
  05:26:09 STEP 2787 H=2787:00 +CPU= 25.195
  05:26:25 STEP 2788 H=2788:00 +CPU= 16.056
  05:26:40 STEP 2789 H=2789:00 +CPU= 15.564
  05:27:06 STEP 2790 H=2790:00 +CPU= 25.840
  05:27:22 STEP 2791 H=2791:00 +CPU= 15.793
  05:27:38 STEP 2792 H=2792:00 +CPU= 16.071
  05:28:04 STEP 2793 H=2793:00 +CPU= 25.315
  05:28:20 STEP 2794 H=2794:00 +CPU= 16.372
  05:28:36 STEP 2795 H=2795:00 +CPU= 15.721
  05:29:04 STEP 2796 H=2796:00 +CPU= 27.842
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002796
  05:29:19 STEP 2797 H=2797:00 +CPU= 15.646
  05:29:36 STEP 2798 H=2798:00 +CPU= 16.281
  05:30:01 STEP 2799 H=2799:00 +CPU= 25.039
  05:30:17 STEP 2800 H=2800:00 +CPU= 16.278
  05:30:33 STEP 2801 H=2801:00 +CPU= 15.524
  05:30:59 STEP 2802 H=2802:00 +CPU= 25.879
  05:31:14 STEP 2803 H=2803:00 +CPU= 15.686
  05:31:31 STEP 2804 H=2804:00 +CPU= 16.149
  05:31:56 STEP 2805 H=2805:00 +CPU= 25.237
  05:32:12 STEP 2806 H=2806:00 +CPU= 16.146
  05:32:28 STEP 2807 H=2807:00 +CPU= 16.205
  05:32:58 STEP 2808 H=2808:00 +CPU= 29.759
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_116.zip
Uploading the intermediate file: upload_file_116.zip
  05:33:14 STEP 2809 H=2809:00 +CPU= 15.562
  05:33:30 STEP 2810 H=2810:00 +CPU= 16.156
  05:33:55 STEP 2811 H=2811:00 +CPU= 25.109
  05:34:11 STEP 2812 H=2812:00 +CPU= 16.141
  05:34:27 STEP 2813 H=2813:00 +CPU= 15.706
  05:34:53 STEP 2814 H=2814:00 +CPU= 25.912
  05:35:09 STEP 2815 H=2815:00 +CPU= 15.614
  05:35:25 STEP 2816 H=2816:00 +CPU= 16.122
  05:35:50 STEP 2817 H=2817:00 +CPU= 25.284
  05:36:06 STEP 2818 H=2818:00 +CPU= 16.077
  05:36:22 STEP 2819 H=2819:00 +CPU= 15.778
  05:36:50 STEP 2820 H=2820:00 +CPU= 27.883
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002820
  05:37:06 STEP 2821 H=2821:00 +CPU= 15.530
  05:37:22 STEP 2822 H=2822:00 +CPU= 16.279
  05:37:48 STEP 2823 H=2823:00 +CPU= 25.353
  05:38:04 STEP 2824 H=2824:00 +CPU= 16.300
  05:38:20 STEP 2825 H=2825:00 +CPU= 15.563
  05:38:46 STEP 2826 H=2826:00 +CPU= 25.936
  05:39:01 STEP 2827 H=2827:00 +CPU= 15.577
  05:39:17 STEP 2828 H=2828:00 +CPU= 16.122
  05:39:43 STEP 2829 H=2829:00 +CPU= 25.253
  05:39:59 STEP 2830 H=2830:00 +CPU= 16.252
  05:40:15 STEP 2831 H=2831:00 +CPU= 16.303
  05:40:45 STEP 2832 H=2832:00 +CPU= 29.691
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_117.zip
Uploading the intermediate file: upload_file_117.zip
  05:41:01 STEP 2833 H=2833:00 +CPU= 15.781
  05:41:17 STEP 2834 H=2834:00 +CPU= 16.236
  05:41:43 STEP 2835 H=2835:00 +CPU= 25.368
  05:41:59 STEP 2836 H=2836:00 +CPU= 16.193
  05:42:15 STEP 2837 H=2837:00 +CPU= 15.772
  05:42:41 STEP 2838 H=2838:00 +CPU= 25.863
  05:42:56 STEP 2839 H=2839:00 +CPU= 15.651
  05:43:13 STEP 2840 H=2840:00 +CPU= 16.161
  05:43:38 STEP 2841 H=2841:00 +CPU= 25.392
  05:43:54 STEP 2842 H=2842:00 +CPU= 16.108
  05:44:10 STEP 2843 H=2843:00 +CPU= 15.791
  05:44:38 STEP 2844 H=2844:00 +CPU= 28.102
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002844
  05:44:54 STEP 2845 H=2845:00 +CPU= 15.627
  05:45:10 STEP 2846 H=2846:00 +CPU= 16.194
  05:45:36 STEP 2847 H=2847:00 +CPU= 25.343
  05:45:52 STEP 2848 H=2848:00 +CPU= 16.184
  05:46:08 STEP 2849 H=2849:00 +CPU= 15.742
  05:46:34 STEP 2850 H=2850:00 +CPU= 26.030
  05:46:49 STEP 2851 H=2851:00 +CPU= 15.608
  05:47:06 STEP 2852 H=2852:00 +CPU= 16.153
  05:47:31 STEP 2853 H=2853:00 +CPU= 25.433
  05:47:48 STEP 2854 H=2854:00 +CPU= 16.383
  05:48:04 STEP 2855 H=2855:00 +CPU= 16.132
  05:48:34 STEP 2856 H=2856:00 +CPU= 30.065
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_118.zip
Uploading the intermediate file: upload_file_118.zip
  05:48:50 STEP 2857 H=2857:00 +CPU= 15.853
  05:49:06 STEP 2858 H=2858:00 +CPU= 16.234
  05:49:31 STEP 2859 H=2859:00 +CPU= 25.221
  05:49:48 STEP 2860 H=2860:00 +CPU= 16.120
  05:50:03 STEP 2861 H=2861:00 +CPU= 15.567
  05:50:29 STEP 2862 H=2862:00 +CPU= 25.819
  05:50:45 STEP 2863 H=2863:00 +CPU= 15.833
  05:51:01 STEP 2864 H=2864:00 +CPU= 16.271
  05:51:27 STEP 2865 H=2865:00 +CPU= 25.402
  05:51:43 STEP 2866 H=2866:00 +CPU= 16.152
  05:51:59 STEP 2867 H=2867:00 +CPU= 15.853
  05:52:27 STEP 2868 H=2868:00 +CPU= 28.091
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002868
  05:52:43 STEP 2869 H=2869:00 +CPU= 15.572
  05:52:59 STEP 2870 H=2870:00 +CPU= 16.263
  05:53:24 STEP 2871 H=2871:00 +CPU= 25.064
  05:53:40 STEP 2872 H=2872:00 +CPU= 16.054
  05:53:56 STEP 2873 H=2873:00 +CPU= 15.492
  05:54:22 STEP 2874 H=2874:00 +CPU= 25.669
  05:54:37 STEP 2875 H=2875:00 +CPU= 15.635
  05:54:54 STEP 2876 H=2876:00 +CPU= 16.281
  05:55:19 STEP 2877 H=2877:00 +CPU= 24.958
  05:55:35 STEP 2878 H=2878:00 +CPU= 16.031
  05:55:51 STEP 2879 H=2879:00 +CPU= 16.168
  05:56:21 STEP 2880 H=2880:00 +CPU= 29.607
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_119.zip
Uploading the intermediate file: upload_file_119.zip
  05:56:36 STEP 2881 H=2881:00 +CPU= 15.509
  05:56:52 STEP 2882 H=2882:00 +CPU= 16.231
  05:57:18 STEP 2883 H=2883:00 +CPU= 25.156
  05:57:34 STEP 2884 H=2884:00 +CPU= 16.119
  05:57:50 STEP 2885 H=2885:00 +CPU= 15.675
  05:58:15 STEP 2886 H=2886:00 +CPU= 25.838
  05:58:31 STEP 2887 H=2887:00 +CPU= 15.632
  05:58:48 STEP 2888 H=2888:00 +CPU= 16.301
  05:59:13 STEP 2889 H=2889:00 +CPU= 25.194
  05:59:29 STEP 2890 H=2890:00 +CPU= 16.316
  05:59:45 STEP 2891 H=2891:00 +CPU= 15.583
  06:00:13 STEP 2892 H=2892:00 +CPU= 27.899
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002892
  06:00:29 STEP 2893 H=2893:00 +CPU= 15.745
  06:00:45 STEP 2894 H=2894:00 +CPU= 16.345
  06:01:11 STEP 2895 H=2895:00 +CPU= 25.650
  06:01:27 STEP 2896 H=2896:00 +CPU= 16.307
  06:01:43 STEP 2897 H=2897:00 +CPU= 15.743
  06:02:09 STEP 2898 H=2898:00 +CPU= 25.612
  06:02:24 STEP 2899 H=2899:00 +CPU= 15.662
  06:02:40 STEP 2900 H=2900:00 +CPU= 16.136
  06:03:05 STEP 2901 H=2901:00 +CPU= 24.855
  06:03:22 STEP 2902 H=2902:00 +CPU= 16.194
  06:03:38 STEP 2903 H=2903:00 +CPU= 15.998
  06:04:07 STEP 2904 H=2904:00 +CPU= 29.684
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_120.zip
Uploading the intermediate file: upload_file_120.zip
  06:04:23 STEP 2905 H=2905:00 +CPU= 15.672
  06:04:39 STEP 2906 H=2906:00 +CPU= 16.077
  06:05:05 STEP 2907 H=2907:00 +CPU= 25.152
  06:05:21 STEP 2908 H=2908:00 +CPU= 16.172
  06:05:36 STEP 2909 H=2909:00 +CPU= 15.690
  06:06:02 STEP 2910 H=2910:00 +CPU= 25.894
  06:06:18 STEP 2911 H=2911:00 +CPU= 15.577
  06:06:34 STEP 2912 H=2912:00 +CPU= 16.013
  06:06:59 STEP 2913 H=2913:00 +CPU= 25.261
  06:07:16 STEP 2914 H=2914:00 +CPU= 16.197
  06:07:32 STEP 2915 H=2915:00 +CPU= 15.845
  06:08:00 STEP 2916 H=2916:00 +CPU= 28.088
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002916
  06:08:16 STEP 2917 H=2917:00 +CPU= 15.836
  06:08:32 STEP 2918 H=2918:00 +CPU= 16.141
  06:08:57 STEP 2919 H=2919:00 +CPU= 25.255
  06:09:14 STEP 2920 H=2920:00 +CPU= 16.382
  06:09:29 STEP 2921 H=2921:00 +CPU= 15.702
  06:09:55 STEP 2922 H=2922:00 +CPU= 25.765
  06:10:11 STEP 2923 H=2923:00 +CPU= 15.615
  06:10:27 STEP 2924 H=2924:00 +CPU= 16.110
  06:10:53 STEP 2925 H=2925:00 +CPU= 25.365
  06:11:09 STEP 2926 H=2926:00 +CPU= 16.129
  06:11:25 STEP 2927 H=2927:00 +CPU= 16.336
  06:11:55 STEP 2928 H=2928:00 +CPU= 29.732
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_121.zip
Uploading the intermediate file: upload_file_121.zip
  06:12:11 STEP 2929 H=2929:00 +CPU= 15.643
  06:12:27 STEP 2930 H=2930:00 +CPU= 16.083
  06:12:52 STEP 2931 H=2931:00 +CPU= 25.326
  06:13:08 STEP 2932 H=2932:00 +CPU= 16.069
  06:13:24 STEP 2933 H=2933:00 +CPU= 15.829
  06:13:50 STEP 2934 H=2934:00 +CPU= 25.962
  06:14:06 STEP 2935 H=2935:00 +CPU= 15.751
  06:14:22 STEP 2936 H=2936:00 +CPU= 16.203
  06:14:48 STEP 2937 H=2937:00 +CPU= 25.318
  06:15:04 STEP 2938 H=2938:00 +CPU= 16.037
  06:15:20 STEP 2939 H=2939:00 +CPU= 15.929
  06:15:48 STEP 2940 H=2940:00 +CPU= 28.072
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002940
  06:16:04 STEP 2941 H=2941:00 +CPU= 15.817
  06:16:20 STEP 2942 H=2942:00 +CPU= 16.299
  06:16:46 STEP 2943 H=2943:00 +CPU= 25.369
  06:17:02 STEP 2944 H=2944:00 +CPU= 16.180
  06:17:18 STEP 2945 H=2945:00 +CPU= 15.707
  06:17:44 STEP 2946 H=2946:00 +CPU= 25.928
  06:17:59 STEP 2947 H=2947:00 +CPU= 15.740
  06:18:16 STEP 2948 H=2948:00 +CPU= 16.235
  06:18:41 STEP 2949 H=2949:00 +CPU= 25.265
  06:18:57 STEP 2950 H=2950:00 +CPU= 15.986
  06:19:13 STEP 2951 H=2951:00 +CPU= 16.131
  06:19:42 STEP 2952 H=2952:00 +CPU= 28.768
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12197158/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0514_2011050100_123_980_12197158_0_r1211372848_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
06:23:05 (287406): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:02 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 10,623,600 59,087 0.0056
09 May 2023 16:39:59 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 10,022,400 55,833 0.0056
09 May 2023 16:27:58 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 8,467,200 46,796 0.0055
09 May 2023 16:27:52 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 7,603,200 42,003 0.0055
09 May 2023 16:27:41 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 6,739,200 37,300 0.0055
09 May 2023 16:27:36 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 5,875,200 32,580 0.0055
09 May 2023 16:27:31 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 5,011,200 27,824 0.0056
09 May 2023 16:27:08 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 2,592,000 14,317 0.0055
09 May 2023 16:27:02 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 1,728,000 9,560 0.0055
09 May 2023 16:26:49 1496140 22283182 oifs_43r3_ps_0514_2011050100_123_980_12197158_0 864,000 4,794 0.0055


©2024 cpdn.org