climateprediction.net home page
Task 22274996

Task 22274996

Name oifs_43r3_ps_0809_2003050100_123_972_12189453_0
Workunit 12189453
Created 23 Dec 2022, 6:18:50 UTC
Sent 16 Jan 2023, 16:02:01 UTC
Report deadline 17 Mar 2023, 16:02:01 UTC
Received 17 Jan 2023, 7:35:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1519908
Run time 10 hours 45 min
CPU time 10 hours 24 min 27 sec
Validate state Invalid
Credit 9,313.92
Device peak FLOPS 5.56 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.98 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,682.23 MB
Stderr
<core_client_version>7.16.17</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
jects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_65.zip
Uploading the intermediate file: upload_file_65.zip
  05:14:58 STEP 1585 H=1585:00 +CPU= 14.540
Uploading trickle at timestep: 5702400
  05:15:14 STEP 1586 H=1586:00 +CPU= 14.842
  05:15:38 STEP 1587 H=1587:00 +CPU= 23.180
  05:15:54 STEP 1588 H=1588:00 +CPU= 15.871
  05:16:10 STEP 1589 H=1589:00 +CPU= 15.451
  05:16:35 STEP 1590 H=1590:00 +CPU= 24.295
  05:16:51 STEP 1591 H=1591:00 +CPU= 15.490
  05:17:07 STEP 1592 H=1592:00 +CPU= 15.896
  05:17:32 STEP 1593 H=1593:00 +CPU= 23.861
  05:17:49 STEP 1594 H=1594:00 +CPU= 15.911
  05:18:05 STEP 1595 H=1595:00 +CPU= 15.465
  05:18:32 STEP 1596 H=1596:00 +CPU= 26.369
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001596
  05:18:48 STEP 1597 H=1597:00 +CPU= 15.456
  05:19:04 STEP 1598 H=1598:00 +CPU= 15.912
  05:19:29 STEP 1599 H=1599:00 +CPU= 23.852
  05:19:46 STEP 1600 H=1600:00 +CPU= 15.907
  05:20:02 STEP 1601 H=1601:00 +CPU= 15.491
  05:20:27 STEP 1602 H=1602:00 +CPU= 24.388
  05:20:43 STEP 1603 H=1603:00 +CPU= 15.451
  05:20:59 STEP 1604 H=1604:00 +CPU= 15.889
  05:21:24 STEP 1605 H=1605:00 +CPU= 23.929
  05:21:40 STEP 1606 H=1606:00 +CPU= 15.876
  05:21:57 STEP 1607 H=1607:00 +CPU= 15.918
  05:22:26 STEP 1608 H=1608:00 +CPU= 28.338
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_66.zip
Uploading the intermediate file: upload_file_66.zip
  05:22:42 STEP 1609 H=1609:00 +CPU= 15.459
  05:22:59 STEP 1610 H=1610:00 +CPU= 15.877
  05:23:24 STEP 1611 H=1611:00 +CPU= 23.861
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2003050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0809
(argv4) batchid: 972
(argv5) wuid: 12189453
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f583785e33a05476ea7bf8fe63b15a20 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0809_2003050100_123_972_12189453.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0809_2003050100_123_972_12189453.zip
ic_ancil_file: ic_ancil_12189453
ifsdata_file: ifsdata_12189453
climate_data_file: clim_data_12189453
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_8d9363779299b8bd1ce8b2d0d8f92fa9 to: /var/lib/boinc-client/slots/4/ic_ancil_12189453.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12189453.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5858f49933bbb3ede947e4e434e0ca88 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12189453.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12189453.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12189453.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12189453.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12189453.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12189453.xml
-- Model is restarting --
Adjusting last_iter, 1611, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12189453.xml
last_cpu_time: 29868
upload_file_number: 67
last_iter: 1607
last_upload: 5788800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480
The child process has been launched with process id: 2780294
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2780294:2780294] [20230117:055822:1673931502:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:58:52 STEP 1608 H=1608:00 +CPU= 27.169
  05:59:07 STEP 1609 H=1609:00 +CPU= 15.223
  05:59:24 STEP 1610 H=1610:00 +CPU= 15.829
  05:59:48 STEP 1611 H=1611:00 +CPU= 24.022
  06:00:04 STEP 1612 H=1612:00 +CPU= 15.651
  06:00:21 STEP 1613 H=1613:00 +CPU= 15.444
  06:00:46 STEP 1614 H=1614:00 +CPU= 24.520
  06:01:01 STEP 1615 H=1615:00 +CPU= 15.246
  06:01:18 STEP 1616 H=1616:00 +CPU= 15.887
  06:01:42 STEP 1617 H=1617:00 +CPU= 24.042
  06:01:59 STEP 1618 H=1618:00 +CPU= 15.726
  06:02:15 STEP 1619 H=1619:00 +CPU= 15.436
  06:02:42 STEP 1620 H=1620:00 +CPU= 26.556
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001620
  06:02:57 STEP 1621 H=1621:00 +CPU= 15.248
  06:03:14 STEP 1622 H=1622:00 +CPU= 15.924
  06:03:38 STEP 1623 H=1623:00 +CPU= 24.036
  06:03:54 STEP 1624 H=1624:00 +CPU= 15.689
  06:04:10 STEP 1625 H=1625:00 +CPU= 15.470
  06:04:36 STEP 1626 H=1626:00 +CPU= 24.508
  06:04:52 STEP 1627 H=1627:00 +CPU= 15.213
  06:05:08 STEP 1628 H=1628:00 +CPU= 15.901
  06:05:32 STEP 1629 H=1629:00 +CPU= 23.997
  06:05:49 STEP 1630 H=1630:00 +CPU= 15.666
  06:06:05 STEP 1631 H=1631:00 +CPU= 15.901
  06:06:34 STEP 1632 H=1632:00 +CPU= 28.182
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_67.zip
Uploading the intermediate file: upload_file_67.zip
  06:06:50 STEP 1633 H=1633:00 +CPU= 15.317
  06:07:07 STEP 1634 H=1634:00 +CPU= 15.879
  06:07:31 STEP 1635 H=1635:00 +CPU= 23.829
  06:07:47 STEP 1636 H=1636:00 +CPU= 15.726
  06:08:03 STEP 1637 H=1637:00 +CPU= 15.489
  06:08:28 STEP 1638 H=1638:00 +CPU= 24.307
  06:08:44 STEP 1639 H=1639:00 +CPU= 15.308
  06:09:00 STEP 1640 H=1640:00 +CPU= 15.935
  06:09:25 STEP 1641 H=1641:00 +CPU= 23.847
  06:09:41 STEP 1642 H=1642:00 +CPU= 15.783
  06:09:57 STEP 1643 H=1643:00 +CPU= 15.500
  06:10:24 STEP 1644 H=1644:00 +CPU= 26.211
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001644
  06:10:40 STEP 1645 H=1645:00 +CPU= 15.483
  06:10:57 STEP 1646 H=1646:00 +CPU= 15.949
  06:11:21 STEP 1647 H=1647:00 +CPU= 23.692
  06:11:37 STEP 1648 H=1648:00 +CPU= 15.863
  06:11:53 STEP 1649 H=1649:00 +CPU= 15.442
  06:12:18 STEP 1650 H=1650:00 +CPU= 24.171
  06:12:34 STEP 1651 H=1651:00 +CPU= 15.457
  06:12:50 STEP 1652 H=1652:00 +CPU= 15.849
  06:13:15 STEP 1653 H=1653:00 +CPU= 23.695
  06:13:31 STEP 1654 H=1654:00 +CPU= 15.793
  06:13:47 STEP 1655 H=1655:00 +CPU= 15.814
  06:14:16 STEP 1656 H=1656:00 +CPU= 28.047
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_68.zip
Uploading the intermediate file: upload_file_68.zip
  06:14:32 STEP 1657 H=1657:00 +CPU= 15.369
  06:14:49 STEP 1658 H=1658:00 +CPU= 15.799
  06:15:13 STEP 1659 H=1659:00 +CPU= 23.633
  06:15:29 STEP 1660 H=1660:00 +CPU= 15.798
  06:15:45 STEP 1661 H=1661:00 +CPU= 15.447
  06:16:10 STEP 1662 H=1662:00 +CPU= 24.152
  06:16:26 STEP 1663 H=1663:00 +CPU= 15.373
  06:16:43 STEP 1664 H=1664:00 +CPU= 15.822
  06:17:07 STEP 1665 H=1665:00 +CPU= 23.708
  06:17:24 STEP 1666 H=1666:00 +CPU= 15.813
  06:17:40 STEP 1667 H=1667:00 +CPU= 15.399
  06:18:06 STEP 1668 H=1668:00 +CPU= 25.331
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001668
  06:18:20 STEP 1669 H=1669:00 +CPU= 14.078
  06:18:35 STEP 1670 H=1670:00 +CPU= 14.494
  06:18:58 STEP 1671 H=1671:00 +CPU= 22.165
  06:19:13 STEP 1672 H=1672:00 +CPU= 14.473
  06:19:27 STEP 1673 H=1673:00 +CPU= 14.059
  06:19:51 STEP 1674 H=1674:00 +CPU= 22.611
  06:20:05 STEP 1675 H=1675:00 +CPU= 14.078
  06:20:20 STEP 1676 H=1676:00 +CPU= 14.494
  06:20:43 STEP 1677 H=1677:00 +CPU= 22.147
  06:20:58 STEP 1678 H=1678:00 +CPU= 14.457
  06:21:13 STEP 1679 H=1679:00 +CPU= 14.525
  06:21:40 STEP 1680 H=1680:00 +CPU= 26.329
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_69.zip
Uploading the intermediate file: upload_file_69.zip
  06:21:55 STEP 1681 H=1681:00 +CPU= 14.102
  06:22:10 STEP 1682 H=1682:00 +CPU= 14.495
  06:22:33 STEP 1683 H=1683:00 +CPU= 22.194
  06:22:48 STEP 1684 H=1684:00 +CPU= 14.523
  06:23:02 STEP 1685 H=1685:00 +CPU= 14.091
  06:23:25 STEP 1686 H=1686:00 +CPU= 22.694
  06:23:40 STEP 1687 H=1687:00 +CPU= 14.098
  06:23:55 STEP 1688 H=1688:00 +CPU= 14.519
  06:24:18 STEP 1689 H=1689:00 +CPU= 22.208
  06:24:33 STEP 1690 H=1690:00 +CPU= 14.535
  06:24:47 STEP 1691 H=1691:00 +CPU= 14.084
  06:25:13 STEP 1692 H=1692:00 +CPU= 24.597
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001692
  06:25:27 STEP 1693 H=1693:00 +CPU= 14.122
  06:25:42 STEP 1694 H=1694:00 +CPU= 14.569
  06:26:05 STEP 1695 H=1695:00 +CPU= 22.226
  06:26:20 STEP 1696 H=1696:00 +CPU= 14.513
  06:26:35 STEP 1697 H=1697:00 +CPU= 14.113
  06:26:59 STEP 1698 H=1698:00 +CPU= 22.697
  06:27:13 STEP 1699 H=1699:00 +CPU= 14.083
  06:27:28 STEP 1700 H=1700:00 +CPU= 14.495
  06:27:51 STEP 1701 H=1701:00 +CPU= 22.195
  06:28:05 STEP 1702 H=1702:00 +CPU= 14.470
  06:28:20 STEP 1703 H=1703:00 +CPU= 14.504
  06:28:48 STEP 1704 H=1704:00 +CPU= 26.322
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_70.zip
Uploading the intermediate file: upload_file_70.zip
  06:29:02 STEP 1705 H=1705:00 +CPU= 14.075
  06:29:17 STEP 1706 H=1706:00 +CPU= 14.487
  06:29:40 STEP 1707 H=1707:00 +CPU= 22.256
  06:29:55 STEP 1708 H=1708:00 +CPU= 14.495
  06:30:10 STEP 1709 H=1709:00 +CPU= 14.118
  06:30:33 STEP 1710 H=1710:00 +CPU= 22.722
  06:30:48 STEP 1711 H=1711:00 +CPU= 14.085
  06:31:02 STEP 1712 H=1712:00 +CPU= 14.486
  06:31:25 STEP 1713 H=1713:00 +CPU= 22.245
  06:31:40 STEP 1714 H=1714:00 +CPU= 14.531
  06:31:56 STEP 1715 H=1715:00 +CPU= 14.175
  06:32:21 STEP 1716 H=1716:00 +CPU= 24.599
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001716
  06:32:35 STEP 1717 H=1717:00 +CPU= 14.096
  06:32:50 STEP 1718 H=1718:00 +CPU= 14.524
  06:33:13 STEP 1719 H=1719:00 +CPU= 22.238
  06:33:28 STEP 1720 H=1720:00 +CPU= 14.499
  06:33:43 STEP 1721 H=1721:00 +CPU= 14.118
  06:34:06 STEP 1722 H=1722:00 +CPU= 22.661
  06:34:20 STEP 1723 H=1723:00 +CPU= 14.073
  06:34:35 STEP 1724 H=1724:00 +CPU= 14.517
  06:34:58 STEP 1725 H=1725:00 +CPU= 22.205
  06:35:13 STEP 1726 H=1726:00 +CPU= 14.467
  06:35:28 STEP 1727 H=1727:00 +CPU= 14.486
  06:35:55 STEP 1728 H=1728:00 +CPU= 26.311
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_71.zip
Uploading the intermediate file: upload_file_71.zip
  06:36:10 STEP 1729 H=1729:00 +CPU= 14.125
  06:36:25 STEP 1730 H=1730:00 +CPU= 14.505
  06:36:48 STEP 1731 H=1731:00 +CPU= 22.272
  06:37:03 STEP 1732 H=1732:00 +CPU= 14.517
  06:37:17 STEP 1733 H=1733:00 +CPU= 14.098
  06:37:41 STEP 1734 H=1734:00 +CPU= 22.725
  06:37:56 STEP 1735 H=1735:00 +CPU= 14.102
  06:38:11 STEP 1736 H=1736:00 +CPU= 14.509
  06:38:34 STEP 1737 H=1737:00 +CPU= 22.247
  06:38:49 STEP 1738 H=1738:00 +CPU= 14.544
  06:39:03 STEP 1739 H=1739:00 +CPU= 14.108
  06:39:29 STEP 1740 H=1740:00 +CPU= 24.620
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001740
  06:39:43 STEP 1741 H=1741:00 +CPU= 14.111
  06:39:58 STEP 1742 H=1742:00 +CPU= 14.507
  06:40:21 STEP 1743 H=1743:00 +CPU= 22.251
  06:40:36 STEP 1744 H=1744:00 +CPU= 14.509
  06:40:50 STEP 1745 H=1745:00 +CPU= 14.091
  06:41:14 STEP 1746 H=1746:00 +CPU= 22.738
  06:41:29 STEP 1747 H=1747:00 +CPU= 14.101
  06:41:43 STEP 1748 H=1748:00 +CPU= 14.499
  06:42:06 STEP 1749 H=1749:00 +CPU= 22.260
  06:42:21 STEP 1750 H=1750:00 +CPU= 14.496
  06:42:36 STEP 1751 H=1751:00 +CPU= 14.506
  06:43:04 STEP 1752 H=1752:00 +CPU= 26.371
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_72.zip
Uploading the intermediate file: upload_file_72.zip
  06:43:19 STEP 1753 H=1753:00 +CPU= 14.093
  06:43:34 STEP 1754 H=1754:00 +CPU= 14.590
  06:43:57 STEP 1755 H=1755:00 +CPU= 22.279
  06:44:12 STEP 1756 H=1756:00 +CPU= 14.510
  06:44:26 STEP 1757 H=1757:00 +CPU= 14.125
  06:44:50 STEP 1758 H=1758:00 +CPU= 22.769
  06:45:04 STEP 1759 H=1759:00 +CPU= 14.114
  06:45:19 STEP 1760 H=1760:00 +CPU= 14.530
  06:45:42 STEP 1761 H=1761:00 +CPU= 22.271
  06:45:57 STEP 1762 H=1762:00 +CPU= 14.522
  06:46:12 STEP 1763 H=1763:00 +CPU= 14.124
  06:46:37 STEP 1764 H=1764:00 +CPU= 24.583
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001764
  06:46:52 STEP 1765 H=1765:00 +CPU= 14.148
  06:47:06 STEP 1766 H=1766:00 +CPU= 14.538
  06:47:29 STEP 1767 H=1767:00 +CPU= 22.284
  06:47:45 STEP 1768 H=1768:00 +CPU= 14.574
  06:47:59 STEP 1769 H=1769:00 +CPU= 14.116
  06:48:23 STEP 1770 H=1770:00 +CPU= 22.743
  06:48:37 STEP 1771 H=1771:00 +CPU= 14.159
  06:48:52 STEP 1772 H=1772:00 +CPU= 14.508
  06:49:15 STEP 1773 H=1773:00 +CPU= 22.234
  06:49:30 STEP 1774 H=1774:00 +CPU= 14.527
  06:49:45 STEP 1775 H=1775:00 +CPU= 14.539
  06:50:12 STEP 1776 H=1776:00 +CPU= 26.365
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_73.zip
Uploading the intermediate file: upload_file_73.zip
  06:50:27 STEP 1777 H=1777:00 +CPU= 14.050
  06:50:42 STEP 1778 H=1778:00 +CPU= 14.506
  06:51:04 STEP 1779 H=1779:00 +CPU= 22.285
  06:51:19 STEP 1780 H=1780:00 +CPU= 14.492
  06:51:34 STEP 1781 H=1781:00 +CPU= 14.095
  06:51:58 STEP 1782 H=1782:00 +CPU= 22.756
  06:52:12 STEP 1783 H=1783:00 +CPU= 14.103
  06:52:27 STEP 1784 H=1784:00 +CPU= 14.507
  06:52:50 STEP 1785 H=1785:00 +CPU= 22.266
  06:53:05 STEP 1786 H=1786:00 +CPU= 14.502
  06:53:19 STEP 1787 H=1787:00 +CPU= 14.103
  06:53:45 STEP 1788 H=1788:00 +CPU= 24.664
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001788
  06:54:00 STEP 1789 H=1789:00 +CPU= 14.074
  06:54:14 STEP 1790 H=1790:00 +CPU= 14.496
  06:54:37 STEP 1791 H=1791:00 +CPU= 22.193
  06:54:52 STEP 1792 H=1792:00 +CPU= 14.494
  06:55:07 STEP 1793 H=1793:00 +CPU= 14.080
  06:55:30 STEP 1794 H=1794:00 +CPU= 22.648
  06:55:44 STEP 1795 H=1795:00 +CPU= 14.073
  06:55:59 STEP 1796 H=1796:00 +CPU= 14.484
  06:56:22 STEP 1797 H=1797:00 +CPU= 22.196
  06:56:37 STEP 1798 H=1798:00 +CPU= 14.490
  06:56:52 STEP 1799 H=1799:00 +CPU= 14.587
  06:57:19 STEP 1800 H=1800:00 +CPU= 26.342
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_74.zip
Uploading the intermediate file: upload_file_74.zip
  06:57:34 STEP 1801 H=1801:00 +CPU= 14.103
  06:57:49 STEP 1802 H=1802:00 +CPU= 14.477
  06:58:12 STEP 1803 H=1803:00 +CPU= 22.270
  06:58:27 STEP 1804 H=1804:00 +CPU= 14.535
  06:58:42 STEP 1805 H=1805:00 +CPU= 14.088
  06:59:06 STEP 1806 H=1806:00 +CPU= 22.822
  06:59:20 STEP 1807 H=1807:00 +CPU= 14.152
  06:59:35 STEP 1808 H=1808:00 +CPU= 14.523
  06:59:58 STEP 1809 H=1809:00 +CPU= 22.280
  07:00:13 STEP 1810 H=1810:00 +CPU= 14.529
  07:00:28 STEP 1811 H=1811:00 +CPU= 14.121
  07:00:53 STEP 1812 H=1812:00 +CPU= 24.638
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001812
  07:01:07 STEP 1813 H=1813:00 +CPU= 14.127
  07:01:22 STEP 1814 H=1814:00 +CPU= 14.542
  07:01:45 STEP 1815 H=1815:00 +CPU= 22.281
  07:02:00 STEP 1816 H=1816:00 +CPU= 14.503
  07:02:15 STEP 1817 H=1817:00 +CPU= 14.117
  07:02:38 STEP 1818 H=1818:00 +CPU= 22.716
  07:02:53 STEP 1819 H=1819:00 +CPU= 14.148
  07:03:07 STEP 1820 H=1820:00 +CPU= 14.509
  07:03:31 STEP 1821 H=1821:00 +CPU= 22.284
  07:03:46 STEP 1822 H=1822:00 +CPU= 14.761
  07:04:01 STEP 1823 H=1823:00 +CPU= 14.908
  07:04:30 STEP 1824 H=1824:00 +CPU= 27.972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_75.zip
Uploading the intermediate file: upload_file_75.zip
  07:04:47 STEP 1825 H=1825:00 +CPU= 15.367
  07:05:03 STEP 1826 H=1826:00 +CPU= 15.662
  07:05:27 STEP 1827 H=1827:00 +CPU= 23.734
  07:05:43 STEP 1828 H=1828:00 +CPU= 15.842
  07:05:59 STEP 1829 H=1829:00 +CPU= 15.244
  07:06:24 STEP 1830 H=1830:00 +CPU= 24.320
  07:06:39 STEP 1831 H=1831:00 +CPU= 15.408
  07:06:56 STEP 1832 H=1832:00 +CPU= 15.644
  07:07:20 STEP 1833 H=1833:00 +CPU= 23.802
  07:07:36 STEP 1834 H=1834:00 +CPU= 15.832
  07:07:52 STEP 1835 H=1835:00 +CPU= 15.221
  07:08:19 STEP 1836 H=1836:00 +CPU= 26.361
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001836
  07:08:34 STEP 1837 H=1837:00 +CPU= 15.434
  07:08:51 STEP 1838 H=1838:00 +CPU= 15.605
  07:09:15 STEP 1839 H=1839:00 +CPU= 23.955
  07:09:32 STEP 1840 H=1840:00 +CPU= 15.878
  07:09:47 STEP 1841 H=1841:00 +CPU= 15.157
  07:10:13 STEP 1842 H=1842:00 +CPU= 24.391
  07:10:29 STEP 1843 H=1843:00 +CPU= 15.370
  07:10:45 STEP 1844 H=1844:00 +CPU= 15.553
  07:11:09 STEP 1845 H=1845:00 +CPU= 23.932
  07:11:25 STEP 1846 H=1846:00 +CPU= 15.825
  07:11:41 STEP 1847 H=1847:00 +CPU= 15.620
  07:12:10 STEP 1848 H=1848:00 +CPU= 28.287
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_76.zip
Uploading the intermediate file: upload_file_76.zip
  07:12:26 STEP 1849 H=1849:00 +CPU= 15.390
Uploading trickle at timestep: 6652800
  07:12:43 STEP 1850 H=1850:00 +CPU= 15.595
  07:13:07 STEP 1851 H=1851:00 +CPU= 23.936
  07:13:23 STEP 1852 H=1852:00 +CPU= 15.842
  07:13:39 STEP 1853 H=1853:00 +CPU= 15.119
  07:14:04 STEP 1854 H=1854:00 +CPU= 24.509
  07:14:20 STEP 1855 H=1855:00 +CPU= 15.459
  07:14:36 STEP 1856 H=1856:00 +CPU= 15.628
  07:15:01 STEP 1857 H=1857:00 +CPU= 24.036
  07:15:18 STEP 1858 H=1858:00 +CPU= 15.897
  07:15:33 STEP 1859 H=1859:00 +CPU= 15.175
  07:16:00 STEP 1860 H=1860:00 +CPU= 26.423
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001860
  07:16:16 STEP 1861 H=1861:00 +CPU= 15.359
  07:16:32 STEP 1862 H=1862:00 +CPU= 15.676
  07:16:57 STEP 1863 H=1863:00 +CPU= 24.000
  07:17:13 STEP 1864 H=1864:00 +CPU= 15.703
  07:17:29 STEP 1865 H=1865:00 +CPU= 15.263
  07:17:54 STEP 1866 H=1866:00 +CPU= 24.405
  07:18:09 STEP 1867 H=1867:00 +CPU= 15.257
  07:18:25 STEP 1868 H=1868:00 +CPU= 15.680
  07:18:50 STEP 1869 H=1869:00 +CPU= 23.982
  07:19:06 STEP 1870 H=1870:00 +CPU= 15.640
  07:19:22 STEP 1871 H=1871:00 +CPU= 15.741
  07:19:51 STEP 1872 H=1872:00 +CPU= 28.323
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_77.zip
Uploading the intermediate file: upload_file_77.zip
  07:20:07 STEP 1873 H=1873:00 +CPU= 15.096
  07:20:24 STEP 1874 H=1874:00 +CPU= 15.826
  07:20:49 STEP 1875 H=1875:00 +CPU= 23.913
  07:21:05 STEP 1876 H=1876:00 +CPU= 15.650
  07:21:21 STEP 1877 H=1877:00 +CPU= 15.442
  07:21:46 STEP 1878 H=1878:00 +CPU= 24.388
  07:22:02 STEP 1879 H=1879:00 +CPU= 15.273
  07:22:18 STEP 1880 H=1880:00 +CPU= 15.871
  07:22:42 STEP 1881 H=1881:00 +CPU= 23.984
  07:22:59 STEP 1882 H=1882:00 +CPU= 15.682
  07:23:14 STEP 1883 H=1883:00 +CPU= 15.446
  07:23:41 STEP 1884 H=1884:00 +CPU= 26.403
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001884
  07:23:57 STEP 1885 H=1885:00 +CPU= 15.228
  07:24:13 STEP 1886 H=1886:00 +CPU= 15.820
  07:24:38 STEP 1887 H=1887:00 +CPU= 23.950
  07:24:54 STEP 1888 H=1888:00 +CPU= 15.595
  07:25:10 STEP 1889 H=1889:00 +CPU= 15.340
  07:25:35 STEP 1890 H=1890:00 +CPU= 24.435
  07:25:51 STEP 1891 H=1891:00 +CPU= 15.183
  07:26:07 STEP 1892 H=1892:00 +CPU= 15.864
  07:26:31 STEP 1893 H=1893:00 +CPU= 23.944
  07:26:48 STEP 1894 H=1894:00 +CPU= 15.620
  07:27:04 STEP 1895 H=1895:00 +CPU= 15.861
  07:27:33 STEP 1896 H=1896:00 +CPU= 28.188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_78.zip
Uploading the intermediate file: upload_file_78.zip
  07:27:49 STEP 1897 H=1897:00 +CPU= 15.247
  07:28:05 STEP 1898 H=1898:00 +CPU= 15.802
  07:28:30 STEP 1899 H=1899:00 +CPU= 23.753
  07:28:46 STEP 1900 H=1900:00 +CPU= 15.669
  07:29:02 STEP 1901 H=1901:00 +CPU= 15.421
  07:29:26 STEP 1902 H=1902:00 +CPU= 24.265
  07:29:42 STEP 1903 H=1903:00 +CPU= 15.294
  07:29:59 STEP 1904 H=1904:00 +CPU= 15.883
  07:30:23 STEP 1905 H=1905:00 +CPU= 23.742
  07:30:39 STEP 1906 H=1906:00 +CPU= 15.751
  07:30:56 STEP 1907 H=1907:00 +CPU= 15.424
  07:31:22 STEP 1908 H=1908:00 +CPU= 26.139
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001908
  07:31:38 STEP 1909 H=1909:00 +CPU= 15.437
  07:31:55 STEP 1910 H=1910:00 +CPU= 15.867
  07:32:19 STEP 1911 H=1911:00 +CPU= 23.696
  07:32:35 STEP 1912 H=1912:00 +CPU= 15.824
  07:32:51 STEP 1913 H=1913:00 +CPU= 15.486
  07:33:16 STEP 1914 H=1914:00 +CPU= 24.163
  07:33:32 STEP 1915 H=1915:00 +CPU= 15.371
  07:33:48 STEP 1916 H=1916:00 +CPU= 15.831
  07:34:12 STEP 1917 H=1917:00 +CPU= 23.638
  07:34:29 STEP 1918 H=1918:00 +CPU= 15.832
  07:34:45 STEP 1919 H=1919:00 +CPU= 15.853
  07:35:14 STEP 1920 H=1920:00 +CPU= 28.106
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_79.zip
Uploading the intermediate file: upload_file_79.zip
  07:35:30 STEP 1921 H=1921:00 +CPU= 15.393
  07:35:46 STEP 1922 H=1922:00 +CPU= 15.804
  07:36:11 STEP 1923 H=1923:00 +CPU= 23.721
  07:36:27 STEP 1924 H=1924:00 +CPU= 15.841
  07:36:43 STEP 1925 H=1925:00 +CPU= 15.432
  07:37:08 STEP 1926 H=1926:00 +CPU= 24.229
  07:37:24 STEP 1927 H=1927:00 +CPU= 15.473
  07:37:40 STEP 1928 H=1928:00 +CPU= 15.828
  07:38:05 STEP 1929 H=1929:00 +CPU= 23.745
  07:38:21 STEP 1930 H=1930:00 +CPU= 15.825
  07:38:37 STEP 1931 H=1931:00 +CPU= 15.421
  07:39:04 STEP 1932 H=1932:00 +CPU= 26.284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001932
  07:39:20 STEP 1933 H=1933:00 +CPU= 15.396
  07:39:36 STEP 1934 H=1934:00 +CPU= 15.817
  07:40:00 STEP 1935 H=1935:00 +CPU= 23.815
  07:40:17 STEP 1936 H=1936:00 +CPU= 15.855
  07:40:33 STEP 1937 H=1937:00 +CPU= 15.414
  07:40:57 STEP 1938 H=1938:00 +CPU= 24.250
  07:41:13 STEP 1939 H=1939:00 +CPU= 15.407
  07:41:30 STEP 1940 H=1940:00 +CPU= 15.811
  07:41:54 STEP 1941 H=1941:00 +CPU= 23.818
  07:42:10 STEP 1942 H=1942:00 +CPU= 15.785
  07:42:26 STEP 1943 H=1943:00 +CPU= 15.859
  07:42:56 STEP 1944 H=1944:00 +CPU= 28.214
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_80.zip
Uploading the intermediate file: upload_file_80.zip
  07:43:12 STEP 1945 H=1945:00 +CPU= 15.427
  07:43:28 STEP 1946 H=1946:00 +CPU= 15.827
  07:43:53 STEP 1947 H=1947:00 +CPU= 23.755
  07:44:09 STEP 1948 H=1948:00 +CPU= 15.886
  07:44:25 STEP 1949 H=1949:00 +CPU= 15.410
  07:44:50 STEP 1950 H=1950:00 +CPU= 24.251
  07:45:06 STEP 1951 H=1951:00 +CPU= 15.431
  07:45:22 STEP 1952 H=1952:00 +CPU= 15.843
  07:45:47 STEP 1953 H=1953:00 +CPU= 23.782
  07:46:03 STEP 1954 H=1954:00 +CPU= 15.872
  07:46:19 STEP 1955 H=1955:00 +CPU= 15.360
  07:46:46 STEP 1956 H=1956:00 +CPU= 26.144
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001956
  07:47:02 STEP 1957 H=1957:00 +CPU= 15.417
  07:47:18 STEP 1958 H=1958:00 +CPU= 15.624
  07:47:42 STEP 1959 H=1959:00 +CPU= 23.842
  07:47:59 STEP 1960 H=1960:00 +CPU= 15.859
  07:48:15 STEP 1961 H=1961:00 +CPU= 15.165
  07:48:39 STEP 1962 H=1962:00 +CPU= 24.273
  07:48:55 STEP 1963 H=1963:00 +CPU= 15.432
  07:49:11 STEP 1964 H=1964:00 +CPU= 15.592
  07:49:36 STEP 1965 H=1965:00 +CPU= 23.827
  07:49:52 STEP 1966 H=1966:00 +CPU= 15.813
  07:50:08 STEP 1967 H=1967:00 +CPU= 15.603
  07:50:37 STEP 1968 H=1968:00 +CPU= 28.277
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_81.zip
Uploading the intermediate file: upload_file_81.zip
  07:50:53 STEP 1969 H=1969:00 +CPU= 15.370
  07:51:09 STEP 1970 H=1970:00 +CPU= 15.639
  07:51:34 STEP 1971 H=1971:00 +CPU= 23.942
  07:51:50 STEP 1972 H=1972:00 +CPU= 15.781
  07:52:06 STEP 1973 H=1973:00 +CPU= 15.237
  07:52:31 STEP 1974 H=1974:00 +CPU= 24.386
  07:52:47 STEP 1975 H=1975:00 +CPU= 15.404
  07:53:03 STEP 1976 H=1976:00 +CPU= 15.668
  07:53:27 STEP 1977 H=1977:00 +CPU= 23.973
  07:53:44 STEP 1978 H=1978:00 +CPU= 15.814
  07:54:00 STEP 1979 H=1979:00 +CPU= 15.166
  07:54:27 STEP 1980 H=1980:00 +CPU= 26.429
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001980
  07:54:42 STEP 1981 H=1981:00 +CPU= 15.430
  07:54:58 STEP 1982 H=1982:00 +CPU= 15.627
  07:55:23 STEP 1983 H=1983:00 +CPU= 23.964
  07:55:39 STEP 1984 H=1984:00 +CPU= 15.826
  07:55:55 STEP 1985 H=1985:00 +CPU= 15.133
  07:56:20 STEP 1986 H=1986:00 +CPU= 24.414
  07:56:36 STEP 1987 H=1987:00 +CPU= 15.387
  07:56:52 STEP 1988 H=1988:00 +CPU= 15.518
  07:57:16 STEP 1989 H=1989:00 +CPU= 23.890
  07:57:33 STEP 1990 H=1990:00 +CPU= 15.775
  07:57:49 STEP 1991 H=1991:00 +CPU= 15.595
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2003050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0809
(argv4) batchid: 972
(argv5) wuid: 12189453
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f583785e33a05476ea7bf8fe63b15a20 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0809_2003050100_123_972_12189453.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0809_2003050100_123_972_12189453.zip
ic_ancil_file: ic_ancil_12189453
ifsdata_file: ifsdata_12189453
climate_data_file: clim_data_12189453
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_8d9363779299b8bd1ce8b2d0d8f92fa9 to: /var/lib/boinc-client/slots/4/ic_ancil_12189453.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12189453.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5858f49933bbb3ede947e4e434e0ca88 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12189453.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12189453.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12189453.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12189453.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12189453.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12189453.xml
-- Model is restarting --
Adjusting last_iter, 1992, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12189453.xml
last_cpu_time: 36832
upload_file_number: 82
last_iter: 1991
last_upload: 7084800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480
The child process has been launched with process id: 2803950
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Lenovo-i5-7400:1:1:2803950:2803950] [20230117:080846:1673939326:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:09:14 STEP 1992 H=1992:00 +CPU= 25.053
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_82.zip
Uploading the intermediate file: upload_file_82.zip
  08:09:28 STEP 1993 H=1993:00 +CPU= 14.076
  08:09:43 STEP 1994 H=1994:00 +CPU= 14.452
  08:10:06 STEP 1995 H=1995:00 +CPU= 22.241
  08:10:21 STEP 1996 H=1996:00 +CPU= 14.550
  08:10:36 STEP 1997 H=1997:00 +CPU= 14.056
  08:10:59 STEP 1998 H=1998:00 +CPU= 22.827
  08:11:13 STEP 1999 H=1999:00 +CPU= 14.099
  08:11:28 STEP 2000 H=2000:00 +CPU= 14.649
  08:11:51 STEP 2001 H=2001:00 +CPU= 22.223
  08:12:06 STEP 2002 H=2002:00 +CPU= 14.553
  08:12:21 STEP 2003 H=2003:00 +CPU= 14.075
  08:12:45 STEP 2004 H=2004:00 +CPU= 24.513
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002004
  08:13:00 STEP 2005 H=2005:00 +CPU= 14.120
  08:13:15 STEP 2006 H=2006:00 +CPU= 14.485
  08:13:37 STEP 2007 H=2007:00 +CPU= 22.224
  08:13:52 STEP 2008 H=2008:00 +CPU= 14.502
  08:14:07 STEP 2009 H=2009:00 +CPU= 14.157
  08:14:30 STEP 2010 H=2010:00 +CPU= 22.625
  08:14:44 STEP 2011 H=2011:00 +CPU= 14.059
  08:14:59 STEP 2012 H=2012:00 +CPU= 14.516
  08:15:22 STEP 2013 H=2013:00 +CPU= 22.227
  08:15:37 STEP 2014 H=2014:00 +CPU= 14.449
  08:15:52 STEP 2015 H=2015:00 +CPU= 14.544
  08:16:19 STEP 2016 H=2016:00 +CPU= 26.163
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189453/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0809_2003050100_123_972_12189453_0_r1914144480_83.zip
Uploading the intermediate file: upload_file_83.zip
  08:16:33 STEP 2017 H=2017:00 +CPU= 14.039
  08:16:48 STEP 2018 H=2018:00 +CPU= 14.484
  08:17:11 STEP 2019 H=2019:00 +CPU= 22.253
  08:17:26 STEP 2020 H=2020:00 +CPU= 14.482
  08:17:40 STEP 2021 H=2021:00 +CPU= 14.059
  08:18:03 STEP 2022 H=2022:00 +CPU= 22.739
  08:18:18 STEP 2023 H=2023:00 +CPU= 14.101
  08:18:32 STEP 2024 H=2024:00 +CPU= 14.525
  08:18:55 STEP 2025 H=2025:00 +CPU= 22.283
  08:19:10 STEP 2026 H=2026:00 +CPU= 14.476
  08:19:25 STEP 2027 H=2027:00 +CPU= 14.110
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:23:40 1519908 22274996 oifs_43r3_ps_0809_2003050100_123_972_12189453_0 6,652,800 34,163 0.0051
09 May 2023 16:23:31 1519908 22274996 oifs_43r3_ps_0809_2003050100_123_972_12189453_0 5,702,400 29,371 0.0052
09 May 2023 16:22:52 1519908 22274996 oifs_43r3_ps_0809_2003050100_123_972_12189453_0 1,900,800 9,436 0.0050
09 May 2023 16:22:43 1519908 22274996 oifs_43r3_ps_0809_2003050100_123_972_12189453_0 864,000 4,179 0.0048


©2024 cpdn.org