climateprediction.net home page
Task 22299467

Task 22299467

Name oifs_43r3_ps_0443_1984050100_123_953_12170087_1
Workunit 12170087
Created 18 Jan 2023, 14:58:03 UTC
Sent 18 Jan 2023, 15:10:30 UTC
Report deadline 19 Mar 2023, 15:10:30 UTC
Received 19 Jan 2023, 3:34:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1478928
Run time 11 hours 56 min 31 sec
CPU time 11 hours 56 min 31 sec
Validate state Invalid
Credit 11,491.20
Device peak FLOPS 8.02 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,763.80 MB
Peak swap size 4,980.86 MB
Peak disk usage 7,406.35 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5575fe8a5642211647f8b0bf4d0e224d to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0443_1984050100_123_953_12170087.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0443_1984050100_123_953_12170087.zip
ic_ancil_file: ic_ancil_12170087
ifsdata_file: ifsdata_12170087
climate_data_file: clim_data_12170087
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f3c810164c628f229e4bdfa3cce615da to: /var/lib/boinc-client/slots/0/ic_ancil_12170087.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12170087.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9a4b069fb8d1e2509b420ddaa70c61b1 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12170087.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12170087.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12170087.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12170087.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12170087.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12170087.xml
-- Model is restarting --
Adjusting last_iter, 2060, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12170087.xml
last_cpu_time: 35387
upload_file_number: 85
last_iter: 2039
last_upload: 7344000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041
The child process has been launched with process id: 2020811
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2020811:2020811] [20230118:212219:1674091339:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  21:22:46 STEP 2040 H=2040:00 +CPU= 24.161
  21:22:59 STEP 2041 H=2041:00 +CPU= 13.404
  21:23:13 STEP 2042 H=2042:00 +CPU= 13.362
  21:23:33 STEP 2043 H=2043:00 +CPU= 20.393
  21:23:48 STEP 2044 H=2044:00 +CPU= 14.326
  21:24:02 STEP 2045 H=2045:00 +CPU= 14.310
  21:24:24 STEP 2046 H=2046:00 +CPU= 21.608
  21:24:37 STEP 2047 H=2047:00 +CPU= 13.384
  21:24:51 STEP 2048 H=2048:00 +CPU= 13.601
  21:25:12 STEP 2049 H=2049:00 +CPU= 20.699
  21:25:26 STEP 2050 H=2050:00 +CPU= 14.292
  21:25:40 STEP 2051 H=2051:00 +CPU= 13.376
  21:26:02 STEP 2052 H=2052:00 +CPU= 22.611
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002052
  21:26:15 STEP 2053 H=2053:00 +CPU= 13.155
  21:26:30 STEP 2054 H=2054:00 +CPU= 14.121
  21:26:51 STEP 2055 H=2055:00 +CPU= 20.997
  21:27:04 STEP 2056 H=2056:00 +CPU= 13.263
  21:27:18 STEP 2057 H=2057:00 +CPU= 13.324
  21:27:38 STEP 2058 H=2058:00 +CPU= 20.785
  21:27:52 STEP 2059 H=2059:00 +CPU= 13.884
  21:28:07 STEP 2060 H=2060:00 +CPU= 14.277
  21:28:27 STEP 2061 H=2061:00 +CPU= 20.180
  21:28:43 STEP 2062 H=2062:00 +CPU= 13.316
  21:28:57 STEP 2063 H=2063:00 +CPU= 13.643
  21:29:23 STEP 2064 H=2064:00 +CPU= 26.444
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_85.zip
Uploading the intermediate file: upload_file_85.zip
  21:29:36 STEP 2065 H=2065:00 +CPU= 13.250
  21:29:50 STEP 2066 H=2066:00 +CPU= 13.211
  21:30:10 STEP 2067 H=2067:00 +CPU= 20.813
  21:30:25 STEP 2068 H=2068:00 +CPU= 14.177
  21:30:39 STEP 2069 H=2069:00 +CPU= 14.135
  21:31:00 STEP 2070 H=2070:00 +CPU= 20.908
  21:31:13 STEP 2071 H=2071:00 +CPU= 13.554
  21:31:27 STEP 2072 H=2072:00 +CPU= 13.422
  21:31:47 STEP 2073 H=2073:00 +CPU= 20.154
  21:32:01 STEP 2074 H=2074:00 +CPU= 13.778
  21:32:14 STEP 2075 H=2075:00 +CPU= 13.065
  21:32:37 STEP 2076 H=2076:00 +CPU= 22.633
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002076
  21:32:51 STEP 2077 H=2077:00 +CPU= 14.212
  21:33:04 STEP 2078 H=2078:00 +CPU= 13.176
  21:33:26 STEP 2079 H=2079:00 +CPU= 21.096
  21:33:40 STEP 2080 H=2080:00 +CPU= 13.739
  21:33:53 STEP 2081 H=2081:00 +CPU= 12.982
  21:34:14 STEP 2082 H=2082:00 +CPU= 20.558
  21:34:27 STEP 2083 H=2083:00 +CPU= 13.492
  21:34:41 STEP 2084 H=2084:00 +CPU= 13.579
  21:35:02 STEP 2085 H=2085:00 +CPU= 20.780
  21:35:16 STEP 2086 H=2086:00 +CPU= 14.506
  21:35:30 STEP 2087 H=2087:00 +CPU= 13.643
  21:35:54 STEP 2088 H=2088:00 +CPU= 23.795
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_86.zip
Uploading the intermediate file: upload_file_86.zip
  21:36:07 STEP 2089 H=2089:00 +CPU= 13.381
  21:36:21 STEP 2090 H=2090:00 +CPU= 13.908
  21:36:42 STEP 2091 H=2091:00 +CPU= 21.152
  21:36:56 STEP 2092 H=2092:00 +CPU= 13.841
  21:37:09 STEP 2093 H=2093:00 +CPU= 13.101
  21:37:30 STEP 2094 H=2094:00 +CPU= 20.743
  21:37:45 STEP 2095 H=2095:00 +CPU= 14.389
  21:37:59 STEP 2096 H=2096:00 +CPU= 13.523
  21:38:18 STEP 2097 H=2097:00 +CPU= 19.728
  21:38:32 STEP 2098 H=2098:00 +CPU= 13.959
  21:38:46 STEP 2099 H=2099:00 +CPU= 13.125
  21:39:10 STEP 2100 H=2100:00 +CPU= 23.842
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002100
  21:39:23 STEP 2101 H=2101:00 +CPU= 13.254
  21:39:36 STEP 2102 H=2102:00 +CPU= 13.386
  21:39:57 STEP 2103 H=2103:00 +CPU= 20.444
  21:40:11 STEP 2104 H=2104:00 +CPU= 13.911
  21:40:25 STEP 2105 H=2105:00 +CPU= 14.247
  21:40:46 STEP 2106 H=2106:00 +CPU= 20.737
  21:40:59 STEP 2107 H=2107:00 +CPU= 13.190
  21:41:13 STEP 2108 H=2108:00 +CPU= 13.286
  21:41:33 STEP 2109 H=2109:00 +CPU= 20.788
  21:41:48 STEP 2110 H=2110:00 +CPU= 14.704
  21:42:02 STEP 2111 H=2111:00 +CPU= 13.387
  21:42:26 STEP 2112 H=2112:00 +CPU= 24.093
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_87.zip
Uploading the intermediate file: upload_file_87.zip
  21:42:39 STEP 2113 H=2113:00 +CPU= 12.991
  21:42:52 STEP 2114 H=2114:00 +CPU= 13.102
  21:43:13 STEP 2115 H=2115:00 +CPU= 20.540
  21:43:26 STEP 2116 H=2116:00 +CPU= 13.275
  21:43:39 STEP 2117 H=2117:00 +CPU= 12.689
  21:44:00 STEP 2118 H=2118:00 +CPU= 21.168
  21:44:14 STEP 2119 H=2119:00 +CPU= 13.428
  21:44:27 STEP 2120 H=2120:00 +CPU= 13.276
  21:44:48 STEP 2121 H=2121:00 +CPU= 20.596
  21:45:02 STEP 2122 H=2122:00 +CPU= 14.092
  21:45:15 STEP 2123 H=2123:00 +CPU= 13.318
  21:45:39 STEP 2124 H=2124:00 +CPU= 23.646
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002124
  21:45:52 STEP 2125 H=2125:00 +CPU= 12.802
  21:46:05 STEP 2126 H=2126:00 +CPU= 13.117
  21:46:26 STEP 2127 H=2127:00 +CPU= 20.712
  21:46:40 STEP 2128 H=2128:00 +CPU= 14.607
  21:46:54 STEP 2129 H=2129:00 +CPU= 13.896
  21:47:15 STEP 2130 H=2130:00 +CPU= 21.075
  21:47:29 STEP 2131 H=2131:00 +CPU= 13.667
  21:47:43 STEP 2132 H=2132:00 +CPU= 13.358
  21:48:04 STEP 2133 H=2133:00 +CPU= 21.174
  21:48:18 STEP 2134 H=2134:00 +CPU= 13.673
  21:48:32 STEP 2135 H=2135:00 +CPU= 14.013
  21:48:57 STEP 2136 H=2136:00 +CPU= 24.557
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_88.zip
Uploading the intermediate file: upload_file_88.zip
  21:49:11 STEP 2137 H=2137:00 +CPU= 13.662
  21:49:26 STEP 2138 H=2138:00 +CPU= 13.974
  21:49:49 STEP 2139 H=2139:00 +CPU= 22.473
  21:50:04 STEP 2140 H=2140:00 +CPU= 14.819
  21:50:18 STEP 2141 H=2141:00 +CPU= 13.832
  21:50:39 STEP 2142 H=2142:00 +CPU= 21.404
  21:50:54 STEP 2143 H=2143:00 +CPU= 14.774
  21:51:08 STEP 2144 H=2144:00 +CPU= 13.648
  21:51:30 STEP 2145 H=2145:00 +CPU= 21.817
  21:51:45 STEP 2146 H=2146:00 +CPU= 14.522
  21:51:58 STEP 2147 H=2147:00 +CPU= 12.929
  21:52:21 STEP 2148 H=2148:00 +CPU= 23.691
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002148
  21:52:34 STEP 2149 H=2149:00 +CPU= 13.155
  21:52:48 STEP 2150 H=2150:00 +CPU= 13.361
  21:53:11 STEP 2151 H=2151:00 +CPU= 22.602
  21:53:25 STEP 2152 H=2152:00 +CPU= 14.648
  21:53:40 STEP 2153 H=2153:00 +CPU= 14.237
  21:54:03 STEP 2154 H=2154:00 +CPU= 22.797
  21:54:17 STEP 2155 H=2155:00 +CPU= 14.002
  21:54:31 STEP 2156 H=2156:00 +CPU= 13.864
  21:54:51 STEP 2157 H=2157:00 +CPU= 20.664
  21:55:06 STEP 2158 H=2158:00 +CPU= 14.519
  21:55:21 STEP 2159 H=2159:00 +CPU= 14.370
  21:55:46 STEP 2160 H=2160:00 +CPU= 25.049
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_89.zip
Uploading the intermediate file: upload_file_89.zip
  21:55:59 STEP 2161 H=2161:00 +CPU= 13.284
  21:56:13 STEP 2162 H=2162:00 +CPU= 13.555
  21:56:34 STEP 2163 H=2163:00 +CPU= 21.585
  21:56:49 STEP 2164 H=2164:00 +CPU= 14.521
  21:57:03 STEP 2165 H=2165:00 +CPU= 14.030
  21:57:24 STEP 2166 H=2166:00 +CPU= 21.180
  21:57:38 STEP 2167 H=2167:00 +CPU= 13.203
  21:57:51 STEP 2168 H=2168:00 +CPU= 13.313
  21:58:13 STEP 2169 H=2169:00 +CPU= 22.307
  21:58:28 STEP 2170 H=2170:00 +CPU= 14.648
  21:58:41 STEP 2171 H=2171:00 +CPU= 13.093
  21:59:04 STEP 2172 H=2172:00 +CPU= 22.630
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002172
  21:59:17 STEP 2173 H=2173:00 +CPU= 13.214
  21:59:31 STEP 2174 H=2174:00 +CPU= 13.976
  21:59:54 STEP 2175 H=2175:00 +CPU= 22.382
  22:00:07 STEP 2176 H=2176:00 +CPU= 13.744
  22:00:21 STEP 2177 H=2177:00 +CPU= 13.166
  22:00:42 STEP 2178 H=2178:00 +CPU= 21.280
  22:00:56 STEP 2179 H=2179:00 +CPU= 13.595
  22:01:11 STEP 2180 H=2180:00 +CPU= 15.020
  22:01:33 STEP 2181 H=2181:00 +CPU= 21.249
  22:01:47 STEP 2182 H=2182:00 +CPU= 13.798
  22:02:00 STEP 2183 H=2183:00 +CPU= 13.433
  22:02:24 STEP 2184 H=2184:00 +CPU= 24.015
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_90.zip
Uploading the intermediate file: upload_file_90.zip
  22:02:39 STEP 2185 H=2185:00 +CPU= 14.400
  22:02:53 STEP 2186 H=2186:00 +CPU= 14.549
  22:03:15 STEP 2187 H=2187:00 +CPU= 21.721
  22:03:29 STEP 2188 H=2188:00 +CPU= 13.575
  22:03:42 STEP 2189 H=2189:00 +CPU= 12.812
  22:04:03 STEP 2190 H=2190:00 +CPU= 20.894
  22:04:17 STEP 2191 H=2191:00 +CPU= 14.059
  22:04:31 STEP 2192 H=2192:00 +CPU= 14.409
  22:04:52 STEP 2193 H=2193:00 +CPU= 20.388
  22:05:05 STEP 2194 H=2194:00 +CPU= 13.617
  22:05:19 STEP 2195 H=2195:00 +CPU= 13.169
  22:05:42 STEP 2196 H=2196:00 +CPU= 23.662
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002196
  22:05:57 STEP 2197 H=2197:00 +CPU= 15.071
  22:06:12 STEP 2198 H=2198:00 +CPU= 14.517
  22:06:32 STEP 2199 H=2199:00 +CPU= 20.349
  22:06:46 STEP 2200 H=2200:00 +CPU= 13.740
  22:07:00 STEP 2201 H=2201:00 +CPU= 13.282
  22:07:22 STEP 2202 H=2202:00 +CPU= 22.121
  22:07:35 STEP 2203 H=2203:00 +CPU= 13.715
  22:07:49 STEP 2204 H=2204:00 +CPU= 13.203
  22:08:09 STEP 2205 H=2205:00 +CPU= 20.212
  22:08:23 STEP 2206 H=2206:00 +CPU= 13.635
  22:08:37 STEP 2207 H=2207:00 +CPU= 14.417
  22:09:04 STEP 2208 H=2208:00 +CPU= 26.226
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_91.zip
Uploading the intermediate file: upload_file_91.zip
  22:09:17 STEP 2209 H=2209:00 +CPU= 13.158
  22:09:30 STEP 2210 H=2210:00 +CPU= 13.084
  22:09:50 STEP 2211 H=2211:00 +CPU= 20.450
  22:10:04 STEP 2212 H=2212:00 +CPU= 13.637
  22:10:22 STEP 2213 H=2213:00 +CPU= 12.117
  22:10:45 STEP 2214 H=2214:00 +CPU= 23.255
  22:11:00 STEP 2215 H=2215:00 +CPU= 14.516
  22:11:13 STEP 2216 H=2216:00 +CPU= 13.594
  22:11:34 STEP 2217 H=2217:00 +CPU= 20.841
  22:11:48 STEP 2218 H=2218:00 +CPU= 13.542
  22:12:01 STEP 2219 H=2219:00 +CPU= 13.475
  22:12:26 STEP 2220 H=2220:00 +CPU= 24.373
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002220
  22:12:39 STEP 2221 H=2221:00 +CPU= 13.334
  22:12:53 STEP 2222 H=2222:00 +CPU= 13.795
  22:13:13 STEP 2223 H=2223:00 +CPU= 20.364
  22:13:28 STEP 2224 H=2224:00 +CPU= 14.430
  22:13:42 STEP 2225 H=2225:00 +CPU= 14.073
  22:14:03 STEP 2226 H=2226:00 +CPU= 20.953
  22:14:16 STEP 2227 H=2227:00 +CPU= 13.309
  22:14:30 STEP 2228 H=2228:00 +CPU= 13.583
  22:14:52 STEP 2229 H=2229:00 +CPU= 22.109
  22:15:08 STEP 2230 H=2230:00 +CPU= 15.352
  22:15:24 STEP 2231 H=2231:00 +CPU= 15.574
  22:15:49 STEP 2232 H=2232:00 +CPU= 24.904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_92.zip
Uploading the intermediate file: upload_file_92.zip
  22:16:02 STEP 2233 H=2233:00 +CPU= 13.216
  22:16:16 STEP 2234 H=2234:00 +CPU= 13.821
  22:16:37 STEP 2235 H=2235:00 +CPU= 20.877
  22:16:52 STEP 2236 H=2236:00 +CPU= 15.041
  22:17:06 STEP 2237 H=2237:00 +CPU= 13.867
  22:17:27 STEP 2238 H=2238:00 +CPU= 20.772
  22:17:40 STEP 2239 H=2239:00 +CPU= 13.274
  22:17:54 STEP 2240 H=2240:00 +CPU= 13.575
  22:18:15 STEP 2241 H=2241:00 +CPU= 21.718
  22:18:31 STEP 2242 H=2242:00 +CPU= 15.189
  22:18:44 STEP 2243 H=2243:00 +CPU= 13.551
  22:19:07 STEP 2244 H=2244:00 +CPU= 22.595
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002244
  22:19:20 STEP 2245 H=2245:00 +CPU= 13.368
  22:19:34 STEP 2246 H=2246:00 +CPU= 13.778
  22:19:57 STEP 2247 H=2247:00 +CPU= 22.059
  22:20:11 STEP 2248 H=2248:00 +CPU= 14.855
  22:20:25 STEP 2249 H=2249:00 +CPU= 13.195
  22:20:45 STEP 2250 H=2250:00 +CPU= 20.617
  22:20:58 STEP 2251 H=2251:00 +CPU= 13.003
  22:21:12 STEP 2252 H=2252:00 +CPU= 13.526
  22:21:34 STEP 2253 H=2253:00 +CPU= 21.823
  22:21:50 STEP 2254 H=2254:00 +CPU= 15.015
  22:22:04 STEP 2255 H=2255:00 +CPU= 13.993
  22:22:28 STEP 2256 H=2256:00 +CPU= 23.987
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_93.zip
Uploading the intermediate file: upload_file_93.zip
  22:22:41 STEP 2257 H=2257:00 +CPU= 13.312
  22:22:55 STEP 2258 H=2258:00 +CPU= 13.448
  22:23:18 STEP 2259 H=2259:00 +CPU= 22.531
  22:23:32 STEP 2260 H=2260:00 +CPU= 14.014
  22:23:46 STEP 2261 H=2261:00 +CPU= 14.115
  22:24:09 STEP 2262 H=2262:00 +CPU= 22.785
  22:24:22 STEP 2263 H=2263:00 +CPU= 13.346
  22:24:35 STEP 2264 H=2264:00 +CPU= 12.980
  22:24:56 STEP 2265 H=2265:00 +CPU= 20.753
  22:25:10 STEP 2266 H=2266:00 +CPU= 14.012
  22:25:24 STEP 2267 H=2267:00 +CPU= 14.108
  22:25:48 STEP 2268 H=2268:00 +CPU= 24.048
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002268
  22:26:02 STEP 2269 H=2269:00 +CPU= 13.266
  22:26:15 STEP 2270 H=2270:00 +CPU= 13.224
  22:26:36 STEP 2271 H=2271:00 +CPU= 20.558
  22:26:50 STEP 2272 H=2272:00 +CPU= 14.642
  22:27:04 STEP 2273 H=2273:00 +CPU= 13.695
  22:27:27 STEP 2274 H=2274:00 +CPU= 22.213
  22:27:40 STEP 2275 H=2275:00 +CPU= 13.279
  22:27:53 STEP 2276 H=2276:00 +CPU= 12.827
  22:28:14 STEP 2277 H=2277:00 +CPU= 20.668
  22:28:28 STEP 2278 H=2278:00 +CPU= 14.707
  22:28:43 STEP 2279 H=2279:00 +CPU= 14.281
  22:29:11 STEP 2280 H=2280:00 +CPU= 25.248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_94.zip
Uploading the intermediate file: upload_file_94.zip
  22:29:25 STEP 2281 H=2281:00 +CPU= 13.147
  22:29:38 STEP 2282 H=2282:00 +CPU= 13.123
Uploading trickle at timestep: 8208000
  22:29:59 STEP 2283 H=2283:00 +CPU= 20.659
  22:30:13 STEP 2284 H=2284:00 +CPU= 14.441
  22:30:39 STEP 2285 H=2285:00 +CPU= 15.017
  22:31:01 STEP 2286 H=2286:00 +CPU= 21.805
  22:31:15 STEP 2287 H=2287:00 +CPU= 13.139
  22:31:28 STEP 2288 H=2288:00 +CPU= 13.570
  22:31:49 STEP 2289 H=2289:00 +CPU= 20.877
  22:32:04 STEP 2290 H=2290:00 +CPU= 14.918
  22:32:18 STEP 2291 H=2291:00 +CPU= 14.049
  22:32:41 STEP 2292 H=2292:00 +CPU= 22.770
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002292
  22:32:54 STEP 2293 H=2293:00 +CPU= 13.297
  22:33:08 STEP 2294 H=2294:00 +CPU= 13.559
  22:33:30 STEP 2295 H=2295:00 +CPU= 21.927
  22:33:44 STEP 2296 H=2296:00 +CPU= 14.089
  22:33:57 STEP 2297 H=2297:00 +CPU= 13.118
  22:34:18 STEP 2298 H=2298:00 +CPU= 20.905
  22:34:32 STEP 2299 H=2299:00 +CPU= 13.380
  22:34:45 STEP 2300 H=2300:00 +CPU= 13.657
  22:35:08 STEP 2301 H=2301:00 +CPU= 22.163
  22:35:21 STEP 2302 H=2302:00 +CPU= 13.586
  22:35:35 STEP 2303 H=2303:00 +CPU= 13.529
  22:35:59 STEP 2304 H=2304:00 +CPU= 23.847
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_95.zip
Uploading the intermediate file: upload_file_95.zip
  22:36:12 STEP 2305 H=2305:00 +CPU= 13.310
  22:36:27 STEP 2306 H=2306:00 +CPU= 14.329
  22:36:48 STEP 2307 H=2307:00 +CPU= 20.947
  22:37:01 STEP 2308 H=2308:00 +CPU= 13.611
  22:37:15 STEP 2309 H=2309:00 +CPU= 13.342
  22:37:36 STEP 2310 H=2310:00 +CPU= 20.747
  22:37:50 STEP 2311 H=2311:00 +CPU= 14.350
  22:38:05 STEP 2312 H=2312:00 +CPU= 15.044
  22:38:27 STEP 2313 H=2313:00 +CPU= 22.149
  22:38:41 STEP 2314 H=2314:00 +CPU= 13.956
  22:38:55 STEP 2315 H=2315:00 +CPU= 13.378
  22:39:17 STEP 2316 H=2316:00 +CPU= 22.658
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002316
  22:39:32 STEP 2317 H=2317:00 +CPU= 14.400
  22:39:46 STEP 2318 H=2318:00 +CPU= 14.223
  22:40:07 STEP 2319 H=2319:00 +CPU= 20.823
  22:40:21 STEP 2320 H=2320:00 +CPU= 13.791
  22:40:34 STEP 2321 H=2321:00 +CPU= 13.396
  22:40:57 STEP 2322 H=2322:00 +CPU= 21.886
  22:41:11 STEP 2323 H=2323:00 +CPU= 14.845
  22:41:26 STEP 2324 H=2324:00 +CPU= 14.613
  22:41:47 STEP 2325 H=2325:00 +CPU= 20.735
  22:42:01 STEP 2326 H=2326:00 +CPU= 13.963
  22:42:15 STEP 2327 H=2327:00 +CPU= 13.506
  22:42:40 STEP 2328 H=2328:00 +CPU= 25.506
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_96.zip
Uploading the intermediate file: upload_file_96.zip
  22:42:54 STEP 2329 H=2329:00 +CPU= 13.821
  22:43:07 STEP 2330 H=2330:00 +CPU= 13.063
  22:43:28 STEP 2331 H=2331:00 +CPU= 20.820
  22:43:42 STEP 2332 H=2332:00 +CPU= 13.599
  22:43:55 STEP 2333 H=2333:00 +CPU= 12.889
  22:44:18 STEP 2334 H=2334:00 +CPU= 23.132
  22:44:33 STEP 2335 H=2335:00 +CPU= 15.184
  22:44:48 STEP 2336 H=2336:00 +CPU= 14.607
  22:45:10 STEP 2337 H=2337:00 +CPU= 21.657
  22:45:23 STEP 2338 H=2338:00 +CPU= 13.695
  22:45:36 STEP 2339 H=2339:00 +CPU= 12.896
  22:46:00 STEP 2340 H=2340:00 +CPU= 22.980
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002340
  22:46:15 STEP 2341 H=2341:00 +CPU= 14.996
  22:46:30 STEP 2342 H=2342:00 +CPU= 14.862
  22:46:53 STEP 2343 H=2343:00 +CPU= 23.437
  22:47:08 STEP 2344 H=2344:00 +CPU= 15.220
  22:47:22 STEP 2345 H=2345:00 +CPU= 13.255
  22:47:43 STEP 2346 H=2346:00 +CPU= 20.951
  22:47:56 STEP 2347 H=2347:00 +CPU= 13.239
  22:48:09 STEP 2348 H=2348:00 +CPU= 12.964
  22:48:31 STEP 2349 H=2349:00 +CPU= 21.732
  22:48:46 STEP 2350 H=2350:00 +CPU= 15.357
  22:48:59 STEP 2351 H=2351:00 +CPU= 13.165
  22:49:23 STEP 2352 H=2352:00 +CPU= 23.754
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_97.zip
Uploading the intermediate file: upload_file_97.zip
  22:49:37 STEP 2353 H=2353:00 +CPU= 13.266
  22:49:50 STEP 2354 H=2354:00 +CPU= 13.060
  22:50:13 STEP 2355 H=2355:00 +CPU= 22.637
  22:50:27 STEP 2356 H=2356:00 +CPU= 13.546
  22:50:40 STEP 2357 H=2357:00 +CPU= 12.902
  22:51:01 STEP 2358 H=2358:00 +CPU= 20.670
  22:51:14 STEP 2359 H=2359:00 +CPU= 13.243
  22:51:28 STEP 2360 H=2360:00 +CPU= 14.207
  22:51:51 STEP 2361 H=2361:00 +CPU= 22.736
  22:52:07 STEP 2362 H=2362:00 +CPU= 15.382
  22:52:20 STEP 2363 H=2363:00 +CPU= 12.922
  22:52:42 STEP 2364 H=2364:00 +CPU= 22.433
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002364
  22:52:56 STEP 2365 H=2365:00 +CPU= 13.582
  22:53:09 STEP 2366 H=2366:00 +CPU= 13.101
  22:53:31 STEP 2367 H=2367:00 +CPU= 21.728
  22:53:46 STEP 2368 H=2368:00 +CPU= 15.191
  22:54:00 STEP 2369 H=2369:00 +CPU= 14.137
  22:54:24 STEP 2370 H=2370:00 +CPU= 23.375
  22:54:38 STEP 2371 H=2371:00 +CPU= 13.853
  22:54:51 STEP 2372 H=2372:00 +CPU= 13.002
  22:55:11 STEP 2373 H=2373:00 +CPU= 20.368
  22:55:25 STEP 2374 H=2374:00 +CPU= 13.724
  22:55:39 STEP 2375 H=2375:00 +CPU= 14.306
  22:56:06 STEP 2376 H=2376:00 +CPU= 26.313
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_98.zip
Uploading the intermediate file: upload_file_98.zip
  22:56:19 STEP 2377 H=2377:00 +CPU= 13.311
  22:56:32 STEP 2378 H=2378:00 +CPU= 12.956
  22:56:53 STEP 2379 H=2379:00 +CPU= 20.682
  22:57:07 STEP 2380 H=2380:00 +CPU= 13.699
  22:57:21 STEP 2381 H=2381:00 +CPU= 14.205
  22:57:45 STEP 2382 H=2382:00 +CPU= 23.657
  22:57:59 STEP 2383 H=2383:00 +CPU= 14.081
  22:58:12 STEP 2384 H=2384:00 +CPU= 13.123
  22:58:33 STEP 2385 H=2385:00 +CPU= 20.619
  22:58:47 STEP 2386 H=2386:00 +CPU= 13.793
  22:59:01 STEP 2387 H=2387:00 +CPU= 13.793
  22:59:25 STEP 2388 H=2388:00 +CPU= 24.571
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002388
  22:59:39 STEP 2389 H=2389:00 +CPU= 13.344
  22:59:52 STEP 2390 H=2390:00 +CPU= 12.943
  23:00:12 STEP 2391 H=2391:00 +CPU= 20.443
  23:00:26 STEP 2392 H=2392:00 +CPU= 13.690
  23:00:40 STEP 2393 H=2393:00 +CPU= 14.475
  23:01:04 STEP 2394 H=2394:00 +CPU= 23.091
  23:01:19 STEP 2395 H=2395:00 +CPU= 15.185
  23:01:34 STEP 2396 H=2396:00 +CPU= 14.934
  23:01:55 STEP 2397 H=2397:00 +CPU= 20.800
  23:02:08 STEP 2398 H=2398:00 +CPU= 13.450
  23:02:22 STEP 2399 H=2399:00 +CPU= 13.455
  23:02:46 STEP 2400 H=2400:00 +CPU= 24.284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:03:01 STEP 2401 H=2401:00 +CPU= 14.992
  23:03:16 STEP 2402 H=2402:00 +CPU= 14.647
  23:03:39 STEP 2403 H=2403:00 +CPU= 23.039
  23:03:54 STEP 2404 H=2404:00 +CPU= 14.763
  23:04:07 STEP 2405 H=2405:00 +CPU= 12.780
  23:04:27 STEP 2406 H=2406:00 +CPU= 20.620
  23:04:41 STEP 2407 H=2407:00 +CPU= 13.153
  23:04:54 STEP 2408 H=2408:00 +CPU= 13.509
  23:05:17 STEP 2409 H=2409:00 +CPU= 22.690
  23:05:32 STEP 2410 H=2410:00 +CPU= 14.606
  23:05:47 STEP 2411 H=2411:00 +CPU= 13.373
  23:06:09 STEP 2412 H=2412:00 +CPU= 22.554
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002412
  23:06:23 STEP 2413 H=2413:00 +CPU= 13.474
  23:06:37 STEP 2414 H=2414:00 +CPU= 13.978
  23:07:00 STEP 2415 H=2415:00 +CPU= 22.800
  23:07:15 STEP 2416 H=2416:00 +CPU= 15.079
  23:07:29 STEP 2417 H=2417:00 +CPU= 13.781
  23:07:50 STEP 2418 H=2418:00 +CPU= 20.937
  23:08:03 STEP 2419 H=2419:00 +CPU= 13.314
  23:08:17 STEP 2420 H=2420:00 +CPU= 13.620
  23:08:39 STEP 2421 H=2421:00 +CPU= 21.641
  23:08:54 STEP 2422 H=2422:00 +CPU= 15.082
  23:09:09 STEP 2423 H=2423:00 +CPU= 15.463
  23:09:34 STEP 2424 H=2424:00 +CPU= 24.999
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:09:48 STEP 2425 H=2425:00 +CPU= 13.059
  23:10:01 STEP 2426 H=2426:00 +CPU= 13.223
  23:10:22 STEP 2427 H=2427:00 +CPU= 20.871
  23:10:37 STEP 2428 H=2428:00 +CPU= 15.174
  23:10:51 STEP 2429 H=2429:00 +CPU= 13.784
  23:11:12 STEP 2430 H=2430:00 +CPU= 20.931
  23:11:25 STEP 2431 H=2431:00 +CPU= 13.272
  23:11:39 STEP 2432 H=2432:00 +CPU= 13.431
  23:12:00 STEP 2433 H=2433:00 +CPU= 21.652
  23:12:15 STEP 2434 H=2434:00 +CPU= 14.498
  23:12:28 STEP 2435 H=2435:00 +CPU= 13.162
  23:12:51 STEP 2436 H=2436:00 +CPU= 22.424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002436
  23:13:04 STEP 2437 H=2437:00 +CPU= 13.428
  23:13:18 STEP 2438 H=2438:00 +CPU= 13.631
  23:13:41 STEP 2439 H=2439:00 +CPU= 22.704
  23:13:56 STEP 2440 H=2440:00 +CPU= 15.486
  23:14:10 STEP 2441 H=2441:00 +CPU= 13.957
  23:14:31 STEP 2442 H=2442:00 +CPU= 20.827
  23:14:44 STEP 2443 H=2443:00 +CPU= 13.263
  23:14:58 STEP 2444 H=2444:00 +CPU= 13.510
  23:15:20 STEP 2445 H=2445:00 +CPU= 21.903
  23:15:34 STEP 2446 H=2446:00 +CPU= 14.254
  23:15:48 STEP 2447 H=2447:00 +CPU= 13.551
  23:16:12 STEP 2448 H=2448:00 +CPU= 23.722
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_101.zip
Uploading the intermediate file: upload_file_101.zip
  23:16:25 STEP 2449 H=2449:00 +CPU= 12.978
  23:16:38 STEP 2450 H=2450:00 +CPU= 13.537
  23:17:01 STEP 2451 H=2451:00 +CPU= 22.746
  23:17:17 STEP 2452 H=2452:00 +CPU= 15.330
  23:17:31 STEP 2453 H=2453:00 +CPU= 14.716
  23:17:55 STEP 2454 H=2454:00 +CPU= 23.123
  23:18:08 STEP 2455 H=2455:00 +CPU= 13.221
  23:18:21 STEP 2456 H=2456:00 +CPU= 13.429
  23:18:42 STEP 2457 H=2457:00 +CPU= 20.555
  23:18:56 STEP 2458 H=2458:00 +CPU= 13.896
  23:19:11 STEP 2459 H=2459:00 +CPU= 14.776
  23:19:36 STEP 2460 H=2460:00 +CPU= 25.036
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002460
  23:19:51 STEP 2461 H=2461:00 +CPU= 14.759
  23:20:05 STEP 2462 H=2462:00 +CPU= 14.295
  23:20:26 STEP 2463 H=2463:00 +CPU= 20.416
  23:20:39 STEP 2464 H=2464:00 +CPU= 13.703
  23:20:52 STEP 2465 H=2465:00 +CPU= 13.117
  23:21:15 STEP 2466 H=2466:00 +CPU= 22.483
  23:21:29 STEP 2467 H=2467:00 +CPU= 13.705
  23:21:42 STEP 2468 H=2468:00 +CPU= 13.608
  23:22:03 STEP 2469 H=2469:00 +CPU= 20.618
  23:22:16 STEP 2470 H=2470:00 +CPU= 13.328
  23:22:31 STEP 2471 H=2471:00 +CPU= 14.309
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0443
(argv4) batchid: 953
(argv5) wuid: 12170087
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5575fe8a5642211647f8b0bf4d0e224d to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0443_1984050100_123_953_12170087.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0443_1984050100_123_953_12170087.zip
ic_ancil_file: ic_ancil_12170087
ifsdata_file: ifsdata_12170087
climate_data_file: clim_data_12170087
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f3c810164c628f229e4bdfa3cce615da to: /var/lib/boinc-client/slots/0/ic_ancil_12170087.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12170087.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9a4b069fb8d1e2509b420ddaa70c61b1 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12170087.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12170087.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12170087.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12170087.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12170087.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12170087.xml
-- Model is restarting --
Adjusting last_iter, 2472, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12170087.xml
last_cpu_time: 42548
upload_file_number: 102
last_iter: 2471
last_upload: 8812800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041
The child process has been launched with process id: 2583319
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2583319:2583319] [20230118:232525:1674098725:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:25:52 STEP 2472 H=2472:00 +CPU= 25.660
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_102.zip
Uploading the intermediate file: upload_file_102.zip
  23:26:06 STEP 2473 H=2473:00 +CPU= 13.528
  23:26:19 STEP 2474 H=2474:00 +CPU= 13.124
  23:26:40 STEP 2475 H=2475:00 +CPU= 20.149
  23:26:53 STEP 2476 H=2476:00 +CPU= 13.513
  23:27:07 STEP 2477 H=2477:00 +CPU= 13.637
  23:27:29 STEP 2478 H=2478:00 +CPU= 21.319
  23:27:42 STEP 2479 H=2479:00 +CPU= 13.444
  23:27:56 STEP 2480 H=2480:00 +CPU= 13.428
  23:28:17 STEP 2481 H=2481:00 +CPU= 21.001
  23:28:32 STEP 2482 H=2482:00 +CPU= 15.365
  23:28:47 STEP 2483 H=2483:00 +CPU= 14.436
  23:29:09 STEP 2484 H=2484:00 +CPU= 22.206
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002484
  23:29:22 STEP 2485 H=2485:00 +CPU= 13.107
  23:29:35 STEP 2486 H=2486:00 +CPU= 13.191
  23:29:56 STEP 2487 H=2487:00 +CPU= 21.114
  23:30:11 STEP 2488 H=2488:00 +CPU= 14.397
  23:30:24 STEP 2489 H=2489:00 +CPU= 12.895
  23:30:46 STEP 2490 H=2490:00 +CPU= 21.203
  23:30:59 STEP 2491 H=2491:00 +CPU= 13.020
  23:31:12 STEP 2492 H=2492:00 +CPU= 13.366
  23:31:35 STEP 2493 H=2493:00 +CPU= 22.418
  23:31:48 STEP 2494 H=2494:00 +CPU= 13.304
  23:32:03 STEP 2495 H=2495:00 +CPU= 14.761
  23:32:27 STEP 2496 H=2496:00 +CPU= 24.032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170087/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0443_1984050100_123_953_12170087_1_r1836462041_103.zip
Uploading the intermediate file: upload_file_103.zip
  23:32:41 STEP 2497 H=2497:00 +CPU= 13.699
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:27:37 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 8,208,000 39,372 0.0048
09 May 2023 16:27:26 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 6,739,200 32,288 0.0048
09 May 2023 16:27:16 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 5,270,400 25,401 0.0048
09 May 2023 16:27:05 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 3,888,000 18,323 0.0047
09 May 2023 16:26:53 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 2,419,200 11,394 0.0047
09 May 2023 16:26:40 1478928 22299467 oifs_43r3_ps_0443_1984050100_123_953_12170087_1 864,000 3,804 0.0044


©2024 cpdn.org