<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
ess
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0761
(argv4) batchid: 953
(argv5) wuid: 12170405
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5f76cd56f0b8f61e4e5b98fcd66f6da1 to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
ic_ancil_file: ic_ancil_12170405
ifsdata_file: ifsdata_12170405
climate_data_file: clim_data_12170405
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b733c123376ebc2f863610998416b1cb to: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_84bc3c6010ba01f20392890ef79a61ba to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12170405.xml
-- Model is restarting --
Adjusting last_iter, 300, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
last_cpu_time: 14951
upload_file_number: 12
last_iter: 287
last_upload: 1036800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452
The child process has been launched with process id: 1689255
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1689255:1689255] [20230113:072037:1673562037:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
07:21:18 STEP 288 H= 288:00 +CPU= 37.974
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:23:22 STEP 289 H= 289:00 +CPU= 21.286
07:23:44 STEP 290 H= 290:00 +CPU= 21.622
07:24:17 STEP 291 H= 291:00 +CPU= 33.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:26:41 STEP 292 H= 292:00 +CPU= 22.037
07:27:01 STEP 293 H= 293:00 +CPU= 20.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:29:38 STEP 294 H= 294:00 +CPU= 34.714
07:29:59 STEP 295 H= 295:00 +CPU= 21.393
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:32:33 STEP 296 H= 296:00 +CPU= 21.481
07:33:07 STEP 297 H= 297:00 +CPU= 33.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:35:30 STEP 298 H= 298:00 +CPU= 21.825
07:35:52 STEP 299 H= 299:00 +CPU= 21.307
07:36:29 STEP 300 H= 300:00 +CPU= 36.994
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:38:52 STEP 301 H= 301:00 +CPU= 21.756
07:39:14 STEP 302 H= 302:00 +CPU= 21.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:41:49 STEP 303 H= 303:00 +CPU= 33.130
07:42:11 STEP 304 H= 304:00 +CPU= 21.967
07:42:33 STEP 305 H= 305:00 +CPU= 21.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:45:28 STEP 306 H= 306:00 +CPU= 33.774
07:45:49 STEP 307 H= 307:00 +CPU= 20.702
07:46:11 STEP 308 H= 308:00 +CPU= 21.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:48:36 STEP 309 H= 309:00 +CPU= 34.012
07:48:58 STEP 310 H= 310:00 +CPU= 21.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:51:32 STEP 311 H= 311:00 +CPU= 22.769
07:52:12 STEP 312 H= 312:00 +CPU= 39.732
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_12.zip
Uploading the intermediate file: upload_file_12.zip
07:52:33 STEP 313 H= 313:00 +CPU= 20.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:54:39 STEP 314 H= 314:00 +CPU= 20.765
07:55:13 STEP 315 H= 315:00 +CPU= 33.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:57:26 STEP 316 H= 316:00 +CPU= 21.453
07:57:47 STEP 317 H= 317:00 +CPU= 21.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:00:33 STEP 318 H= 318:00 +CPU= 34.011
08:00:55 STEP 319 H= 319:00 +CPU= 21.776
08:01:17 STEP 320 H= 320:00 +CPU= 22.217
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:03:43 STEP 321 H= 321:00 +CPU= 34.636
08:04:05 STEP 322 H= 322:00 +CPU= 21.505
08:04:27 STEP 323 H= 323:00 +CPU= 21.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:06:47 STEP 324 H= 324:00 +CPU= 37.599
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000324
08:07:08 STEP 325 H= 325:00 +CPU= 21.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:09:31 STEP 326 H= 326:00 +CPU= 21.994
08:10:06 STEP 327 H= 327:00 +CPU= 34.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:12:19 STEP 328 H= 328:00 +CPU= 21.821
08:12:40 STEP 329 H= 329:00 +CPU= 20.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:14:57 STEP 330 H= 330:00 +CPU= 35.246
08:15:18 STEP 331 H= 331:00 +CPU= 20.690
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:17:21 STEP 332 H= 332:00 +CPU= 21.882
08:17:56 STEP 333 H= 333:00 +CPU= 34.459
08:18:17 STEP 334 H= 334:00 +CPU= 21.561
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:20:31 STEP 335 H= 335:00 +CPU= 22.274
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:23:12 STEP 336 H= 336:00 +CPU= 40.165
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_13.zip
Uploading the intermediate file: upload_file_13.zip
08:23:34 STEP 337 H= 337:00 +CPU= 21.078
08:23:55 STEP 338 H= 338:00 +CPU= 21.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:26:11 STEP 339 H= 339:00 +CPU= 33.745
08:26:33 STEP 340 H= 340:00 +CPU= 21.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:28:56 STEP 341 H= 341:00 +CPU= 22.043
08:29:31 STEP 342 H= 342:00 +CPU= 34.296
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:31:53 STEP 343 H= 343:00 +CPU= 20.809
08:32:16 STEP 344 H= 344:00 +CPU= 22.680
08:32:50 STEP 345 H= 345:00 +CPU= 33.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:35:23 STEP 346 H= 346:00 +CPU= 21.697
08:35:44 STEP 347 H= 347:00 +CPU= 21.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:38:35 STEP 348 H= 348:00 +CPU= 37.851
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000348
08:38:56 STEP 349 H= 349:00 +CPU= 21.531
08:39:18 STEP 350 H= 350:00 +CPU= 21.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:42:14 STEP 351 H= 351:00 +CPU= 34.353
08:42:37 STEP 352 H= 352:00 +CPU= 22.019
08:42:57 STEP 353 H= 353:00 +CPU= 20.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:45:34 STEP 354 H= 354:00 +CPU= 34.958
08:45:55 STEP 355 H= 355:00 +CPU= 21.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:48:00 STEP 356 H= 356:00 +CPU= 22.232
08:48:35 STEP 357 H= 357:00 +CPU= 34.269
08:48:57 STEP 358 H= 358:00 +CPU= 21.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:51:20 STEP 359 H= 359:00 +CPU= 22.386
08:52:01 STEP 360 H= 360:00 +CPU= 40.554
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_14.zip
Uploading the intermediate file: upload_file_14.zip
08:54:04 STEP 361 H= 361:00 +CPU= 21.604
08:54:27 STEP 362 H= 362:00 +CPU= 21.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:57:13 STEP 363 H= 363:00 +CPU= 34.586
08:57:36 STEP 364 H= 364:00 +CPU= 22.487
08:57:57 STEP 365 H= 365:00 +CPU= 21.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:00:23 STEP 366 H= 366:00 +CPU= 34.883
09:00:44 STEP 367 H= 367:00 +CPU= 21.181
09:01:06 STEP 368 H= 368:00 +CPU= 21.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:04:00 STEP 369 H= 369:00 +CPU= 33.558
09:04:23 STEP 370 H= 370:00 +CPU= 22.486
09:04:44 STEP 371 H= 371:00 +CPU= 20.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:07:32 STEP 372 H= 372:00 +CPU= 37.633
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000372
09:07:54 STEP 373 H= 373:00 +CPU= 21.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:10:17 STEP 374 H= 374:00 +CPU= 22.046
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:12:34 STEP 375 H= 375:00 +CPU= 34.123
09:12:56 STEP 376 H= 376:00 +CPU= 21.800
09:13:17 STEP 377 H= 377:00 +CPU= 21.544
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:16:04 STEP 378 H= 378:00 +CPU= 34.563
09:16:25 STEP 379 H= 379:00 +CPU= 21.216
09:16:47 STEP 380 H= 380:00 +CPU= 21.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:19:33 STEP 381 H= 381:00 +CPU= 34.813
09:19:56 STEP 382 H= 382:00 +CPU= 22.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:22:08 STEP 383 H= 383:00 +CPU= 21.920
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0761
(argv4) batchid: 953
(argv5) wuid: 12170405
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5f76cd56f0b8f61e4e5b98fcd66f6da1 to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
ic_ancil_file: ic_ancil_12170405
ifsdata_file: ifsdata_12170405
climate_data_file: clim_data_12170405
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b733c123376ebc2f863610998416b1cb to: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_84bc3c6010ba01f20392890ef79a61ba to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12170405.xml
-- Model is restarting --
Adjusting last_iter, 384, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
last_cpu_time: 17491
upload_file_number: 15
last_iter: 383
last_upload: 1296000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452
The child process has been launched with process id: 1707373
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1707373:1707373] [20230113:092720:1673569640:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
09:28:01 STEP 384 H= 384:00 +CPU= 38.483
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_15.zip
Uploading the intermediate file: upload_file_15.zip
09:28:22 STEP 385 H= 385:00 +CPU= 20.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:30:39 STEP 386 H= 386:00 +CPU= 21.225
09:31:13 STEP 387 H= 387:00 +CPU= 33.694
09:31:35 STEP 388 H= 388:00 +CPU= 21.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:34:08 STEP 389 H= 389:00 +CPU= 21.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:36:34 STEP 390 H= 390:00 +CPU= 34.428
09:36:56 STEP 391 H= 391:00 +CPU= 21.733
09:37:17 STEP 392 H= 392:00 +CPU= 21.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:40:03 STEP 393 H= 393:00 +CPU= 33.828
09:40:26 STEP 394 H= 394:00 +CPU= 22.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:42:38 STEP 395 H= 395:00 +CPU= 20.537
09:43:16 STEP 396 H= 396:00 +CPU= 37.576
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:45:59 STEP 397 H= 397:00 +CPU= 21.370
09:46:21 STEP 398 H= 398:00 +CPU= 21.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:48:46 STEP 399 H= 399:00 +CPU= 33.762
09:49:08 STEP 400 H= 400:00 +CPU= 21.951
09:49:29 STEP 401 H= 401:00 +CPU= 20.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:52:24 STEP 402 H= 402:00 +CPU= 33.678
09:52:45 STEP 403 H= 403:00 +CPU= 20.357
09:53:06 STEP 404 H= 404:00 +CPU= 20.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:55:20 STEP 405 H= 405:00 +CPU= 32.719
09:55:40 STEP 406 H= 406:00 +CPU= 20.831
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:58:21 STEP 407 H= 407:00 +CPU= 20.441
09:59:00 STEP 408 H= 408:00 +CPU= 38.858
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_16.zip
Uploading the intermediate file: upload_file_16.zip
09:59:20 STEP 409 H= 409:00 +CPU= 20.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:02:23 STEP 410 H= 410:00 +CPU= 19.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:04:07 STEP 411 H= 411:00 +CPU= 32.763
10:04:27 STEP 412 H= 412:00 +CPU= 20.741
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:06:10 STEP 413 H= 413:00 +CPU= 20.746
10:06:45 STEP 414 H= 414:00 +CPU= 33.954
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:08:45 STEP 415 H= 415:00 +CPU= 20.347
10:09:07 STEP 416 H= 416:00 +CPU= 21.668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:11:23 STEP 417 H= 417:00 +CPU= 33.041
10:11:44 STEP 418 H= 418:00 +CPU= 21.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:13:46 STEP 419 H= 419:00 +CPU= 20.482
10:14:22 STEP 420 H= 420:00 +CPU= 36.189
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:15:55 STEP 421 H= 421:00 +CPU= 21.034
10:16:16 STEP 422 H= 422:00 +CPU= 20.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:18:41 STEP 423 H= 423:00 +CPU= 33.211
10:19:02 STEP 424 H= 424:00 +CPU= 21.307
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:21:03 STEP 425 H= 425:00 +CPU= 20.066
10:21:37 STEP 426 H= 426:00 +CPU= 33.477
10:21:57 STEP 427 H= 427:00 +CPU= 20.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:24:11 STEP 428 H= 428:00 +CPU= 21.307
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:26:05 STEP 429 H= 429:00 +CPU= 32.277
10:26:27 STEP 430 H= 430:00 +CPU= 21.614
10:26:48 STEP 431 H= 431:00 +CPU= 20.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:29:10 STEP 432 H= 432:00 +CPU= 39.288
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_17.zip
Uploading the intermediate file: upload_file_17.zip
10:29:30 STEP 433 H= 433:00 +CPU= 19.820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:31:15 STEP 434 H= 434:00 +CPU= 20.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:33:19 STEP 435 H= 435:00 +CPU= 33.397
10:33:41 STEP 436 H= 436:00 +CPU= 21.125
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:35:12 STEP 437 H= 437:00 +CPU= 20.374
10:35:46 STEP 438 H= 438:00 +CPU= 33.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:38:19 STEP 439 H= 439:00 +CPU= 20.779
10:38:41 STEP 440 H= 440:00 +CPU= 21.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:40:55 STEP 441 H= 441:00 +CPU= 33.626
10:41:17 STEP 442 H= 442:00 +CPU= 21.680
10:41:37 STEP 443 H= 443:00 +CPU= 20.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:44:14 STEP 444 H= 444:00 +CPU= 36.205
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000444
10:44:35 STEP 445 H= 445:00 +CPU= 20.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:46:38 STEP 446 H= 446:00 +CPU= 21.034
10:47:10 STEP 447 H= 447:00 +CPU= 32.523
10:47:31 STEP 448 H= 448:00 +CPU= 21.037
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:49:24 STEP 449 H= 449:00 +CPU= 20.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:30:23 STEP 450 H= 450:00 +CPU= 33.390
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0761
(argv4) batchid: 953
(argv5) wuid: 12170405
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5f76cd56f0b8f61e4e5b98fcd66f6da1 to: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_ps_0761_1984050100_123_953_12170405.zip
ic_ancil_file: ic_ancil_12170405
ifsdata_file: ifsdata_12170405
climate_data_file: clim_data_12170405
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b733c123376ebc2f863610998416b1cb to: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12170405.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_84bc3c6010ba01f20392890ef79a61ba to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12170405.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12170405.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12170405.xml
-- Model is restarting --
Adjusting last_iter, 451, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12170405.xml
last_cpu_time: 19222
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452
The child process has been launched with process id: 1732348
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1732348:1732348] [20230113:113454:1673577294:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:35:40 STEP 432 H= 432:00 +CPU= 40.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:38:53 STEP 433 H= 433:00 +CPU= 21.401
11:39:14 STEP 434 H= 434:00 +CPU= 20.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:42:08 STEP 435 H= 435:00 +CPU= 32.941
11:42:29 STEP 436 H= 436:00 +CPU= 21.342
11:42:50 STEP 437 H= 437:00 +CPU= 20.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:44:55 STEP 438 H= 438:00 +CPU= 33.441
11:45:16 STEP 439 H= 439:00 +CPU= 20.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:47:38 STEP 440 H= 440:00 +CPU= 20.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:49:52 STEP 441 H= 441:00 +CPU= 32.374
11:50:13 STEP 442 H= 442:00 +CPU= 21.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:52:04 STEP 443 H= 443:00 +CPU= 20.624
11:52:41 STEP 444 H= 444:00 +CPU= 36.749
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000444
11:53:01 STEP 445 H= 445:00 +CPU= 20.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:55:14 STEP 446 H= 446:00 +CPU= 21.085
11:55:46 STEP 447 H= 447:00 +CPU= 32.038
11:56:07 STEP 448 H= 448:00 +CPU= 20.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:58:18 STEP 449 H= 449:00 +CPU= 20.110
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:00:03 STEP 450 H= 450:00 +CPU= 33.153
12:00:24 STEP 451 H= 451:00 +CPU= 20.779
12:00:45 STEP 452 H= 452:00 +CPU= 20.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:08 STEP 453 H= 453:00 +CPU= 32.038
12:03:29 STEP 454 H= 454:00 +CPU= 20.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:05:11 STEP 455 H= 455:00 +CPU= 20.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:51 STEP 456 H= 456:00 +CPU= 37.966
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_18.zip
Uploading the intermediate file: upload_file_18.zip
12:08:11 STEP 457 H= 457:00 +CPU= 20.370
12:08:32 STEP 458 H= 458:00 +CPU= 20.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:10:56 STEP 459 H= 459:00 +CPU= 32.593
12:11:17 STEP 460 H= 460:00 +CPU= 21.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:13:18 STEP 461 H= 461:00 +CPU= 20.710
12:13:51 STEP 462 H= 462:00 +CPU= 32.726
12:14:11 STEP 463 H= 463:00 +CPU= 20.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:16:25 STEP 464 H= 464:00 +CPU= 21.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:18:38 STEP 465 H= 465:00 +CPU= 32.447
12:18:59 STEP 466 H= 466:00 +CPU= 21.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:20:51 STEP 467 H= 467:00 +CPU= 20.201
12:21:27 STEP 468 H= 468:00 +CPU= 36.044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:36:10 STEP 469 H= 469:00 +CPU= 20.107
12:36:32 STEP 470 H= 470:00 +CPU= 21.892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:48:59 STEP 471 H= 471:00 +CPU= 34.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:59 STEP 472 H= 472:00 +CPU= 22.811
14:04:22 STEP 473 H= 473:00 +CPU= 22.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:49 STEP 474 H= 474:00 +CPU= 35.197
22:32:09 STEP 475 H= 475:00 +CPU= 20.273
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:34:41 STEP 476 H= 476:00 +CPU= 21.129
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:38:14 STEP 477 H= 477:00 +CPU= 31.745
22:38:35 STEP 478 H= 478:00 +CPU= 20.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:40:38 STEP 479 H= 479:00 +CPU= 20.462
22:41:15 STEP 480 H= 480:00 +CPU= 36.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_19.zip
Uploading the intermediate file: upload_file_19.zip
22:43:36 STEP 481 H= 481:00 +CPU= 19.900
22:43:56 STEP 482 H= 482:00 +CPU= 20.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:46:29 STEP 483 H= 483:00 +CPU= 31.827
22:46:50 STEP 484 H= 484:00 +CPU= 21.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:49:21 STEP 485 H= 485:00 +CPU= 19.807
22:49:53 STEP 486 H= 486:00 +CPU= 32.129
22:50:13 STEP 487 H= 487:00 +CPU= 19.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:52:45 STEP 488 H= 488:00 +CPU= 20.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:38 STEP 489 H= 489:00 +CPU= 31.890
22:55:59 STEP 490 H= 490:00 +CPU= 21.093
22:56:19 STEP 491 H= 491:00 +CPU= 20.240
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:59:26 STEP 492 H= 492:00 +CPU= 35.582
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:37 STEP 493 H= 493:00 +CPU= 19.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:40 STEP 494 H= 494:00 +CPU= 20.489
23:04:11 STEP 495 H= 495:00 +CPU= 31.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:07:05 STEP 496 H= 496:00 +CPU= 21.125
23:07:24 STEP 497 H= 497:00 +CPU= 19.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:18 STEP 498 H= 498:00 +CPU= 32.733
23:10:38 STEP 499 H= 499:00 +CPU= 19.570
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:10 STEP 500 H= 500:00 +CPU= 20.846
23:13:42 STEP 501 H= 501:00 +CPU= 32.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:14 STEP 502 H= 502:00 +CPU= 20.942
23:16:35 STEP 503 H= 503:00 +CPU= 20.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:33 STEP 504 H= 504:00 +CPU= 37.534
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170405/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0761_1984050100_123_953_12170405_0_r2055697452_20.zip
Uploading the intermediate file: upload_file_20.zip
23:19:53 STEP 505 H= 505:00 +CPU= 19.954
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:35 STEP 506 H= 506:00 +CPU= 20.193
23:23:06 STEP 507 H= 507:00 +CPU= 31.173
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:07 STEP 508 H= 508:00 +CPU= 20.050
23:25:27 STEP 509 H= 509:00 +CPU= 19.708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:52 STEP 510 H= 510:00 +CPU= 33.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:29:53 STEP 511 H= 511:00 +CPU= 19.857
23:30:14 STEP 512 H= 512:00 +CPU= 20.751
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:32:57 STEP 513 H= 513:00 +CPU= 32.228
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:34:50 STEP 514 H= 514:00 +CPU= 21.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:36:51 STEP 515 H= 515:00 +CPU= 19.982
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
