<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
SHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_14.zip
Uploading the intermediate file: upload_file_14.zip
03:19:33 STEP 361 H= 361:00 +CPU= 19.151
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:22:26 STEP 362 H= 362:00 +CPU= 19.553
03:22:58 STEP 363 H= 363:00 +CPU= 32.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:25:40 STEP 364 H= 364:00 +CPU= 21.270
03:26:01 STEP 365 H= 365:00 +CPU= 20.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:31:07 STEP 366 H= 366:00 +CPU= 33.223
03:31:28 STEP 367 H= 367:00 +CPU= 21.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:34:10 STEP 368 H= 368:00 +CPU= 20.653
03:34:44 STEP 369 H= 369:00 +CPU= 33.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:37:55 STEP 370 H= 370:00 +CPU= 20.691
03:38:16 STEP 371 H= 371:00 +CPU= 20.699
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:41:14 STEP 372 H= 372:00 +CPU= 35.259
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:44:17 STEP 373 H= 373:00 +CPU= 20.612
03:44:38 STEP 374 H= 374:00 +CPU= 21.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:49:13 STEP 375 H= 375:00 +CPU= 32.905
03:49:34 STEP 376 H= 376:00 +CPU= 20.960
03:49:54 STEP 377 H= 377:00 +CPU= 20.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:52:48 STEP 378 H= 378:00 +CPU= 32.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:56:50 STEP 379 H= 379:00 +CPU= 19.954
03:57:12 STEP 380 H= 380:00 +CPU= 22.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:59:35 STEP 381 H= 381:00 +CPU= 32.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:02:28 STEP 382 H= 382:00 +CPU= 21.234
04:02:49 STEP 383 H= 383:00 +CPU= 21.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:05:49 STEP 384 H= 384:00 +CPU= 38.314
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_15.zip
Uploading the intermediate file: upload_file_15.zip
04:06:07 STEP 385 H= 385:00 +CPU= 18.661
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:08:44 STEP 386 H= 386:00 +CPU= 20.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:11:59 STEP 387 H= 387:00 +CPU= 32.506
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:16:51 STEP 388 H= 388:00 +CPU= 20.874
04:17:12 STEP 389 H= 389:00 +CPU= 20.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:20:17 STEP 390 H= 390:00 +CPU= 33.745
04:20:38 STEP 391 H= 391:00 +CPU= 20.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:23:20 STEP 392 H= 392:00 +CPU= 21.435
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:26:44 STEP 393 H= 393:00 +CPU= 32.112
04:27:05 STEP 394 H= 394:00 +CPU= 21.569
04:27:26 STEP 395 H= 395:00 +CPU= 20.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:30:44 STEP 396 H= 396:00 +CPU= 36.209
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:34:05 STEP 397 H= 397:00 +CPU= 20.110
04:34:28 STEP 398 H= 398:00 +CPU= 22.249
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:37:32 STEP 399 H= 399:00 +CPU= 33.058
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:39:55 STEP 400 H= 400:00 +CPU= 21.161
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2015050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0935
(argv4) batchid: 984
(argv5) wuid: 12201579
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b64d417dbbe36fec74aac52a38c1ca20 to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
ic_ancil_file: ic_ancil_12201579
ifsdata_file: ifsdata_12201579
climate_data_file: clim_data_12201579
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c3a7a1d21fa2cbee2d96b97baf803571 to: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a0186ac7ef313544447138d11ba8b5 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12201579.xml
-- Model is restarting --
Adjusting last_iter, 401, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
last_cpu_time: 12098
upload_file_number: 16
last_iter: 383
last_upload: 1382400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115
The child process has been launched with process id: 1930145
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1930145:1930145] [20230114:044246:1673638966:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:45:27 STEP 384 H= 384:00 +CPU= 37.746
04:45:48 STEP 385 H= 385:00 +CPU= 20.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:48:21 STEP 386 H= 386:00 +CPU= 21.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:50:43 STEP 387 H= 387:00 +CPU= 32.449
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:53:25 STEP 388 H= 388:00 +CPU= 20.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:56:17 STEP 389 H= 389:00 +CPU= 20.465
04:56:51 STEP 390 H= 390:00 +CPU= 33.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:59:33 STEP 391 H= 391:00 +CPU= 20.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:02:57 STEP 392 H= 392:00 +CPU= 22.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:05:22 STEP 393 H= 393:00 +CPU= 33.056
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:07:45 STEP 394 H= 394:00 +CPU= 21.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:09:56 STEP 395 H= 395:00 +CPU= 20.258
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:12:04 STEP 396 H= 396:00 +CPU= 36.823
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000396
05:12:24 STEP 397 H= 397:00 +CPU= 20.549
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:15:07 STEP 398 H= 398:00 +CPU= 21.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:18:01 STEP 399 H= 399:00 +CPU= 33.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:20:34 STEP 400 H= 400:00 +CPU= 21.130
05:20:54 STEP 401 H= 401:00 +CPU= 20.240
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:23:29 STEP 402 H= 402:00 +CPU= 32.539
05:23:49 STEP 403 H= 403:00 +CPU= 20.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:21 STEP 404 H= 404:00 +CPU= 20.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:15 STEP 405 H= 405:00 +CPU= 32.442
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:59 STEP 406 H= 406:00 +CPU= 21.873
05:32:20 STEP 407 H= 407:00 +CPU= 21.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:52 STEP 408 H= 408:00 +CPU= 38.786
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_16.zip
Uploading the intermediate file: upload_file_16.zip
05:36:11 STEP 409 H= 409:00 +CPU= 19.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:49 STEP 410 H= 410:00 +CPU= 20.515
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:43 STEP 411 H= 411:00 +CPU= 32.443
05:42:05 STEP 412 H= 412:00 +CPU= 21.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:57 STEP 413 H= 413:00 +CPU= 21.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:02 STEP 414 H= 414:00 +CPU= 33.011
05:48:23 STEP 415 H= 415:00 +CPU= 20.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:52:17 STEP 416 H= 416:00 +CPU= 21.475
05:52:49 STEP 417 H= 417:00 +CPU= 32.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:56:33 STEP 418 H= 418:00 +CPU= 21.225
05:56:53 STEP 419 H= 419:00 +CPU= 20.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:59:50 STEP 420 H= 420:00 +CPU= 35.797
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:02:12 STEP 421 H= 421:00 +CPU= 20.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:03:53 STEP 422 H= 422:00 +CPU= 21.155
06:04:25 STEP 423 H= 423:00 +CPU= 31.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:06:58 STEP 424 H= 424:00 +CPU= 21.162
06:07:19 STEP 425 H= 425:00 +CPU= 20.535
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:09:53 STEP 426 H= 426:00 +CPU= 33.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:12:25 STEP 427 H= 427:00 +CPU= 20.407
06:12:46 STEP 428 H= 428:00 +CPU= 21.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:59 STEP 429 H= 429:00 +CPU= 32.092
06:15:20 STEP 430 H= 430:00 +CPU= 20.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:17:42 STEP 431 H= 431:00 +CPU= 21.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:21:12 STEP 432 H= 432:00 +CPU= 38.217
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_17.zip
Uploading the intermediate file: upload_file_17.zip
06:21:31 STEP 433 H= 433:00 +CPU= 18.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:22:57 STEP 434 H= 434:00 +CPU= 20.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:25:12 STEP 435 H= 435:00 +CPU= 32.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:27:03 STEP 436 H= 436:00 +CPU= 21.089
06:27:24 STEP 437 H= 437:00 +CPU= 20.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:30:09 STEP 438 H= 438:00 +CPU= 32.960
06:30:29 STEP 439 H= 439:00 +CPU= 20.515
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:33:12 STEP 440 H= 440:00 +CPU= 21.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:36:27 STEP 441 H= 441:00 +CPU= 32.847
06:36:48 STEP 442 H= 442:00 +CPU= 21.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:38:50 STEP 443 H= 443:00 +CPU= 20.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:42:07 STEP 444 H= 444:00 +CPU= 36.187
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000444
06:42:28 STEP 445 H= 445:00 +CPU= 20.715
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2015050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0935
(argv4) batchid: 984
(argv5) wuid: 12201579
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b64d417dbbe36fec74aac52a38c1ca20 to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
ic_ancil_file: ic_ancil_12201579
ifsdata_file: ifsdata_12201579
climate_data_file: clim_data_12201579
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c3a7a1d21fa2cbee2d96b97baf803571 to: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a0186ac7ef313544447138d11ba8b5 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12201579.xml
-- Model is restarting --
Adjusting last_iter, 446, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
last_cpu_time: 13673
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115
The child process has been launched with process id: 1953980
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1953980:1953980] [20230114:064500:1673646300:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:48:00 STEP 432 H= 432:00 +CPU= 36.519
06:48:21 STEP 433 H= 433:00 +CPU= 20.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:50:35 STEP 434 H= 434:00 +CPU= 21.222
06:51:07 STEP 435 H= 435:00 +CPU= 32.199
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:53:29 STEP 436 H= 436:00 +CPU= 21.017
06:53:50 STEP 437 H= 437:00 +CPU= 20.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:56:24 STEP 438 H= 438:00 +CPU= 33.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:58:36 STEP 439 H= 439:00 +CPU= 20.348
06:58:57 STEP 440 H= 440:00 +CPU= 21.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:01:51 STEP 441 H= 441:00 +CPU= 32.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:05:24 STEP 442 H= 442:00 +CPU= 21.601
07:05:45 STEP 443 H= 443:00 +CPU= 20.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:08:32 STEP 444 H= 444:00 +CPU= 35.779
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000444
07:08:53 STEP 445 H= 445:00 +CPU= 20.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:12:26 STEP 446 H= 446:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:14:51 STEP 447 H= 447:00 +CPU= 32.409
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:17:03 STEP 448 H= 448:00 +CPU= 21.575
07:17:24 STEP 449 H= 449:00 +CPU= 21.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:20:29 STEP 450 H= 450:00 +CPU= 33.366
07:20:49 STEP 451 H= 451:00 +CPU= 20.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:23:22 STEP 452 H= 452:00 +CPU= 21.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:26:07 STEP 453 H= 453:00 +CPU= 32.786
07:26:29 STEP 454 H= 454:00 +CPU= 21.516
07:26:49 STEP 455 H= 455:00 +CPU= 20.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:29:49 STEP 456 H= 456:00 +CPU= 38.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_18.zip
Uploading the intermediate file: upload_file_18.zip
07:31:51 STEP 457 H= 457:00 +CPU= 20.831
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:33:53 STEP 458 H= 458:00 +CPU= 20.659
07:34:26 STEP 459 H= 459:00 +CPU= 32.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:37:19 STEP 460 H= 460:00 +CPU= 21.631
07:37:39 STEP 461 H= 461:00 +CPU= 20.350
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:40:14 STEP 462 H= 462:00 +CPU= 33.485
07:40:35 STEP 463 H= 463:00 +CPU= 20.423
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:43:18 STEP 464 H= 464:00 +CPU= 21.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:45:43 STEP 465 H= 465:00 +CPU= 32.575
07:46:04 STEP 466 H= 466:00 +CPU= 20.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:48:55 STEP 467 H= 467:00 +CPU= 19.965
07:49:31 STEP 468 H= 468:00 +CPU= 35.846
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:51:52 STEP 469 H= 469:00 +CPU= 20.116
07:52:14 STEP 470 H= 470:00 +CPU= 21.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:54:29 STEP 471 H= 471:00 +CPU= 32.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:57:22 STEP 472 H= 472:00 +CPU= 20.883
07:57:42 STEP 473 H= 473:00 +CPU= 20.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:00:28 STEP 474 H= 474:00 +CPU= 33.327
08:00:49 STEP 475 H= 475:00 +CPU= 20.704
08:01:09 STEP 476 H= 476:00 +CPU= 20.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:04:03 STEP 477 H= 477:00 +CPU= 32.365
08:04:24 STEP 478 H= 478:00 +CPU= 21.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:06:58 STEP 479 H= 479:00 +CPU= 20.986
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:10:00 STEP 480 H= 480:00 +CPU= 39.328
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_19.zip
Uploading the intermediate file: upload_file_19.zip
08:10:20 STEP 481 H= 481:00 +CPU= 20.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:12:30 STEP 482 H= 482:00 +CPU= 20.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:14:54 STEP 483 H= 483:00 +CPU= 32.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:16:58 STEP 484 H= 484:00 +CPU= 21.437
08:17:18 STEP 485 H= 485:00 +CPU= 19.902
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:19:53 STEP 486 H= 486:00 +CPU= 33.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:22:05 STEP 487 H= 487:00 +CPU= 21.073
08:22:26 STEP 488 H= 488:00 +CPU= 20.772
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:24:21 STEP 489 H= 489:00 +CPU= 33.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:26:33 STEP 490 H= 490:00 +CPU= 20.558
08:26:53 STEP 491 H= 491:00 +CPU= 20.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:29:51 STEP 492 H= 492:00 +CPU= 36.052
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000492
08:30:11 STEP 493 H= 493:00 +CPU= 20.203
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:32:03 STEP 494 H= 494:00 +CPU= 21.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:34:18 STEP 495 H= 495:00 +CPU= 32.673
08:34:39 STEP 496 H= 496:00 +CPU= 20.898
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:36:50 STEP 497 H= 497:00 +CPU= 20.265
08:37:24 STEP 498 H= 498:00 +CPU= 33.587
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:40:06 STEP 499 H= 499:00 +CPU= 20.106
08:40:26 STEP 500 H= 500:00 +CPU= 20.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:43:19 STEP 501 H= 501:00 +CPU= 31.774
08:43:40 STEP 502 H= 502:00 +CPU= 21.513
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:45:43 STEP 503 H= 503:00 +CPU= 21.058
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2015050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0935
(argv4) batchid: 984
(argv5) wuid: 12201579
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b64d417dbbe36fec74aac52a38c1ca20 to: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_ps_0935_2015050100_123_984_12201579.zip
ic_ancil_file: ic_ancil_12201579
ifsdata_file: ifsdata_12201579
climate_data_file: clim_data_12201579
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c3a7a1d21fa2cbee2d96b97baf803571 to: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12201579.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_93a0186ac7ef313544447138d11ba8b5 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12201579.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12201579.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12201579.xml
-- Model is restarting --
Adjusting last_iter, 503, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12201579.xml
last_cpu_time: 15483
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115
The child process has been launched with process id: 1972118
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1972118:1972118] [20230114:084834:1673653714:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:51:17 STEP 504 H= 504:00 +CPU= 37.026
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_20.zip
Uploading the intermediate file: upload_file_20.zip
08:51:38 STEP 505 H= 505:00 +CPU= 20.722
08:51:59 STEP 506 H= 506:00 +CPU= 21.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:54:53 STEP 507 H= 507:00 +CPU= 32.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:57:15 STEP 508 H= 508:00 +CPU= 21.254
08:57:36 STEP 509 H= 509:00 +CPU= 21.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:59:42 STEP 510 H= 510:00 +CPU= 32.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:02:34 STEP 511 H= 511:00 +CPU= 21.146
09:02:55 STEP 512 H= 512:00 +CPU= 21.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:06:18 STEP 513 H= 513:00 +CPU= 31.618
09:06:40 STEP 514 H= 514:00 +CPU= 21.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:09:01 STEP 515 H= 515:00 +CPU= 20.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:11:18 STEP 516 H= 516:00 +CPU= 36.473
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000516
09:11:39 STEP 517 H= 517:00 +CPU= 20.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:14:01 STEP 518 H= 518:00 +CPU= 20.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:16:16 STEP 519 H= 519:00 +CPU= 33.056
09:16:38 STEP 520 H= 520:00 +CPU= 21.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:18:29 STEP 521 H= 521:00 +CPU= 20.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:21:05 STEP 522 H= 522:00 +CPU= 34.031
09:21:25 STEP 523 H= 523:00 +CPU= 20.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:23:57 STEP 524 H= 524:00 +CPU= 20.985
09:24:29 STEP 525 H= 525:00 +CPU= 32.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:26:53 STEP 526 H= 526:00 +CPU= 22.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:29:05 STEP 527 H= 527:00 +CPU= 20.874
09:29:43 STEP 528 H= 528:00 +CPU= 38.212
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201579/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_2015050100_123_984_12201579_0_r789694115_21.zip
Uploading the intermediate file: upload_file_21.zip
09:30:02 STEP 529 H= 529:00 +CPU= 18.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:32:09 STEP 530 H= 530:00 +CPU= 21.236
09:32:41 STEP 531 H= 531:00 +CPU= 32.019
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:35:14 STEP 532 H= 532:00 +CPU= 21.449
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:37:36 STEP 533 H= 533:00 +CPU= 20.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:39:40 STEP 534 H= 534:00 +CPU= 33.243
09:40:01 STEP 535 H= 535:00 +CPU= 20.434
09:40:22 STEP 536 H= 536:00 +CPU= 21.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:44:17 STEP 537 H= 537:00 +CPU= 31.731
09:44:39 STEP 538 H= 538:00 +CPU= 22.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:46:50 STEP 539 H= 539:00 +CPU= 20.624
09:47:26 STEP 540 H= 540:00 +CPU= 35.350
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAhq0f+000540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:49:58 STEP 541 H= 541:00 +CPU= 21.232
09:50:19 STEP 542 H= 542:00 +CPU= 21.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:52:43 STEP 543 H= 543:00 +CPU= 32.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:54:47 STEP 544 H= 544:00 +CPU= 21.520
09:55:07 STEP 545 H= 545:00 +CPU= 20.322
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:57:32 STEP 546 H= 546:00 +CPU= 33.683
09:57:53 STEP 547 H= 547:00 +CPU= 20.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:00:15 STEP 548 H= 548:00 +CPU= 21.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:05:19 STEP 549 H= 549:00 +CPU= 32.212
10:05:41 STEP 550 H= 550:00 +CPU= 21.937
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:08:13 STEP 551 H= 551:00 +CPU= 21.113
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
