<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
ntermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_14.zip
Uploading the intermediate file: upload_file_14.zip
00:51:32 STEP 361 H= 361:00 +CPU= 20.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:14 STEP 362 H= 362:00 +CPU= 20.404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:55:39 STEP 363 H= 363:00 +CPU= 32.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:57:13 STEP 364 H= 364:00 +CPU= 21.516
00:57:33 STEP 365 H= 365:00 +CPU= 19.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:36 STEP 366 H= 366:00 +CPU= 33.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:01:38 STEP 367 H= 367:00 +CPU= 20.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:03:20 STEP 368 H= 368:00 +CPU= 21.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:05:13 STEP 369 H= 369:00 +CPU= 31.562
01:05:35 STEP 370 H= 370:00 +CPU= 22.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:07:17 STEP 371 H= 371:00 +CPU= 20.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:09:24 STEP 372 H= 372:00 +CPU= 36.258
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:11:06 STEP 373 H= 373:00 +CPU= 20.212
01:11:27 STEP 374 H= 374:00 +CPU= 20.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:14:31 STEP 375 H= 375:00 +CPU= 32.991
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:16:04 STEP 376 H= 376:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 377, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 11462
upload_file_number: 15
last_iter: 359
last_upload: 1296000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1632921
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632921:1632921] [20230113:011934:1673540374:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:44 STEP 360 H= 360:00 +CPU= 36.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:23:47 STEP 361 H= 361:00 +CPU= 20.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:10 STEP 362 H= 362:00 +CPU= 21.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:55 STEP 363 H= 363:00 +CPU= 32.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:47 STEP 364 H= 364:00 +CPU= 21.380
01:29:09 STEP 365 H= 365:00 +CPU= 21.701
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:32:45 STEP 366 H= 366:00 +CPU= 32.743
01:33:07 STEP 367 H= 367:00 +CPU= 21.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:58 STEP 368 H= 368:00 +CPU= 20.966
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:36:50 STEP 369 H= 369:00 +CPU= 31.828
01:37:11 STEP 370 H= 370:00 +CPU= 20.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:38:42 STEP 371 H= 371:00 +CPU= 20.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:40:29 STEP 372 H= 372:00 +CPU= 35.479
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000372
01:40:50 STEP 373 H= 373:00 +CPU= 20.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:42:42 STEP 374 H= 374:00 +CPU= 21.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:44:36 STEP 375 H= 375:00 +CPU= 32.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:46:19 STEP 376 H= 376:00 +CPU= 20.999
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:48:01 STEP 377 H= 377:00 +CPU= 20.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:54 STEP 378 H= 378:00 +CPU= 33.676
01:50:15 STEP 379 H= 379:00 +CPU= 20.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:52:07 STEP 380 H= 380:00 +CPU= 21.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:54:10 STEP 381 H= 381:00 +CPU= 32.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:55:53 STEP 382 H= 382:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:57:36 STEP 383 H= 383:00 +CPU= 22.160
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:59:45 STEP 384 H= 384:00 +CPU= 37.051
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_15.zip
Uploading the intermediate file: upload_file_15.zip
02:00:06 STEP 385 H= 385:00 +CPU= 20.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:10 STEP 386 H= 386:00 +CPU= 19.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:13 STEP 387 H= 387:00 +CPU= 32.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:34 STEP 388 H= 388:00 +CPU= 21.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:07:36 STEP 389 H= 389:00 +CPU= 20.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:09:21 STEP 390 H= 390:00 +CPU= 32.470
02:09:41 STEP 391 H= 391:00 +CPU= 20.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:11:04 STEP 392 H= 392:00 +CPU= 20.992
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:13:08 STEP 393 H= 393:00 +CPU= 32.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:14:59 STEP 394 H= 394:00 +CPU= 20.861
02:15:20 STEP 395 H= 395:00 +CPU= 20.961
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:17:38 STEP 396 H= 396:00 +CPU= 36.147
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:30 STEP 397 H= 397:00 +CPU= 21.093
02:19:51 STEP 398 H= 398:00 +CPU= 21.356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:21:55 STEP 399 H= 399:00 +CPU= 32.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:23:17 STEP 400 H= 400:00 +CPU= 21.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:25:11 STEP 401 H= 401:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:27:06 STEP 402 H= 402:00 +CPU= 33.106
02:27:26 STEP 403 H= 403:00 +CPU= 20.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:29:18 STEP 404 H= 404:00 +CPU= 21.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:31:21 STEP 405 H= 405:00 +CPU= 32.231
02:31:42 STEP 406 H= 406:00 +CPU= 20.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:34:03 STEP 407 H= 407:00 +CPU= 21.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:36:22 STEP 408 H= 408:00 +CPU= 37.498
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_16.zip
Uploading the intermediate file: upload_file_16.zip
02:36:42 STEP 409 H= 409:00 +CPU= 19.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:38:16 STEP 410 H= 410:00 +CPU= 20.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:40:08 STEP 411 H= 411:00 +CPU= 31.466
02:40:28 STEP 412 H= 412:00 +CPU= 20.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:42:39 STEP 413 H= 413:00 +CPU= 19.937
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:44:45 STEP 414 H= 414:00 +CPU= 33.402
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:46:28 STEP 415 H= 415:00 +CPU= 20.959
02:46:49 STEP 416 H= 416:00 +CPU= 21.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:48:41 STEP 417 H= 417:00 +CPU= 31.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:50:24 STEP 418 H= 418:00 +CPU= 21.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:52:05 STEP 419 H= 419:00 +CPU= 20.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:54:22 STEP 420 H= 420:00 +CPU= 35.854
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000420
02:54:42 STEP 421 H= 421:00 +CPU= 19.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:56:34 STEP 422 H= 422:00 +CPU= 21.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:58:27 STEP 423 H= 423:00 +CPU= 31.916
02:58:48 STEP 424 H= 424:00 +CPU= 20.930
02:59:09 STEP 425 H= 425:00 +CPU= 20.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:01:22 STEP 426 H= 426:00 +CPU= 31.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:03:33 STEP 427 H= 427:00 +CPU= 20.014
03:03:55 STEP 428 H= 428:00 +CPU= 21.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:05:47 STEP 429 H= 429:00 +CPU= 31.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:08:08 STEP 430 H= 430:00 +CPU= 21.185
03:08:30 STEP 431 H= 431:00 +CPU= 20.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:10:38 STEP 432 H= 432:00 +CPU= 37.793
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_17.zip
Uploading the intermediate file: upload_file_17.zip
03:10:57 STEP 433 H= 433:00 +CPU= 18.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:13:03 STEP 434 H= 434:00 +CPU= 19.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:14:58 STEP 435 H= 435:00 +CPU= 33.120
03:15:19 STEP 436 H= 436:00 +CPU= 21.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:17:11 STEP 437 H= 437:00 +CPU= 20.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:19:25 STEP 438 H= 438:00 +CPU= 32.643
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 439, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 13461
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1650335
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1650335:1650335] [20230113:032107:1673547667:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:23:08 STEP 432 H= 432:00 +CPU= 36.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:24:22 STEP 433 H= 433:00 +CPU= 21.562
03:24:43 STEP 434 H= 434:00 +CPU= 21.095
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:26:45 STEP 435 H= 435:00 +CPU= 31.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:28:27 STEP 436 H= 436:00 +CPU= 21.023
03:28:48 STEP 437 H= 437:00 +CPU= 20.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:30:53 STEP 438 H= 438:00 +CPU= 33.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:32:25 STEP 439 H= 439:00 +CPU= 20.969
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:33:47 STEP 440 H= 440:00 +CPU= 21.403
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:35:29 STEP 441 H= 441:00 +CPU= 31.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:37:01 STEP 442 H= 442:00 +CPU= 21.530
03:37:21 STEP 443 H= 443:00 +CPU= 20.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:39:28 STEP 444 H= 444:00 +CPU= 35.835
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:41:10 STEP 445 H= 445:00 +CPU= 20.504
03:41:31 STEP 446 H= 446:00 +CPU= 20.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:43:34 STEP 447 H= 447:00 +CPU= 32.158
03:43:56 STEP 448 H= 448:00 +CPU= 21.343
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:45:48 STEP 449 H= 449:00 +CPU= 20.780
03:46:21 STEP 450 H= 450:00 +CPU= 33.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:48:12 STEP 451 H= 451:00 +CPU= 20.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:49:55 STEP 452 H= 452:00 +CPU= 21.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:51:39 STEP 453 H= 453:00 +CPU= 32.601
03:52:00 STEP 454 H= 454:00 +CPU= 21.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:54:22 STEP 455 H= 455:00 +CPU= 20.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:56:42 STEP 456 H= 456:00 +CPU= 38.382
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_18.zip
Uploading the intermediate file: upload_file_18.zip
03:57:02 STEP 457 H= 457:00 +CPU= 20.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:58:45 STEP 458 H= 458:00 +CPU= 21.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:00:37 STEP 459 H= 459:00 +CPU= 32.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:02:20 STEP 460 H= 460:00 +CPU= 21.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:04:01 STEP 461 H= 461:00 +CPU= 20.543
04:04:35 STEP 462 H= 462:00 +CPU= 33.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:06:37 STEP 463 H= 463:00 +CPU= 20.683
04:06:58 STEP 464 H= 464:00 +CPU= 21.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:09:02 STEP 465 H= 465:00 +CPU= 32.537
04:09:23 STEP 466 H= 466:00 +CPU= 21.648
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:11:25 STEP 467 H= 467:00 +CPU= 20.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:13:22 STEP 468 H= 468:00 +CPU= 35.915
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000468
04:13:43 STEP 469 H= 469:00 +CPU= 20.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:15:35 STEP 470 H= 470:00 +CPU= 20.726
04:16:07 STEP 471 H= 471:00 +CPU= 32.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:18:00 STEP 472 H= 472:00 +CPU= 21.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:20:01 STEP 473 H= 473:00 +CPU= 20.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:21:46 STEP 474 H= 474:00 +CPU= 33.347
04:22:07 STEP 475 H= 475:00 +CPU= 21.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:23:59 STEP 476 H= 476:00 +CPU= 21.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:25:43 STEP 477 H= 477:00 +CPU= 32.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:27:16 STEP 478 H= 478:00 +CPU= 21.900
04:27:37 STEP 479 H= 479:00 +CPU= 21.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:30:27 STEP 480 H= 480:00 +CPU= 37.758
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_19.zip
Uploading the intermediate file: upload_file_19.zip
04:30:47 STEP 481 H= 481:00 +CPU= 19.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:32:03 STEP 482 H= 482:00 +CPU= 19.352
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:33:38 STEP 483 H= 483:00 +CPU= 32.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:35:20 STEP 484 H= 484:00 +CPU= 21.280
04:35:41 STEP 485 H= 485:00 +CPU= 21.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:37:56 STEP 486 H= 486:00 +CPU= 33.509
04:38:16 STEP 487 H= 487:00 +CPU= 20.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:41:00 STEP 488 H= 488:00 +CPU= 22.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:43:05 STEP 489 H= 489:00 +CPU= 33.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:47:09 STEP 490 H= 490:00 +CPU= 21.979
04:47:30 STEP 491 H= 491:00 +CPU= 21.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:49:58 STEP 492 H= 492:00 +CPU= 36.994
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:51:42 STEP 493 H= 493:00 +CPU= 21.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:54:15 STEP 494 H= 494:00 +CPU= 21.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:57:00 STEP 495 H= 495:00 +CPU= 33.642
04:57:21 STEP 496 H= 496:00 +CPU= 21.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:59:54 STEP 497 H= 497:00 +CPU= 21.021
05:00:28 STEP 498 H= 498:00 +CPU= 34.074
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:03:00 STEP 499 H= 499:00 +CPU= 20.894
05:03:22 STEP 500 H= 500:00 +CPU= 21.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:06:27 STEP 501 H= 501:00 +CPU= 33.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:09:09 STEP 502 H= 502:00 +CPU= 20.825
05:09:31 STEP 503 H= 503:00 +CPU= 21.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:12:34 STEP 504 H= 504:00 +CPU= 40.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_20.zip
Uploading the intermediate file: upload_file_20.zip
05:15:07 STEP 505 H= 505:00 +CPU= 21.323
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:17:40 STEP 506 H= 506:00 +CPU= 21.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:20:26 STEP 507 H= 507:00 +CPU= 34.982
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:22:30 STEP 508 H= 508:00 +CPU= 22.811
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2014050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0634
(argv4) batchid: 983
(argv5) wuid: 12200278
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1673fc870edc11c9baca993cae59f2ac to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0634_2014050100_123_983_12200278.zip
ic_ancil_file: ic_ancil_12200278
ifsdata_file: ifsdata_12200278
climate_data_file: clim_data_12200278
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e25e1b5c900090864d964cf7347fbc08 to: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12200278.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c9fa142b2cf9aa26bed9645cbf810dd5 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12200278.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12200278.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12200278.xml
-- Model is restarting --
Adjusting last_iter, 508, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12200278.xml
last_cpu_time: 15426
upload_file_number: 21
last_iter: 503
last_upload: 1814400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408
The child process has been launched with process id: 1671300
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1671300:1671300] [20230113:052431:1673555071:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:52 STEP 504 H= 504:00 +CPU= 37.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:28:55 STEP 505 H= 505:00 +CPU= 20.738
05:29:17 STEP 506 H= 506:00 +CPU= 22.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:34 STEP 507 H= 507:00 +CPU= 33.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:17 STEP 508 H= 508:00 +CPU= 21.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:48 STEP 509 H= 509:00 +CPU= 20.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:43 STEP 510 H= 510:00 +CPU= 33.938
05:37:05 STEP 511 H= 511:00 +CPU= 21.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:08 STEP 512 H= 512:00 +CPU= 21.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:43 STEP 513 H= 513:00 +CPU= 33.406
05:42:05 STEP 514 H= 514:00 +CPU= 21.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:28 STEP 515 H= 515:00 +CPU= 21.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:46:36 STEP 516 H= 516:00 +CPU= 36.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000516
05:48:18 STEP 517 H= 517:00 +CPU= 20.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:01 STEP 518 H= 518:00 +CPU= 21.001
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:36 STEP 519 H= 519:00 +CPU= 33.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:20 STEP 520 H= 520:00 +CPU= 21.805
05:53:41 STEP 521 H= 521:00 +CPU= 21.200
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:55:46 STEP 522 H= 522:00 +CPU= 33.798
05:56:06 STEP 523 H= 523:00 +CPU= 19.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:57:58 STEP 524 H= 524:00 +CPU= 20.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:59:43 STEP 525 H= 525:00 +CPU= 32.858
06:00:04 STEP 526 H= 526:00 +CPU= 21.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:01:57 STEP 527 H= 527:00 +CPU= 21.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:04:06 STEP 528 H= 528:00 +CPU= 37.971
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12200278/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0634_2014050100_123_983_12200278_0_r1232831408_21.zip
Uploading the intermediate file: upload_file_21.zip
06:04:27 STEP 529 H= 529:00 +CPU= 21.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:50 STEP 530 H= 530:00 +CPU= 21.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:07:43 STEP 531 H= 531:00 +CPU= 32.386
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:09:36 STEP 532 H= 532:00 +CPU= 20.993
06:09:56 STEP 533 H= 533:00 +CPU= 20.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:12:01 STEP 534 H= 534:00 +CPU= 33.681
06:12:21 STEP 535 H= 535:00 +CPU= 20.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:24 STEP 536 H= 536:00 +CPU= 21.472
06:14:57 STEP 537 H= 537:00 +CPU= 32.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:16:50 STEP 538 H= 538:00 +CPU= 20.714
06:17:11 STEP 539 H= 539:00 +CPU= 21.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:19:29 STEP 540 H= 540:00 +CPU= 36.218
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000540
06:19:49 STEP 541 H= 541:00 +CPU= 20.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>