climateprediction.net home page
Task 22265942

Task 22265942

Name oifs_43r3_ps_0304_1995050100_123_964_12180948_0
Workunit 12180948
Created 22 Dec 2022, 8:00:56 UTC
Sent 11 Jan 2023, 20:12:22 UTC
Report deadline 10 Feb 2023, 20:12:22 UTC
Received 14 Jan 2023, 4:25:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1519251
Run time 7 hours 50 min 54 sec
CPU time 6 hours 24 min 17 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.94 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.77 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,689.96 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
q0f+000444
  05:26:45 STEP  445 H= 445:00 +CPU= 19.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:31:51 STEP  446 H= 446:00 +CPU= 21.671
  05:32:24 STEP  447 H= 447:00 +CPU= 33.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:35:37 STEP  448 H= 448:00 +CPU= 21.223
  05:35:58 STEP  449 H= 449:00 +CPU= 20.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:39:04 STEP  450 H= 450:00 +CPU= 33.132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:41:46 STEP  451 H= 451:00 +CPU= 20.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:44:40 STEP  452 H= 452:00 +CPU= 22.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:47:45 STEP  453 H= 453:00 +CPU= 32.921
  05:48:06 STEP  454 H= 454:00 +CPU= 21.737
  05:48:29 STEP  455 H= 455:00 +CPU= 22.038
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:52:40 STEP  456 H= 456:00 +CPU= 38.548
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_18.zip
Uploading the intermediate file: upload_file_18.zip
  05:53:01 STEP  457 H= 457:00 +CPU= 20.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:56:34 STEP  458 H= 458:00 +CPU= 20.659
  05:57:06 STEP  459 H= 459:00 +CPU= 32.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:59:48 STEP  460 H= 460:00 +CPU= 21.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:02:11 STEP  461 H= 461:00 +CPU= 20.495
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:04:05 STEP  462 H= 462:00 +CPU= 32.964
  06:04:25 STEP  463 H= 463:00 +CPU= 20.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:06:58 STEP  464 H= 464:00 +CPU= 20.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:09:32 STEP  465 H= 465:00 +CPU= 32.441
  06:09:53 STEP  466 H= 466:00 +CPU= 21.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:12:24 STEP  467 H= 467:00 +CPU= 19.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:14:42 STEP  468 H= 468:00 +CPU= 35.886
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000468
  06:15:02 STEP  469 H= 469:00 +CPU= 20.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:17:24 STEP  470 H= 470:00 +CPU= 20.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:19:28 STEP  471 H= 471:00 +CPU= 32.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:21:11 STEP  472 H= 472:00 +CPU= 21.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:22:52 STEP  473 H= 473:00 +CPU= 20.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:25:08 STEP  474 H= 474:00 +CPU= 33.667
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:27:00 STEP  475 H= 475:00 +CPU= 20.441
  06:27:21 STEP  476 H= 476:00 +CPU= 21.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:30:05 STEP  477 H= 477:00 +CPU= 32.506
  06:30:26 STEP  478 H= 478:00 +CPU= 20.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:33:08 STEP  479 H= 479:00 +CPU= 20.811
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:36:28 STEP  480 H= 480:00 +CPU= 38.339
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_19.zip
Uploading the intermediate file: upload_file_19.zip
  06:36:48 STEP  481 H= 481:00 +CPU= 20.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:38:50 STEP  482 H= 482:00 +CPU= 20.743
  06:39:22 STEP  483 H= 483:00 +CPU= 31.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:42:25 STEP  484 H= 484:00 +CPU= 21.567
  06:42:45 STEP  485 H= 485:00 +CPU= 20.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:45:19 STEP  486 H= 486:00 +CPU= 32.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:48:00 STEP  487 H= 487:00 +CPU= 20.147
  06:48:22 STEP  488 H= 488:00 +CPU= 21.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:50:47 STEP  489 H= 489:00 +CPU= 32.996
  06:51:08 STEP  490 H= 490:00 +CPU= 20.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:53:30 STEP  491 H= 491:00 +CPU= 20.817
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:56:07 STEP  492 H= 492:00 +CPU= 35.946
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000492
  06:56:28 STEP  493 H= 493:00 +CPU= 20.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:58:40 STEP  494 H= 494:00 +CPU= 21.090
  06:59:13 STEP  495 H= 495:00 +CPU= 32.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0304
(argv4) batchid: 964
(argv5) wuid: 12180948
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
ic_ancil_file: ic_ancil_12180948
ifsdata_file: ifsdata_12180948
climate_data_file: clim_data_12180948
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml
-- Model is restarting --
Adjusting last_iter, 496, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
last_cpu_time: 18803
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474
The child process has been launched with process id: 1956866
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:06:06 STEP  480 H= 480:00 +CPU= 36.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:08:39 STEP  481 H= 481:00 +CPU= 20.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:12:12 STEP  482 H= 482:00 +CPU= 20.722
  07:12:45 STEP  483 H= 483:00 +CPU= 32.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:14:58 STEP  484 H= 484:00 +CPU= 21.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:17:10 STEP  485 H= 485:00 +CPU= 20.933
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:20:16 STEP  486 H= 486:00 +CPU= 34.006
  07:20:36 STEP  487 H= 487:00 +CPU= 20.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:23:08 STEP  488 H= 488:00 +CPU= 21.193
  07:23:41 STEP  489 H= 489:00 +CPU= 32.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:26:14 STEP  490 H= 490:00 +CPU= 21.329
  07:26:35 STEP  491 H= 491:00 +CPU= 20.706
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:29:32 STEP  492 H= 492:00 +CPU= 35.999
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:31:33 STEP  493 H= 493:00 +CPU= 20.749
  07:31:55 STEP  494 H= 494:00 +CPU= 21.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:34:10 STEP  495 H= 495:00 +CPU= 32.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:37:02 STEP  496 H= 496:00 +CPU= 21.012
  07:37:23 STEP  497 H= 497:00 +CPU= 20.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:39:57 STEP  498 H= 498:00 +CPU= 32.886
  07:40:18 STEP  499 H= 499:00 +CPU= 20.873
  07:40:39 STEP  500 H= 500:00 +CPU= 20.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:45:25 STEP  501 H= 501:00 +CPU= 32.315
  07:45:47 STEP  502 H= 502:00 +CPU= 21.471
  07:46:08 STEP  503 H= 503:00 +CPU= 20.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:49:18 STEP  504 H= 504:00 +CPU= 37.901
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_20.zip
Uploading the intermediate file: upload_file_20.zip
  07:49:38 STEP  505 H= 505:00 +CPU= 20.057
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:51:57 STEP  506 H= 506:00 +CPU= 20.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:54:12 STEP  507 H= 507:00 +CPU= 32.419
  07:54:33 STEP  508 H= 508:00 +CPU= 21.350
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:57:25 STEP  509 H= 509:00 +CPU= 20.326
  07:57:58 STEP  510 H= 510:00 +CPU= 33.329
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:00:30 STEP  511 H= 511:00 +CPU= 20.322
  08:00:52 STEP  512 H= 512:00 +CPU= 22.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:03:46 STEP  513 H= 513:00 +CPU= 32.423
  08:04:07 STEP  514 H= 514:00 +CPU= 21.335
  08:04:28 STEP  515 H= 515:00 +CPU= 20.524
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:07:15 STEP  516 H= 516:00 +CPU= 36.291
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:09:52 STEP  517 H= 517:00 +CPU= 20.602
  08:10:14 STEP  518 H= 518:00 +CPU= 21.499
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:12:38 STEP  519 H= 519:00 +CPU= 32.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:14:50 STEP  520 H= 520:00 +CPU= 21.137
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:16:54 STEP  521 H= 521:00 +CPU= 21.153
  08:17:27 STEP  522 H= 522:00 +CPU= 32.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:19:49 STEP  523 H= 523:00 +CPU= 20.147
  08:20:11 STEP  524 H= 524:00 +CPU= 22.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:23:56 STEP  525 H= 525:00 +CPU= 32.591
  08:24:18 STEP  526 H= 526:00 +CPU= 21.083
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:26:31 STEP  527 H= 527:00 +CPU= 21.354
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:29:40 STEP  528 H= 528:00 +CPU= 38.026
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_21.zip
Uploading the intermediate file: upload_file_21.zip
  08:30:01 STEP  529 H= 529:00 +CPU= 21.160
  08:30:22 STEP  530 H= 530:00 +CPU= 21.039
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:34:07 STEP  531 H= 531:00 +CPU= 32.820
  08:34:27 STEP  532 H= 532:00 +CPU= 20.803
  08:34:48 STEP  533 H= 533:00 +CPU= 20.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:37:13 STEP  534 H= 534:00 +CPU= 33.747
  08:37:33 STEP  535 H= 535:00 +CPU= 20.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:40:15 STEP  536 H= 536:00 +CPU= 20.669
  08:40:47 STEP  537 H= 537:00 +CPU= 32.225
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:43:30 STEP  538 H= 538:00 +CPU= 21.270
  08:43:51 STEP  539 H= 539:00 +CPU= 20.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:46:07 STEP  540 H= 540:00 +CPU= 35.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000540
  08:48:39 STEP  541 H= 541:00 +CPU= 21.009
  08:49:00 STEP  542 H= 542:00 +CPU= 21.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:51:36 STEP  543 H= 543:00 +CPU= 32.346
  08:51:57 STEP  544 H= 544:00 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:54:38 STEP  545 H= 545:00 +CPU= 20.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:57:13 STEP  546 H= 546:00 +CPU= 33.370
  08:57:34 STEP  547 H= 547:00 +CPU= 20.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:59:27 STEP  548 H= 548:00 +CPU= 21.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:02:31 STEP  549 H= 549:00 +CPU= 32.974
  09:02:52 STEP  550 H= 550:00 +CPU= 21.336
  09:03:13 STEP  551 H= 551:00 +CPU= 20.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0304
(argv4) batchid: 964
(argv5) wuid: 12180948
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
ic_ancil_file: ic_ancil_12180948
ifsdata_file: ifsdata_12180948
climate_data_file: clim_data_12180948
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml
-- Model is restarting --
Adjusting last_iter, 552, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
last_cpu_time: 20643
upload_file_number: 22
last_iter: 551
last_upload: 1900800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474
The child process has been launched with process id: 1974969
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:11:20 STEP  552 H= 552:00 +CPU= 36.722
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_22.zip
Uploading the intermediate file: upload_file_22.zip
  09:11:41 STEP  553 H= 553:00 +CPU= 20.916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:14:03 STEP  554 H= 554:00 +CPU= 21.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:16:17 STEP  555 H= 555:00 +CPU= 32.637
  09:16:38 STEP  556 H= 556:00 +CPU= 21.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:18:31 STEP  557 H= 557:00 +CPU= 21.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:21:06 STEP  558 H= 558:00 +CPU= 32.953
  09:21:26 STEP  559 H= 559:00 +CPU= 20.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:23:59 STEP  560 H= 560:00 +CPU= 21.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:26:32 STEP  561 H= 561:00 +CPU= 32.284
  09:26:54 STEP  562 H= 562:00 +CPU= 22.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:29:06 STEP  563 H= 563:00 +CPU= 20.260
  09:29:42 STEP  564 H= 564:00 +CPU= 35.459
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:32:03 STEP  565 H= 565:00 +CPU= 20.599
  09:32:24 STEP  566 H= 566:00 +CPU= 21.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:35:08 STEP  567 H= 567:00 +CPU= 32.412
  09:35:29 STEP  568 H= 568:00 +CPU= 21.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:37:51 STEP  569 H= 569:00 +CPU= 20.946
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:39:56 STEP  570 H= 570:00 +CPU= 33.447
  09:40:16 STEP  571 H= 571:00 +CPU= 20.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:42:20 STEP  572 H= 572:00 +CPU= 21.714
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:44:35 STEP  573 H= 573:00 +CPU= 33.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:46:46 STEP  574 H= 574:00 +CPU= 21.294
  09:47:07 STEP  575 H= 575:00 +CPU= 21.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:49:57 STEP  576 H= 576:00 +CPU= 38.057
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_23.zip
Uploading the intermediate file: upload_file_23.zip
  09:50:17 STEP  577 H= 577:00 +CPU= 20.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:52:29 STEP  578 H= 578:00 +CPU= 20.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:54:43 STEP  579 H= 579:00 +CPU= 33.355
  09:55:05 STEP  580 H= 580:00 +CPU= 21.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:57:16 STEP  581 H= 581:00 +CPU= 20.647
  09:57:50 STEP  582 H= 582:00 +CPU= 33.295
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:00:12 STEP  583 H= 583:00 +CPU= 20.980
  10:00:33 STEP  584 H= 584:00 +CPU= 21.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:05:39 STEP  585 H= 585:00 +CPU= 33.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:08:11 STEP  586 H= 586:00 +CPU= 20.754
  10:08:31 STEP  587 H= 587:00 +CPU= 20.576
  10:09:06 STEP  588 H= 588:00 +CPU= 34.338
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:11:38 STEP  589 H= 589:00 +CPU= 19.698
  10:11:59 STEP  590 H= 590:00 +CPU= 21.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:14:33 STEP  591 H= 591:00 +CPU= 32.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:16:45 STEP  592 H= 592:00 +CPU= 21.296
  10:17:06 STEP  593 H= 593:00 +CPU= 20.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:20:20 STEP  594 H= 594:00 +CPU= 33.543
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:22:52 STEP  595 H= 595:00 +CPU= 20.563
  10:23:14 STEP  596 H= 596:00 +CPU= 21.519
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:26:19 STEP  597 H= 597:00 +CPU= 33.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:29:21 STEP  598 H= 598:00 +CPU= 20.823
  10:29:43 STEP  599 H= 599:00 +CPU= 21.743
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:32:22 STEP  600 H= 600:00 +CPU= 37.946
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_24.zip
Uploading the intermediate file: upload_file_24.zip
  10:32:42 STEP  601 H= 601:00 +CPU= 19.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:36:24 STEP  602 H= 602:00 +CPU= 21.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:39:38 STEP  603 H= 603:00 +CPU= 32.809
  10:39:59 STEP  604 H= 604:00 +CPU= 20.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:45:03 STEP  605 H= 605:00 +CPU= 21.371
  10:45:38 STEP  606 H= 606:00 +CPU= 34.506
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:48:20 STEP  607 H= 607:00 +CPU= 20.970
  10:48:42 STEP  608 H= 608:00 +CPU= 21.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:52:27 STEP  609 H= 609:00 +CPU= 33.325
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:55:09 STEP  610 H= 610:00 +CPU= 21.645
  10:55:30 STEP  611 H= 611:00 +CPU= 20.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:58:59 STEP  612 H= 612:00 +CPU= 36.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000612
  11:01:31 STEP  613 H= 613:00 +CPU= 21.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:04:14 STEP  614 H= 614:00 +CPU= 21.351
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:07:56 STEP  615 H= 615:00 +CPU= 32.349
  11:08:18 STEP  616 H= 616:00 +CPU= 21.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:11:19 STEP  617 H= 617:00 +CPU= 19.974
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0304
(argv4) batchid: 964
(argv5) wuid: 12180948
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip
ic_ancil_file: ic_ancil_12180948
ifsdata_file: ifsdata_12180948
climate_data_file: clim_data_12180948
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml
-- Model is restarting --
Adjusting last_iter, 618, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml
last_cpu_time: 22324
upload_file_number: 25
last_iter: 599
last_upload: 2160000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474
The child process has been launched with process id: 1994615
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:17:31 STEP  600 H= 600:00 +CPU= 37.882
  11:17:52 STEP  601 H= 601:00 +CPU= 20.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:21:05 STEP  602 H= 602:00 +CPU= 22.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:27:01 STEP  603 H= 603:00 +CPU= 32.473
  11:27:22 STEP  604 H= 604:00 +CPU= 20.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:30:15 STEP  605 H= 605:00 +CPU= 20.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:33:59 STEP  606 H= 606:00 +CPU= 33.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:36:31 STEP  607 H= 607:00 +CPU= 20.472
  11:36:53 STEP  608 H= 608:00 +CPU= 21.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:40:06 STEP  609 H= 609:00 +CPU= 32.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:42:50 STEP  610 H= 610:00 +CPU= 22.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:45:53 STEP  611 H= 611:00 +CPU= 21.091
  11:46:28 STEP  612 H= 612:00 +CPU= 35.506
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:49:29 STEP  613 H= 613:00 +CPU= 20.428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:52:31 STEP  614 H= 614:00 +CPU= 20.910
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:55:15 STEP  615 H= 615:00 +CPU= 32.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:58:09 STEP  616 H= 616:00 +CPU= 21.699
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:00:21 STEP  617 H= 617:00 +CPU= 20.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:07:17 STEP  618 H= 618:00 +CPU= 33.567
  12:07:37 STEP  619 H= 619:00 +CPU= 20.460
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:10:31 STEP  620 H= 620:00 +CPU= 22.144
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:14:25 STEP  621 H= 621:00 +CPU= 32.452
  12:14:46 STEP  622 H= 622:00 +CPU= 21.544
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:17:19 STEP  623 H= 623:00 +CPU= 21.992
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:20:09 STEP  624 H= 624:00 +CPU= 38.201
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_25.zip
Uploading the intermediate file: upload_file_25.zip
  12:20:28 STEP  625 H= 625:00 +CPU= 19.273
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:24:36 STEP  626 H= 626:00 +CPU= 20.161
  12:25:08 STEP  627 H= 627:00 +CPU= 32.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org