Name | oifs_43r3_ps_0304_1995050100_123_964_12180948_0 |
Workunit | 12180948 |
Created | 22 Dec 2022, 8:00:56 UTC |
Sent | 11 Jan 2023, 20:12:22 UTC |
Report deadline | 10 Feb 2023, 20:12:22 UTC |
Received | 14 Jan 2023, 4:25:37 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED |
Computer ID | 1519251 |
Run time | 7 hours 50 min 54 sec |
CPU time | 6 hours 24 min 17 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 4.94 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,418.77 MB |
Peak swap size | 4,978.08 MB |
Peak disk usage | 7,689.96 MB |
Stderr | <core_client_version>7.16.6</core_client_version> <![CDATA[ <message> Disk usage limit exceeded</message> <stderr_txt> q0f+000444 05:26:45 STEP 445 H= 445:00 +CPU= 19.775 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:31:51 STEP 446 H= 446:00 +CPU= 21.671 05:32:24 STEP 447 H= 447:00 +CPU= 33.170 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:35:37 STEP 448 H= 448:00 +CPU= 21.223 05:35:58 STEP 449 H= 449:00 +CPU= 20.824 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:39:04 STEP 450 H= 450:00 +CPU= 33.132 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:41:46 STEP 451 H= 451:00 +CPU= 20.529 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:44:40 STEP 452 H= 452:00 +CPU= 22.101 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:47:45 STEP 453 H= 453:00 +CPU= 32.921 05:48:06 STEP 454 H= 454:00 +CPU= 21.737 05:48:29 STEP 455 H= 455:00 +CPU= 22.038 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:52:40 STEP 456 H= 456:00 +CPU= 38.548 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000456 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000456 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000444 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000444 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000444 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_18.zip Uploading the intermediate file: upload_file_18.zip 05:53:01 STEP 457 H= 457:00 +CPU= 20.827 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:56:34 STEP 458 H= 458:00 +CPU= 20.659 05:57:06 STEP 459 H= 459:00 +CPU= 32.463 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:59:48 STEP 460 H= 460:00 +CPU= 21.072 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:02:11 STEP 461 H= 461:00 +CPU= 20.495 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:04:05 STEP 462 H= 462:00 +CPU= 32.964 06:04:25 STEP 463 H= 463:00 +CPU= 20.017 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:06:58 STEP 464 H= 464:00 +CPU= 20.663 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:09:32 STEP 465 H= 465:00 +CPU= 32.441 06:09:53 STEP 466 H= 466:00 +CPU= 21.556 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:12:24 STEP 467 H= 467:00 +CPU= 19.975 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:14:42 STEP 468 H= 468:00 +CPU= 35.886 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000468 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000468 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000468 06:15:02 STEP 469 H= 469:00 +CPU= 20.184 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:17:24 STEP 470 H= 470:00 +CPU= 20.542 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:19:28 STEP 471 H= 471:00 +CPU= 32.466 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:21:11 STEP 472 H= 472:00 +CPU= 21.455 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:22:52 STEP 473 H= 473:00 +CPU= 20.381 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:25:08 STEP 474 H= 474:00 +CPU= 33.667 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:27:00 STEP 475 H= 475:00 +CPU= 20.441 06:27:21 STEP 476 H= 476:00 +CPU= 21.522 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:30:05 STEP 477 H= 477:00 +CPU= 32.506 06:30:26 STEP 478 H= 478:00 +CPU= 20.687 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:33:08 STEP 479 H= 479:00 +CPU= 20.811 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:36:28 STEP 480 H= 480:00 +CPU= 38.339 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000480 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000480 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000468 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000468 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000468 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_19.zip Uploading the intermediate file: upload_file_19.zip 06:36:48 STEP 481 H= 481:00 +CPU= 20.563 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:38:50 STEP 482 H= 482:00 +CPU= 20.743 06:39:22 STEP 483 H= 483:00 +CPU= 31.906 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:42:25 STEP 484 H= 484:00 +CPU= 21.567 06:42:45 STEP 485 H= 485:00 +CPU= 20.164 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:45:19 STEP 486 H= 486:00 +CPU= 32.710 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:48:00 STEP 487 H= 487:00 +CPU= 20.147 06:48:22 STEP 488 H= 488:00 +CPU= 21.650 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:50:47 STEP 489 H= 489:00 +CPU= 32.996 06:51:08 STEP 490 H= 490:00 +CPU= 20.753 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:53:30 STEP 491 H= 491:00 +CPU= 20.817 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:56:07 STEP 492 H= 492:00 +CPU= 35.946 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000492 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000492 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000492 06:56:28 STEP 493 H= 493:00 +CPU= 20.580 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:58:40 STEP 494 H= 494:00 +CPU= 21.090 06:59:13 STEP 495 H= 495:00 +CPU= 32.490 Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1995050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0304 (argv4) batchid: 964 (argv5) wuid: 12180948 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/10 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip ic_ancil_file: ic_ancil_12180948 ifsdata_file: ifsdata_12180948 climate_data_file: clim_data_12180948 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml -- Model is restarting -- Adjusting last_iter, 496, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml last_cpu_time: 18803 upload_file_number: 20 last_iter: 479 last_upload: 1728000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474 The child process has been launched with process id: 1956866 Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1956866:1956866] [20230114:070522:1673647522:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 07:06:06 STEP 480 H= 480:00 +CPU= 36.913 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:08:39 STEP 481 H= 481:00 +CPU= 20.868 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:12:12 STEP 482 H= 482:00 +CPU= 20.722 07:12:45 STEP 483 H= 483:00 +CPU= 32.753 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:14:58 STEP 484 H= 484:00 +CPU= 21.357 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:17:10 STEP 485 H= 485:00 +CPU= 20.933 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:20:16 STEP 486 H= 486:00 +CPU= 34.006 07:20:36 STEP 487 H= 487:00 +CPU= 20.410 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:23:08 STEP 488 H= 488:00 +CPU= 21.193 07:23:41 STEP 489 H= 489:00 +CPU= 32.314 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:26:14 STEP 490 H= 490:00 +CPU= 21.329 07:26:35 STEP 491 H= 491:00 +CPU= 20.706 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:29:32 STEP 492 H= 492:00 +CPU= 35.999 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000492 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000492 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000492 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:31:33 STEP 493 H= 493:00 +CPU= 20.749 07:31:55 STEP 494 H= 494:00 +CPU= 21.717 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:34:10 STEP 495 H= 495:00 +CPU= 32.783 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:37:02 STEP 496 H= 496:00 +CPU= 21.012 07:37:23 STEP 497 H= 497:00 +CPU= 20.845 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:39:57 STEP 498 H= 498:00 +CPU= 32.886 07:40:18 STEP 499 H= 499:00 +CPU= 20.873 07:40:39 STEP 500 H= 500:00 +CPU= 20.987 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:45:25 STEP 501 H= 501:00 +CPU= 32.315 07:45:47 STEP 502 H= 502:00 +CPU= 21.471 07:46:08 STEP 503 H= 503:00 +CPU= 20.939 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:49:18 STEP 504 H= 504:00 +CPU= 37.901 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000504 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000504 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000492 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000492 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000492 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_20.zip Uploading the intermediate file: upload_file_20.zip 07:49:38 STEP 505 H= 505:00 +CPU= 20.057 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:51:57 STEP 506 H= 506:00 +CPU= 20.770 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:54:12 STEP 507 H= 507:00 +CPU= 32.419 07:54:33 STEP 508 H= 508:00 +CPU= 21.350 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:57:25 STEP 509 H= 509:00 +CPU= 20.326 07:57:58 STEP 510 H= 510:00 +CPU= 33.329 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:00:30 STEP 511 H= 511:00 +CPU= 20.322 08:00:52 STEP 512 H= 512:00 +CPU= 22.455 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:03:46 STEP 513 H= 513:00 +CPU= 32.423 08:04:07 STEP 514 H= 514:00 +CPU= 21.335 08:04:28 STEP 515 H= 515:00 +CPU= 20.524 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:07:15 STEP 516 H= 516:00 +CPU= 36.291 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000516 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000516 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000516 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:09:52 STEP 517 H= 517:00 +CPU= 20.602 08:10:14 STEP 518 H= 518:00 +CPU= 21.499 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:12:38 STEP 519 H= 519:00 +CPU= 32.818 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:14:50 STEP 520 H= 520:00 +CPU= 21.137 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:16:54 STEP 521 H= 521:00 +CPU= 21.153 08:17:27 STEP 522 H= 522:00 +CPU= 32.805 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:19:49 STEP 523 H= 523:00 +CPU= 20.147 08:20:11 STEP 524 H= 524:00 +CPU= 22.000 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:23:56 STEP 525 H= 525:00 +CPU= 32.591 08:24:18 STEP 526 H= 526:00 +CPU= 21.083 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:26:31 STEP 527 H= 527:00 +CPU= 21.354 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:29:40 STEP 528 H= 528:00 +CPU= 38.026 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000528 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000528 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000516 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000516 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000516 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_21.zip Uploading the intermediate file: upload_file_21.zip 08:30:01 STEP 529 H= 529:00 +CPU= 21.160 08:30:22 STEP 530 H= 530:00 +CPU= 21.039 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:34:07 STEP 531 H= 531:00 +CPU= 32.820 08:34:27 STEP 532 H= 532:00 +CPU= 20.803 08:34:48 STEP 533 H= 533:00 +CPU= 20.150 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:37:13 STEP 534 H= 534:00 +CPU= 33.747 08:37:33 STEP 535 H= 535:00 +CPU= 20.461 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:40:15 STEP 536 H= 536:00 +CPU= 20.669 08:40:47 STEP 537 H= 537:00 +CPU= 32.225 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:43:30 STEP 538 H= 538:00 +CPU= 21.270 08:43:51 STEP 539 H= 539:00 +CPU= 20.825 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:46:07 STEP 540 H= 540:00 +CPU= 35.238 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000540 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000540 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000540 08:48:39 STEP 541 H= 541:00 +CPU= 21.009 08:49:00 STEP 542 H= 542:00 +CPU= 21.140 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:51:36 STEP 543 H= 543:00 +CPU= 32.346 08:51:57 STEP 544 H= 544:00 +CPU= 20.843 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:54:38 STEP 545 H= 545:00 +CPU= 20.063 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:57:13 STEP 546 H= 546:00 +CPU= 33.370 08:57:34 STEP 547 H= 547:00 +CPU= 20.957 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:59:27 STEP 548 H= 548:00 +CPU= 21.654 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:02:31 STEP 549 H= 549:00 +CPU= 32.974 09:02:52 STEP 550 H= 550:00 +CPU= 21.336 09:03:13 STEP 551 H= 551:00 +CPU= 20.476 Suspend request received from the BOINC client, suspending the child process Resuming the child process Quit request received from BOINC client, ending the child process ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1995050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0304 (argv4) batchid: 964 (argv5) wuid: 12180948 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/10 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip ic_ancil_file: ic_ancil_12180948 ifsdata_file: ifsdata_12180948 climate_data_file: clim_data_12180948 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml -- Model is restarting -- Adjusting last_iter, 552, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml last_cpu_time: 20643 upload_file_number: 22 last_iter: 551 last_upload: 1900800 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474 The child process has been launched with process id: 1974969 Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1974969:1974969] [20230114:090854:1673654934:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:11:20 STEP 552 H= 552:00 +CPU= 36.722 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000552 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000552 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000540 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000540 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000540 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_22.zip Uploading the intermediate file: upload_file_22.zip 09:11:41 STEP 553 H= 553:00 +CPU= 20.916 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:14:03 STEP 554 H= 554:00 +CPU= 21.013 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:16:17 STEP 555 H= 555:00 +CPU= 32.637 09:16:38 STEP 556 H= 556:00 +CPU= 21.406 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:18:31 STEP 557 H= 557:00 +CPU= 21.186 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:21:06 STEP 558 H= 558:00 +CPU= 32.953 09:21:26 STEP 559 H= 559:00 +CPU= 20.408 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:23:59 STEP 560 H= 560:00 +CPU= 21.362 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:26:32 STEP 561 H= 561:00 +CPU= 32.284 09:26:54 STEP 562 H= 562:00 +CPU= 22.162 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:29:06 STEP 563 H= 563:00 +CPU= 20.260 09:29:42 STEP 564 H= 564:00 +CPU= 35.459 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000564 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000564 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000564 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:32:03 STEP 565 H= 565:00 +CPU= 20.599 09:32:24 STEP 566 H= 566:00 +CPU= 21.106 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:35:08 STEP 567 H= 567:00 +CPU= 32.412 09:35:29 STEP 568 H= 568:00 +CPU= 21.073 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:37:51 STEP 569 H= 569:00 +CPU= 20.946 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:39:56 STEP 570 H= 570:00 +CPU= 33.447 09:40:16 STEP 571 H= 571:00 +CPU= 20.316 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:42:20 STEP 572 H= 572:00 +CPU= 21.714 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:44:35 STEP 573 H= 573:00 +CPU= 33.041 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:46:46 STEP 574 H= 574:00 +CPU= 21.294 09:47:07 STEP 575 H= 575:00 +CPU= 21.327 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:49:57 STEP 576 H= 576:00 +CPU= 38.057 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000576 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000576 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000564 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000564 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000564 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_23.zip Uploading the intermediate file: upload_file_23.zip 09:50:17 STEP 577 H= 577:00 +CPU= 20.569 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:52:29 STEP 578 H= 578:00 +CPU= 20.149 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:54:43 STEP 579 H= 579:00 +CPU= 33.355 09:55:05 STEP 580 H= 580:00 +CPU= 21.161 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:57:16 STEP 581 H= 581:00 +CPU= 20.647 09:57:50 STEP 582 H= 582:00 +CPU= 33.295 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:00:12 STEP 583 H= 583:00 +CPU= 20.980 10:00:33 STEP 584 H= 584:00 +CPU= 21.079 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:05:39 STEP 585 H= 585:00 +CPU= 33.090 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:08:11 STEP 586 H= 586:00 +CPU= 20.754 10:08:31 STEP 587 H= 587:00 +CPU= 20.576 10:09:06 STEP 588 H= 588:00 +CPU= 34.338 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000588 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000588 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000588 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:11:38 STEP 589 H= 589:00 +CPU= 19.698 10:11:59 STEP 590 H= 590:00 +CPU= 21.410 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:14:33 STEP 591 H= 591:00 +CPU= 32.139 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:16:45 STEP 592 H= 592:00 +CPU= 21.296 10:17:06 STEP 593 H= 593:00 +CPU= 20.441 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:20:20 STEP 594 H= 594:00 +CPU= 33.543 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:22:52 STEP 595 H= 595:00 +CPU= 20.563 10:23:14 STEP 596 H= 596:00 +CPU= 21.519 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:26:19 STEP 597 H= 597:00 +CPU= 33.024 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:29:21 STEP 598 H= 598:00 +CPU= 20.823 10:29:43 STEP 599 H= 599:00 +CPU= 21.743 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:32:22 STEP 600 H= 600:00 +CPU= 37.946 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000600 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000600 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000588 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_24.zip Uploading the intermediate file: upload_file_24.zip 10:32:42 STEP 601 H= 601:00 +CPU= 19.907 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:36:24 STEP 602 H= 602:00 +CPU= 21.610 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:39:38 STEP 603 H= 603:00 +CPU= 32.809 10:39:59 STEP 604 H= 604:00 +CPU= 20.880 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:45:03 STEP 605 H= 605:00 +CPU= 21.371 10:45:38 STEP 606 H= 606:00 +CPU= 34.506 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:48:20 STEP 607 H= 607:00 +CPU= 20.970 10:48:42 STEP 608 H= 608:00 +CPU= 21.255 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:52:27 STEP 609 H= 609:00 +CPU= 33.325 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:55:09 STEP 610 H= 610:00 +CPU= 21.645 10:55:30 STEP 611 H= 611:00 +CPU= 20.605 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:58:59 STEP 612 H= 612:00 +CPU= 36.646 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000612 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000612 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000612 11:01:31 STEP 613 H= 613:00 +CPU= 21.108 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:04:14 STEP 614 H= 614:00 +CPU= 21.351 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:07:56 STEP 615 H= 615:00 +CPU= 32.349 11:08:18 STEP 616 H= 616:00 +CPU= 21.388 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:11:19 STEP 617 H= 617:00 +CPU= 19.974 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1995050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0304 (argv4) batchid: 964 (argv5) wuid: 12180948 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/10 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_bd60e2c9cdc103bcd42816bf997c8e7c to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0304_1995050100_123_964_12180948.zip ic_ancil_file: ic_ancil_12180948 ifsdata_file: ifsdata_12180948 climate_data_file: clim_data_12180948 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_58c5a2f839b30ca77ea2acd3fcc20eae to: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12180948.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fe8fb794ffaac24f3d179f564203310c to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12180948.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12180948.zip Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12180948.xml -- Model is restarting -- Adjusting last_iter, 618, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12180948.xml last_cpu_time: 22324 upload_file_number: 25 last_iter: 599 last_upload: 2160000 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474 The child process has been launched with process id: 1994615 Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:1994615:1994615] [20230114:111427:1673662467:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:17:31 STEP 600 H= 600:00 +CPU= 37.882 11:17:52 STEP 601 H= 601:00 +CPU= 20.473 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:21:05 STEP 602 H= 602:00 +CPU= 22.341 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:27:01 STEP 603 H= 603:00 +CPU= 32.473 11:27:22 STEP 604 H= 604:00 +CPU= 20.846 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:30:15 STEP 605 H= 605:00 +CPU= 20.905 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:33:59 STEP 606 H= 606:00 +CPU= 33.729 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:36:31 STEP 607 H= 607:00 +CPU= 20.472 11:36:53 STEP 608 H= 608:00 +CPU= 21.493 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:40:06 STEP 609 H= 609:00 +CPU= 32.421 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:42:50 STEP 610 H= 610:00 +CPU= 22.525 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:45:53 STEP 611 H= 611:00 +CPU= 21.091 11:46:28 STEP 612 H= 612:00 +CPU= 35.506 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000612 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000612 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000612 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:49:29 STEP 613 H= 613:00 +CPU= 20.428 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:52:31 STEP 614 H= 614:00 +CPU= 20.910 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:55:15 STEP 615 H= 615:00 +CPU= 32.680 Suspend request received from the BOINC client, suspending the child process Resuming the child process 11:58:09 STEP 616 H= 616:00 +CPU= 21.699 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:00:21 STEP 617 H= 617:00 +CPU= 20.494 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:07:17 STEP 618 H= 618:00 +CPU= 33.567 12:07:37 STEP 619 H= 619:00 +CPU= 20.460 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:10:31 STEP 620 H= 620:00 +CPU= 22.144 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:14:25 STEP 621 H= 621:00 +CPU= 32.452 12:14:46 STEP 622 H= 622:00 +CPU= 21.544 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:17:19 STEP 623 H= 623:00 +CPU= 21.992 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:20:09 STEP 624 H= 624:00 +CPU= 38.201 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+000624 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+000624 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMGGhq0f+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMSHhq0f+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180948/ICMUAhq0f+000612 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0304_1995050100_123_964_12180948_0_r37263474_25.zip Uploading the intermediate file: upload_file_25.zip 12:20:28 STEP 625 H= 625:00 +CPU= 19.273 Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:24:36 STEP 626 H= 626:00 +CPU= 20.161 12:25:08 STEP 627 H= 627:00 +CPU= 32.170 Suspend request received from the BOINC client, suspending the child process Resuming the child process Abort request received from BOINC client, ending the child process </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org