climateprediction.net home page
Task 22302830

Task 22302830

Name oifs_43r3_ps_0541_2000050100_123_969_12186185_1
Workunit 12186185
Created 24 Jan 2023, 9:10:33 UTC
Sent 24 Jan 2023, 9:22:50 UTC
Report deadline 25 Mar 2023, 9:22:50 UTC
Received 26 Jan 2023, 11:12:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532331
Run time 22 hours 33 min 30 sec
CPU time 22 hours 23 min 59 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.10 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.40 MB
Peak swap size 4,978.07 MB
Peak disk usage 5,260.07 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
s_12186185/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_100.zip
Uploading the intermediate file: upload_file_100.zip
  05:04:24 STEP 2425 H=2425:00 +CPU= 25.404
  05:04:50 STEP 2426 H=2426:00 +CPU= 26.166
  05:05:31 STEP 2427 H=2427:00 +CPU= 40.633
  05:05:56 STEP 2428 H=2428:00 +CPU= 25.228
  05:06:20 STEP 2429 H=2429:00 +CPU= 24.058
  05:07:02 STEP 2430 H=2430:00 +CPU= 41.648
  05:07:30 STEP 2431 H=2431:00 +CPU= 27.478
  05:07:56 STEP 2432 H=2432:00 +CPU= 25.797
  05:08:33 STEP 2433 H=2433:00 +CPU= 36.952
  05:08:56 STEP 2434 H=2434:00 +CPU= 23.157
  05:09:20 STEP 2435 H=2435:00 +CPU= 23.618
  05:10:04 STEP 2436 H=2436:00 +CPU= 43.615
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002436
  05:10:30 STEP 2437 H=2437:00 +CPU= 26.163
  05:10:58 STEP 2438 H=2438:00 +CPU= 28.042
  05:11:39 STEP 2439 H=2439:00 +CPU= 41.085
  05:12:06 STEP 2440 H=2440:00 +CPU= 26.745
  05:12:34 STEP 2441 H=2441:00 +CPU= 27.615
  05:13:14 STEP 2442 H=2442:00 +CPU= 39.438
  05:13:40 STEP 2443 H=2443:00 +CPU= 26.015
  05:14:07 STEP 2444 H=2444:00 +CPU= 26.585
  05:14:44 STEP 2445 H=2445:00 +CPU= 36.991
  05:15:09 STEP 2446 H=2446:00 +CPU= 25.110
  05:15:33 STEP 2447 H=2447:00 +CPU= 24.278
  05:16:16 STEP 2448 H=2448:00 +CPU= 43.056
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_101.zip
Uploading the intermediate file: upload_file_101.zip
  05:16:43 STEP 2449 H=2449:00 +CPU= 26.342
  05:17:12 STEP 2450 H=2450:00 +CPU= 29.220
  05:17:54 STEP 2451 H=2451:00 +CPU= 41.434
  05:18:23 STEP 2452 H=2452:00 +CPU= 28.638
  05:18:47 STEP 2453 H=2453:00 +CPU= 23.490
  05:19:24 STEP 2454 H=2454:00 +CPU= 36.906
  05:19:48 STEP 2455 H=2455:00 +CPU= 24.007
  05:20:13 STEP 2456 H=2456:00 +CPU= 24.740
  05:20:50 STEP 2457 H=2457:00 +CPU= 36.765
  05:21:14 STEP 2458 H=2458:00 +CPU= 24.023
  05:21:38 STEP 2459 H=2459:00 +CPU= 23.914
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0541
(argv4) batchid: 969
(argv5) wuid: 12186185
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/19
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/19/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/19/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5079284fa103e223cc365026a3ec93cd to: /var/lib/boinc-client/slots/19/oifs_43r3_ps_0541_2000050100_123_969_12186185.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/19/oifs_43r3_ps_0541_2000050100_123_969_12186185.zip
ic_ancil_file: ic_ancil_12186185
ifsdata_file: ifsdata_12186185
climate_data_file: clim_data_12186185
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c47ade2daddee8f6b8386e326dbc9efd to: /var/lib/boinc-client/slots/19/ic_ancil_12186185.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/19/ic_ancil_12186185.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_645f6526f6b680afc30a88102866feaa to: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12186185.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12186185.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/19/159l_2/clim_data_12186185.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/19/159l_2/clim_data_12186185.zip
Checking for progress XML file: /var/lib/boinc-client/slots/19/progress_file_12186185.xml
Opened progress file ok : /var/lib/boinc-client/slots/19/progress_file_12186185.xml
-- Model is restarting --
Adjusting last_iter, 2460, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/19/progress_file_12186185.xml
last_cpu_time: 63954
upload_file_number: 102
last_iter: 2447
last_upload: 8812800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408
The child process has been launched with process id: 1551571
Executing the command: /var/lib/boinc-client/slots/19/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Serveur-Master:1:1:1551571:1551571] [20230126:054738:1674712058:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:48:19 STEP 2448 H=2448:00 +CPU= 37.981
  05:48:40 STEP 2449 H=2449:00 +CPU= 19.498
  05:49:03 STEP 2450 H=2450:00 +CPU= 20.950
  05:49:36 STEP 2451 H=2451:00 +CPU= 31.168
  05:49:55 STEP 2452 H=2452:00 +CPU= 18.673
  05:50:13 STEP 2453 H=2453:00 +CPU= 18.154
  05:50:46 STEP 2454 H=2454:00 +CPU= 31.880
  05:51:08 STEP 2455 H=2455:00 +CPU= 21.709
  05:51:32 STEP 2456 H=2456:00 +CPU= 22.331
  05:52:09 STEP 2457 H=2457:00 +CPU= 35.807
  05:52:33 STEP 2458 H=2458:00 +CPU= 23.449
  05:52:56 STEP 2459 H=2459:00 +CPU= 22.114
  05:53:38 STEP 2460 H=2460:00 +CPU= 39.469
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002460
  05:54:02 STEP 2461 H=2461:00 +CPU= 23.018
  05:54:28 STEP 2462 H=2462:00 +CPU= 25.009
  05:55:03 STEP 2463 H=2463:00 +CPU= 34.631
  05:55:28 STEP 2464 H=2464:00 +CPU= 23.396
  05:55:54 STEP 2465 H=2465:00 +CPU= 23.950
  05:56:35 STEP 2466 H=2466:00 +CPU= 38.781
  05:57:02 STEP 2467 H=2467:00 +CPU= 24.700
  05:57:28 STEP 2468 H=2468:00 +CPU= 24.344
  05:58:06 STEP 2469 H=2469:00 +CPU= 36.318
  05:58:31 STEP 2470 H=2470:00 +CPU= 24.249
  05:58:57 STEP 2471 H=2471:00 +CPU= 24.661
  05:59:45 STEP 2472 H=2472:00 +CPU= 45.765
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_102.zip
Uploading the intermediate file: upload_file_102.zip
  06:00:14 STEP 2473 H=2473:00 +CPU= 28.687
  06:00:43 STEP 2474 H=2474:00 +CPU= 28.363
  06:01:23 STEP 2475 H=2475:00 +CPU= 40.380
  06:01:47 STEP 2476 H=2476:00 +CPU= 23.257
  06:02:10 STEP 2477 H=2477:00 +CPU= 23.913
  06:02:48 STEP 2478 H=2478:00 +CPU= 37.141
  06:03:10 STEP 2479 H=2479:00 +CPU= 22.310
  06:03:36 STEP 2480 H=2480:00 +CPU= 25.930
  06:04:13 STEP 2481 H=2481:00 +CPU= 37.060
  06:04:36 STEP 2482 H=2482:00 +CPU= 22.796
  06:04:59 STEP 2483 H=2483:00 +CPU= 22.282
  06:05:39 STEP 2484 H=2484:00 +CPU= 40.731
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002484
  06:06:02 STEP 2485 H=2485:00 +CPU= 22.266
  06:06:26 STEP 2486 H=2486:00 +CPU= 23.962
  06:07:03 STEP 2487 H=2487:00 +CPU= 37.274
  06:07:26 STEP 2488 H=2488:00 +CPU= 22.953
  06:07:49 STEP 2489 H=2489:00 +CPU= 22.270
  06:08:27 STEP 2490 H=2490:00 +CPU= 38.533
  06:08:49 STEP 2491 H=2491:00 +CPU= 21.762
  06:09:12 STEP 2492 H=2492:00 +CPU= 23.208
  06:09:50 STEP 2493 H=2493:00 +CPU= 37.808
  06:10:13 STEP 2494 H=2494:00 +CPU= 22.348
  06:10:35 STEP 2495 H=2495:00 +CPU= 22.613
  06:11:16 STEP 2496 H=2496:00 +CPU= 40.055
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_103.zip
Uploading the intermediate file: upload_file_103.zip
  06:11:35 STEP 2497 H=2497:00 +CPU= 19.689
  06:11:56 STEP 2498 H=2498:00 +CPU= 20.805
  06:12:29 STEP 2499 H=2499:00 +CPU= 32.803
  06:12:50 STEP 2500 H=2500:00 +CPU= 20.369
  06:13:10 STEP 2501 H=2501:00 +CPU= 20.165
  06:13:40 STEP 2502 H=2502:00 +CPU= 30.272
  06:13:58 STEP 2503 H=2503:00 +CPU= 18.142
  06:14:19 STEP 2504 H=2504:00 +CPU= 20.509
  06:14:50 STEP 2505 H=2505:00 +CPU= 31.574
  06:15:10 STEP 2506 H=2506:00 +CPU= 19.851
  06:15:30 STEP 2507 H=2507:00 +CPU= 19.865
  06:16:05 STEP 2508 H=2508:00 +CPU= 34.920
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002508
  06:16:24 STEP 2509 H=2509:00 +CPU= 18.793
  06:16:43 STEP 2510 H=2510:00 +CPU= 19.167
  06:17:14 STEP 2511 H=2511:00 +CPU= 30.823
  06:17:34 STEP 2512 H=2512:00 +CPU= 19.246
  06:17:53 STEP 2513 H=2513:00 +CPU= 19.580
  06:18:26 STEP 2514 H=2514:00 +CPU= 32.735
  06:18:45 STEP 2515 H=2515:00 +CPU= 18.614
  06:19:06 STEP 2516 H=2516:00 +CPU= 21.049
  06:19:37 STEP 2517 H=2517:00 +CPU= 31.506
  06:19:57 STEP 2518 H=2518:00 +CPU= 19.236
  06:20:17 STEP 2519 H=2519:00 +CPU= 19.924
  06:20:54 STEP 2520 H=2520:00 +CPU= 37.743
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_104.zip
Uploading the intermediate file: upload_file_104.zip
  06:21:14 STEP 2521 H=2521:00 +CPU= 19.345
  06:21:34 STEP 2522 H=2522:00 +CPU= 20.022
  06:22:06 STEP 2523 H=2523:00 +CPU= 31.908
  06:22:27 STEP 2524 H=2524:00 +CPU= 20.842
  06:22:46 STEP 2525 H=2525:00 +CPU= 18.637
  06:23:18 STEP 2526 H=2526:00 +CPU= 32.465
  06:23:39 STEP 2527 H=2527:00 +CPU= 20.518
  06:23:59 STEP 2528 H=2528:00 +CPU= 19.885
  06:24:32 STEP 2529 H=2529:00 +CPU= 33.322
  06:24:52 STEP 2530 H=2530:00 +CPU= 20.289
  06:25:13 STEP 2531 H=2531:00 +CPU= 20.137
  06:25:48 STEP 2532 H=2532:00 +CPU= 35.289
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002532
  06:26:07 STEP 2533 H=2533:00 +CPU= 18.859
  06:26:28 STEP 2534 H=2534:00 +CPU= 20.842
  06:27:00 STEP 2535 H=2535:00 +CPU= 32.004
  06:27:20 STEP 2536 H=2536:00 +CPU= 19.608
  06:27:40 STEP 2537 H=2537:00 +CPU= 20.002
  06:28:14 STEP 2538 H=2538:00 +CPU= 34.555
  06:28:34 STEP 2539 H=2539:00 +CPU= 19.762
  06:28:54 STEP 2540 H=2540:00 +CPU= 20.279
  06:29:27 STEP 2541 H=2541:00 +CPU= 32.486
  06:29:47 STEP 2542 H=2542:00 +CPU= 19.501
  06:30:07 STEP 2543 H=2543:00 +CPU= 20.219
  06:30:47 STEP 2544 H=2544:00 +CPU= 39.607
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_105.zip
Uploading the intermediate file: upload_file_105.zip
  06:31:06 STEP 2545 H=2545:00 +CPU= 19.490
  06:31:28 STEP 2546 H=2546:00 +CPU= 21.411
  06:32:01 STEP 2547 H=2547:00 +CPU= 33.110
  06:32:21 STEP 2548 H=2548:00 +CPU= 20.097
  06:32:41 STEP 2549 H=2549:00 +CPU= 20.513
  06:33:15 STEP 2550 H=2550:00 +CPU= 33.776
  06:33:36 STEP 2551 H=2551:00 +CPU= 20.515
  06:33:58 STEP 2552 H=2552:00 +CPU= 21.502
  06:34:31 STEP 2553 H=2553:00 +CPU= 33.333
  06:34:52 STEP 2554 H=2554:00 +CPU= 21.415
  06:35:12 STEP 2555 H=2555:00 +CPU= 19.486
  06:35:48 STEP 2556 H=2556:00 +CPU= 35.809
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002556
  06:36:07 STEP 2557 H=2557:00 +CPU= 19.259
  06:36:29 STEP 2558 H=2558:00 +CPU= 21.829
  06:37:02 STEP 2559 H=2559:00 +CPU= 33.207
  06:37:23 STEP 2560 H=2560:00 +CPU= 20.351
  06:37:44 STEP 2561 H=2561:00 +CPU= 21.459
  06:38:16 STEP 2562 H=2562:00 +CPU= 32.055
  06:38:36 STEP 2563 H=2563:00 +CPU= 19.456
  06:38:57 STEP 2564 H=2564:00 +CPU= 21.179
  06:39:30 STEP 2565 H=2565:00 +CPU= 32.695
  06:39:51 STEP 2566 H=2566:00 +CPU= 21.387
  06:40:13 STEP 2567 H=2567:00 +CPU= 21.467
  06:40:50 STEP 2568 H=2568:00 +CPU= 36.672
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_106.zip
Uploading the intermediate file: upload_file_106.zip
  06:41:10 STEP 2569 H=2569:00 +CPU= 20.364
  06:41:31 STEP 2570 H=2570:00 +CPU= 21.132
  06:42:04 STEP 2571 H=2571:00 +CPU= 32.538
  06:42:24 STEP 2572 H=2572:00 +CPU= 20.182
  06:42:44 STEP 2573 H=2573:00 +CPU= 20.106
  06:43:18 STEP 2574 H=2574:00 +CPU= 33.519
  06:43:39 STEP 2575 H=2575:00 +CPU= 20.709
  06:44:00 STEP 2576 H=2576:00 +CPU= 21.539
  06:44:33 STEP 2577 H=2577:00 +CPU= 32.647
  06:44:53 STEP 2578 H=2578:00 +CPU= 20.189
  06:45:13 STEP 2579 H=2579:00 +CPU= 19.468
  06:45:49 STEP 2580 H=2580:00 +CPU= 36.058
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002580
  06:46:09 STEP 2581 H=2581:00 +CPU= 19.836
  06:46:30 STEP 2582 H=2582:00 +CPU= 21.219
  06:47:02 STEP 2583 H=2583:00 +CPU= 31.240
  06:47:23 STEP 2584 H=2584:00 +CPU= 21.170
  06:47:43 STEP 2585 H=2585:00 +CPU= 20.077
  06:48:16 STEP 2586 H=2586:00 +CPU= 32.467
  06:48:36 STEP 2587 H=2587:00 +CPU= 20.826
  06:48:56 STEP 2588 H=2588:00 +CPU= 19.582
  06:49:27 STEP 2589 H=2589:00 +CPU= 30.474
  06:49:49 STEP 2590 H=2590:00 +CPU= 22.753
  06:50:11 STEP 2591 H=2591:00 +CPU= 21.544
  06:50:49 STEP 2592 H=2592:00 +CPU= 38.243
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_107.zip
Uploading the intermediate file: upload_file_107.zip
  06:51:09 STEP 2593 H=2593:00 +CPU= 19.698
  06:51:31 STEP 2594 H=2594:00 +CPU= 22.053
  06:52:04 STEP 2595 H=2595:00 +CPU= 32.374
  06:52:26 STEP 2596 H=2596:00 +CPU= 21.714
  06:52:46 STEP 2597 H=2597:00 +CPU= 20.473
  06:53:19 STEP 2598 H=2598:00 +CPU= 32.740
  06:53:40 STEP 2599 H=2599:00 +CPU= 20.728
  06:54:00 STEP 2600 H=2600:00 +CPU= 20.211
  06:54:33 STEP 2601 H=2601:00 +CPU= 32.633
  06:54:56 STEP 2602 H=2602:00 +CPU= 23.017
  06:55:20 STEP 2603 H=2603:00 +CPU= 23.651
  06:55:56 STEP 2604 H=2604:00 +CPU= 36.770
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002604
  06:56:21 STEP 2605 H=2605:00 +CPU= 24.218
  06:56:43 STEP 2606 H=2606:00 +CPU= 22.615
  06:57:19 STEP 2607 H=2607:00 +CPU= 35.492
  06:57:43 STEP 2608 H=2608:00 +CPU= 23.941
  06:58:05 STEP 2609 H=2609:00 +CPU= 21.439
  06:58:40 STEP 2610 H=2610:00 +CPU= 35.737
  06:59:03 STEP 2611 H=2611:00 +CPU= 22.221
  06:59:26 STEP 2612 H=2612:00 +CPU= 22.772
  07:00:02 STEP 2613 H=2613:00 +CPU= 35.874
  07:00:25 STEP 2614 H=2614:00 +CPU= 23.629
  07:00:49 STEP 2615 H=2615:00 +CPU= 23.383
  07:01:31 STEP 2616 H=2616:00 +CPU= 41.835
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_108.zip
Uploading the intermediate file: upload_file_108.zip
  07:01:53 STEP 2617 H=2617:00 +CPU= 22.526
  07:02:17 STEP 2618 H=2618:00 +CPU= 23.666
  07:02:52 STEP 2619 H=2619:00 +CPU= 34.835
  07:03:16 STEP 2620 H=2620:00 +CPU= 23.731
  07:03:37 STEP 2621 H=2621:00 +CPU= 21.219
  07:04:15 STEP 2622 H=2622:00 +CPU= 37.453
  07:04:37 STEP 2623 H=2623:00 +CPU= 22.440
  07:05:00 STEP 2624 H=2624:00 +CPU= 23.103
  07:05:37 STEP 2625 H=2625:00 +CPU= 36.375
  07:06:00 STEP 2626 H=2626:00 +CPU= 23.292
  07:06:22 STEP 2627 H=2627:00 +CPU= 21.300
  07:07:01 STEP 2628 H=2628:00 +CPU= 39.131
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002628
  07:07:24 STEP 2629 H=2629:00 +CPU= 23.603
  07:07:48 STEP 2630 H=2630:00 +CPU= 23.006
  07:08:23 STEP 2631 H=2631:00 +CPU= 34.847
  07:08:46 STEP 2632 H=2632:00 +CPU= 23.545
  07:09:07 STEP 2633 H=2633:00 +CPU= 21.110
  07:09:43 STEP 2634 H=2634:00 +CPU= 35.772
  07:10:06 STEP 2635 H=2635:00 +CPU= 23.230
  07:10:30 STEP 2636 H=2636:00 +CPU= 23.051
  07:11:04 STEP 2637 H=2637:00 +CPU= 34.124
  07:11:28 STEP 2638 H=2638:00 +CPU= 23.637
  07:11:49 STEP 2639 H=2639:00 +CPU= 21.710
  07:12:31 STEP 2640 H=2640:00 +CPU= 41.183
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_109.zip
Uploading the intermediate file: upload_file_109.zip
  07:12:53 STEP 2641 H=2641:00 +CPU= 22.491
  07:13:16 STEP 2642 H=2642:00 +CPU= 22.426
  07:13:52 STEP 2643 H=2643:00 +CPU= 36.299
  07:14:16 STEP 2644 H=2644:00 +CPU= 24.306
  07:14:40 STEP 2645 H=2645:00 +CPU= 23.925
  07:15:17 STEP 2646 H=2646:00 +CPU= 36.243
  07:15:39 STEP 2647 H=2647:00 +CPU= 22.311
  07:16:03 STEP 2648 H=2648:00 +CPU= 24.000
  07:16:37 STEP 2649 H=2649:00 +CPU= 34.048
  07:17:00 STEP 2650 H=2650:00 +CPU= 22.846
  07:17:25 STEP 2651 H=2651:00 +CPU= 24.421
  07:18:04 STEP 2652 H=2652:00 +CPU= 38.536
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002652
  07:18:27 STEP 2653 H=2653:00 +CPU= 23.163
  07:18:50 STEP 2654 H=2654:00 +CPU= 23.440
  07:19:25 STEP 2655 H=2655:00 +CPU= 34.283
  07:19:48 STEP 2656 H=2656:00 +CPU= 23.333
  07:20:11 STEP 2657 H=2657:00 +CPU= 22.478
  07:20:46 STEP 2658 H=2658:00 +CPU= 34.997
  07:21:07 STEP 2659 H=2659:00 +CPU= 21.621
  07:21:31 STEP 2660 H=2660:00 +CPU= 23.561
  07:22:06 STEP 2661 H=2661:00 +CPU= 35.125
  07:22:29 STEP 2662 H=2662:00 +CPU= 22.696
  07:22:53 STEP 2663 H=2663:00 +CPU= 23.769
  07:23:34 STEP 2664 H=2664:00 +CPU= 41.322
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_110.zip
Uploading the intermediate file: upload_file_110.zip
  07:23:58 STEP 2665 H=2665:00 +CPU= 23.048
  07:24:20 STEP 2666 H=2666:00 +CPU= 22.678
  07:24:55 STEP 2667 H=2667:00 +CPU= 34.684
  07:25:19 STEP 2668 H=2668:00 +CPU= 23.486
  07:25:42 STEP 2669 H=2669:00 +CPU= 23.069
  07:26:17 STEP 2670 H=2670:00 +CPU= 35.121
  07:26:43 STEP 2671 H=2671:00 +CPU= 25.965
  07:27:10 STEP 2672 H=2672:00 +CPU= 26.440
  07:27:49 STEP 2673 H=2673:00 +CPU= 39.444
  07:28:15 STEP 2674 H=2674:00 +CPU= 25.590
  07:28:42 STEP 2675 H=2675:00 +CPU= 26.634
  07:29:23 STEP 2676 H=2676:00 +CPU= 41.565
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002676
  07:29:49 STEP 2677 H=2677:00 +CPU= 25.417
  07:30:14 STEP 2678 H=2678:00 +CPU= 25.431
  07:30:53 STEP 2679 H=2679:00 +CPU= 38.508
  07:31:18 STEP 2680 H=2680:00 +CPU= 25.315
  07:31:44 STEP 2681 H=2681:00 +CPU= 25.543
  07:32:23 STEP 2682 H=2682:00 +CPU= 38.590
  07:32:48 STEP 2683 H=2683:00 +CPU= 25.364
  07:33:13 STEP 2684 H=2684:00 +CPU= 24.758
  07:33:54 STEP 2685 H=2685:00 +CPU= 40.778
  07:34:18 STEP 2686 H=2686:00 +CPU= 24.189
  07:34:43 STEP 2687 H=2687:00 +CPU= 25.057
  07:35:30 STEP 2688 H=2688:00 +CPU= 46.374
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_111.zip
Uploading the intermediate file: upload_file_111.zip
  07:35:57 STEP 2689 H=2689:00 +CPU= 26.756
Uploading trickle at timestep: 9676800
  07:36:26 STEP 2690 H=2690:00 +CPU= 28.706
  07:37:07 STEP 2691 H=2691:00 +CPU= 41.384
  07:37:35 STEP 2692 H=2692:00 +CPU= 27.746
  07:38:02 STEP 2693 H=2693:00 +CPU= 26.599
  07:38:44 STEP 2694 H=2694:00 +CPU= 42.256
  07:39:13 STEP 2695 H=2695:00 +CPU= 28.654
  07:39:41 STEP 2696 H=2696:00 +CPU= 27.866
  07:40:22 STEP 2697 H=2697:00 +CPU= 41.343
  07:40:51 STEP 2698 H=2698:00 +CPU= 28.800
  07:41:19 STEP 2699 H=2699:00 +CPU= 27.199
  07:42:04 STEP 2700 H=2700:00 +CPU= 44.928
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002700
  07:42:32 STEP 2701 H=2701:00 +CPU= 28.508
  07:43:01 STEP 2702 H=2702:00 +CPU= 28.688
  07:43:42 STEP 2703 H=2703:00 +CPU= 41.002
  07:44:10 STEP 2704 H=2704:00 +CPU= 27.723
  07:44:37 STEP 2705 H=2705:00 +CPU= 26.633
  07:45:20 STEP 2706 H=2706:00 +CPU= 42.764
  07:45:47 STEP 2707 H=2707:00 +CPU= 27.759
  07:46:17 STEP 2708 H=2708:00 +CPU= 29.019
  07:46:58 STEP 2709 H=2709:00 +CPU= 41.221
  07:47:26 STEP 2710 H=2710:00 +CPU= 28.198
  07:47:54 STEP 2711 H=2711:00 +CPU= 27.523
  07:48:44 STEP 2712 H=2712:00 +CPU= 49.527
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_112.zip
Uploading the intermediate file: upload_file_112.zip
  07:49:10 STEP 2713 H=2713:00 +CPU= 26.740
  07:49:38 STEP 2714 H=2714:00 +CPU= 27.245
  07:50:20 STEP 2715 H=2715:00 +CPU= 42.408
  07:50:48 STEP 2716 H=2716:00 +CPU= 27.935
  07:51:15 STEP 2717 H=2717:00 +CPU= 26.666
  07:51:58 STEP 2718 H=2718:00 +CPU= 42.823
  07:52:26 STEP 2719 H=2719:00 +CPU= 28.164
  07:52:53 STEP 2720 H=2720:00 +CPU= 26.362
  07:53:36 STEP 2721 H=2721:00 +CPU= 43.376
  07:54:04 STEP 2722 H=2722:00 +CPU= 28.011
  07:54:32 STEP 2723 H=2723:00 +CPU= 27.243
  07:55:19 STEP 2724 H=2724:00 +CPU= 46.934
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002724
  07:55:46 STEP 2725 H=2725:00 +CPU= 27.460
  07:56:16 STEP 2726 H=2726:00 +CPU= 29.084
  07:56:57 STEP 2727 H=2727:00 +CPU= 41.261
  07:57:25 STEP 2728 H=2728:00 +CPU= 27.577
  07:57:52 STEP 2729 H=2729:00 +CPU= 27.419
  07:58:34 STEP 2730 H=2730:00 +CPU= 41.497
  07:59:01 STEP 2731 H=2731:00 +CPU= 27.526
  07:59:29 STEP 2732 H=2732:00 +CPU= 26.964
  08:00:11 STEP 2733 H=2733:00 +CPU= 42.352
  08:00:39 STEP 2734 H=2734:00 +CPU= 28.165
  08:01:06 STEP 2735 H=2735:00 +CPU= 26.447
  08:01:56 STEP 2736 H=2736:00 +CPU= 50.123
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_113.zip
Uploading the intermediate file: upload_file_113.zip
  08:02:23 STEP 2737 H=2737:00 +CPU= 27.047
  08:02:50 STEP 2738 H=2738:00 +CPU= 27.023
  08:03:32 STEP 2739 H=2739:00 +CPU= 41.515
  08:04:00 STEP 2740 H=2740:00 +CPU= 28.250
  08:04:26 STEP 2741 H=2741:00 +CPU= 25.484
  08:05:12 STEP 2742 H=2742:00 +CPU= 45.530
  08:05:43 STEP 2743 H=2743:00 +CPU= 31.163
  08:06:13 STEP 2744 H=2744:00 +CPU= 29.337
  08:07:00 STEP 2745 H=2745:00 +CPU= 47.528
  08:07:33 STEP 2746 H=2746:00 +CPU= 32.462
  08:08:01 STEP 2747 H=2747:00 +CPU= 28.299
  08:08:52 STEP 2748 H=2748:00 +CPU= 50.028
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002748
  08:09:22 STEP 2749 H=2749:00 +CPU= 29.891
  08:09:55 STEP 2750 H=2750:00 +CPU= 32.854
  08:10:46 STEP 2751 H=2751:00 +CPU= 51.127
  08:11:24 STEP 2752 H=2752:00 +CPU= 37.797
  08:11:59 STEP 2753 H=2753:00 +CPU= 35.009
  08:12:55 STEP 2754 H=2754:00 +CPU= 55.455
  08:13:30 STEP 2755 H=2755:00 +CPU= 35.162
  08:14:07 STEP 2756 H=2756:00 +CPU= 37.314
  08:15:02 STEP 2757 H=2757:00 +CPU= 53.834
  08:15:39 STEP 2758 H=2758:00 +CPU= 37.121
  08:16:16 STEP 2759 H=2759:00 +CPU= 37.180
  08:17:21 STEP 2760 H=2760:00 +CPU= 64.367
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_114.zip
Uploading the intermediate file: upload_file_114.zip
  08:17:56 STEP 2761 H=2761:00 +CPU= 34.792
  08:18:33 STEP 2762 H=2762:00 +CPU= 37.164
  08:19:28 STEP 2763 H=2763:00 +CPU= 54.451
  08:20:04 STEP 2764 H=2764:00 +CPU= 36.110
  08:20:40 STEP 2765 H=2765:00 +CPU= 35.705
  08:21:37 STEP 2766 H=2766:00 +CPU= 56.769
  08:22:15 STEP 2767 H=2767:00 +CPU= 38.337
  08:22:59 STEP 2768 H=2768:00 +CPU= 43.074
  08:24:04 STEP 2769 H=2769:00 +CPU= 64.385
  08:24:48 STEP 2770 H=2770:00 +CPU= 43.229
  08:25:28 STEP 2771 H=2771:00 +CPU= 40.754
  08:26:36 STEP 2772 H=2772:00 +CPU= 67.422
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002772
  08:27:20 STEP 2773 H=2773:00 +CPU= 43.093
  08:28:04 STEP 2774 H=2774:00 +CPU= 44.595
  08:29:11 STEP 2775 H=2775:00 +CPU= 65.694
  08:29:55 STEP 2776 H=2776:00 +CPU= 43.733
  08:30:34 STEP 2777 H=2777:00 +CPU= 38.722
  08:31:37 STEP 2778 H=2778:00 +CPU= 62.814
  08:32:22 STEP 2779 H=2779:00 +CPU= 44.651
  08:33:04 STEP 2780 H=2780:00 +CPU= 41.462
  08:34:06 STEP 2781 H=2781:00 +CPU= 61.271
  08:34:50 STEP 2782 H=2782:00 +CPU= 43.631
  08:35:34 STEP 2783 H=2783:00 +CPU= 44.214
  08:36:51 STEP 2784 H=2784:00 +CPU= 76.119
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_115.zip
Uploading the intermediate file: upload_file_115.zip
  08:37:33 STEP 2785 H=2785:00 +CPU= 41.887
  08:38:14 STEP 2786 H=2786:00 +CPU= 40.931
  08:39:13 STEP 2787 H=2787:00 +CPU= 58.303
  08:39:51 STEP 2788 H=2788:00 +CPU= 38.220
  08:40:29 STEP 2789 H=2789:00 +CPU= 37.818
  08:41:29 STEP 2790 H=2790:00 +CPU= 59.542
  08:42:09 STEP 2791 H=2791:00 +CPU= 39.536
  08:42:47 STEP 2792 H=2792:00 +CPU= 37.636
  08:43:40 STEP 2793 H=2793:00 +CPU= 52.845
  08:44:20 STEP 2794 H=2794:00 +CPU= 39.524
  08:44:57 STEP 2795 H=2795:00 +CPU= 37.195
  08:45:57 STEP 2796 H=2796:00 +CPU= 59.550
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002796
  08:46:34 STEP 2797 H=2797:00 +CPU= 36.928
  08:47:11 STEP 2798 H=2798:00 +CPU= 37.234
  08:48:07 STEP 2799 H=2799:00 +CPU= 55.158
  08:48:45 STEP 2800 H=2800:00 +CPU= 38.109
  08:49:20 STEP 2801 H=2801:00 +CPU= 35.262
  08:50:16 STEP 2802 H=2802:00 +CPU= 55.467
  08:50:53 STEP 2803 H=2803:00 +CPU= 36.728
  08:51:29 STEP 2804 H=2804:00 +CPU= 35.471
  08:52:24 STEP 2805 H=2805:00 +CPU= 55.317
  08:53:02 STEP 2806 H=2806:00 +CPU= 37.541
  08:53:38 STEP 2807 H=2807:00 +CPU= 35.845
  08:54:41 STEP 2808 H=2808:00 +CPU= 63.038
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_116.zip
Uploading the intermediate file: upload_file_116.zip
  08:55:19 STEP 2809 H=2809:00 +CPU= 37.400
  08:55:54 STEP 2810 H=2810:00 +CPU= 34.608
  08:56:45 STEP 2811 H=2811:00 +CPU= 50.930
  08:57:20 STEP 2812 H=2812:00 +CPU= 35.087
  08:57:54 STEP 2813 H=2813:00 +CPU= 33.813
  08:58:43 STEP 2814 H=2814:00 +CPU= 48.750
  08:59:16 STEP 2815 H=2815:00 +CPU= 33.453
  08:59:50 STEP 2816 H=2816:00 +CPU= 33.121
  09:00:39 STEP 2817 H=2817:00 +CPU= 49.147
  09:01:11 STEP 2818 H=2818:00 +CPU= 32.281
  09:01:41 STEP 2819 H=2819:00 +CPU= 29.796
  09:02:32 STEP 2820 H=2820:00 +CPU= 50.791
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002820
  09:03:02 STEP 2821 H=2821:00 +CPU= 29.899
  09:03:35 STEP 2822 H=2822:00 +CPU= 32.054
  09:04:22 STEP 2823 H=2823:00 +CPU= 46.885
  09:04:54 STEP 2824 H=2824:00 +CPU= 32.233
  09:05:25 STEP 2825 H=2825:00 +CPU= 31.229
  09:06:13 STEP 2826 H=2826:00 +CPU= 47.341
  09:06:45 STEP 2827 H=2827:00 +CPU= 32.056
  09:07:15 STEP 2828 H=2828:00 +CPU= 29.936
  09:08:02 STEP 2829 H=2829:00 +CPU= 47.111
  09:08:35 STEP 2830 H=2830:00 +CPU= 32.877
  09:09:09 STEP 2831 H=2831:00 +CPU= 33.067
  09:10:04 STEP 2832 H=2832:00 +CPU= 55.609
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_117.zip
Uploading the intermediate file: upload_file_117.zip
  09:10:36 STEP 2833 H=2833:00 +CPU= 31.632
  09:11:06 STEP 2834 H=2834:00 +CPU= 29.868
  09:11:53 STEP 2835 H=2835:00 +CPU= 46.441
  09:12:24 STEP 2836 H=2836:00 +CPU= 31.196
  09:12:54 STEP 2837 H=2837:00 +CPU= 29.951
  09:13:40 STEP 2838 H=2838:00 +CPU= 45.767
  09:14:12 STEP 2839 H=2839:00 +CPU= 32.258
  09:14:44 STEP 2840 H=2840:00 +CPU= 31.504
  09:15:30 STEP 2841 H=2841:00 +CPU= 45.950
  09:16:02 STEP 2842 H=2842:00 +CPU= 31.671
  09:16:33 STEP 2843 H=2843:00 +CPU= 31.193
  09:17:26 STEP 2844 H=2844:00 +CPU= 52.340
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002844
  09:17:56 STEP 2845 H=2845:00 +CPU= 30.154
  09:18:28 STEP 2846 H=2846:00 +CPU= 31.788
  09:19:14 STEP 2847 H=2847:00 +CPU= 46.321
  09:19:46 STEP 2848 H=2848:00 +CPU= 31.298
  09:20:17 STEP 2849 H=2849:00 +CPU= 31.207
  09:21:06 STEP 2850 H=2850:00 +CPU= 48.158
  09:21:37 STEP 2851 H=2851:00 +CPU= 30.916
  09:22:07 STEP 2852 H=2852:00 +CPU= 30.721
  09:22:56 STEP 2853 H=2853:00 +CPU= 48.178
  09:23:28 STEP 2854 H=2854:00 +CPU= 31.661
  09:23:58 STEP 2855 H=2855:00 +CPU= 30.772
  09:24:53 STEP 2856 H=2856:00 +CPU= 54.635
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_118.zip
Uploading the intermediate file: upload_file_118.zip
  09:25:25 STEP 2857 H=2857:00 +CPU= 31.302
  09:25:55 STEP 2858 H=2858:00 +CPU= 30.380
  09:26:39 STEP 2859 H=2859:00 +CPU= 43.237
  09:27:08 STEP 2860 H=2860:00 +CPU= 29.341
  09:27:39 STEP 2861 H=2861:00 +CPU= 30.957
  09:28:27 STEP 2862 H=2862:00 +CPU= 47.734
  09:29:00 STEP 2863 H=2863:00 +CPU= 33.055
  09:29:31 STEP 2864 H=2864:00 +CPU= 30.221
  09:30:18 STEP 2865 H=2865:00 +CPU= 46.903
  09:30:49 STEP 2866 H=2866:00 +CPU= 30.657
  09:31:18 STEP 2867 H=2867:00 +CPU= 29.859
  09:32:09 STEP 2868 H=2868:00 +CPU= 50.414
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002868
  09:32:40 STEP 2869 H=2869:00 +CPU= 30.846
  09:33:11 STEP 2870 H=2870:00 +CPU= 30.769
  09:33:57 STEP 2871 H=2871:00 +CPU= 46.040
  09:34:28 STEP 2872 H=2872:00 +CPU= 30.417
  09:34:59 STEP 2873 H=2873:00 +CPU= 31.279
  09:35:46 STEP 2874 H=2874:00 +CPU= 46.907
  09:36:16 STEP 2875 H=2875:00 +CPU= 29.657
  09:36:46 STEP 2876 H=2876:00 +CPU= 29.655
  09:37:31 STEP 2877 H=2877:00 +CPU= 45.464
  09:38:03 STEP 2878 H=2878:00 +CPU= 31.352
  09:38:35 STEP 2879 H=2879:00 +CPU= 32.139
  09:39:29 STEP 2880 H=2880:00 +CPU= 53.716
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_119.zip
Uploading the intermediate file: upload_file_119.zip
  09:39:58 STEP 2881 H=2881:00 +CPU= 28.710
  09:40:28 STEP 2882 H=2882:00 +CPU= 30.013
  09:41:15 STEP 2883 H=2883:00 +CPU= 47.050
  09:41:50 STEP 2884 H=2884:00 +CPU= 34.238
  09:42:22 STEP 2885 H=2885:00 +CPU= 32.086
  09:43:16 STEP 2886 H=2886:00 +CPU= 53.622
  09:43:52 STEP 2887 H=2887:00 +CPU= 36.101
  09:44:30 STEP 2888 H=2888:00 +CPU= 37.628
  09:45:22 STEP 2889 H=2889:00 +CPU= 52.447
  09:45:57 STEP 2890 H=2890:00 +CPU= 34.207
  09:46:30 STEP 2891 H=2891:00 +CPU= 33.333
  09:47:28 STEP 2892 H=2892:00 +CPU= 57.195
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002892
  09:48:02 STEP 2893 H=2893:00 +CPU= 34.360
  09:48:37 STEP 2894 H=2894:00 +CPU= 35.018
  09:49:30 STEP 2895 H=2895:00 +CPU= 52.165
  09:50:05 STEP 2896 H=2896:00 +CPU= 35.156
  09:50:38 STEP 2897 H=2897:00 +CPU= 33.008
  09:51:31 STEP 2898 H=2898:00 +CPU= 52.835
  09:52:04 STEP 2899 H=2899:00 +CPU= 32.724
  09:52:39 STEP 2900 H=2900:00 +CPU= 34.412
  09:53:30 STEP 2901 H=2901:00 +CPU= 51.269
  09:54:05 STEP 2902 H=2902:00 +CPU= 35.145
  09:54:39 STEP 2903 H=2903:00 +CPU= 33.559
  09:55:39 STEP 2904 H=2904:00 +CPU= 59.535
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_120.zip
Uploading the intermediate file: upload_file_120.zip
  09:56:11 STEP 2905 H=2905:00 +CPU= 32.203
  09:56:44 STEP 2906 H=2906:00 +CPU= 32.563
  09:57:36 STEP 2907 H=2907:00 +CPU= 52.326
  09:58:09 STEP 2908 H=2908:00 +CPU= 32.882
  09:58:43 STEP 2909 H=2909:00 +CPU= 33.195
  09:59:33 STEP 2910 H=2910:00 +CPU= 49.716
  10:00:07 STEP 2911 H=2911:00 +CPU= 34.573
  10:00:43 STEP 2912 H=2912:00 +CPU= 34.979
  10:01:32 STEP 2913 H=2913:00 +CPU= 49.177
  10:02:07 STEP 2914 H=2914:00 +CPU= 34.793
  10:02:39 STEP 2915 H=2915:00 +CPU= 32.202
  10:03:34 STEP 2916 H=2916:00 +CPU= 54.346
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002916
  10:04:06 STEP 2917 H=2917:00 +CPU= 32.463
  10:04:39 STEP 2918 H=2918:00 +CPU= 32.158
  10:05:28 STEP 2919 H=2919:00 +CPU= 49.323
  10:06:03 STEP 2920 H=2920:00 +CPU= 35.068
  10:06:36 STEP 2921 H=2921:00 +CPU= 32.888
  10:07:28 STEP 2922 H=2922:00 +CPU= 51.436
  10:08:01 STEP 2923 H=2923:00 +CPU= 33.121
  10:08:35 STEP 2924 H=2924:00 +CPU= 33.665
  10:09:22 STEP 2925 H=2925:00 +CPU= 47.088
  10:09:56 STEP 2926 H=2926:00 +CPU= 33.552
  10:10:29 STEP 2927 H=2927:00 +CPU= 33.219
  10:11:29 STEP 2928 H=2928:00 +CPU= 58.952
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_121.zip
Uploading the intermediate file: upload_file_121.zip
Uploading trickle at timestep: 10540800
  10:12:02 STEP 2929 H=2929:00 +CPU= 33.501
  10:12:38 STEP 2930 H=2930:00 +CPU= 35.022
  10:13:29 STEP 2931 H=2931:00 +CPU= 51.130
  10:14:02 STEP 2932 H=2932:00 +CPU= 32.832
  10:14:33 STEP 2933 H=2933:00 +CPU= 31.288
  10:15:24 STEP 2934 H=2934:00 +CPU= 50.328
  10:15:56 STEP 2935 H=2935:00 +CPU= 32.374
  10:16:29 STEP 2936 H=2936:00 +CPU= 32.893
  10:17:19 STEP 2937 H=2937:00 +CPU= 49.776
  10:17:53 STEP 2938 H=2938:00 +CPU= 33.505
  10:18:27 STEP 2939 H=2939:00 +CPU= 34.254
  10:19:21 STEP 2940 H=2940:00 +CPU= 53.963
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002940
  10:19:55 STEP 2941 H=2941:00 +CPU= 33.052
  10:20:29 STEP 2942 H=2942:00 +CPU= 33.849
  10:21:18 STEP 2943 H=2943:00 +CPU= 48.911
  10:21:52 STEP 2944 H=2944:00 +CPU= 33.840
  10:22:25 STEP 2945 H=2945:00 +CPU= 33.242
  10:23:15 STEP 2946 H=2946:00 +CPU= 49.774
  10:23:49 STEP 2947 H=2947:00 +CPU= 33.342
  10:24:24 STEP 2948 H=2948:00 +CPU= 35.193
  10:25:13 STEP 2949 H=2949:00 +CPU= 48.666
  10:25:48 STEP 2950 H=2950:00 +CPU= 34.978
  10:26:22 STEP 2951 H=2951:00 +CPU= 34.100
  10:27:18 STEP 2952 H=2952:00 +CPU= 56.000
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186185/ICMGGhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0541_2000050100_123_969_12186185_1_r391021408_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:30:42 (1551566): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:42:01 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 10,623,600 80,639 0.0076
09 May 2023 16:41:58 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 10,540,800 79,696 0.0076
09 May 2023 16:41:52 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 9,676,800 70,383 0.0073
09 May 2023 16:40:18 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 6,998,400 41,250 0.0059
09 May 2023 16:40:09 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 6,134,400 32,684 0.0053
09 May 2023 16:40:05 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 5,270,400 28,151 0.0053
09 May 2023 16:40:02 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 4,406,400 23,659 0.0054
09 May 2023 16:40:02 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 4,406,400 23,659 0.0054
09 May 2023 16:39:55 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 3,542,400 19,147 0.0054
09 May 2023 16:39:52 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 2,678,400 14,654 0.0055
09 May 2023 16:39:48 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 1,814,400 10,152 0.0056
09 May 2023 16:39:45 1532331 22302830 oifs_43r3_ps_0541_2000050100_123_969_12186185_1 950,400 5,650 0.0059


©2024 climateprediction.net