climateprediction.net home page
Task 22291004

Task 22291004

Name oifs_43r3_ps_0858_2018050100_123_987_12204502_0
Workunit 12204502
Created 24 Dec 2022, 21:44:45 UTC
Sent 24 Dec 2022, 22:01:52 UTC
Report deadline 23 Jan 2023, 22:01:52 UTC
Received 4 Jan 2023, 20:15:48 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1529574
Run time 13 hours 52 min 30 sec
CPU time 13 hours 41 min 56 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 3.41 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,393.38 MB
Peak swap size 4,978.00 MB
Peak disk usage 3,763.49 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
ICMSHhq0f+002424
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002424
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002400
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002400
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002400
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002412
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002412
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002412
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_100.zip
Uploading the intermediate file: upload_file_100.zip
  06:19:33 STEP 2425 H=2425:00 +CPU= 12.790
  06:19:46 STEP 2426 H=2426:00 +CPU= 13.227
  06:20:07 STEP 2427 H=2427:00 +CPU= 20.676
  06:20:20 STEP 2428 H=2428:00 +CPU= 13.239
  06:20:33 STEP 2429 H=2429:00 +CPU= 13.087
  06:20:54 STEP 2430 H=2430:00 +CPU= 21.167
  06:21:07 STEP 2431 H=2431:00 +CPU= 12.930
  06:21:21 STEP 2432 H=2432:00 +CPU= 13.656
  06:21:43 STEP 2433 H=2433:00 +CPU= 21.847
  06:21:57 STEP 2434 H=2434:00 +CPU= 14.355
  06:22:11 STEP 2435 H=2435:00 +CPU= 13.807
  06:22:38 STEP 2436 H=2436:00 +CPU= 25.858
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002436
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002436
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002436
  06:22:52 STEP 2437 H=2437:00 +CPU= 14.251
  06:23:07 STEP 2438 H=2438:00 +CPU= 14.492
  06:23:30 STEP 2439 H=2439:00 +CPU= 22.579
  06:23:44 STEP 2440 H=2440:00 +CPU= 14.386
  06:23:59 STEP 2441 H=2441:00 +CPU= 14.664
  06:24:22 STEP 2442 H=2442:00 +CPU= 23.318
  06:24:36 STEP 2443 H=2443:00 +CPU= 13.532
  06:24:51 STEP 2444 H=2444:00 +CPU= 15.441
  06:25:13 STEP 2445 H=2445:00 +CPU= 21.418
  06:25:27 STEP 2446 H=2446:00 +CPU= 13.873
  06:25:41 STEP 2447 H=2447:00 +CPU= 14.243
  06:26:06 STEP 2448 H=2448:00 +CPU= 24.934
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002448
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002448
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002448
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002424
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002424
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002424
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002436
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002436
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002436
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_101.zip
Uploading the intermediate file: upload_file_101.zip
  06:26:21 STEP 2449 H=2449:00 +CPU= 13.880
  06:26:35 STEP 2450 H=2450:00 +CPU= 14.289
  06:26:56 STEP 2451 H=2451:00 +CPU= 21.228
  06:27:11 STEP 2452 H=2452:00 +CPU= 14.361
  06:27:25 STEP 2453 H=2453:00 +CPU= 13.971
  06:27:48 STEP 2454 H=2454:00 +CPU= 22.876
  06:28:01 STEP 2455 H=2455:00 +CPU= 13.781
  06:28:16 STEP 2456 H=2456:00 +CPU= 14.545
  06:28:38 STEP 2457 H=2457:00 +CPU= 21.692
  06:28:52 STEP 2458 H=2458:00 +CPU= 13.817
  06:29:05 STEP 2459 H=2459:00 +CPU= 13.505
  06:29:29 STEP 2460 H=2460:00 +CPU= 23.675
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002460
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002460
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002460
  06:29:42 STEP 2461 H=2461:00 +CPU= 13.175
  06:29:56 STEP 2462 H=2462:00 +CPU= 13.879
  06:30:17 STEP 2463 H=2463:00 +CPU= 21.109
  06:30:31 STEP 2464 H=2464:00 +CPU= 13.484
  06:30:45 STEP 2465 H=2465:00 +CPU= 13.513
  06:31:07 STEP 2466 H=2466:00 +CPU= 22.095
  06:31:20 STEP 2467 H=2467:00 +CPU= 13.091
  06:31:34 STEP 2468 H=2468:00 +CPU= 13.671
  06:31:54 STEP 2469 H=2469:00 +CPU= 20.645
  06:32:08 STEP 2470 H=2470:00 +CPU= 13.517
  06:32:21 STEP 2471 H=2471:00 +CPU= 13.264
  06:32:46 STEP 2472 H=2472:00 +CPU= 24.770
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002472
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002472
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002472
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002448
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002448
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002448
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002460
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002460
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002460
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_102.zip
Uploading the intermediate file: upload_file_102.zip
  06:32:59 STEP 2473 H=2473:00 +CPU= 12.903
  06:33:13 STEP 2474 H=2474:00 +CPU= 13.751
  06:33:36 STEP 2475 H=2475:00 +CPU= 22.481
  06:33:51 STEP 2476 H=2476:00 +CPU= 14.779
  06:34:05 STEP 2477 H=2477:00 +CPU= 14.321
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2018050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0858
(argv4) batchid: 987
(argv5) wuid: 12204502
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/thebigguy/Desktop/slots/3
Project directory is: /home/thebigguy/Desktop/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502
..mkdir for temp folder for results failed
Copying: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/thebigguy/Desktop/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/thebigguy/Desktop/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6a871e6147b3819fa2e964f1e77e9f6f to: /home/thebigguy/Desktop/slots/3/oifs_43r3_ps_0858_2018050100_123_987_12204502.zip
Unzipping the namelist zip file: /home/thebigguy/Desktop/slots/3/oifs_43r3_ps_0858_2018050100_123_987_12204502.zip
ic_ancil_file: ic_ancil_12204502
ifsdata_file: ifsdata_12204502
climate_data_file: clim_data_12204502
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b616257e41b7fedeba0331227266438f to: /home/thebigguy/Desktop/slots/3/ic_ancil_12204502.zip
Unzipping the IC ancils zip file: /home/thebigguy/Desktop/slots/3/ic_ancil_12204502.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4acbd44c951ac50bd283821aa9c50c72 to: /home/thebigguy/Desktop/slots/3/ifsdata/ifsdata_12204502.zip
Unzipping the ifsdata_zip file: /home/thebigguy/Desktop/slots/3/ifsdata/ifsdata_12204502.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/thebigguy/Desktop/slots/3/159l_2/clim_data_12204502.zip
Unzipping the climate data zip file: /home/thebigguy/Desktop/slots/3/159l_2/clim_data_12204502.zip
Checking for progress XML file: /home/thebigguy/Desktop/slots/3/progress_file_12204502.xml
Opened progress file ok : /home/thebigguy/Desktop/slots/3/progress_file_12204502.xml
-- Model is restarting --
Adjusting last_iter, 2477, to previous model restart step.
Creating progress file: /home/thebigguy/Desktop/slots/3/progress_file_12204502.xml
last_cpu_time: 41890
upload_file_number: 103
last_iter: 2471
last_upload: 8899200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023
The child process has been launched with process id: 4941
Executing the command: /home/thebigguy/Desktop/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:linux:1:1:4941:4941] [20221225:064339:1671968619:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:45:05 STEP 2472 H=2472:00 +CPU= 23.800
  06:45:19 STEP 2473 H=2473:00 +CPU= 12.984
  06:45:32 STEP 2474 H=2474:00 +CPU= 13.310
  06:45:53 STEP 2475 H=2475:00 +CPU= 20.624
  06:46:06 STEP 2476 H=2476:00 +CPU= 13.389
  06:46:20 STEP 2477 H=2477:00 +CPU= 13.258
  06:46:41 STEP 2478 H=2478:00 +CPU= 21.320
  06:46:54 STEP 2479 H=2479:00 +CPU= 13.350
  06:47:08 STEP 2480 H=2480:00 +CPU= 13.616
  06:47:29 STEP 2481 H=2481:00 +CPU= 20.395
  06:47:42 STEP 2482 H=2482:00 +CPU= 13.071
  06:47:55 STEP 2483 H=2483:00 +CPU= 12.823
  06:48:17 STEP 2484 H=2484:00 +CPU= 22.652
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002484
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002484
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002484
  06:48:30 STEP 2485 H=2485:00 +CPU= 12.778
  06:48:44 STEP 2486 H=2486:00 +CPU= 13.515
  06:49:05 STEP 2487 H=2487:00 +CPU= 20.913
  06:49:18 STEP 2488 H=2488:00 +CPU= 12.995
  06:49:31 STEP 2489 H=2489:00 +CPU= 13.355
  06:49:52 STEP 2490 H=2490:00 +CPU= 20.499
  06:50:04 STEP 2491 H=2491:00 +CPU= 12.622
  06:50:18 STEP 2492 H=2492:00 +CPU= 13.404
  06:50:38 STEP 2493 H=2493:00 +CPU= 20.205
  06:50:51 STEP 2494 H=2494:00 +CPU= 13.116
  06:51:05 STEP 2495 H=2495:00 +CPU= 13.492
  06:51:58 STEP 2496 H=2496:00 +CPU= 24.483
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002496
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002496
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002496
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002472
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002472
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002472
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002484
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002484
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002484
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_103.zip
Uploading the intermediate file: upload_file_103.zip
  06:52:11 STEP 2497 H=2497:00 +CPU= 12.654
  06:52:24 STEP 2498 H=2498:00 +CPU= 13.128
  06:52:44 STEP 2499 H=2499:00 +CPU= 20.643
  06:52:58 STEP 2500 H=2500:00 +CPU= 13.057
  06:53:12 STEP 2501 H=2501:00 +CPU= 13.875
  06:53:33 STEP 2502 H=2502:00 +CPU= 21.231
  06:53:46 STEP 2503 H=2503:00 +CPU= 12.784
  06:53:59 STEP 2504 H=2504:00 +CPU= 13.287
  06:54:20 STEP 2505 H=2505:00 +CPU= 20.657
  06:54:33 STEP 2506 H=2506:00 +CPU= 12.984
  06:54:46 STEP 2507 H=2507:00 +CPU= 12.818
  06:55:08 STEP 2508 H=2508:00 +CPU= 22.699
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002508
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002508
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002508
  06:55:21 STEP 2509 H=2509:00 +CPU= 12.737
  06:55:34 STEP 2510 H=2510:00 +CPU= 13.175
  06:55:55 STEP 2511 H=2511:00 +CPU= 20.509
  06:56:08 STEP 2512 H=2512:00 +CPU= 13.032
  06:56:21 STEP 2513 H=2513:00 +CPU= 12.778
  06:56:42 STEP 2514 H=2514:00 +CPU= 20.737
  06:56:54 STEP 2515 H=2515:00 +CPU= 12.738
  06:57:08 STEP 2516 H=2516:00 +CPU= 13.192
  06:57:28 STEP 2517 H=2517:00 +CPU= 20.379
  06:57:41 STEP 2518 H=2518:00 +CPU= 13.081
  06:57:55 STEP 2519 H=2519:00 +CPU= 13.162
  06:58:29 STEP 2520 H=2520:00 +CPU= 24.321
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002520
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002520
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002520
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002496
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002496
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002496
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002508
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002508
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002508
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_104.zip
Uploading the intermediate file: upload_file_104.zip
  06:58:42 STEP 2521 H=2521:00 +CPU= 13.105
  06:58:55 STEP 2522 H=2522:00 +CPU= 13.197
  06:59:16 STEP 2523 H=2523:00 +CPU= 20.439
  06:59:29 STEP 2524 H=2524:00 +CPU= 13.428
  06:59:42 STEP 2525 H=2525:00 +CPU= 12.773
  07:00:03 STEP 2526 H=2526:00 +CPU= 20.767
  07:00:16 STEP 2527 H=2527:00 +CPU= 13.188
  07:00:30 STEP 2528 H=2528:00 +CPU= 13.255
  07:00:50 STEP 2529 H=2529:00 +CPU= 20.199
  07:01:03 STEP 2530 H=2530:00 +CPU= 13.301
  07:01:16 STEP 2531 H=2531:00 +CPU= 12.841
  07:01:39 STEP 2532 H=2532:00 +CPU= 22.351
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002532
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002532
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002532
  07:01:52 STEP 2533 H=2533:00 +CPU= 12.987
  07:02:05 STEP 2534 H=2534:00 +CPU= 13.385
  07:02:25 STEP 2535 H=2535:00 +CPU= 20.306
  07:02:39 STEP 2536 H=2536:00 +CPU= 13.570
  07:02:52 STEP 2537 H=2537:00 +CPU= 12.953
  07:03:13 STEP 2538 H=2538:00 +CPU= 20.725
  07:03:26 STEP 2539 H=2539:00 +CPU= 13.084
  07:03:39 STEP 2540 H=2540:00 +CPU= 13.123
  07:04:00 STEP 2541 H=2541:00 +CPU= 20.232
  07:04:13 STEP 2542 H=2542:00 +CPU= 13.192
  07:04:26 STEP 2543 H=2543:00 +CPU= 13.142
  07:04:54 STEP 2544 H=2544:00 +CPU= 24.078
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002544
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002544
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002544
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002520
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002520
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002520
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002532
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002532
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002532
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_105.zip
Uploading the intermediate file: upload_file_105.zip
  07:05:07 STEP 2545 H=2545:00 +CPU= 12.994
  07:05:20 STEP 2546 H=2546:00 +CPU= 13.267
  07:05:41 STEP 2547 H=2547:00 +CPU= 20.588
  07:05:54 STEP 2548 H=2548:00 +CPU= 13.386
  07:06:08 STEP 2549 H=2549:00 +CPU= 13.044
  07:06:29 STEP 2550 H=2550:00 +CPU= 21.020
  07:06:42 STEP 2551 H=2551:00 +CPU= 12.824
  07:06:55 STEP 2552 H=2552:00 +CPU= 13.221
  07:07:16 STEP 2553 H=2553:00 +CPU= 20.772
  07:07:29 STEP 2554 H=2554:00 +CPU= 13.403
  07:07:43 STEP 2555 H=2555:00 +CPU= 13.251
  07:08:07 STEP 2556 H=2556:00 +CPU= 24.192
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002556
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002556
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002556
  07:08:21 STEP 2557 H=2557:00 +CPU= 14.412
  07:08:35 STEP 2558 H=2558:00 +CPU= 13.827
  07:08:56 STEP 2559 H=2559:00 +CPU= 20.660
  07:09:10 STEP 2560 H=2560:00 +CPU= 13.476
  07:09:23 STEP 2561 H=2561:00 +CPU= 13.670
  07:09:45 STEP 2562 H=2562:00 +CPU= 21.365
  07:09:58 STEP 2563 H=2563:00 +CPU= 13.391
  07:10:13 STEP 2564 H=2564:00 +CPU= 14.438
  07:10:34 STEP 2565 H=2565:00 +CPU= 20.633
  07:10:47 STEP 2566 H=2566:00 +CPU= 13.371
  07:11:01 STEP 2567 H=2567:00 +CPU= 13.376
  07:11:26 STEP 2568 H=2568:00 +CPU= 24.159
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002568
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002568
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002568
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002544
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002544
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002544
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002556
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002556
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002556
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_106.zip
Uploading the intermediate file: upload_file_106.zip
  07:11:39 STEP 2569 H=2569:00 +CPU= 13.037
  07:11:52 STEP 2570 H=2570:00 +CPU= 13.211
  07:12:13 STEP 2571 H=2571:00 +CPU= 20.676
  07:12:26 STEP 2572 H=2572:00 +CPU= 13.344
  07:12:39 STEP 2573 H=2573:00 +CPU= 13.105
  07:13:01 STEP 2574 H=2574:00 +CPU= 21.372
  07:13:14 STEP 2575 H=2575:00 +CPU= 13.424
  07:13:29 STEP 2576 H=2576:00 +CPU= 14.600
  07:13:50 STEP 2577 H=2577:00 +CPU= 20.786
  07:14:04 STEP 2578 H=2578:00 +CPU= 13.879
  07:14:17 STEP 2579 H=2579:00 +CPU= 13.612
  07:14:40 STEP 2580 H=2580:00 +CPU= 22.939
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002580
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002580
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002580
  07:14:54 STEP 2581 H=2581:00 +CPU= 13.390
  07:15:07 STEP 2582 H=2582:00 +CPU= 13.672
  07:15:29 STEP 2583 H=2583:00 +CPU= 21.443
  07:15:43 STEP 2584 H=2584:00 +CPU= 13.653
  07:15:56 STEP 2585 H=2585:00 +CPU= 13.422
  07:16:18 STEP 2586 H=2586:00 +CPU= 21.757
  07:16:32 STEP 2587 H=2587:00 +CPU= 13.481
  07:16:45 STEP 2588 H=2588:00 +CPU= 13.582
  07:17:06 STEP 2589 H=2589:00 +CPU= 20.956
  07:17:20 STEP 2590 H=2590:00 +CPU= 13.821
  07:17:34 STEP 2591 H=2591:00 +CPU= 13.805
  07:18:03 STEP 2592 H=2592:00 +CPU= 24.662
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002592
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002592
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002592
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002568
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002568
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002568
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002580
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002580
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002580
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_107.zip
Uploading the intermediate file: upload_file_107.zip
  07:18:16 STEP 2593 H=2593:00 +CPU= 13.293
  07:18:29 STEP 2594 H=2594:00 +CPU= 13.334
  07:18:50 STEP 2595 H=2595:00 +CPU= 20.697
  07:19:04 STEP 2596 H=2596:00 +CPU= 14.197
  07:19:18 STEP 2597 H=2597:00 +CPU= 13.133
  07:19:39 STEP 2598 H=2598:00 +CPU= 21.245
  07:19:52 STEP 2599 H=2599:00 +CPU= 13.481
  07:20:06 STEP 2600 H=2600:00 +CPU= 13.527
  07:20:27 STEP 2601 H=2601:00 +CPU= 20.540
  07:20:40 STEP 2602 H=2602:00 +CPU= 13.571
  07:20:54 STEP 2603 H=2603:00 +CPU= 13.168
  07:21:17 STEP 2604 H=2604:00 +CPU= 23.393
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002604
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002604
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002604
  07:21:30 STEP 2605 H=2605:00 +CPU= 13.036
  07:21:44 STEP 2606 H=2606:00 +CPU= 13.498
  07:22:05 STEP 2607 H=2607:00 +CPU= 21.689
  07:22:20 STEP 2608 H=2608:00 +CPU= 14.889
  07:22:34 STEP 2609 H=2609:00 +CPU= 13.809
  07:22:56 STEP 2610 H=2610:00 +CPU= 21.677
  07:23:11 STEP 2611 H=2611:00 +CPU= 14.762
  07:23:25 STEP 2612 H=2612:00 +CPU= 14.609
  07:23:48 STEP 2613 H=2613:00 +CPU= 22.631
  07:24:03 STEP 2614 H=2614:00 +CPU= 14.384
  07:24:17 STEP 2615 H=2615:00 +CPU= 14.127
  07:24:42 STEP 2616 H=2616:00 +CPU= 24.237
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002616
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002616
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002616
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002592
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002592
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002592
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002604
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002604
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002604
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_108.zip
Uploading the intermediate file: upload_file_108.zip
  07:24:55 STEP 2617 H=2617:00 +CPU= 13.012
  07:25:09 STEP 2618 H=2618:00 +CPU= 13.350
  07:25:30 STEP 2619 H=2619:00 +CPU= 21.163
  07:25:44 STEP 2620 H=2620:00 +CPU= 13.545
  07:25:57 STEP 2621 H=2621:00 +CPU= 12.835
  07:26:17 STEP 2622 H=2622:00 +CPU= 20.409
  07:26:30 STEP 2623 H=2623:00 +CPU= 12.867
  07:26:43 STEP 2624 H=2624:00 +CPU= 12.950
  07:27:03 STEP 2625 H=2625:00 +CPU= 20.064
  07:27:16 STEP 2626 H=2626:00 +CPU= 13.104
  07:27:29 STEP 2627 H=2627:00 +CPU= 12.584
  07:27:51 STEP 2628 H=2628:00 +CPU= 21.982
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002628
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002628
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002628
  07:28:04 STEP 2629 H=2629:00 +CPU= 12.911
  07:28:17 STEP 2630 H=2630:00 +CPU= 13.110
  07:28:37 STEP 2631 H=2631:00 +CPU= 20.087
  07:28:50 STEP 2632 H=2632:00 +CPU= 13.266
  07:29:03 STEP 2633 H=2633:00 +CPU= 12.628
  07:29:24 STEP 2634 H=2634:00 +CPU= 20.714
  07:29:37 STEP 2635 H=2635:00 +CPU= 12.906
  07:29:50 STEP 2636 H=2636:00 +CPU= 13.015
  07:30:10 STEP 2637 H=2637:00 +CPU= 19.984
  07:30:23 STEP 2638 H=2638:00 +CPU= 12.983
  07:30:36 STEP 2639 H=2639:00 +CPU= 12.985
  07:31:03 STEP 2640 H=2640:00 +CPU= 23.671
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002640
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002640
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002640
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002616
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002616
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002616
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002628
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002628
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002628
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_109.zip
Uploading the intermediate file: upload_file_109.zip
  07:31:15 STEP 2641 H=2641:00 +CPU= 12.599
  07:31:29 STEP 2642 H=2642:00 +CPU= 13.171
  07:31:49 STEP 2643 H=2643:00 +CPU= 20.146
  07:32:02 STEP 2644 H=2644:00 +CPU= 12.924
  07:32:14 STEP 2645 H=2645:00 +CPU= 12.697
  07:32:35 STEP 2646 H=2646:00 +CPU= 20.323
  07:32:47 STEP 2647 H=2647:00 +CPU= 12.623
  07:33:01 STEP 2648 H=2648:00 +CPU= 13.224
  07:33:21 STEP 2649 H=2649:00 +CPU= 20.151
  07:33:34 STEP 2650 H=2650:00 +CPU= 13.024
  07:33:47 STEP 2651 H=2651:00 +CPU= 12.639
  07:34:09 STEP 2652 H=2652:00 +CPU= 22.126
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002652
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002652
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002652
  07:34:21 STEP 2653 H=2653:00 +CPU= 12.587
  07:34:35 STEP 2654 H=2654:00 +CPU= 13.184
  07:34:55 STEP 2655 H=2655:00 +CPU= 19.950
  07:35:07 STEP 2656 H=2656:00 +CPU= 12.829
  07:35:20 STEP 2657 H=2657:00 +CPU= 12.746
  07:35:41 STEP 2658 H=2658:00 +CPU= 20.672
  07:35:54 STEP 2659 H=2659:00 +CPU= 12.873
  07:36:07 STEP 2660 H=2660:00 +CPU= 13.116
  07:36:27 STEP 2661 H=2661:00 +CPU= 19.898
  07:36:40 STEP 2662 H=2662:00 +CPU= 13.099
  07:36:55 STEP 2663 H=2663:00 +CPU= 13.061
  07:37:20 STEP 2664 H=2664:00 +CPU= 23.919
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002664
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002664
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002664
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002640
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002640
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002640
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002652
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002652
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002652
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_110.zip
Uploading the intermediate file: upload_file_110.zip
  07:37:33 STEP 2665 H=2665:00 +CPU= 12.927
  07:37:46 STEP 2666 H=2666:00 +CPU= 12.970
  07:38:06 STEP 2667 H=2667:00 +CPU= 19.949
  07:38:19 STEP 2668 H=2668:00 +CPU= 13.211
  07:38:32 STEP 2669 H=2669:00 +CPU= 12.788
  07:38:52 STEP 2670 H=2670:00 +CPU= 20.449
  07:39:05 STEP 2671 H=2671:00 +CPU= 12.554
  07:39:18 STEP 2672 H=2672:00 +CPU= 13.000
  07:39:38 STEP 2673 H=2673:00 +CPU= 19.969
  07:39:51 STEP 2674 H=2674:00 +CPU= 13.012
  07:40:04 STEP 2675 H=2675:00 +CPU= 12.648
  07:40:26 STEP 2676 H=2676:00 +CPU= 21.989
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002676
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002676
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002676
  07:40:38 STEP 2677 H=2677:00 +CPU= 12.616
  07:40:52 STEP 2678 H=2678:00 +CPU= 13.264
  07:41:12 STEP 2679 H=2679:00 +CPU= 20.199
  07:41:25 STEP 2680 H=2680:00 +CPU= 13.070
  07:41:38 STEP 2681 H=2681:00 +CPU= 12.781
  07:41:58 STEP 2682 H=2682:00 +CPU= 20.583
  07:42:11 STEP 2683 H=2683:00 +CPU= 12.604
  07:42:24 STEP 2684 H=2684:00 +CPU= 13.248
  07:42:45 STEP 2685 H=2685:00 +CPU= 20.303
  07:42:58 STEP 2686 H=2686:00 +CPU= 12.952
  07:43:11 STEP 2687 H=2687:00 +CPU= 12.890
  07:43:35 STEP 2688 H=2688:00 +CPU= 23.810
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002688
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002688
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002688
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002664
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002664
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002664
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002676
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002676
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002676
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_111.zip
Uploading the intermediate file: upload_file_111.zip
  07:43:48 STEP 2689 H=2689:00 +CPU= 12.648
  07:44:01 STEP 2690 H=2690:00 +CPU= 13.770
  07:44:22 STEP 2691 H=2691:00 +CPU= 20.436
  07:44:35 STEP 2692 H=2692:00 +CPU= 13.023
  07:44:48 STEP 2693 H=2693:00 +CPU= 12.889
  07:45:09 STEP 2694 H=2694:00 +CPU= 20.768
  07:45:21 STEP 2695 H=2695:00 +CPU= 12.543
  07:45:34 STEP 2696 H=2696:00 +CPU= 13.247
  07:45:55 STEP 2697 H=2697:00 +CPU= 20.044
  07:46:08 STEP 2698 H=2698:00 +CPU= 12.991
  07:46:20 STEP 2699 H=2699:00 +CPU= 12.696
  07:46:43 STEP 2700 H=2700:00 +CPU= 22.189
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002700
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002700
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002700
  07:46:55 STEP 2701 H=2701:00 +CPU= 12.673
  07:47:08 STEP 2702 H=2702:00 +CPU= 13.028
  07:47:28 STEP 2703 H=2703:00 +CPU= 20.004
  07:47:41 STEP 2704 H=2704:00 +CPU= 13.070
  07:47:54 STEP 2705 H=2705:00 +CPU= 12.809
  07:48:15 STEP 2706 H=2706:00 +CPU= 20.819
  07:48:28 STEP 2707 H=2707:00 +CPU= 12.700
  07:48:41 STEP 2708 H=2708:00 +CPU= 13.125
  07:49:01 STEP 2709 H=2709:00 +CPU= 20.148
  07:49:14 STEP 2710 H=2710:00 +CPU= 12.839
  07:49:27 STEP 2711 H=2711:00 +CPU= 13.203
  07:49:51 STEP 2712 H=2712:00 +CPU= 22.439
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002712
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002712
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002712
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002688
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002688
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002688
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002700
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002700
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002700
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_112.zip
Uploading the intermediate file: upload_file_112.zip
  07:50:03 STEP 2713 H=2713:00 +CPU= 11.813
  07:50:15 STEP 2714 H=2714:00 +CPU= 12.043
Uploading trickle at timestep: 9763200
  07:50:34 STEP 2715 H=2715:00 +CPU= 18.815
  07:50:46 STEP 2716 H=2716:00 +CPU= 12.116
  07:50:58 STEP 2717 H=2717:00 +CPU= 11.746
  07:51:17 STEP 2718 H=2718:00 +CPU= 19.134
  07:51:28 STEP 2719 H=2719:00 +CPU= 11.727
  07:51:41 STEP 2720 H=2720:00 +CPU= 12.091
  07:51:59 STEP 2721 H=2721:00 +CPU= 18.818
  07:52:12 STEP 2722 H=2722:00 +CPU= 12.092
  07:52:23 STEP 2723 H=2723:00 +CPU= 11.750
  07:52:44 STEP 2724 H=2724:00 +CPU= 20.731
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002724
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002724
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002724
  07:52:56 STEP 2725 H=2725:00 +CPU= 11.842
  07:53:08 STEP 2726 H=2726:00 +CPU= 12.200
  07:53:27 STEP 2727 H=2727:00 +CPU= 19.201
  07:53:40 STEP 2728 H=2728:00 +CPU= 12.311
  07:53:51 STEP 2729 H=2729:00 +CPU= 11.777
  07:54:11 STEP 2730 H=2730:00 +CPU= 19.117
  07:54:22 STEP 2731 H=2731:00 +CPU= 11.832
  07:54:35 STEP 2732 H=2732:00 +CPU= 12.234
  07:54:54 STEP 2733 H=2733:00 +CPU= 18.839
  07:55:06 STEP 2734 H=2734:00 +CPU= 12.094
  07:55:18 STEP 2735 H=2735:00 +CPU= 11.984
  07:55:40 STEP 2736 H=2736:00 +CPU= 22.363
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002736
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002736
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002736
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002712
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002712
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002712
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002724
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002724
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002724
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_113.zip
Uploading the intermediate file: upload_file_113.zip
  07:55:52 STEP 2737 H=2737:00 +CPU= 11.753
  07:56:04 STEP 2738 H=2738:00 +CPU= 12.180
  07:56:23 STEP 2739 H=2739:00 +CPU= 18.771
  07:56:35 STEP 2740 H=2740:00 +CPU= 12.143
  07:56:47 STEP 2741 H=2741:00 +CPU= 11.791
  07:57:06 STEP 2742 H=2742:00 +CPU= 19.224
  07:57:18 STEP 2743 H=2743:00 +CPU= 11.731
  07:57:30 STEP 2744 H=2744:00 +CPU= 12.243
  07:57:49 STEP 2745 H=2745:00 +CPU= 18.781
  07:58:01 STEP 2746 H=2746:00 +CPU= 12.063
  07:58:13 STEP 2747 H=2747:00 +CPU= 11.806
  07:58:34 STEP 2748 H=2748:00 +CPU= 20.804
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002748
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002748
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002748
  07:58:46 STEP 2749 H=2749:00 +CPU= 11.719
  07:58:58 STEP 2750 H=2750:00 +CPU= 12.095
  07:59:16 STEP 2751 H=2751:00 +CPU= 18.674
  07:59:28 STEP 2752 H=2752:00 +CPU= 12.100
  07:59:40 STEP 2753 H=2753:00 +CPU= 11.674
  07:59:59 STEP 2754 H=2754:00 +CPU= 19.208
  08:00:11 STEP 2755 H=2755:00 +CPU= 11.764
  08:00:24 STEP 2756 H=2756:00 +CPU= 12.387
  08:00:43 STEP 2757 H=2757:00 +CPU= 19.255
  08:00:55 STEP 2758 H=2758:00 +CPU= 12.223
  08:01:07 STEP 2759 H=2759:00 +CPU= 12.171
  08:01:30 STEP 2760 H=2760:00 +CPU= 22.493
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002760
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002760
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002760
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002736
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002736
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002736
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002748
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002748
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002748
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_114.zip
Uploading the intermediate file: upload_file_114.zip
  08:01:42 STEP 2761 H=2761:00 +CPU= 12.230
  08:01:55 STEP 2762 H=2762:00 +CPU= 12.595
  08:02:14 STEP 2763 H=2763:00 +CPU= 19.569
  08:02:27 STEP 2764 H=2764:00 +CPU= 12.442
  08:02:39 STEP 2765 H=2765:00 +CPU= 11.991
  08:02:58 STEP 2766 H=2766:00 +CPU= 19.523
  08:03:10 STEP 2767 H=2767:00 +CPU= 12.012
  08:03:23 STEP 2768 H=2768:00 +CPU= 12.711
  08:03:43 STEP 2769 H=2769:00 +CPU= 19.531
  08:03:55 STEP 2770 H=2770:00 +CPU= 12.519
  08:04:07 STEP 2771 H=2771:00 +CPU= 12.110
  08:04:31 STEP 2772 H=2772:00 +CPU= 23.427
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002772
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002772
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002772
  08:04:44 STEP 2773 H=2773:00 +CPU= 13.169
  08:04:57 STEP 2774 H=2774:00 +CPU= 12.870
  08:05:17 STEP 2775 H=2775:00 +CPU= 20.173
  08:05:30 STEP 2776 H=2776:00 +CPU= 13.168
  08:05:43 STEP 2777 H=2777:00 +CPU= 12.840
  08:06:04 STEP 2778 H=2778:00 +CPU= 20.670
  08:06:17 STEP 2779 H=2779:00 +CPU= 12.805
  08:06:30 STEP 2780 H=2780:00 +CPU= 13.520
  08:06:51 STEP 2781 H=2781:00 +CPU= 20.475
  08:07:04 STEP 2782 H=2782:00 +CPU= 13.238
  08:07:18 STEP 2783 H=2783:00 +CPU= 13.123
  08:07:42 STEP 2784 H=2784:00 +CPU= 24.040
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002784
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002784
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002784
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002760
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002760
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002760
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002772
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002772
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002772
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_115.zip
Uploading the intermediate file: upload_file_115.zip
  08:07:54 STEP 2785 H=2785:00 +CPU= 12.403
  08:08:07 STEP 2786 H=2786:00 +CPU= 12.498
  08:08:26 STEP 2787 H=2787:00 +CPU= 19.753
  08:08:39 STEP 2788 H=2788:00 +CPU= 12.704
  08:08:53 STEP 2789 H=2789:00 +CPU= 13.538
  08:09:13 STEP 2790 H=2790:00 +CPU= 20.448
  08:09:26 STEP 2791 H=2791:00 +CPU= 12.462
  08:09:38 STEP 2792 H=2792:00 +CPU= 12.843
  08:09:59 STEP 2793 H=2793:00 +CPU= 20.368
  08:10:13 STEP 2794 H=2794:00 +CPU= 14.250
  08:10:27 STEP 2795 H=2795:00 +CPU= 13.282
  08:10:49 STEP 2796 H=2796:00 +CPU= 22.461
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002796
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002796
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002796
  08:11:02 STEP 2797 H=2797:00 +CPU= 12.624
  08:11:14 STEP 2798 H=2798:00 +CPU= 12.656
  08:11:34 STEP 2799 H=2799:00 +CPU= 19.847
  08:11:47 STEP 2800 H=2800:00 +CPU= 12.791
  08:12:00 STEP 2801 H=2801:00 +CPU= 12.703
  08:12:20 STEP 2802 H=2802:00 +CPU= 20.455
  08:12:32 STEP 2803 H=2803:00 +CPU= 12.187
  08:12:45 STEP 2804 H=2804:00 +CPU= 12.554
  08:13:05 STEP 2805 H=2805:00 +CPU= 19.491
  08:13:17 STEP 2806 H=2806:00 +CPU= 12.591
  08:13:30 STEP 2807 H=2807:00 +CPU= 12.596
  08:13:53 STEP 2808 H=2808:00 +CPU= 22.875
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002808
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002808
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002808
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002784
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002784
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002784
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002796
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002796
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002796
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_116.zip
Uploading the intermediate file: upload_file_116.zip
  08:14:05 STEP 2809 H=2809:00 +CPU= 11.981
  08:14:17 STEP 2810 H=2810:00 +CPU= 12.470
  08:14:37 STEP 2811 H=2811:00 +CPU= 19.227
  08:14:49 STEP 2812 H=2812:00 +CPU= 12.524
  08:15:01 STEP 2813 H=2813:00 +CPU= 12.095
  08:15:21 STEP 2814 H=2814:00 +CPU= 19.686
  08:15:33 STEP 2815 H=2815:00 +CPU= 12.099
  08:15:46 STEP 2816 H=2816:00 +CPU= 12.554
  08:16:05 STEP 2817 H=2817:00 +CPU= 19.613
  08:16:18 STEP 2818 H=2818:00 +CPU= 12.438
  08:16:30 STEP 2819 H=2819:00 +CPU= 12.223
  08:16:51 STEP 2820 H=2820:00 +CPU= 21.288
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002820
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002820
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002820
  08:17:03 STEP 2821 H=2821:00 +CPU= 12.063
  08:17:16 STEP 2822 H=2822:00 +CPU= 12.474
  08:17:35 STEP 2823 H=2823:00 +CPU= 19.210
  08:17:48 STEP 2824 H=2824:00 +CPU= 12.498
  08:18:00 STEP 2825 H=2825:00 +CPU= 12.004
  08:18:19 STEP 2826 H=2826:00 +CPU= 19.668
  08:18:32 STEP 2827 H=2827:00 +CPU= 12.119
  08:18:44 STEP 2828 H=2828:00 +CPU= 12.400
  08:19:04 STEP 2829 H=2829:00 +CPU= 19.480
  08:19:17 STEP 2830 H=2830:00 +CPU= 12.999
  08:19:29 STEP 2831 H=2831:00 +CPU= 12.361
  08:19:52 STEP 2832 H=2832:00 +CPU= 22.790
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002832
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002832
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002832
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002808
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002808
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002808
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002820
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002820
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002820
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_117.zip
Uploading the intermediate file: upload_file_117.zip
  08:20:04 STEP 2833 H=2833:00 +CPU= 12.112
  08:20:17 STEP 2834 H=2834:00 +CPU= 12.497
  08:20:36 STEP 2835 H=2835:00 +CPU= 19.193
  08:20:48 STEP 2836 H=2836:00 +CPU= 12.466
  08:21:01 STEP 2837 H=2837:00 +CPU= 12.077
  08:21:20 STEP 2838 H=2838:00 +CPU= 19.653
  08:21:32 STEP 2839 H=2839:00 +CPU= 12.170
  08:21:45 STEP 2840 H=2840:00 +CPU= 12.428
  08:22:04 STEP 2841 H=2841:00 +CPU= 19.321
  08:22:17 STEP 2842 H=2842:00 +CPU= 12.509
  08:22:29 STEP 2843 H=2843:00 +CPU= 12.064
  08:22:50 STEP 2844 H=2844:00 +CPU= 21.379
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002844
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002844
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002844
  08:23:02 STEP 2845 H=2845:00 +CPU= 12.140
  08:23:15 STEP 2846 H=2846:00 +CPU= 12.574
  08:23:35 STEP 2847 H=2847:00 +CPU= 19.547
  08:23:47 STEP 2848 H=2848:00 +CPU= 12.432
  08:23:59 STEP 2849 H=2849:00 +CPU= 12.074
  08:24:19 STEP 2850 H=2850:00 +CPU= 19.822
  08:24:31 STEP 2851 H=2851:00 +CPU= 12.161
  08:24:44 STEP 2852 H=2852:00 +CPU= 12.434
  08:25:03 STEP 2853 H=2853:00 +CPU= 19.496
  08:25:16 STEP 2854 H=2854:00 +CPU= 12.390
  08:25:28 STEP 2855 H=2855:00 +CPU= 12.340
  08:25:51 STEP 2856 H=2856:00 +CPU= 23.025
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002856
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002856
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002856
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002832
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002832
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002832
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002844
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002844
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002844
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_118.zip
Uploading the intermediate file: upload_file_118.zip
  08:26:04 STEP 2857 H=2857:00 +CPU= 12.335
  08:26:17 STEP 2858 H=2858:00 +CPU= 12.505
  08:26:36 STEP 2859 H=2859:00 +CPU= 19.386
  08:26:48 STEP 2860 H=2860:00 +CPU= 12.373
  08:27:01 STEP 2861 H=2861:00 +CPU= 12.147
  08:27:20 STEP 2862 H=2862:00 +CPU= 19.861
  08:27:32 STEP 2863 H=2863:00 +CPU= 12.065
  08:27:45 STEP 2864 H=2864:00 +CPU= 12.467
  08:28:04 STEP 2865 H=2865:00 +CPU= 19.389
  08:28:17 STEP 2866 H=2866:00 +CPU= 12.446
  08:28:29 STEP 2867 H=2867:00 +CPU= 12.177
  08:28:50 STEP 2868 H=2868:00 +CPU= 21.350
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002868
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002868
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002868
  08:29:03 STEP 2869 H=2869:00 +CPU= 12.090
  08:29:15 STEP 2870 H=2870:00 +CPU= 12.499
  08:29:34 STEP 2871 H=2871:00 +CPU= 19.294
  08:29:47 STEP 2872 H=2872:00 +CPU= 12.532
  08:29:59 STEP 2873 H=2873:00 +CPU= 12.031
  08:30:19 STEP 2874 H=2874:00 +CPU= 19.737
  08:30:31 STEP 2875 H=2875:00 +CPU= 12.017
  08:30:43 STEP 2876 H=2876:00 +CPU= 12.468
  08:31:03 STEP 2877 H=2877:00 +CPU= 19.307
  08:31:15 STEP 2878 H=2878:00 +CPU= 12.317
  08:31:27 STEP 2879 H=2879:00 +CPU= 12.516
  08:31:50 STEP 2880 H=2880:00 +CPU= 22.809
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002880
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002880
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002880
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002856
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002856
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002856
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002868
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002868
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002868
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_119.zip
Uploading the intermediate file: upload_file_119.zip
  08:32:02 STEP 2881 H=2881:00 +CPU= 12.051
  08:32:15 STEP 2882 H=2882:00 +CPU= 12.454
  08:32:34 STEP 2883 H=2883:00 +CPU= 19.433
  08:32:47 STEP 2884 H=2884:00 +CPU= 12.421
  08:32:59 STEP 2885 H=2885:00 +CPU= 12.070
  08:33:18 STEP 2886 H=2886:00 +CPU= 19.532
  08:33:31 STEP 2887 H=2887:00 +CPU= 12.072
  08:33:43 STEP 2888 H=2888:00 +CPU= 12.437
  08:34:02 STEP 2889 H=2889:00 +CPU= 19.134
  08:34:14 STEP 2890 H=2890:00 +CPU= 12.267
  08:34:27 STEP 2891 H=2891:00 +CPU= 12.154
  08:34:48 STEP 2892 H=2892:00 +CPU= 21.310
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002892
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002892
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002892
  08:35:00 STEP 2893 H=2893:00 +CPU= 12.102
  08:35:13 STEP 2894 H=2894:00 +CPU= 12.523
  08:35:32 STEP 2895 H=2895:00 +CPU= 19.350
  08:35:44 STEP 2896 H=2896:00 +CPU= 12.461
  08:35:57 STEP 2897 H=2897:00 +CPU= 12.141
  08:36:16 STEP 2898 H=2898:00 +CPU= 19.780
  08:36:29 STEP 2899 H=2899:00 +CPU= 12.130
  08:36:41 STEP 2900 H=2900:00 +CPU= 12.429
  08:37:00 STEP 2901 H=2901:00 +CPU= 19.314
  08:37:13 STEP 2902 H=2902:00 +CPU= 12.475
  08:37:25 STEP 2903 H=2903:00 +CPU= 12.360
  08:37:48 STEP 2904 H=2904:00 +CPU= 22.856
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002904
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002904
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002904
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002880
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002880
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002880
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002892
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002892
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002892
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_120.zip
Uploading the intermediate file: upload_file_120.zip
  08:38:00 STEP 2905 H=2905:00 +CPU= 12.116
  08:38:13 STEP 2906 H=2906:00 +CPU= 12.469
  08:38:32 STEP 2907 H=2907:00 +CPU= 19.235
  08:38:45 STEP 2908 H=2908:00 +CPU= 12.427
  08:38:57 STEP 2909 H=2909:00 +CPU= 12.121
  08:39:16 STEP 2910 H=2910:00 +CPU= 19.646
  08:39:29 STEP 2911 H=2911:00 +CPU= 12.076
  08:39:41 STEP 2912 H=2912:00 +CPU= 12.530
  08:40:00 STEP 2913 H=2913:00 +CPU= 19.243
  08:40:13 STEP 2914 H=2914:00 +CPU= 12.349
  08:40:25 STEP 2915 H=2915:00 +CPU= 12.231
  08:40:46 STEP 2916 H=2916:00 +CPU= 21.162
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002916
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002916
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002916
  08:40:58 STEP 2917 H=2917:00 +CPU= 12.022
  08:41:11 STEP 2918 H=2918:00 +CPU= 12.576
  08:41:30 STEP 2919 H=2919:00 +CPU= 19.107
  08:41:43 STEP 2920 H=2920:00 +CPU= 12.535
  08:41:55 STEP 2921 H=2921:00 +CPU= 12.091
  08:42:14 STEP 2922 H=2922:00 +CPU= 19.754
  08:42:27 STEP 2923 H=2923:00 +CPU= 12.069
  08:42:39 STEP 2924 H=2924:00 +CPU= 12.473
  08:42:58 STEP 2925 H=2925:00 +CPU= 19.373
  08:43:11 STEP 2926 H=2926:00 +CPU= 12.648
  08:43:24 STEP 2927 H=2927:00 +CPU= 12.860
  08:43:47 STEP 2928 H=2928:00 +CPU= 22.963
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002928
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002928
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002928
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002904
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002904
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002904
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002916
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002916
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002916
Zipping up the intermediate file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_121.zip
Uploading the intermediate file: upload_file_121.zip
  08:43:59 STEP 2929 H=2929:00 +CPU= 11.975
  08:44:12 STEP 2930 H=2930:00 +CPU= 12.490
  08:44:31 STEP 2931 H=2931:00 +CPU= 19.241
  08:44:43 STEP 2932 H=2932:00 +CPU= 12.468
  08:44:56 STEP 2933 H=2933:00 +CPU= 12.038
  08:45:15 STEP 2934 H=2934:00 +CPU= 19.854
  08:45:27 STEP 2935 H=2935:00 +CPU= 12.040
  08:45:40 STEP 2936 H=2936:00 +CPU= 12.502
  08:45:59 STEP 2937 H=2937:00 +CPU= 19.229
  08:46:12 STEP 2938 H=2938:00 +CPU= 12.357
  08:46:24 STEP 2939 H=2939:00 +CPU= 12.056
  08:46:45 STEP 2940 H=2940:00 +CPU= 21.344
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002940
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002940
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002940
  08:46:57 STEP 2941 H=2941:00 +CPU= 12.137
  08:47:10 STEP 2942 H=2942:00 +CPU= 12.551
  08:47:29 STEP 2943 H=2943:00 +CPU= 19.307
  08:47:42 STEP 2944 H=2944:00 +CPU= 12.536
  08:47:54 STEP 2945 H=2945:00 +CPU= 12.154
  08:48:14 STEP 2946 H=2946:00 +CPU= 19.831
  08:48:26 STEP 2947 H=2947:00 +CPU= 12.176
  08:48:38 STEP 2948 H=2948:00 +CPU= 12.481
  08:48:58 STEP 2949 H=2949:00 +CPU= 19.367
  08:49:11 STEP 2950 H=2950:00 +CPU= 12.291
  08:49:22 STEP 2951 H=2951:00 +CPU= 11.830
  08:49:44 STEP 2952 H=2952:00 +CPU= 21.317
The child process terminated with status: 0
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMGGhq0f+002952
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMSHhq0f+002952
Moving to projects directory: /home/thebigguy/Desktop/slots/3/ICMUAhq0f+002952
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002952
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002940
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002952
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002928
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002940
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMSHhq0f+002940
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002952
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMGGhq0f+002928
Adding to the zip: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_12204502/ICMUAhq0f+002928
Zipping up the final file: /home/thebigguy/Desktop/projects/climateprediction.net/oifs_43r3_ps_0858_2018050100_123_987_12204502_0_r1381420023_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
08:53:08 (4928): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:55:06 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 10,623,600 49,316 0.0046
09 May 2023 15:55:01 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 9,763,200 45,737 0.0047
09 May 2023 15:54:47 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 8,640,000 40,640 0.0047
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 7,776,000 36,771 0.0047
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 6,912,000 32,853 0.0048
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 6,048,000 28,925 0.0048
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 5,184,000 25,006 0.0048
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 4,320,000 21,044 0.0049
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 3,456,000 16,922 0.0049
09 May 2023 15:54:40 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 2,592,000 12,793 0.0049
09 May 2023 15:53:56 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 1,728,000 8,675 0.0050
09 May 2023 15:53:41 1529574 22291004 oifs_43r3_ps_0858_2018050100_123_987_12204502_0 864,000 4,549 0.0053


©2024 cpdn.org