climateprediction.net (CPDN) home page
Task 22450122

Task 22450122

Name oifs_43r3_bl_a251_2016092300_20_1018_12291100_1
Workunit 12291100
Created 20 Jun 2024, 2:45:56 UTC
Sent 20 Jun 2024, 2:48:32 UTC
Report deadline 19 Aug 2024, 2:48:32 UTC
Received 20 Jun 2024, 17:56:57 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537499
Run time 10 hours 42 min 32 sec
CPU time 10 hours 11 min 20 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 6.99 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4.90 GB
Peak swap size 5.84 GB
Peak disk usage 1.26 GB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
eating progress file: /var/lib/boinc-client/slots/2/progress_file_12291100.xml
last_cpu_time: 26850
upload_file_number: 14
last_iter: 1393
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085
The child process has been launched with process id: 1570689
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:HomeServer01:1:1:1570689:1570689] [20240620:160012:1718892012:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:00:44 STEP 1392 H= 348:00 +CPU= 26.919
  16:01:05 STEP 1393 H= 348:15 +CPU= 20.101
  16:01:30 STEP 1394 H= 348:30 +CPU= 24.355
  16:01:49 STEP 1395 H= 348:45 +CPU= 17.950
  16:02:06 STEP 1396 H= 349:00 +CPU= 16.036
  16:02:22 STEP 1397 H= 349:15 +CPU= 15.705
  16:02:41 STEP 1398 H= 349:30 +CPU= 17.535
  16:03:03 STEP 1399 H= 349:45 +CPU= 21.556
  16:03:20 STEP 1400 H= 350:00 +CPU= 16.147
  16:03:37 STEP 1401 H= 350:15 +CPU= 15.760
  16:03:54 STEP 1402 H= 350:30 +CPU= 15.903
  16:04:11 STEP 1403 H= 350:45 +CPU= 16.181
  16:04:32 STEP 1404 H= 351:00 +CPU= 19.898
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  16:04:49 STEP 1405 H= 351:15 +CPU= 15.917
  16:05:10 STEP 1406 H= 351:30 +CPU= 20.075
  16:05:35 STEP 1407 H= 351:45 +CPU= 23.981
  16:05:57 STEP 1408 H= 352:00 +CPU= 21.889
  16:06:23 STEP 1409 H= 352:15 +CPU= 24.394
  16:06:48 STEP 1410 H= 352:30 +CPU= 24.473
  16:07:10 STEP 1411 H= 352:45 +CPU= 21.053
  16:07:30 STEP 1412 H= 353:00 +CPU= 19.237
  16:07:47 STEP 1413 H= 353:15 +CPU= 15.947
  16:08:04 STEP 1414 H= 353:30 +CPU= 15.818
  16:08:20 STEP 1415 H= 353:45 +CPU= 15.819
  16:08:41 STEP 1416 H= 354:00 +CPU= 19.820
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  16:08:57 STEP 1417 H= 354:15 +CPU= 15.634
  16:09:14 STEP 1418 H= 354:30 +CPU= 15.872
  16:09:31 STEP 1419 H= 354:45 +CPU= 16.140
  16:09:48 STEP 1420 H= 355:00 +CPU= 16.237
  16:10:05 STEP 1421 H= 355:15 +CPU= 16.574
  16:10:22 STEP 1422 H= 355:30 +CPU= 15.882
  16:10:38 STEP 1423 H= 355:45 +CPU= 15.706
  16:10:55 STEP 1424 H= 356:00 +CPU= 16.022
  16:11:11 STEP 1425 H= 356:15 +CPU= 15.767
  16:11:28 STEP 1426 H= 356:30 +CPU= 15.847
  16:11:45 STEP 1427 H= 356:45 +CPU= 16.507
  16:12:06 STEP 1428 H= 357:00 +CPU= 20.012
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001428
  16:12:22 STEP 1429 H= 357:15 +CPU= 15.759
  16:12:39 STEP 1430 H= 357:30 +CPU= 15.728
  16:12:55 STEP 1431 H= 357:45 +CPU= 15.841
  16:13:14 STEP 1432 H= 358:00 +CPU= 17.519
  16:13:32 STEP 1433 H= 358:15 +CPU= 16.376
  16:13:49 STEP 1434 H= 358:30 +CPU= 16.291
  16:14:07 STEP 1435 H= 358:45 +CPU= 16.328
  16:14:24 STEP 1436 H= 359:00 +CPU= 16.550
  16:14:43 STEP 1437 H= 359:15 +CPU= 16.984
  16:15:00 STEP 1438 H= 359:30 +CPU= 16.338
  16:15:23 STEP 1439 H= 359:45 +CPU= 21.703
  16:15:51 STEP 1440 H= 360:00 +CPU= 26.234
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_14.zip
Uploading the intermediate file: upload_file_14.zip
  16:16:11 STEP 1441 H= 360:15 +CPU= 18.310
  16:16:28 STEP 1442 H= 360:30 +CPU= 16.582
  16:16:46 STEP 1443 H= 360:45 +CPU= 16.151
  16:17:11 STEP 1444 H= 361:00 +CPU= 24.107
  16:17:31 STEP 1445 H= 361:15 +CPU= 19.519
  16:17:49 STEP 1446 H= 361:30 +CPU= 16.254
  16:18:05 STEP 1447 H= 361:45 +CPU= 15.880
  16:18:22 STEP 1448 H= 362:00 +CPU= 16.249
  16:18:39 STEP 1449 H= 362:15 +CPU= 15.760
  16:18:55 STEP 1450 H= 362:30 +CPU= 15.901
  16:19:13 STEP 1451 H= 362:45 +CPU= 16.476
  16:19:33 STEP 1452 H= 363:00 +CPU= 19.696
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001452
  16:19:50 STEP 1453 H= 363:15 +CPU= 15.870
  16:20:06 STEP 1454 H= 363:30 +CPU= 15.858
  16:20:23 STEP 1455 H= 363:45 +CPU= 15.739
  16:20:40 STEP 1456 H= 364:00 +CPU= 16.547
  16:20:58 STEP 1457 H= 364:15 +CPU= 16.084
  16:21:14 STEP 1458 H= 364:30 +CPU= 15.767
  16:21:31 STEP 1459 H= 364:45 +CPU= 16.033
  16:21:47 STEP 1460 H= 365:00 +CPU= 16.070
  16:22:06 STEP 1461 H= 365:15 +CPU= 17.730
  16:22:24 STEP 1462 H= 365:30 +CPU= 16.357
  16:22:41 STEP 1463 H= 365:45 +CPU= 16.211
  16:23:05 STEP 1464 H= 366:00 +CPU= 22.018
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001464
  16:23:30 STEP 1465 H= 366:15 +CPU= 24.644
  16:23:48 STEP 1466 H= 366:30 +CPU= 17.042
  16:24:05 STEP 1467 H= 366:45 +CPU= 15.805
  16:24:23 STEP 1468 H= 367:00 +CPU= 16.595
  16:24:39 STEP 1469 H= 367:15 +CPU= 16.032
  16:24:56 STEP 1470 H= 367:30 +CPU= 16.072
  16:25:19 STEP 1471 H= 367:45 +CPU= 21.330
  16:25:42 STEP 1472 H= 368:00 +CPU= 22.124
  16:25:59 STEP 1473 H= 368:15 +CPU= 16.269
  16:26:17 STEP 1474 H= 368:30 +CPU= 16.197
  16:26:34 STEP 1475 H= 368:45 +CPU= 16.109
  16:26:59 STEP 1476 H= 369:00 +CPU= 23.561
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001476
  16:27:24 STEP 1477 H= 369:15 +CPU= 24.599
  16:27:50 STEP 1478 H= 369:30 +CPU= 24.533
  16:28:15 STEP 1479 H= 369:45 +CPU= 24.633
  16:28:42 STEP 1480 H= 370:00 +CPU= 25.184
  16:29:07 STEP 1481 H= 370:15 +CPU= 24.483
  16:29:26 STEP 1482 H= 370:30 +CPU= 17.545
  16:29:44 STEP 1483 H= 370:45 +CPU= 16.678
  16:30:02 STEP 1484 H= 371:00 +CPU= 16.753
  16:30:21 STEP 1485 H= 371:15 +CPU= 17.432
  16:30:38 STEP 1486 H= 371:30 +CPU= 15.967
  16:30:54 STEP 1487 H= 371:45 +CPU= 15.867
  16:31:18 STEP 1488 H= 372:00 +CPU= 22.305
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001488
  16:31:34 STEP 1489 H= 372:15 +CPU= 15.765
  16:31:50 STEP 1490 H= 372:30 +CPU= 15.849
  16:32:13 STEP 1491 H= 372:45 +CPU= 22.077
  16:32:31 STEP 1492 H= 373:00 +CPU= 16.752
  16:32:49 STEP 1493 H= 373:15 +CPU= 16.527
  16:33:07 STEP 1494 H= 373:30 +CPU= 16.677
  16:33:25 STEP 1495 H= 373:45 +CPU= 16.517
  16:33:43 STEP 1496 H= 374:00 +CPU= 16.889
  16:34:01 STEP 1497 H= 374:15 +CPU= 16.594
  16:34:19 STEP 1498 H= 374:30 +CPU= 16.234
  16:34:36 STEP 1499 H= 374:45 +CPU= 16.350
  16:34:58 STEP 1500 H= 375:00 +CPU= 20.242
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001500
  16:35:23 STEP 1501 H= 375:15 +CPU= 24.495
  16:35:43 STEP 1502 H= 375:30 +CPU= 18.510
  16:36:00 STEP 1503 H= 375:45 +CPU= 16.278
  16:36:17 STEP 1504 H= 376:00 +CPU= 16.277
  16:36:35 STEP 1505 H= 376:15 +CPU= 16.398
  16:36:58 STEP 1506 H= 376:30 +CPU= 22.918
  16:37:20 STEP 1507 H= 376:45 +CPU= 20.613
  16:37:37 STEP 1508 H= 377:00 +CPU= 16.702
  16:37:54 STEP 1509 H= 377:15 +CPU= 16.239
  16:38:12 STEP 1510 H= 377:30 +CPU= 16.748
  16:38:29 STEP 1511 H= 377:45 +CPU= 16.010
  16:38:50 STEP 1512 H= 378:00 +CPU= 20.128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001512
  16:39:12 STEP 1513 H= 378:15 +CPU= 20.577
  16:39:37 STEP 1514 H= 378:30 +CPU= 24.476
  16:40:00 STEP 1515 H= 378:45 +CPU= 21.832
  16:40:17 STEP 1516 H= 379:00 +CPU= 16.470
  16:40:34 STEP 1517 H= 379:15 +CPU= 15.812
  16:40:51 STEP 1518 H= 379:30 +CPU= 16.140
  16:41:14 STEP 1519 H= 379:45 +CPU= 21.528
  16:41:38 STEP 1520 H= 380:00 +CPU= 22.419
  16:41:55 STEP 1521 H= 380:15 +CPU= 16.212
  16:42:12 STEP 1522 H= 380:30 +CPU= 16.241
  16:42:29 STEP 1523 H= 380:45 +CPU= 15.876
  16:42:49 STEP 1524 H= 381:00 +CPU= 19.743
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001524
  16:43:09 STEP 1525 H= 381:15 +CPU= 18.823
  16:43:35 STEP 1526 H= 381:30 +CPU= 24.531
  16:44:00 STEP 1527 H= 381:45 +CPU= 24.394
  16:44:26 STEP 1528 H= 382:00 +CPU= 24.872
  16:44:51 STEP 1529 H= 382:15 +CPU= 24.523
  16:45:08 STEP 1530 H= 382:30 +CPU= 16.246
  16:45:25 STEP 1531 H= 382:45 +CPU= 15.911
  16:45:42 STEP 1532 H= 383:00 +CPU= 16.197
  16:45:58 STEP 1533 H= 383:15 +CPU= 15.747
  16:46:16 STEP 1534 H= 383:30 +CPU= 16.279
  16:46:32 STEP 1535 H= 383:45 +CPU= 15.714
  16:46:55 STEP 1536 H= 384:00 +CPU= 21.824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_15.zip
Uploading the intermediate file: upload_file_15.zip
  16:47:13 STEP 1537 H= 384:15 +CPU= 17.365
  16:47:30 STEP 1538 H= 384:30 +CPU= 16.459
  16:47:49 STEP 1539 H= 384:45 +CPU= 18.328
  16:48:12 STEP 1540 H= 385:00 +CPU= 21.596
  16:48:37 STEP 1541 H= 385:15 +CPU= 24.499
  16:48:55 STEP 1542 H= 385:30 +CPU= 17.747
  16:49:21 STEP 1543 H= 385:45 +CPU= 24.300
  16:49:38 STEP 1544 H= 386:00 +CPU= 16.398
  16:50:03 STEP 1545 H= 386:15 +CPU= 24.438
  16:50:29 STEP 1546 H= 386:30 +CPU= 24.485
  16:50:54 STEP 1547 H= 386:45 +CPU= 24.430
  16:51:16 STEP 1548 H= 387:00 +CPU= 20.835
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001548
  16:51:32 STEP 1549 H= 387:15 +CPU= 15.750
  16:51:48 STEP 1550 H= 387:30 +CPU= 15.690
  16:52:08 STEP 1551 H= 387:45 +CPU= 18.164
  16:52:33 STEP 1552 H= 388:00 +CPU= 24.922
  16:52:56 STEP 1553 H= 388:15 +CPU= 21.822
  16:53:12 STEP 1554 H= 388:30 +CPU= 15.782
  16:53:29 STEP 1555 H= 388:45 +CPU= 15.975
  16:53:47 STEP 1556 H= 389:00 +CPU= 16.415
  16:54:03 STEP 1557 H= 389:15 +CPU= 15.712
  16:54:20 STEP 1558 H= 389:30 +CPU= 15.847
  16:54:36 STEP 1559 H= 389:45 +CPU= 15.731
  16:54:56 STEP 1560 H= 390:00 +CPU= 19.671
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001560
  16:55:13 STEP 1561 H= 390:15 +CPU= 16.178
  16:55:30 STEP 1562 H= 390:30 +CPU= 15.914
  16:55:46 STEP 1563 H= 390:45 +CPU= 15.823
  16:56:03 STEP 1564 H= 391:00 +CPU= 16.142
  16:56:20 STEP 1565 H= 391:15 +CPU= 15.725
  16:56:37 STEP 1566 H= 391:30 +CPU= 15.980
  16:56:53 STEP 1567 H= 391:45 +CPU= 15.663
  16:57:10 STEP 1568 H= 392:00 +CPU= 16.321
  16:57:26 STEP 1569 H= 392:15 +CPU= 15.797
  16:57:43 STEP 1570 H= 392:30 +CPU= 15.913
  16:58:00 STEP 1571 H= 392:45 +CPU= 15.987
  16:58:21 STEP 1572 H= 393:00 +CPU= 20.522
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001572
  16:58:39 STEP 1573 H= 393:15 +CPU= 16.173
  16:58:55 STEP 1574 H= 393:30 +CPU= 15.987
  16:59:12 STEP 1575 H= 393:45 +CPU= 15.929
  16:59:30 STEP 1576 H= 394:00 +CPU= 16.406
  16:59:47 STEP 1577 H= 394:15 +CPU= 16.227
  17:00:04 STEP 1578 H= 394:30 +CPU= 16.085
  17:00:21 STEP 1579 H= 394:45 +CPU= 16.043
  17:00:38 STEP 1580 H= 395:00 +CPU= 16.255
  17:00:55 STEP 1581 H= 395:15 +CPU= 15.877
  17:01:12 STEP 1582 H= 395:30 +CPU= 16.238
  17:01:29 STEP 1583 H= 395:45 +CPU= 16.027
  17:02:02 STEP 1584 H= 396:00 +CPU= 31.173
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001584
  17:02:25 STEP 1585 H= 396:15 +CPU= 22.386
  17:02:44 STEP 1586 H= 396:30 +CPU= 17.067
  17:03:01 STEP 1587 H= 396:45 +CPU= 16.143
  17:03:19 STEP 1588 H= 397:00 +CPU= 16.556
  17:03:36 STEP 1589 H= 397:15 +CPU= 16.292
  17:03:53 STEP 1590 H= 397:30 +CPU= 15.986
  17:04:15 STEP 1591 H= 397:45 +CPU= 20.845
  17:04:41 STEP 1592 H= 398:00 +CPU= 24.926
  17:05:06 STEP 1593 H= 398:15 +CPU= 24.525
  17:05:26 STEP 1594 H= 398:30 +CPU= 18.922
  17:05:44 STEP 1595 H= 398:45 +CPU= 16.569
  17:06:05 STEP 1596 H= 399:00 +CPU= 19.963
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001596
  17:06:22 STEP 1597 H= 399:15 +CPU= 15.997
  17:06:39 STEP 1598 H= 399:30 +CPU= 16.014
  17:06:56 STEP 1599 H= 399:45 +CPU= 16.057
  17:07:14 STEP 1600 H= 400:00 +CPU= 17.495
  17:07:32 STEP 1601 H= 400:15 +CPU= 16.182
  17:07:49 STEP 1602 H= 400:30 +CPU= 16.203
  17:08:05 STEP 1603 H= 400:45 +CPU= 16.001
  17:08:22 STEP 1604 H= 401:00 +CPU= 16.257
  17:08:41 STEP 1605 H= 401:15 +CPU= 17.723
  17:08:59 STEP 1606 H= 401:30 +CPU= 16.145
  17:09:24 STEP 1607 H= 401:45 +CPU= 24.420
  17:09:56 STEP 1608 H= 402:00 +CPU= 30.577
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001608
  17:10:22 STEP 1609 H= 402:15 +CPU= 24.746
  17:10:47 STEP 1610 H= 402:30 +CPU= 24.615
  17:11:13 STEP 1611 H= 402:45 +CPU= 24.465
  17:11:31 STEP 1612 H= 403:00 +CPU= 16.878
  17:11:48 STEP 1613 H= 403:15 +CPU= 16.179
  17:12:10 STEP 1614 H= 403:30 +CPU= 21.360
  17:12:36 STEP 1615 H= 403:45 +CPU= 24.557
  17:13:02 STEP 1616 H= 404:00 +CPU= 25.063
  17:13:27 STEP 1617 H= 404:15 +CPU= 24.641
  17:13:53 STEP 1618 H= 404:30 +CPU= 24.725
  17:14:13 STEP 1619 H= 404:45 +CPU= 18.963
  17:14:35 STEP 1620 H= 405:00 +CPU= 20.196
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001620
  17:14:51 STEP 1621 H= 405:15 +CPU= 15.902
  17:15:08 STEP 1622 H= 405:30 +CPU= 16.115
  17:15:28 STEP 1623 H= 405:45 +CPU= 17.934
  17:15:46 STEP 1624 H= 406:00 +CPU= 16.849
  17:16:04 STEP 1625 H= 406:15 +CPU= 16.566
  17:16:21 STEP 1626 H= 406:30 +CPU= 16.220
  17:16:38 STEP 1627 H= 406:45 +CPU= 15.930
  17:16:55 STEP 1628 H= 407:00 +CPU= 16.272
  17:17:17 STEP 1629 H= 407:15 +CPU= 20.953
  17:17:39 STEP 1630 H= 407:30 +CPU= 21.449
  17:18:01 STEP 1631 H= 407:45 +CPU= 20.581
  17:18:35 STEP 1632 H= 408:00 +CPU= 33.380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_16.zip
Uploading the intermediate file: upload_file_16.zip
  17:19:01 STEP 1633 H= 408:15 +CPU= 24.684
  17:19:19 STEP 1634 H= 408:30 +CPU= 16.710
  17:19:40 STEP 1635 H= 408:45 +CPU= 19.674
  17:19:58 STEP 1636 H= 409:00 +CPU= 16.507
  17:20:16 STEP 1637 H= 409:15 +CPU= 16.431
  17:20:34 STEP 1638 H= 409:30 +CPU= 17.020
  17:20:51 STEP 1639 H= 409:45 +CPU= 16.214
  17:21:09 STEP 1640 H= 410:00 +CPU= 16.578
  17:21:27 STEP 1641 H= 410:15 +CPU= 16.269
  17:21:44 STEP 1642 H= 410:30 +CPU= 16.190
  17:22:02 STEP 1643 H= 410:45 +CPU= 16.935
  17:22:27 STEP 1644 H= 411:00 +CPU= 23.272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001644
  17:22:53 STEP 1645 H= 411:15 +CPU= 24.486
  17:23:18 STEP 1646 H= 411:30 +CPU= 24.534
  17:23:38 STEP 1647 H= 411:45 +CPU= 18.728
  17:23:55 STEP 1648 H= 412:00 +CPU= 16.170
  17:24:12 STEP 1649 H= 412:15 +CPU= 15.896
  17:24:28 STEP 1650 H= 412:30 +CPU= 15.959
  17:24:45 STEP 1651 H= 412:45 +CPU= 15.753
  17:25:03 STEP 1652 H= 413:00 +CPU= 17.202
  17:25:19 STEP 1653 H= 413:15 +CPU= 15.908
  17:25:38 STEP 1654 H= 413:30 +CPU= 18.028
  17:26:04 STEP 1655 H= 413:45 +CPU= 24.539
  17:26:31 STEP 1656 H= 414:00 +CPU= 26.225
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001656
  17:26:48 STEP 1657 H= 414:15 +CPU= 15.982
  17:27:04 STEP 1658 H= 414:30 +CPU= 15.778
  17:27:21 STEP 1659 H= 414:45 +CPU= 16.294
  17:27:38 STEP 1660 H= 415:00 +CPU= 16.077
  17:27:55 STEP 1661 H= 415:15 +CPU= 15.946
  17:28:12 STEP 1662 H= 415:30 +CPU= 16.449
  17:28:28 STEP 1663 H= 415:45 +CPU= 16.024
  17:28:45 STEP 1664 H= 416:00 +CPU= 16.197
  17:29:02 STEP 1665 H= 416:15 +CPU= 15.932
  17:29:18 STEP 1666 H= 416:30 +CPU= 15.749
  17:29:36 STEP 1667 H= 416:45 +CPU= 16.608
  17:29:57 STEP 1668 H= 417:00 +CPU= 19.576
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001668
  17:30:16 STEP 1669 H= 417:15 +CPU= 17.658
  17:30:33 STEP 1670 H= 417:30 +CPU= 16.247
  17:30:50 STEP 1671 H= 417:45 +CPU= 15.868
  17:31:07 STEP 1672 H= 418:00 +CPU= 16.618
  17:31:24 STEP 1673 H= 418:15 +CPU= 16.094
  17:31:41 STEP 1674 H= 418:30 +CPU= 16.147
  17:31:58 STEP 1675 H= 418:45 +CPU= 16.156
  17:32:16 STEP 1676 H= 419:00 +CPU= 16.454
  17:32:34 STEP 1677 H= 419:15 +CPU= 16.560
  17:32:50 STEP 1678 H= 419:30 +CPU= 15.995
  17:33:07 STEP 1679 H= 419:45 +CPU= 15.942
  17:33:31 STEP 1680 H= 420:00 +CPU= 22.176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001680
  17:33:48 STEP 1681 H= 420:15 +CPU= 16.220
  17:34:05 STEP 1682 H= 420:30 +CPU= 16.570
  17:34:22 STEP 1683 H= 420:45 +CPU= 16.051
  17:34:39 STEP 1684 H= 421:00 +CPU= 16.215
  17:34:56 STEP 1685 H= 421:15 +CPU= 15.909
  17:35:12 STEP 1686 H= 421:30 +CPU= 16.063
  17:35:29 STEP 1687 H= 421:45 +CPU= 16.017
  17:35:47 STEP 1688 H= 422:00 +CPU= 17.002
  17:36:04 STEP 1689 H= 422:15 +CPU= 15.945
  17:36:20 STEP 1690 H= 422:30 +CPU= 15.863
  17:36:37 STEP 1691 H= 422:45 +CPU= 15.852
  17:36:57 STEP 1692 H= 423:00 +CPU= 19.649
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001692
  17:37:14 STEP 1693 H= 423:15 +CPU= 16.136
  17:37:35 STEP 1694 H= 423:30 +CPU= 20.144
  17:37:52 STEP 1695 H= 423:45 +CPU= 16.107
  17:38:09 STEP 1696 H= 424:00 +CPU= 16.123
  17:38:26 STEP 1697 H= 424:15 +CPU= 16.368
  17:38:44 STEP 1698 H= 424:30 +CPU= 16.694
  17:39:00 STEP 1699 H= 424:45 +CPU= 15.930
  17:39:17 STEP 1700 H= 425:00 +CPU= 16.252
  17:39:34 STEP 1701 H= 425:15 +CPU= 15.935
  17:39:50 STEP 1702 H= 425:30 +CPU= 15.871
  17:40:08 STEP 1703 H= 425:45 +CPU= 16.569
  17:40:29 STEP 1704 H= 426:00 +CPU= 19.788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001704
  17:40:45 STEP 1705 H= 426:15 +CPU= 15.950
  17:41:02 STEP 1706 H= 426:30 +CPU= 15.891
  17:41:18 STEP 1707 H= 426:45 +CPU= 15.933
  17:41:36 STEP 1708 H= 427:00 +CPU= 16.581
  17:41:54 STEP 1709 H= 427:15 +CPU= 16.505
  17:42:12 STEP 1710 H= 427:30 +CPU= 16.815
  17:42:29 STEP 1711 H= 427:45 +CPU= 16.308
  17:42:46 STEP 1712 H= 428:00 +CPU= 15.951
  17:43:03 STEP 1713 H= 428:15 +CPU= 16.491
  17:43:21 STEP 1714 H= 428:30 +CPU= 16.154
  17:43:38 STEP 1715 H= 428:45 +CPU= 16.398
  17:43:59 STEP 1716 H= 429:00 +CPU= 19.972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001716
  17:44:16 STEP 1717 H= 429:15 +CPU= 16.424
  17:44:39 STEP 1718 H= 429:30 +CPU= 21.875
  17:44:56 STEP 1719 H= 429:45 +CPU= 16.113
  17:45:20 STEP 1720 H= 430:00 +CPU= 23.019
  17:45:40 STEP 1721 H= 430:15 +CPU= 18.516
  17:46:02 STEP 1722 H= 430:30 +CPU= 21.305
  17:46:28 STEP 1723 H= 430:45 +CPU= 24.657
  17:46:54 STEP 1724 H= 431:00 +CPU= 25.186
  17:47:20 STEP 1725 H= 431:15 +CPU= 24.635
  17:47:45 STEP 1726 H= 431:30 +CPU= 24.684
  17:48:09 STEP 1727 H= 431:45 +CPU= 22.124
  17:48:33 STEP 1728 H= 432:00 +CPU= 22.345
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_17.zip
Uploading the intermediate file: upload_file_17.zip
  17:48:58 STEP 1729 H= 432:15 +CPU= 23.860
  17:49:22 STEP 1730 H= 432:30 +CPU= 22.815
  17:49:39 STEP 1731 H= 432:45 +CPU= 16.058
  17:49:56 STEP 1732 H= 433:00 +CPU= 16.275
  17:50:13 STEP 1733 H= 433:15 +CPU= 16.142
  17:50:30 STEP 1734 H= 433:30 +CPU= 16.264
  17:50:48 STEP 1735 H= 433:45 +CPU= 16.763
  17:51:05 STEP 1736 H= 434:00 +CPU= 16.185
  17:51:22 STEP 1737 H= 434:15 +CPU= 16.050
  17:51:38 STEP 1738 H= 434:30 +CPU= 15.956
  17:51:55 STEP 1739 H= 434:45 +CPU= 16.029
  17:52:17 STEP 1740 H= 435:00 +CPU= 20.330
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001740
  17:52:40 STEP 1741 H= 435:15 +CPU= 21.499
  17:53:05 STEP 1742 H= 435:30 +CPU= 24.791
  17:53:30 STEP 1743 H= 435:45 +CPU= 23.570
  17:53:50 STEP 1744 H= 436:00 +CPU= 19.054
  17:54:16 STEP 1745 H= 436:15 +CPU= 24.649
  17:54:42 STEP 1746 H= 436:30 +CPU= 24.694
  17:55:02 STEP 1747 H= 436:45 +CPU= 19.437
  17:55:28 STEP 1748 H= 437:00 +CPU= 25.170
  17:55:54 STEP 1749 H= 437:15 +CPU= 24.703
  17:56:12 STEP 1750 H= 437:30 +CPU= 17.178
  17:56:29 STEP 1751 H= 437:45 +CPU= 16.091
  17:56:50 STEP 1752 H= 438:00 +CPU= 20.564
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001752
  17:57:07 STEP 1753 H= 438:15 +CPU= 15.794
  17:57:23 STEP 1754 H= 438:30 +CPU= 15.940
  17:57:49 STEP 1755 H= 438:45 +CPU= 24.429
  17:58:13 STEP 1756 H= 439:00 +CPU= 23.717
  17:58:30 STEP 1757 H= 439:15 +CPU= 15.997
  17:58:47 STEP 1758 H= 439:30 +CPU= 16.296
  17:59:04 STEP 1759 H= 439:45 +CPU= 16.228
  17:59:22 STEP 1760 H= 440:00 +CPU= 16.280
  17:59:39 STEP 1761 H= 440:15 +CPU= 16.351
  17:59:55 STEP 1762 H= 440:30 +CPU= 15.792
  18:00:12 STEP 1763 H= 440:45 +CPU= 16.260
  18:00:33 STEP 1764 H= 441:00 +CPU= 19.778
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001764
  18:00:50 STEP 1765 H= 441:15 +CPU= 15.991
  18:01:07 STEP 1766 H= 441:30 +CPU= 16.283
  18:01:24 STEP 1767 H= 441:45 +CPU= 15.936
  18:01:40 STEP 1768 H= 442:00 +CPU= 15.976
  18:01:57 STEP 1769 H= 442:15 +CPU= 15.896
  18:02:13 STEP 1770 H= 442:30 +CPU= 15.762
  18:02:30 STEP 1771 H= 442:45 +CPU= 16.293
  18:02:48 STEP 1772 H= 443:00 +CPU= 16.839
  18:03:06 STEP 1773 H= 443:15 +CPU= 16.529
  18:03:24 STEP 1774 H= 443:30 +CPU= 16.464
  18:03:42 STEP 1775 H= 443:45 +CPU= 16.706
  18:04:08 STEP 1776 H= 444:00 +CPU= 23.145
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001776
  18:04:25 STEP 1777 H= 444:15 +CPU= 16.115
  18:04:46 STEP 1778 H= 444:30 +CPU= 20.555
  18:05:11 STEP 1779 H= 444:45 +CPU= 24.388
  18:05:38 STEP 1780 H= 445:00 +CPU= 25.174
  18:06:03 STEP 1781 H= 445:15 +CPU= 24.703
  18:06:29 STEP 1782 H= 445:30 +CPU= 24.585
  18:06:50 STEP 1783 H= 445:45 +CPU= 20.636
  18:07:09 STEP 1784 H= 446:00 +CPU= 17.466
  18:07:26 STEP 1785 H= 446:15 +CPU= 16.271
  18:07:48 STEP 1786 H= 446:30 +CPU= 20.222
  18:08:04 STEP 1787 H= 446:45 +CPU= 16.045
  18:08:26 STEP 1788 H= 447:00 +CPU= 20.049
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001788
  18:08:44 STEP 1789 H= 447:15 +CPU= 16.866
  18:09:01 STEP 1790 H= 447:30 +CPU= 16.229
  18:09:18 STEP 1791 H= 447:45 +CPU= 16.017
  18:09:35 STEP 1792 H= 448:00 +CPU= 16.592
  18:09:52 STEP 1793 H= 448:15 +CPU= 16.023
  18:10:10 STEP 1794 H= 448:30 +CPU= 16.582
  18:10:27 STEP 1795 H= 448:45 +CPU= 16.137
  18:10:44 STEP 1796 H= 449:00 +CPU= 16.171
  18:11:01 STEP 1797 H= 449:15 +CPU= 15.968
  18:11:18 STEP 1798 H= 449:30 +CPU= 16.015
  18:11:35 STEP 1799 H= 449:45 +CPU= 16.273
  18:11:56 STEP 1800 H= 450:00 +CPU= 19.792
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001800
  18:12:12 STEP 1801 H= 450:15 +CPU= 15.905
  18:12:29 STEP 1802 H= 450:30 +CPU= 15.955
  18:12:54 STEP 1803 H= 450:45 +CPU= 24.269
  18:13:14 STEP 1804 H= 451:00 +CPU= 18.886
  18:13:31 STEP 1805 H= 451:15 +CPU= 16.062
  18:13:48 STEP 1806 H= 451:30 +CPU= 16.228
  18:14:05 STEP 1807 H= 451:45 +CPU= 16.175
  18:14:23 STEP 1808 H= 452:00 +CPU= 16.583
  18:14:41 STEP 1809 H= 452:15 +CPU= 16.640
  18:14:58 STEP 1810 H= 452:30 +CPU= 16.062
  18:15:21 STEP 1811 H= 452:45 +CPU= 22.646
  18:15:53 STEP 1812 H= 453:00 +CPU= 30.589
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001812
  18:16:18 STEP 1813 H= 453:15 +CPU= 23.881
  18:16:35 STEP 1814 H= 453:30 +CPU= 16.061
  18:16:51 STEP 1815 H= 453:45 +CPU= 16.059
  18:17:13 STEP 1816 H= 454:00 +CPU= 21.275
  18:17:39 STEP 1817 H= 454:15 +CPU= 24.711
  18:18:00 STEP 1818 H= 454:30 +CPU= 19.250
  18:18:25 STEP 1819 H= 454:45 +CPU= 24.335
  18:18:50 STEP 1820 H= 455:00 +CPU= 23.708
  18:19:12 STEP 1821 H= 455:15 +CPU= 20.485
  18:19:31 STEP 1822 H= 455:30 +CPU= 17.890
  18:19:57 STEP 1823 H= 455:45 +CPU= 24.604
  18:20:27 STEP 1824 H= 456:00 +CPU= 29.316
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_18.zip
Uploading the intermediate file: upload_file_18.zip
  18:20:52 STEP 1825 H= 456:15 +CPU= 23.033
  18:21:17 STEP 1826 H= 456:30 +CPU= 24.810
  18:21:41 STEP 1827 H= 456:45 +CPU= 22.154
  18:22:04 STEP 1828 H= 457:00 +CPU= 20.208
  18:22:27 STEP 1829 H= 457:15 +CPU= 20.920
  18:22:52 STEP 1830 H= 457:30 +CPU= 22.025
  18:23:12 STEP 1831 H= 457:45 +CPU= 17.684
  18:23:29 STEP 1832 H= 458:00 +CPU= 16.574
  18:23:47 STEP 1833 H= 458:15 +CPU= 16.737
  18:24:07 STEP 1834 H= 458:30 +CPU= 17.661
  18:24:28 STEP 1835 H= 458:45 +CPU= 18.275
  18:24:53 STEP 1836 H= 459:00 +CPU= 22.688
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001836
  18:25:19 STEP 1837 H= 459:15 +CPU= 24.655
  18:25:41 STEP 1838 H= 459:30 +CPU= 22.001
  18:26:06 STEP 1839 H= 459:45 +CPU= 23.288
  18:26:32 STEP 1840 H= 460:00 +CPU= 25.090
  18:26:57 STEP 1841 H= 460:15 +CPU= 24.624
  18:27:23 STEP 1842 H= 460:30 +CPU= 24.518
  18:27:48 STEP 1843 H= 460:45 +CPU= 24.595
  18:28:06 STEP 1844 H= 461:00 +CPU= 16.841
  18:28:23 STEP 1845 H= 461:15 +CPU= 16.073
  18:28:40 STEP 1846 H= 461:30 +CPU= 15.945
  18:28:57 STEP 1847 H= 461:45 +CPU= 16.320
  18:29:18 STEP 1848 H= 462:00 +CPU= 19.873
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001848
  18:29:35 STEP 1849 H= 462:15 +CPU= 16.550
  18:29:53 STEP 1850 H= 462:30 +CPU= 16.159
  18:30:12 STEP 1851 H= 462:45 +CPU= 17.419
  18:30:29 STEP 1852 H= 463:00 +CPU= 16.536
  18:30:46 STEP 1853 H= 463:15 +CPU= 16.143
  18:31:04 STEP 1854 H= 463:30 +CPU= 16.295
  18:31:20 STEP 1855 H= 463:45 +CPU= 15.955
  18:31:38 STEP 1856 H= 464:00 +CPU= 16.420
  18:31:55 STEP 1857 H= 464:15 +CPU= 16.067
  18:32:11 STEP 1858 H= 464:30 +CPU= 16.056
  18:32:28 STEP 1859 H= 464:45 +CPU= 16.207
  18:32:58 STEP 1860 H= 465:00 +CPU= 27.806
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001860
  18:33:23 STEP 1861 H= 465:15 +CPU= 24.530
  18:33:49 STEP 1862 H= 465:30 +CPU= 24.624
  18:34:11 STEP 1863 H= 465:45 +CPU= 20.962
  18:34:29 STEP 1864 H= 466:00 +CPU= 16.714
  18:34:47 STEP 1865 H= 466:15 +CPU= 16.478
  18:35:12 STEP 1866 H= 466:30 +CPU= 23.892
  18:35:37 STEP 1867 H= 466:45 +CPU= 23.754
  18:35:54 STEP 1868 H= 467:00 +CPU= 16.482
  18:36:11 STEP 1869 H= 467:15 +CPU= 16.078
  18:36:28 STEP 1870 H= 467:30 +CPU= 16.068
  18:36:53 STEP 1871 H= 467:45 +CPU= 24.212
  18:37:28 STEP 1872 H= 468:00 +CPU= 33.674
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001872
  18:37:52 STEP 1873 H= 468:15 +CPU= 22.352
  18:38:09 STEP 1874 H= 468:30 +CPU= 16.366
  18:38:26 STEP 1875 H= 468:45 +CPU= 16.013
  18:38:49 STEP 1876 H= 469:00 +CPU= 21.869
  18:39:16 STEP 1877 H= 469:15 +CPU= 24.863
  18:39:36 STEP 1878 H= 469:30 +CPU= 19.830
  18:39:54 STEP 1879 H= 469:45 +CPU= 16.376
  18:40:12 STEP 1880 H= 470:00 +CPU= 16.938
  18:40:29 STEP 1881 H= 470:15 +CPU= 16.371
  18:40:47 STEP 1882 H= 470:30 +CPU= 16.225
  18:41:04 STEP 1883 H= 470:45 +CPU= 16.261
  18:41:25 STEP 1884 H= 471:00 +CPU= 19.909
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001884
  18:41:42 STEP 1885 H= 471:15 +CPU= 16.641
  18:41:59 STEP 1886 H= 471:30 +CPU= 16.152
  18:42:16 STEP 1887 H= 471:45 +CPU= 16.278
  18:42:34 STEP 1888 H= 472:00 +CPU= 16.681
  18:42:57 STEP 1889 H= 472:15 +CPU= 22.224
  18:43:20 STEP 1890 H= 472:30 +CPU= 22.236
  18:43:37 STEP 1891 H= 472:45 +CPU= 15.944
  18:43:54 STEP 1892 H= 473:00 +CPU= 16.290
  18:44:11 STEP 1893 H= 473:15 +CPU= 15.959
  18:44:27 STEP 1894 H= 473:30 +CPU= 16.079
  18:44:45 STEP 1895 H= 473:45 +CPU= 16.556
  18:45:07 STEP 1896 H= 474:00 +CPU= 21.153
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001896
  18:45:26 STEP 1897 H= 474:15 +CPU= 17.964
  18:45:43 STEP 1898 H= 474:30 +CPU= 16.197
  18:46:00 STEP 1899 H= 474:45 +CPU= 15.963
  18:46:26 STEP 1900 H= 475:00 +CPU= 24.824
  18:46:42 STEP 1901 H= 475:15 +CPU= 15.886
  18:46:59 STEP 1902 H= 475:30 +CPU= 16.025
  18:47:16 STEP 1903 H= 475:45 +CPU= 15.960
  18:47:34 STEP 1904 H= 476:00 +CPU= 17.443
  18:47:56 STEP 1905 H= 476:15 +CPU= 20.233
  18:48:14 STEP 1906 H= 476:30 +CPU= 16.117
  18:48:31 STEP 1907 H= 476:45 +CPU= 16.180
  18:48:52 STEP 1908 H= 477:00 +CPU= 19.944
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001908
  18:49:10 STEP 1909 H= 477:15 +CPU= 16.628
  18:49:27 STEP 1910 H= 477:30 +CPU= 16.180
  18:49:44 STEP 1911 H= 477:45 +CPU= 16.070
  18:50:01 STEP 1912 H= 478:00 +CPU= 16.350
  18:50:18 STEP 1913 H= 478:15 +CPU= 16.087
  18:50:36 STEP 1914 H= 478:30 +CPU= 16.683
  18:50:53 STEP 1915 H= 478:45 +CPU= 16.567
  18:51:18 STEP 1916 H= 479:00 +CPU= 23.276
  18:51:43 STEP 1917 H= 479:15 +CPU= 24.681
  18:52:02 STEP 1918 H= 479:30 +CPU= 17.771
  18:52:20 STEP 1919 H= 479:45 +CPU= 16.322
  18:52:42 STEP 1920 H= 480:00 +CPU= 20.787
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7049904548E-23      I       0.4275121771E-06      I
ICloud fractionI      0.0000000000E+00      I       0.9438319235E-02      I
I  Relat. Hum. I      0.2659346504E+00      I       0.3251874609E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1794299726E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    308146516 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0073( 4.1%)
 18:52:42 STEP 1920 H= 480:00 +CPU= 20.787
 END CNT3
 NSTEP =  1920 CNT0   000000000  15.214  15.214  16.369   0.929               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        15730/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    278    0       46      1044068    15730 ************    21.0     1.6    19.4     2.6    40.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.96      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  573    3137.0    3137.0     17.37      0.00
   9 SPCM     - SPECTRAL COMP.                     528     583.9     583.9      2.98      0.00
  10 SCAN2M - PHYSICS                              529    8906.3    8906.3     45.52      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 44     619.2     619.2      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 23      38.4      38.4      0.01      0.00
  17 GRIDFPOS IN CNT4                               44      19.9      19.9      0.01      0.00
  27 RESTART FILES - WRITING                        11    2476.6    2476.6      0.26      0.00
  28 RESTART FILES - READING                         1    3689.3    3689.3      0.04      0.00
  29 SU4FPOS IN CNT4                                44       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                44    4005.0    4005.0      1.70      0.00
  31 POSDDH IN STEPO                                 3       0.6       0.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    529    4256.1    4256.1     21.75      0.00
  39 SU0YOMB                                         1     310.1     310.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    529      22.1      22.1      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              528     378.3     378.3      1.93      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              528     100.5     100.5      0.51      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 23       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1148     282.3     282.3      3.13      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1100     176.8     176.8      1.88      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1100      61.8      61.8      0.66      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1148      97.3      97.3      1.08      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      61.5      61.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1148      40.8      40.8      0.45      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1100      22.1      22.1      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1148      33.5      33.5      0.37      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1100      16.1      16.1      0.17      0.00
 400 GSTATS                                      62157       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 57779       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    10350.0 CPU TIME    9830.1 VECTOR TIME     9830.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      167.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291100/ICMGGh7zg+001884
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a251_2016092300_20_1018_12291100_1_r1781853085_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
18:56:12 (1570666): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Jun 2024 16:55:02 1537499 22450122 oifs_43r3_bl_a251_2016092300_20_1018_12291100_1 1,727,100 36,680 0.0212
20 Jun 2024 11:25:41 1537499 22450122 oifs_43r3_bl_a251_2016092300_20_1018_12291100_1 864,000 18,033 0.0209


©2024 cpdn.org