climateprediction.net home page
Task 22279400

Task 22279400

Name oifs_43r3_ps_0957_2007050100_123_976_12193601_0
Workunit 12193601
Created 23 Dec 2022, 17:09:54 UTC
Sent 3 Jan 2023, 23:39:31 UTC
Report deadline 2 Feb 2023, 23:39:31 UTC
Received 5 Jan 2023, 12:01:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1499440
Run time 1 days 9 hours 16 min 11 sec
CPU time 13 hours 29 min 11 sec
Validate state Invalid
Credit 5,080.32
Device peak FLOPS 4.53 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,366.01 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,181.64 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
irectory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000516
  04:35:40 STEP  517 H= 517:00 +CPU= 32.515
  04:36:45 STEP  518 H= 518:00 +CPU= 32.305
  04:37:35 STEP  519 H= 519:00 +CPU= 47.325
  04:38:14 STEP  520 H= 520:00 +CPU= 35.204
  04:38:52 STEP  521 H= 521:00 +CPU= 35.604
  04:39:59 STEP  522 H= 522:00 +CPU= 55.267
  04:40:41 STEP  523 H= 523:00 +CPU= 34.341
  04:41:35 STEP  524 H= 524:00 +CPU= 35.176
  04:42:30 STEP  525 H= 525:00 +CPU= 50.610
  04:43:05 STEP  526 H= 526:00 +CPU= 34.596
  04:45:46 STEP  527 H= 527:00 +CPU= 37.622
  04:48:31 STEP  528 H= 528:00 +CPU= 63.823
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_21.zip
Uploading the intermediate file: upload_file_21.zip
  04:49:16 STEP  529 H= 529:00 +CPU= 32.986
  04:49:52 STEP  530 H= 530:00 +CPU= 34.943
  04:50:56 STEP  531 H= 531:00 +CPU= 53.523
  04:54:47 STEP  532 H= 532:00 +CPU= 34.899
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2007050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0957
(argv4) batchid: 976
(argv5) wuid: 12193601
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a902c6e540cc08f486d1baf7ea5bac36 to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0957_2007050100_123_976_12193601.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0957_2007050100_123_976_12193601.zip
ic_ancil_file: ic_ancil_12193601
ifsdata_file: ifsdata_12193601
climate_data_file: clim_data_12193601
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_912b8ddd939fc1a8b9833cd486fac2c0 to: /var/lib/boinc-client/slots/3/ic_ancil_12193601.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12193601.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_638d0c8baf64ddb2dc160603f23843b1 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12193601.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12193601.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12193601.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12193601.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12193601.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12193601.xml
-- Model is restarting --
Adjusting last_iter, 533, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12193601.xml
last_cpu_time: 25462
upload_file_number: 22
last_iter: 527
last_upload: 1900800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702
The child process has been launched with process id: 23327
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:backup:1:1:23327:23327] [20230105:045742:1672891062:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  04:59:42 STEP  528 H= 528:00 +CPU= 62.947
  05:03:50 STEP  529 H= 529:00 +CPU= 36.409
  05:04:46 STEP  530 H= 530:00 +CPU= 36.329
  05:05:53 STEP  531 H= 531:00 +CPU= 53.732
  05:07:33 STEP  532 H= 532:00 +CPU= 35.476
  05:08:34 STEP  533 H= 533:00 +CPU= 33.929
  05:11:57 STEP  534 H= 534:00 +CPU= 56.591
  05:13:42 STEP  535 H= 535:00 +CPU= 37.206
  05:16:20 STEP  536 H= 536:00 +CPU= 37.898
  05:18:35 STEP  537 H= 537:00 +CPU= 52.833
  05:19:11 STEP  538 H= 538:00 +CPU= 34.579
  05:20:19 STEP  539 H= 539:00 +CPU= 32.064
  05:31:40 STEP  540 H= 540:00 +CPU= 59.744
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000540
  05:32:21 STEP  541 H= 541:00 +CPU= 32.717
  05:32:55 STEP  542 H= 542:00 +CPU= 33.484
  05:43:23 STEP  543 H= 543:00 +CPU= 55.449
  05:47:17 STEP  544 H= 544:00 +CPU= 37.017
  05:48:23 STEP  545 H= 545:00 +CPU= 32.974
  05:49:23 STEP  546 H= 546:00 +CPU= 51.458
  05:50:01 STEP  547 H= 547:00 +CPU= 32.982
  05:50:56 STEP  548 H= 548:00 +CPU= 33.941
  05:52:51 STEP  549 H= 549:00 +CPU= 52.688
  05:54:02 STEP  550 H= 550:00 +CPU= 34.466
  05:54:38 STEP  551 H= 551:00 +CPU= 34.404
  05:56:00 STEP  552 H= 552:00 +CPU= 61.519
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_22.zip
Uploading the intermediate file: upload_file_22.zip
  05:56:33 STEP  553 H= 553:00 +CPU= 32.670
  05:57:07 STEP  554 H= 554:00 +CPU= 33.506
  05:57:58 STEP  555 H= 555:00 +CPU= 50.255
  05:58:33 STEP  556 H= 556:00 +CPU= 34.204
  06:00:38 STEP  557 H= 557:00 +CPU= 36.289
  06:03:09 STEP  558 H= 558:00 +CPU= 54.683
  06:03:50 STEP  559 H= 559:00 +CPU= 34.027
  06:04:27 STEP  560 H= 560:00 +CPU= 34.316
  06:05:26 STEP  561 H= 561:00 +CPU= 52.960
  06:06:03 STEP  562 H= 562:00 +CPU= 36.896
  06:06:40 STEP  563 H= 563:00 +CPU= 36.423
  06:07:44 STEP  564 H= 564:00 +CPU= 60.838
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000564
  06:08:21 STEP  565 H= 565:00 +CPU= 36.133
  06:08:59 STEP  566 H= 566:00 +CPU= 37.067
  06:09:55 STEP  567 H= 567:00 +CPU= 54.812
  06:10:33 STEP  568 H= 568:00 +CPU= 37.368
  06:11:12 STEP  569 H= 569:00 +CPU= 38.976
  06:12:14 STEP  570 H= 570:00 +CPU= 60.262
  06:12:53 STEP  571 H= 571:00 +CPU= 38.846
  06:13:34 STEP  572 H= 572:00 +CPU= 39.766
  06:14:30 STEP  573 H= 573:00 +CPU= 55.579
  06:15:08 STEP  574 H= 574:00 +CPU= 37.140
  06:15:47 STEP  575 H= 575:00 +CPU= 37.014
  06:17:05 STEP  576 H= 576:00 +CPU= 66.740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_23.zip
Uploading the intermediate file: upload_file_23.zip
  06:17:42 STEP  577 H= 577:00 +CPU= 35.994
  06:18:20 STEP  578 H= 578:00 +CPU= 36.817
  06:19:15 STEP  579 H= 579:00 +CPU= 54.989
  06:19:53 STEP  580 H= 580:00 +CPU= 36.812
  06:20:30 STEP  581 H= 581:00 +CPU= 36.207
  06:21:26 STEP  582 H= 582:00 +CPU= 55.946
  06:22:03 STEP  583 H= 583:00 +CPU= 36.061
  06:22:41 STEP  584 H= 584:00 +CPU= 36.947
  06:23:36 STEP  585 H= 585:00 +CPU= 55.080
  06:24:14 STEP  586 H= 586:00 +CPU= 36.777
  06:24:51 STEP  587 H= 587:00 +CPU= 36.260
  06:25:52 STEP  588 H= 588:00 +CPU= 60.413
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000588
  06:26:29 STEP  589 H= 589:00 +CPU= 35.932
  06:27:06 STEP  590 H= 590:00 +CPU= 36.757
  06:28:02 STEP  591 H= 591:00 +CPU= 55.000
  06:28:39 STEP  592 H= 592:00 +CPU= 36.745
  06:29:16 STEP  593 H= 593:00 +CPU= 35.976
  06:30:13 STEP  594 H= 594:00 +CPU= 55.859
  06:30:49 STEP  595 H= 595:00 +CPU= 36.032
  06:31:27 STEP  596 H= 596:00 +CPU= 36.740
  06:32:22 STEP  597 H= 597:00 +CPU= 54.674
  06:32:59 STEP  598 H= 598:00 +CPU= 36.922
  06:33:37 STEP  599 H= 599:00 +CPU= 37.022
  06:34:45 STEP  600 H= 600:00 +CPU= 66.139
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_24.zip
Uploading the intermediate file: upload_file_24.zip
  06:35:22 STEP  601 H= 601:00 +CPU= 36.120
  06:35:59 STEP  602 H= 602:00 +CPU= 36.789
  06:36:55 STEP  603 H= 603:00 +CPU= 54.981
  06:37:33 STEP  604 H= 604:00 +CPU= 36.957
  06:38:09 STEP  605 H= 605:00 +CPU= 36.124
  06:39:06 STEP  606 H= 606:00 +CPU= 55.957
  06:39:43 STEP  607 H= 607:00 +CPU= 36.170
  06:40:21 STEP  608 H= 608:00 +CPU= 37.031
  06:41:17 STEP  609 H= 609:00 +CPU= 55.305
  06:41:54 STEP  610 H= 610:00 +CPU= 36.842
  06:42:31 STEP  611 H= 611:00 +CPU= 36.368
  06:43:33 STEP  612 H= 612:00 +CPU= 60.583
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000612
  06:44:10 STEP  613 H= 613:00 +CPU= 36.126
  06:44:47 STEP  614 H= 614:00 +CPU= 36.938
  06:45:43 STEP  615 H= 615:00 +CPU= 55.192
  06:46:20 STEP  616 H= 616:00 +CPU= 36.635
  06:46:57 STEP  617 H= 617:00 +CPU= 36.136
  06:47:54 STEP  618 H= 618:00 +CPU= 55.834
  06:48:31 STEP  619 H= 619:00 +CPU= 35.929
  06:49:08 STEP  620 H= 620:00 +CPU= 36.847
  06:50:04 STEP  621 H= 621:00 +CPU= 55.025
  06:50:41 STEP  622 H= 622:00 +CPU= 36.638
  06:51:19 STEP  623 H= 623:00 +CPU= 37.039
  06:52:26 STEP  624 H= 624:00 +CPU= 66.006
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_25.zip
Uploading the intermediate file: upload_file_25.zip
  06:53:03 STEP  625 H= 625:00 +CPU= 36.148
  06:53:41 STEP  626 H= 626:00 +CPU= 36.996
  06:54:37 STEP  627 H= 627:00 +CPU= 55.098
  06:55:15 STEP  628 H= 628:00 +CPU= 37.068
  06:55:51 STEP  629 H= 629:00 +CPU= 35.954
  06:56:48 STEP  630 H= 630:00 +CPU= 56.126
  06:57:25 STEP  631 H= 631:00 +CPU= 36.212
  06:58:02 STEP  632 H= 632:00 +CPU= 36.891
  06:58:58 STEP  633 H= 633:00 +CPU= 55.046
  06:59:36 STEP  634 H= 634:00 +CPU= 37.078
  07:00:13 STEP  635 H= 635:00 +CPU= 36.115
  07:01:14 STEP  636 H= 636:00 +CPU= 60.906
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000636
  07:01:51 STEP  637 H= 637:00 +CPU= 36.115
  07:02:29 STEP  638 H= 638:00 +CPU= 37.077
  07:03:25 STEP  639 H= 639:00 +CPU= 55.189
  07:04:02 STEP  640 H= 640:00 +CPU= 36.910
  07:04:39 STEP  641 H= 641:00 +CPU= 36.181
  07:05:36 STEP  642 H= 642:00 +CPU= 55.965
  07:06:13 STEP  643 H= 643:00 +CPU= 36.177
  07:06:50 STEP  644 H= 644:00 +CPU= 36.995
  07:07:46 STEP  645 H= 645:00 +CPU= 54.967
  07:08:23 STEP  646 H= 646:00 +CPU= 36.732
  07:09:01 STEP  647 H= 647:00 +CPU= 37.400
  07:10:08 STEP  648 H= 648:00 +CPU= 65.948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_26.zip
Uploading the intermediate file: upload_file_26.zip
  07:10:45 STEP  649 H= 649:00 +CPU= 36.284
  07:11:23 STEP  650 H= 650:00 +CPU= 36.724
  07:12:19 STEP  651 H= 651:00 +CPU= 55.218
  07:12:56 STEP  652 H= 652:00 +CPU= 36.675
  07:13:33 STEP  653 H= 653:00 +CPU= 36.131
  07:14:30 STEP  654 H= 654:00 +CPU= 55.899
  07:15:06 STEP  655 H= 655:00 +CPU= 36.230
  07:15:44 STEP  656 H= 656:00 +CPU= 36.747
  07:16:39 STEP  657 H= 657:00 +CPU= 54.994
  07:17:17 STEP  658 H= 658:00 +CPU= 36.970
  07:17:54 STEP  659 H= 659:00 +CPU= 36.109
  07:18:55 STEP  660 H= 660:00 +CPU= 60.525
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000660
  07:19:32 STEP  661 H= 661:00 +CPU= 36.205
  07:20:09 STEP  662 H= 662:00 +CPU= 36.874
  07:21:05 STEP  663 H= 663:00 +CPU= 54.992
  07:21:43 STEP  664 H= 664:00 +CPU= 37.048
  07:22:19 STEP  665 H= 665:00 +CPU= 36.076
  07:23:16 STEP  666 H= 666:00 +CPU= 55.998
  07:23:53 STEP  667 H= 667:00 +CPU= 36.185
  07:24:30 STEP  668 H= 668:00 +CPU= 36.811
  07:25:26 STEP  669 H= 669:00 +CPU= 54.826
  07:26:03 STEP  670 H= 670:00 +CPU= 37.017
  07:26:41 STEP  671 H= 671:00 +CPU= 36.927
  07:27:48 STEP  672 H= 672:00 +CPU= 66.152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_27.zip
Uploading the intermediate file: upload_file_27.zip
  07:28:26 STEP  673 H= 673:00 +CPU= 36.191
  07:29:03 STEP  674 H= 674:00 +CPU= 37.154
  07:29:59 STEP  675 H= 675:00 +CPU= 54.531
  07:30:38 STEP  676 H= 676:00 +CPU= 38.132
  07:31:15 STEP  677 H= 677:00 +CPU= 37.156
  07:32:12 STEP  678 H= 678:00 +CPU= 55.947
  07:32:49 STEP  679 H= 679:00 +CPU= 36.337
  07:33:27 STEP  680 H= 680:00 +CPU= 36.790
  07:34:23 STEP  681 H= 681:00 +CPU= 55.429
  07:35:00 STEP  682 H= 682:00 +CPU= 36.834
  07:35:37 STEP  683 H= 683:00 +CPU= 36.318
  07:36:39 STEP  684 H= 684:00 +CPU= 60.866
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000684
  07:37:16 STEP  685 H= 685:00 +CPU= 36.367
  07:37:53 STEP  686 H= 686:00 +CPU= 36.861
  07:38:49 STEP  687 H= 687:00 +CPU= 55.227
  07:39:27 STEP  688 H= 688:00 +CPU= 37.111
  07:40:04 STEP  689 H= 689:00 +CPU= 36.143
  07:41:00 STEP  690 H= 690:00 +CPU= 55.968
  07:41:37 STEP  691 H= 691:00 +CPU= 36.281
  07:42:15 STEP  692 H= 692:00 +CPU= 36.927
  07:43:10 STEP  693 H= 693:00 +CPU= 55.072
  07:43:48 STEP  694 H= 694:00 +CPU= 37.092
  07:44:35 STEP  695 H= 695:00 +CPU= 36.332
  07:46:06 STEP  696 H= 696:00 +CPU= 63.381
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_28.zip
Uploading the intermediate file: upload_file_28.zip
  07:46:45 STEP  697 H= 697:00 +CPU= 36.303
  07:47:27 STEP  698 H= 698:00 +CPU= 37.151
  07:48:25 STEP  699 H= 699:00 +CPU= 55.275
  07:49:03 STEP  700 H= 700:00 +CPU= 37.082
  07:49:40 STEP  701 H= 701:00 +CPU= 36.262
  07:50:37 STEP  702 H= 702:00 +CPU= 55.989
  07:51:14 STEP  703 H= 703:00 +CPU= 36.399
  07:51:51 STEP  704 H= 704:00 +CPU= 36.696
  07:52:48 STEP  705 H= 705:00 +CPU= 55.230
  07:53:25 STEP  706 H= 706:00 +CPU= 36.826
  07:54:02 STEP  707 H= 707:00 +CPU= 36.432
  07:55:04 STEP  708 H= 708:00 +CPU= 60.763
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000708
  07:55:41 STEP  709 H= 709:00 +CPU= 36.136
  07:56:18 STEP  710 H= 710:00 +CPU= 36.947
  07:57:14 STEP  711 H= 711:00 +CPU= 55.099
  07:57:51 STEP  712 H= 712:00 +CPU= 36.963
  07:58:28 STEP  713 H= 713:00 +CPU= 36.251
  07:59:25 STEP  714 H= 714:00 +CPU= 55.917
  08:00:02 STEP  715 H= 715:00 +CPU= 36.019
  08:00:40 STEP  716 H= 716:00 +CPU= 37.163
  08:01:35 STEP  717 H= 717:00 +CPU= 54.912
  08:02:13 STEP  718 H= 718:00 +CPU= 36.717
  08:02:50 STEP  719 H= 719:00 +CPU= 37.042
  08:04:00 STEP  720 H= 720:00 +CPU= 65.936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_29.zip
Uploading the intermediate file: upload_file_29.zip
  08:04:37 STEP  721 H= 721:00 +CPU= 36.103
  08:05:15 STEP  722 H= 722:00 +CPU= 36.990
  08:06:12 STEP  723 H= 723:00 +CPU= 55.135
  08:06:50 STEP  724 H= 724:00 +CPU= 37.139
  08:07:26 STEP  725 H= 725:00 +CPU= 36.072
  08:08:24 STEP  726 H= 726:00 +CPU= 56.061
  08:09:01 STEP  727 H= 727:00 +CPU= 36.422
  08:09:39 STEP  728 H= 728:00 +CPU= 37.096
  08:10:35 STEP  729 H= 729:00 +CPU= 54.970
  08:11:12 STEP  730 H= 730:00 +CPU= 37.060
  08:11:49 STEP  731 H= 731:00 +CPU= 36.146
  08:12:51 STEP  732 H= 732:00 +CPU= 60.599
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000732
  08:13:28 STEP  733 H= 733:00 +CPU= 36.123
  08:14:05 STEP  734 H= 734:00 +CPU= 36.991
  08:15:02 STEP  735 H= 735:00 +CPU= 55.131
  08:15:40 STEP  736 H= 736:00 +CPU= 36.746
  08:16:16 STEP  737 H= 737:00 +CPU= 36.373
  08:17:13 STEP  738 H= 738:00 +CPU= 55.944
  08:17:50 STEP  739 H= 739:00 +CPU= 36.052
  08:18:27 STEP  740 H= 740:00 +CPU= 36.780
  08:19:23 STEP  741 H= 741:00 +CPU= 55.043
  08:20:01 STEP  742 H= 742:00 +CPU= 36.602
  08:20:39 STEP  743 H= 743:00 +CPU= 37.211
  08:21:46 STEP  744 H= 744:00 +CPU= 65.823
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_30.zip
Uploading the intermediate file: upload_file_30.zip
  08:22:23 STEP  745 H= 745:00 +CPU= 36.081
  08:23:01 STEP  746 H= 746:00 +CPU= 36.964
  08:23:57 STEP  747 H= 747:00 +CPU= 54.862
  08:24:35 STEP  748 H= 748:00 +CPU= 37.020
  08:25:13 STEP  749 H= 749:00 +CPU= 37.078
  08:26:14 STEP  750 H= 750:00 +CPU= 59.928
  08:26:54 STEP  751 H= 751:00 +CPU= 39.122
  08:27:35 STEP  752 H= 752:00 +CPU= 39.832
  08:28:33 STEP  753 H= 753:00 +CPU= 57.673
  08:29:11 STEP  754 H= 754:00 +CPU= 37.083
  08:29:48 STEP  755 H= 755:00 +CPU= 36.199
  08:30:50 STEP  756 H= 756:00 +CPU= 60.434
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000756
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000756
  08:31:27 STEP  757 H= 757:00 +CPU= 35.976
  08:32:05 STEP  758 H= 758:00 +CPU= 37.001
  08:33:01 STEP  759 H= 759:00 +CPU= 54.999
  08:33:38 STEP  760 H= 760:00 +CPU= 36.716
  08:34:15 STEP  761 H= 761:00 +CPU= 36.057
  08:35:12 STEP  762 H= 762:00 +CPU= 55.838
  08:35:49 STEP  763 H= 763:00 +CPU= 36.137
  08:36:27 STEP  764 H= 764:00 +CPU= 36.893
  08:37:23 STEP  765 H= 765:00 +CPU= 54.676
  08:38:00 STEP  766 H= 766:00 +CPU= 36.745
  08:38:37 STEP  767 H= 767:00 +CPU= 36.833
  08:39:45 STEP  768 H= 768:00 +CPU= 66.018
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000768
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_31.zip
Uploading the intermediate file: upload_file_31.zip
Uploading trickle at timestep: 2764800
  08:40:23 STEP  769 H= 769:00 +CPU= 36.255
  08:41:01 STEP  770 H= 770:00 +CPU= 36.853
  08:41:57 STEP  771 H= 771:00 +CPU= 55.218
  08:42:34 STEP  772 H= 772:00 +CPU= 36.924
  08:43:11 STEP  773 H= 773:00 +CPU= 36.219
  08:44:08 STEP  774 H= 774:00 +CPU= 55.936
  08:44:46 STEP  775 H= 775:00 +CPU= 36.407
  08:45:23 STEP  776 H= 776:00 +CPU= 36.958
  08:46:20 STEP  777 H= 777:00 +CPU= 55.199
  08:46:58 STEP  778 H= 778:00 +CPU= 37.118
  08:47:35 STEP  779 H= 779:00 +CPU= 36.214
  08:48:37 STEP  780 H= 780:00 +CPU= 60.668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000780
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000780
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000780
  08:49:14 STEP  781 H= 781:00 +CPU= 36.377
  08:49:52 STEP  782 H= 782:00 +CPU= 37.078
  08:50:48 STEP  783 H= 783:00 +CPU= 55.218
  08:51:26 STEP  784 H= 784:00 +CPU= 37.023
  08:52:03 STEP  785 H= 785:00 +CPU= 36.460
  08:53:00 STEP  786 H= 786:00 +CPU= 55.882
  08:53:36 STEP  787 H= 787:00 +CPU= 35.971
  08:54:15 STEP  788 H= 788:00 +CPU= 37.238
  08:55:11 STEP  789 H= 789:00 +CPU= 54.959
  08:55:48 STEP  790 H= 790:00 +CPU= 36.976
  08:56:26 STEP  791 H= 791:00 +CPU= 37.289
  08:57:33 STEP  792 H= 792:00 +CPU= 65.810
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000792
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000792
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000780
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_32.zip
Uploading the intermediate file: upload_file_32.zip
  08:58:11 STEP  793 H= 793:00 +CPU= 36.330
  08:58:49 STEP  794 H= 794:00 +CPU= 36.873
  08:59:44 STEP  795 H= 795:00 +CPU= 54.990
  09:00:22 STEP  796 H= 796:00 +CPU= 37.045
  09:00:59 STEP  797 H= 797:00 +CPU= 36.125
  09:01:56 STEP  798 H= 798:00 +CPU= 55.809
  09:02:33 STEP  799 H= 799:00 +CPU= 36.310
  09:03:11 STEP  800 H= 800:00 +CPU= 36.775
  09:04:07 STEP  801 H= 801:00 +CPU= 54.902
  09:04:44 STEP  802 H= 802:00 +CPU= 36.856
  09:05:21 STEP  803 H= 803:00 +CPU= 36.166
  09:06:22 STEP  804 H= 804:00 +CPU= 60.151
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000804
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000804
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000804
  09:06:59 STEP  805 H= 805:00 +CPU= 36.211
  09:07:37 STEP  806 H= 806:00 +CPU= 36.824
  09:08:33 STEP  807 H= 807:00 +CPU= 55.054
  09:09:11 STEP  808 H= 808:00 +CPU= 36.424
  09:09:47 STEP  809 H= 809:00 +CPU= 36.164
  09:10:44 STEP  810 H= 810:00 +CPU= 55.636
  09:11:21 STEP  811 H= 811:00 +CPU= 36.034
  09:11:59 STEP  812 H= 812:00 +CPU= 36.712
  09:12:55 STEP  813 H= 813:00 +CPU= 54.835
  09:13:32 STEP  814 H= 814:00 +CPU= 36.667
  09:14:10 STEP  815 H= 815:00 +CPU= 37.190
  09:15:18 STEP  816 H= 816:00 +CPU= 65.898
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000816
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000816
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000804
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_33.zip
Uploading the intermediate file: upload_file_33.zip
  09:15:55 STEP  817 H= 817:00 +CPU= 36.088
  09:16:33 STEP  818 H= 818:00 +CPU= 36.748
  09:17:29 STEP  819 H= 819:00 +CPU= 55.114
  09:18:06 STEP  820 H= 820:00 +CPU= 36.945
  09:18:43 STEP  821 H= 821:00 +CPU= 35.986
  09:19:41 STEP  822 H= 822:00 +CPU= 56.071
  09:20:18 STEP  823 H= 823:00 +CPU= 36.219
  09:20:56 STEP  824 H= 824:00 +CPU= 36.897
  09:21:52 STEP  825 H= 825:00 +CPU= 54.857
  09:22:29 STEP  826 H= 826:00 +CPU= 37.137
  09:23:06 STEP  827 H= 827:00 +CPU= 35.997
  09:24:08 STEP  828 H= 828:00 +CPU= 60.624
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000828
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000828
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000828
  09:24:45 STEP  829 H= 829:00 +CPU= 36.316
  09:25:23 STEP  830 H= 830:00 +CPU= 37.049
  09:26:19 STEP  831 H= 831:00 +CPU= 55.033
  09:26:57 STEP  832 H= 832:00 +CPU= 37.101
  09:27:33 STEP  833 H= 833:00 +CPU= 35.899
  09:28:30 STEP  834 H= 834:00 +CPU= 55.866
  09:29:07 STEP  835 H= 835:00 +CPU= 36.160
  09:29:45 STEP  836 H= 836:00 +CPU= 37.106
  09:30:41 STEP  837 H= 837:00 +CPU= 55.013
  09:31:19 STEP  838 H= 838:00 +CPU= 36.733
  09:31:57 STEP  839 H= 839:00 +CPU= 37.448
  09:33:04 STEP  840 H= 840:00 +CPU= 65.833
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000828
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_34.zip
Uploading the intermediate file: upload_file_34.zip
  09:33:42 STEP  841 H= 841:00 +CPU= 36.065
  09:34:19 STEP  842 H= 842:00 +CPU= 36.955
  09:35:15 STEP  843 H= 843:00 +CPU= 55.153
  09:35:53 STEP  844 H= 844:00 +CPU= 37.078
  09:36:31 STEP  845 H= 845:00 +CPU= 36.534
  09:37:29 STEP  846 H= 846:00 +CPU= 56.454
  09:38:06 STEP  847 H= 847:00 +CPU= 36.211
  09:38:44 STEP  848 H= 848:00 +CPU= 36.887
  09:39:40 STEP  849 H= 849:00 +CPU= 54.937
  09:40:18 STEP  850 H= 850:00 +CPU= 37.064
  09:40:55 STEP  851 H= 851:00 +CPU= 36.191
  09:41:57 STEP  852 H= 852:00 +CPU= 60.335
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000852
  09:42:34 STEP  853 H= 853:00 +CPU= 36.057
  09:43:12 STEP  854 H= 854:00 +CPU= 36.849
  09:44:08 STEP  855 H= 855:00 +CPU= 54.910
  09:44:45 STEP  856 H= 856:00 +CPU= 36.939
  09:45:22 STEP  857 H= 857:00 +CPU= 35.930
  09:46:20 STEP  858 H= 858:00 +CPU= 55.902
  09:46:57 STEP  859 H= 859:00 +CPU= 36.115
  09:47:34 STEP  860 H= 860:00 +CPU= 36.864
  09:48:31 STEP  861 H= 861:00 +CPU= 54.963
  09:49:08 STEP  862 H= 862:00 +CPU= 36.785
  09:49:46 STEP  863 H= 863:00 +CPU= 37.052
  09:50:54 STEP  864 H= 864:00 +CPU= 66.115
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_35.zip
Uploading the intermediate file: upload_file_35.zip
  09:51:32 STEP  865 H= 865:00 +CPU= 36.065
  09:52:09 STEP  866 H= 866:00 +CPU= 36.912
  09:53:05 STEP  867 H= 867:00 +CPU= 54.731
  09:53:43 STEP  868 H= 868:00 +CPU= 36.694
  09:54:20 STEP  869 H= 869:00 +CPU= 36.231
  09:55:18 STEP  870 H= 870:00 +CPU= 56.090
  09:55:55 STEP  871 H= 871:00 +CPU= 36.041
  09:56:32 STEP  872 H= 872:00 +CPU= 36.740
  09:57:28 STEP  873 H= 873:00 +CPU= 55.206
  09:58:06 STEP  874 H= 874:00 +CPU= 36.774
  09:58:43 STEP  875 H= 875:00 +CPU= 36.193
  09:59:45 STEP  876 H= 876:00 +CPU= 60.533
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000876
  10:00:22 STEP  877 H= 877:00 +CPU= 36.312
  10:01:00 STEP  878 H= 878:00 +CPU= 36.607
  10:01:56 STEP  879 H= 879:00 +CPU= 55.077
  10:02:34 STEP  880 H= 880:00 +CPU= 36.878
  10:03:11 STEP  881 H= 881:00 +CPU= 36.052
  10:04:08 STEP  882 H= 882:00 +CPU= 55.933
  10:04:45 STEP  883 H= 883:00 +CPU= 36.154
  10:05:23 STEP  884 H= 884:00 +CPU= 36.712
  10:06:20 STEP  885 H= 885:00 +CPU= 55.469
  10:07:00 STEP  886 H= 886:00 +CPU= 39.302
  10:07:38 STEP  887 H= 887:00 +CPU= 37.603
  10:08:46 STEP  888 H= 888:00 +CPU= 66.141
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000876
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_36.zip
Uploading the intermediate file: upload_file_36.zip
  10:09:24 STEP  889 H= 889:00 +CPU= 36.142
  10:10:02 STEP  890 H= 890:00 +CPU= 36.885
  10:10:58 STEP  891 H= 891:00 +CPU= 54.957
  10:11:36 STEP  892 H= 892:00 +CPU= 36.749
  10:12:13 STEP  893 H= 893:00 +CPU= 36.027
  10:13:10 STEP  894 H= 894:00 +CPU= 55.843
  10:13:47 STEP  895 H= 895:00 +CPU= 35.837
  10:14:25 STEP  896 H= 896:00 +CPU= 36.910
  10:15:21 STEP  897 H= 897:00 +CPU= 54.944
  10:15:58 STEP  898 H= 898:00 +CPU= 36.721
  10:16:35 STEP  899 H= 899:00 +CPU= 35.992
  10:17:37 STEP  900 H= 900:00 +CPU= 60.456
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000900
  10:18:14 STEP  901 H= 901:00 +CPU= 36.061
  10:18:52 STEP  902 H= 902:00 +CPU= 36.876
  10:19:48 STEP  903 H= 903:00 +CPU= 54.724
  10:20:25 STEP  904 H= 904:00 +CPU= 36.686
  10:21:02 STEP  905 H= 905:00 +CPU= 35.926
  10:21:59 STEP  906 H= 906:00 +CPU= 55.621
  10:22:36 STEP  907 H= 907:00 +CPU= 35.868
  10:23:13 STEP  908 H= 908:00 +CPU= 36.637
  10:24:09 STEP  909 H= 909:00 +CPU= 54.934
  10:24:47 STEP  910 H= 910:00 +CPU= 36.674
  10:25:25 STEP  911 H= 911:00 +CPU= 37.098
  10:26:32 STEP  912 H= 912:00 +CPU= 66.026
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000900
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_37.zip
Uploading the intermediate file: upload_file_37.zip
  10:27:10 STEP  913 H= 913:00 +CPU= 36.276
  10:27:48 STEP  914 H= 914:00 +CPU= 36.883
  10:28:44 STEP  915 H= 915:00 +CPU= 54.857
  10:29:22 STEP  916 H= 916:00 +CPU= 36.952
  10:29:59 STEP  917 H= 917:00 +CPU= 35.923
  10:30:56 STEP  918 H= 918:00 +CPU= 55.821
  10:31:32 STEP  919 H= 919:00 +CPU= 35.986
  10:32:10 STEP  920 H= 920:00 +CPU= 36.928
  10:33:06 STEP  921 H= 921:00 +CPU= 54.965
  10:33:44 STEP  922 H= 922:00 +CPU= 36.695
  10:34:20 STEP  923 H= 923:00 +CPU= 35.964
  10:35:22 STEP  924 H= 924:00 +CPU= 60.638
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000924
  10:35:59 STEP  925 H= 925:00 +CPU= 35.900
  10:36:37 STEP  926 H= 926:00 +CPU= 37.120
  10:37:33 STEP  927 H= 927:00 +CPU= 54.969
  10:38:11 STEP  928 H= 928:00 +CPU= 36.872
  10:38:48 STEP  929 H= 929:00 +CPU= 36.141
  10:39:45 STEP  930 H= 930:00 +CPU= 55.946
  10:40:25 STEP  931 H= 931:00 +CPU= 38.664
  10:41:06 STEP  932 H= 932:00 +CPU= 39.329
  10:42:06 STEP  933 H= 933:00 +CPU= 58.993
  10:42:47 STEP  934 H= 934:00 +CPU= 39.571
  10:43:26 STEP  935 H= 935:00 +CPU= 37.904
  10:44:33 STEP  936 H= 936:00 +CPU= 65.709
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000924
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_38.zip
Uploading the intermediate file: upload_file_38.zip
  10:45:11 STEP  937 H= 937:00 +CPU= 36.182
  10:45:49 STEP  938 H= 938:00 +CPU= 36.904
  10:46:45 STEP  939 H= 939:00 +CPU= 54.678
  10:47:23 STEP  940 H= 940:00 +CPU= 36.854
  10:47:59 STEP  941 H= 941:00 +CPU= 35.992
  10:48:56 STEP  942 H= 942:00 +CPU= 55.634
  10:49:33 STEP  943 H= 943:00 +CPU= 36.177
  10:50:11 STEP  944 H= 944:00 +CPU= 36.801
  10:51:07 STEP  945 H= 945:00 +CPU= 54.934
  10:51:45 STEP  946 H= 946:00 +CPU= 36.806
  10:52:22 STEP  947 H= 947:00 +CPU= 36.290
  10:53:24 STEP  948 H= 948:00 +CPU= 60.392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000948
  10:54:01 STEP  949 H= 949:00 +CPU= 36.105
  10:54:38 STEP  950 H= 950:00 +CPU= 36.784
  10:55:35 STEP  951 H= 951:00 +CPU= 55.040
  10:56:13 STEP  952 H= 952:00 +CPU= 36.593
  10:56:50 STEP  953 H= 953:00 +CPU= 36.212
  10:57:46 STEP  954 H= 954:00 +CPU= 55.486
  10:58:23 STEP  955 H= 955:00 +CPU= 35.773
  10:59:01 STEP  956 H= 956:00 +CPU= 36.694
  10:59:56 STEP  957 H= 957:00 +CPU= 54.681
  11:00:34 STEP  958 H= 958:00 +CPU= 36.929
  11:01:12 STEP  959 H= 959:00 +CPU= 37.059
  11:02:20 STEP  960 H= 960:00 +CPU= 65.998
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_39.zip
Uploading the intermediate file: upload_file_39.zip
  11:02:57 STEP  961 H= 961:00 +CPU= 36.218
  11:03:35 STEP  962 H= 962:00 +CPU= 36.863
  11:04:32 STEP  963 H= 963:00 +CPU= 55.165
  11:05:10 STEP  964 H= 964:00 +CPU= 37.136
  11:05:47 STEP  965 H= 965:00 +CPU= 36.010
  11:06:44 STEP  966 H= 966:00 +CPU= 55.909
  11:07:21 STEP  967 H= 967:00 +CPU= 36.343
  11:07:59 STEP  968 H= 968:00 +CPU= 36.986
  11:08:55 STEP  969 H= 969:00 +CPU= 54.843
  11:09:33 STEP  970 H= 970:00 +CPU= 37.033
  11:10:10 STEP  971 H= 971:00 +CPU= 35.997
  11:11:12 STEP  972 H= 972:00 +CPU= 60.477
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000972
  11:11:49 STEP  973 H= 973:00 +CPU= 36.159
  11:12:27 STEP  974 H= 974:00 +CPU= 36.978
  11:13:23 STEP  975 H= 975:00 +CPU= 55.159
  11:14:01 STEP  976 H= 976:00 +CPU= 36.705
  11:14:38 STEP  977 H= 977:00 +CPU= 36.395
  11:15:35 STEP  978 H= 978:00 +CPU= 55.847
  11:16:12 STEP  979 H= 979:00 +CPU= 36.083
  11:16:50 STEP  980 H= 980:00 +CPU= 36.863
  11:17:46 STEP  981 H= 981:00 +CPU= 54.941
  11:18:24 STEP  982 H= 982:00 +CPU= 36.874
  11:19:02 STEP  983 H= 983:00 +CPU= 37.368
  11:20:10 STEP  984 H= 984:00 +CPU= 65.952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000972
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_40.zip
Uploading the intermediate file: upload_file_40.zip
  11:20:48 STEP  985 H= 985:00 +CPU= 36.220
  11:21:25 STEP  986 H= 986:00 +CPU= 36.702
  11:22:21 STEP  987 H= 987:00 +CPU= 55.014
  11:23:00 STEP  988 H= 988:00 +CPU= 37.175
  11:23:37 STEP  989 H= 989:00 +CPU= 36.075
  11:24:34 STEP  990 H= 990:00 +CPU= 55.793
  11:25:11 STEP  991 H= 991:00 +CPU= 36.166
  11:25:49 STEP  992 H= 992:00 +CPU= 36.972
  11:26:45 STEP  993 H= 993:00 +CPU= 54.754
  11:27:23 STEP  994 H= 994:00 +CPU= 37.145
  11:28:00 STEP  995 H= 995:00 +CPU= 35.876
  11:29:02 STEP  996 H= 996:00 +CPU= 60.504
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+000996
  11:29:38 STEP  997 H= 997:00 +CPU= 35.893
  11:30:17 STEP  998 H= 998:00 +CPU= 37.062
  11:31:13 STEP  999 H= 999:00 +CPU= 54.906
  11:31:50 STEP 1000 H=1000:00 +CPU= 36.848
  11:32:27 STEP 1001 H=1001:00 +CPU= 35.970
  11:33:24 STEP 1002 H=1002:00 +CPU= 55.664
  11:34:01 STEP 1003 H=1003:00 +CPU= 35.878
  11:34:39 STEP 1004 H=1004:00 +CPU= 36.978
  11:35:35 STEP 1005 H=1005:00 +CPU= 54.834
  11:36:13 STEP 1006 H=1006:00 +CPU= 36.743
  11:36:51 STEP 1007 H=1007:00 +CPU= 37.135
  11:37:58 STEP 1008 H=1008:00 +CPU= 65.816
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+000996
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_41.zip
Uploading the intermediate file: upload_file_41.zip
Uploading trickle at timestep: 3628800
  11:38:35 STEP 1009 H=1009:00 +CPU= 35.857
  11:39:13 STEP 1010 H=1010:00 +CPU= 36.620
  11:40:09 STEP 1011 H=1011:00 +CPU= 55.008
  11:40:47 STEP 1012 H=1012:00 +CPU= 36.949
  11:41:24 STEP 1013 H=1013:00 +CPU= 36.126
  11:42:21 STEP 1014 H=1014:00 +CPU= 55.967
  11:42:58 STEP 1015 H=1015:00 +CPU= 36.191
  11:43:36 STEP 1016 H=1016:00 +CPU= 36.715
  11:44:32 STEP 1017 H=1017:00 +CPU= 55.004
  11:45:10 STEP 1018 H=1018:00 +CPU= 36.868
  11:45:47 STEP 1019 H=1019:00 +CPU= 36.034
  11:46:49 STEP 1020 H=1020:00 +CPU= 60.464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001020
  11:47:26 STEP 1021 H=1021:00 +CPU= 36.193
  11:48:04 STEP 1022 H=1022:00 +CPU= 36.741
  11:49:00 STEP 1023 H=1023:00 +CPU= 54.774
  11:49:37 STEP 1024 H=1024:00 +CPU= 36.882
  11:50:14 STEP 1025 H=1025:00 +CPU= 35.946
  11:51:11 STEP 1026 H=1026:00 +CPU= 55.867
  11:51:48 STEP 1027 H=1027:00 +CPU= 35.858
  11:52:26 STEP 1028 H=1028:00 +CPU= 37.028
  11:53:22 STEP 1029 H=1029:00 +CPU= 54.835
  11:54:00 STEP 1030 H=1030:00 +CPU= 36.878
  11:54:38 STEP 1031 H=1031:00 +CPU= 37.130
  11:55:45 STEP 1032 H=1032:00 +CPU= 65.788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+001020
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_42.zip
Uploading the intermediate file: upload_file_42.zip
  11:56:22 STEP 1033 H=1033:00 +CPU= 35.628
  11:57:00 STEP 1034 H=1034:00 +CPU= 36.876
  11:57:56 STEP 1035 H=1035:00 +CPU= 54.956
  11:58:34 STEP 1036 H=1036:00 +CPU= 36.849
  11:59:11 STEP 1037 H=1037:00 +CPU= 35.850
  12:00:15 STEP 1038 H=1038:00 +CPU= 55.413
  12:00:53 STEP 1039 H=1039:00 +CPU= 36.192
  12:01:30 STEP 1040 H=1040:00 +CPU= 36.742
  12:02:26 STEP 1041 H=1041:00 +CPU= 54.938
  12:03:04 STEP 1042 H=1042:00 +CPU= 36.830
  12:03:41 STEP 1043 H=1043:00 +CPU= 36.159
  12:04:43 STEP 1044 H=1044:00 +CPU= 60.484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001044
  12:05:21 STEP 1045 H=1045:00 +CPU= 36.362
  12:05:58 STEP 1046 H=1046:00 +CPU= 36.822
  12:06:54 STEP 1047 H=1047:00 +CPU= 55.057
  12:07:32 STEP 1048 H=1048:00 +CPU= 36.923
  12:08:09 STEP 1049 H=1049:00 +CPU= 36.005
  12:09:06 STEP 1050 H=1050:00 +CPU= 55.754
  12:09:43 STEP 1051 H=1051:00 +CPU= 36.080
  12:10:21 STEP 1052 H=1052:00 +CPU= 36.803
  12:11:17 STEP 1053 H=1053:00 +CPU= 54.995
  12:11:55 STEP 1054 H=1054:00 +CPU= 36.771
  12:12:33 STEP 1055 H=1055:00 +CPU= 37.262
  12:13:40 STEP 1056 H=1056:00 +CPU= 66.068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMGGhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMSHhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193601/ICMUAhq0f+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0957_2007050100_123_976_12193601_0_r482319702_43.zip
Uploading the intermediate file: upload_file_43.zip
  12:14:17 STEP 1057 H=1057:00 +CPU= 35.767
  12:14:55 STEP 1058 H=1058:00 +CPU= 36.963
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:08:50 1499440 22279400 oifs_43r3_ps_0957_2007050100_123_976_12193601_0 3,628,800 46,384 0.0128
09 May 2023 16:08:40 1499440 22279400 oifs_43r3_ps_0957_2007050100_123_976_12193601_0 2,764,800 35,934 0.0130


©2024 cpdn.org