climateprediction.net home page

Upload process locked


Advanced search

Message boards : Number crunching : Upload process locked

AuthorMessage
Bill H
Send message
Joined: May 11 07
Posts: 36
Credit: 1,341,559
RAC: 464
Message 38941 - Posted 21 Feb 2010 10:09:01 UTC

    I have been trying to upload a couple of completed work units for some days. Is there a server issue?

    Bill H

    -----------------------------------------
    21/02/2010 09:36:13|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
    21/02/2010 09:36:13|QMC@HOME|Sending scheduler request: To report completed tasks. Requesting 0 seconds of work, reporting 1 completed tasks
    21/02/2010 09:36:18|climateprediction.net|[error] Error reported by file upload server: [hadam3p_npdg_2000_2_006583538_1_1.zip] locked by file_upload_handler PID=23989
    21/02/2010 09:36:18|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: transient upload error
    21/02/2010 09:36:18|climateprediction.net|Backing off 13 min 40 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
    21/02/2010 09:36:18|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
    21/02/2010 09:36:24|QMC@HOME|Scheduler request completed: got 0 new tasks
    21/02/2010 09:37:50||Project communication failed: attempting access to reference site
    21/02/2010 09:37:50|climateprediction.net|Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
    21/02/2010 09:37:50|climateprediction.net|Backing off 2 hr 11 min 32 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
    21/02/2010 09:37:53|climateprediction.net|Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
    21/02/2010 09:38:03||General prefs: from rosetta@home (last modified 12-May-2007 22:12:12)
    21/02/2010 09:38:03||Host location: none
    21/02/2010 09:38:03||General prefs: using your defaults
    21/02/2010 09:38:03||Reading preferences override file
    21/02/2010 09:38:03||Preferences limit memory usage when active to 4095.13MB
    21/02/2010 09:38:03||Preferences limit memory usage when idle to 7780.74MB
    21/02/2010 09:38:03||Preferences limit disk usage to 100.00GB
    21/02/2010 09:38:05||Internet access OK - project servers may be temporarily down.
    21/02/2010 09:41:34||Project communication failed: attempting access to reference site
    21/02/2010 09:41:34|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
    21/02/2010 09:41:34|climateprediction.net|Backing off 3 hr 0 min 57 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
    21/02/2010 09:41:39||Internet access OK - project servers may be temporarily down.
    21/02/2010 09:43:09||Project communication failed: attempting access to reference site
    21/02/2010 09:43:09|climateprediction.net|Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
    21/02/2010 09:43:09|climateprediction.net|Backing off 2 hr 29 min 14 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
    21/02/2010 09:43:15||Internet access OK - project servers may be temporarily down.
    21/02/2010 09:43:18||Suspending network activity - user request
    21/02/2010 09:44:02||Resuming network activity
    21/02/2010 09:44:02|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
    21/02/2010 09:44:02|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
    21/02/2010 09:49:19||Project communication failed: attempting access to reference site
    21/02/2010 09:49:19|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
    21/02/2010 09:49:19|climateprediction.net|Backing off 6 min 41 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
    21/02/2010 09:49:19|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
    21/02/2010 09:49:19|climateprediction.net|Backing off 1 hr 43 min 47 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
    21/02/2010 09:49:19|climateprediction.net|Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
    21/02/2010 09:49:19|climateprediction.net|Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
    21/02/2010 09:49:33||Internet access OK - project servers may be temporarily down.
    21/02/2010 09:54:37||Project communication failed: attempting access to reference site
    21/02/2010 09:54:37|climateprediction.net|Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
    21/02/2010 09:54:37|climateprediction.net|Backing off 2 hr 26 min 4 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
    21/02/2010 09:54:40|climateprediction.net|Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
    21/02/2010 09:54:40|climateprediction.net|Backing off 3 hr 22 min 1 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
    21/02/2010 09:54:55||Internet access OK - project servers may be temporarily down.
    21/02/2010 09:56:01|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
    21/02/2010 09:56:09|climateprediction.net|[error] Error reported by file upload server: [hadam3p_npdg_2000_2_006583538_1_1.zip] locked by file_upload_handler PID=24352
    21/02/2010 09:56:09|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: transient upload error
    21/02/2010 09:56:09|climateprediction.net|Backing off 1 hr 21 min 35 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip

    Bill H
    Send message
    Joined: May 11 07
    Posts: 36
    Credit: 1,341,559
    RAC: 464
    Message 38947 - Posted 21 Feb 2010 18:35:16 UTC - in response to Message 38941.

      Update

      Has anyone any ideas?

      I now have 4 zip files waiting for upload and I\'m not sure just what its doing. The router lights flash continuously and my (useful) bandwidth has dropped off dramically.

      hadam3p_npdg_2000_2_006583538_1_2.zip
      hadam3p_npdg_2000_2_006583538_1_1.zip
      hadam3p_npdg_2000_2_006583539_0_2.zip
      hadam3p_npdg_2000_2_006583539_0_1.zip

      All about 20Mb - I\'d hate to waste the work but perhaps I just need to dump the lot!

      Bill H

      Les Bayliss
      Forum moderator
      Send message
      Joined: Sep 5 04
      Posts: 5409
      Credit: 8,958,344
      RAC: 1,679
      Message 38948 - Posted 21 Feb 2010 19:15:52 UTC

        It might be the server, but it\'s still \"the weekend\", so you\'ll have to wait until the project people are back.
        I send them a message for when they get in.

        Profile geophi
        Forum moderator
        Send message
        Joined: Aug 7 04
        Posts: 1477
        Credit: 22,724,605
        RAC: 5,327
        Message 38949 - Posted 21 Feb 2010 19:35:20 UTC

          The boinc wiki states something about the problem, but no firm solution.

          link

          Profile Milo Thurston
          Forum moderator
          Volunteer developer
          Send message
          Joined: Mar 2 06
          Posts: 253
          Credit: 363,646
          RAC: 0
          Message 38958 - Posted 22 Feb 2010 17:44:50 UTC - in response to Message 38949.

            Would someone let me know to which server these files are being uploaded, please?

            Profile [FVG] bax
            Send message
            Joined: Aug 10 08
            Posts: 2
            Credit: 596,270
            RAC: 0
            Message 38960 - Posted 22 Feb 2010 18:36:08 UTC - in response to Message 38947.

              Update

              Has anyone any ideas?

              I now have 4 zip files waiting for upload and I\'m not sure just what its doing. The router lights flash continuously and my (useful) bandwidth has dropped off dramically.


              same problem here :-(

              ____________

              Profile geophi
              Forum moderator
              Send message
              Joined: Aug 7 04
              Posts: 1477
              Credit: 22,724,605
              RAC: 5,327
              Message 38961 - Posted 22 Feb 2010 18:49:52 UTC - in response to Message 38958.

                Last modified: 22 Feb 2010 18:51:13 UTC

                Would someone let me know to which server these files are being uploaded, please?

                Milo,

                Mo posted in the News thread awhile back about which files for hadam3p go to which server. Looks like two servers might be affected if two files are having trouble being uploaded, if Mo is right.

                http://climateapps2.oucs.ox.ac.uk/cpdnboinc/forum_thread.php?id=5447&nowrap=true#38669

                Profile Thyme Lawn
                Forum moderator
                Send message
                Joined: Aug 5 04
                Posts: 1232
                Credit: 10,395,396
                RAC: 1,139
                Message 38963 - Posted 22 Feb 2010 19:06:10 UTC

                  The problem files go to different servers.

                  hadam3p_*_1.zip goes to uploader.oerc.ox.ac.uk (as does hadam3p_*_3.zip)

                  hadam3p_*_2.zip goes to cpdn-upload1.comlab.ox.ac.uk

                  Some users have had problems uploading those 2 files because they are larger than the limit set on their network.
                  ____________
                  "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                  Profile mo.v
                  Forum moderator
                  Avatar
                  Send message
                  Joined: Sep 29 04
                  Posts: 2359
                  Credit: 7,107,484
                  RAC: 3,869
                  Message 38964 - Posted 22 Feb 2010 19:07:56 UTC

                    Last modified: 22 Feb 2010 19:08:56 UTC

                    I have on my (paper) list of which model files go to which server that HadAM3P #1 zip file goes to uploader.oerc.ox.ac.uk and #2 goes to cpdn-upload1.comlab. Both are showing green at the moment on the server status page, though that isn\'t a guarantee.

                    In the past when servers have refused to accept zip file uploads because the disk was nearly full I don\'t remember having seen the Boinc message reported above:

                    [hadam3p_npdg_2000_2_006583538_1_1.zip] locked by file_upload_handler PID=24352
                    ____________
                    Cpdn news

                    Profile mo.v
                    Forum moderator
                    Avatar
                    Send message
                    Joined: Sep 29 04
                    Posts: 2359
                    Credit: 7,107,484
                    RAC: 3,869
                    Message 38965 - Posted 22 Feb 2010 19:11:55 UTC

                      Nobody should do anything to try to force these files to upload. It\'s a nuisance but Milo will sort things out, though not necessarily immediately.
                      ____________
                      Cpdn news

                      Bill H
                      Send message
                      Joined: May 11 07
                      Posts: 36
                      Credit: 1,341,559
                      RAC: 464
                      Message 38966 - Posted 22 Feb 2010 19:24:30 UTC - in response to Message 38961.

                        How do I determine what server?

                        Looked at Netstat -b and could it be cpdn-Upload1 ?

                        Bill H

                        Bill H
                        Send message
                        Joined: May 11 07
                        Posts: 36
                        Credit: 1,341,559
                        RAC: 464
                        Message 38967 - Posted 22 Feb 2010 19:29:07 UTC - in response to Message 38965.

                          OK - Although in the short term the PC becomes almost unusable on-line while its trying to upload. It appears to be uploading the whole 25Mb and then failing, then trying again. Including the latest message log entries in case it helps!

                          Bill H

                          22/02/2010 18:58:38|climateprediction.net|Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
                          22/02/2010 18:58:38|climateprediction.net|Backing off 3 hr 26 min 50 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                          22/02/2010 18:58:42||Internet access OK - project servers may be temporarily down.
                          22/02/2010 19:19:35|climateprediction.net|Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                          22/02/2010 19:22:18|climateprediction.net|Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                          22/02/2010 19:24:44||Project communication failed: attempting access to reference site
                          22/02/2010 19:24:44|climateprediction.net|Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
                          22/02/2010 19:24:44|climateprediction.net|Backing off 2 hr 10 min 3 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                          22/02/2010 19:24:57||Internet access OK - project servers may be temporarily down.

                          Les Bayliss
                          Forum moderator
                          Send message
                          Joined: Sep 5 04
                          Posts: 5409
                          Credit: 8,958,344
                          RAC: 1,679
                          Message 38968 - Posted 22 Feb 2010 19:49:36 UTC

                            When the server sends the files to a computer, included in this is the location of the server for returning the results. This information is stored in BOINC\'s To Do list, aka the client_state.xml file.

                            Open this file with notepad, click on Find in menu, type in the name of the model (the second group of 4 characters should be sufficient), and then keep clicking on Find next until you\'re just past a line which says uploader. This line has the needed server name.

                            Exit from Notepad by clicking on the red X at the top right, so as not to change anything.


                            ____________
                            Backups: Here

                            Bill H
                            Send message
                            Joined: May 11 07
                            Posts: 36
                            Credit: 1,341,559
                            RAC: 464
                            Message 38969 - Posted 22 Feb 2010 20:55:56 UTC - in response to Message 38968.

                              Here is the file section for one of the four zip files for upload:-
                              _____________________________________________________________________
                              <file_info>
                              <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                              <nbytes>26429666.000000</nbytes>
                              <max_nbytes>80000000.000000</max_nbytes>
                              <md5_cksum>84ef44a0a7849a06c98874b21dd3c96b</md5_cksum>
                              <generated_locally/>
                              <status>1</status>
                              <upload_when_present/>
                              <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                              <persistent_file_xfer>
                              <num_retries>33</num_retries>
                              <first_request_time>1266690720.627699</first_request_time>
                              <next_request_time>1266872589.005557</next_request_time>
                              <time_so_far>7611.756095</time_so_far>
                              <last_bytes_xferred>26429666.000000</last_bytes_xferred>
                              </persistent_file_xfer>
                              <signed_xml>
                              <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                              <generated_locally/>
                              <upload_when_present/>
                              <max_nbytes>80000000</max_nbytes>
                              <url> http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler </url>
                              </signed_xml>
                              <xml_signature>
                              498ba8db9391b1d6b0798689ee82ecced61e04f43c0e36cfa1db3e4d5566265c
                              45c007b739023f6279d8dcfef7cbfb5bb00da7c8fcf81f75cd8df8bda6cda2b7
                              3e1c9eefdf2fb1a549405b79db22ddcade68a1e78a43f797897249f7f7ee8252
                              3fb5d0db59795bd4ce7d5903380d90b96345661a3ea802c55a25438a057a82cb
                              .
                              </xml_signature>
                              </file_info>
                              _____________________________________________________________________
                              And Another:-

                              <file_info>
                              <name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
                              <nbytes>26419294.000000</nbytes>
                              <max_nbytes>80000000.000000</max_nbytes>
                              <md5_cksum>185c7982ff7f2e20809c4f677135d7c5</md5_cksum>
                              <generated_locally/>
                              <status>1</status>
                              <upload_when_present/>
                              <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                              <persistent_file_xfer>
                              <num_retries>30</num_retries>
                              <first_request_time>1266656934.528933</first_request_time>
                              <next_request_time>1266876801.588503</next_request_time>
                              <time_so_far>7794.994826</time_so_far>
                              <last_bytes_xferred>26419294.000000</last_bytes_xferred>
                              </persistent_file_xfer>
                              <signed_xml>
                              <name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
                              <generated_locally/>
                              <upload_when_present/>
                              <max_nbytes>80000000</max_nbytes>
                              <url> http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler </url>
                              </signed_xml>
                              <xml_signature>
                              40441c50412715f69240e9b884da777843fa697d3373800e866b66606cb6d9ba
                              2cc41fac1321c1df1addc5106514428e3af0ca4b3a4d06bfb57d79c74abb5e47
                              7533bc1175f8d6509d576fd174863cb189bdf3e5d94eb74f4f5d60e0263a9871
                              3ee88dba0278a5d6f668cddc08cd5649e3573b12862635488acc57c882d9c9a1
                              .
                              </xml_signature>
                              </file_info>


                              Hope that this helps!

                              Bill H

                              Profile mo.v
                              Forum moderator
                              Avatar
                              Send message
                              Joined: Sep 29 04
                              Posts: 2359
                              Credit: 7,107,484
                              RAC: 3,869
                              Message 38970 - Posted 23 Feb 2010 0:21:24 UTC

                                Last modified: 23 Feb 2010 0:25:35 UTC

                                Thank you very much, Bill. These are the sections for the #1 file from each model. They confirm that this file uploads to the server I said in a previous post, uploader.oerc. (These HadAM3P models generate 3 files and each uploads to a different server; that\'s to spread the load of these big files.)

                                Bill, if you could post a file section referring to the second file of one of these models we will be able to confirm that it really should upload to cpdn-upload1.comlab.

                                I\'m not a programmer, but does it matter that line 9 of each section says:

                                <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>

                                with no spaces, but the 9th line from the bottom says:

                                <url> http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler </url>

                                with a space inside each url tag?
                                ____________
                                Cpdn news

                                Bill H
                                Send message
                                Joined: May 11 07
                                Posts: 36
                                Credit: 1,341,559
                                RAC: 464
                                Message 38971 - Posted 23 Feb 2010 7:18:57 UTC - in response to Message 38970.

                                  Last modified: 23 Feb 2010 7:22:11 UTC

                                  I hope that this is what you need?

                                  Bill H
                                  _____________________________________________________________________________

                                  - <file_info>
                                  <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                                  <nbytes>26429666.000000</nbytes>
                                  <max_nbytes>80000000.000000</max_nbytes>
                                  <md5_cksum>84ef44a0a7849a06c98874b21dd3c96b</md5_cksum>
                                  <generated_locally />
                                  <status>1</status>
                                  <upload_when_present />
                                  <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                  - <persistent_file_xfer>
                                  <num_retries>35</num_retries>
                                  <first_request_time>1266690720.627699</first_request_time>
                                  <next_request_time>1266911818.509391</next_request_time>
                                  <time_so_far>8404.975822</time_so_far>
                                  <last_bytes_xferred>26429666.000000</last_bytes_xferred>
                                  </persistent_file_xfer>
                                  - <signed_xml>
                                  <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                                  <generated_locally />
                                  <upload_when_present />
                                  <max_nbytes>80000000</max_nbytes>
                                  <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                  </signed_xml>
                                  <xml_signature>498ba8db9391b1d6b0798689ee82ecced61e04f43c0e36cfa1db3e4d5566265c 45c007b739023f6279d8dcfef7cbfb5bb00da7c8fcf81f75cd8df8bda6cda2b7 3e1c9eefdf2fb1a549405b79db22ddcade68a1e78a43f797897249f7f7ee8252 3fb5d0db59795bd4ce7d5903380d90b96345661a3ea802c55a25438a057a82cb .</xml_signature>
                                  </file_info>
                                  - <file_info>
                                  <name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
                                  <nbytes>21111339.000000</nbytes>
                                  <max_nbytes>50000000.000000</max_nbytes>
                                  <md5_cksum>1284b3c4e21118afca01d7908a974477</md5_cksum>
                                  <generated_locally />
                                  <status>1</status>
                                  <upload_when_present />
                                  <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                  - <persistent_file_xfer>
                                  <num_retries>30</num_retries>
                                  <first_request_time>1266690720.627699</first_request_time>
                                  <next_request_time>1266917625.931492</next_request_time>
                                  <time_so_far>7969.119488</time_so_far>
                                  <last_bytes_xferred>21111339.000000</last_bytes_xferred>
                                  </persistent_file_xfer>
                                  - <signed_xml>
                                  <name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
                                  <generated_locally />
                                  <upload_when_present />
                                  <max_nbytes>50000000</max_nbytes>
                                  <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                  </signed_xml>
                                  <xml_signature>a4ce46e0b86902764275feefb343bf5b75b70dfdcf57cde3fbd01fd3b5441854 a4c522d7a0322ea254ca70a1963e1c165dbcd7268fec58eab5bf902e73300bac c31d34be91dbe89ed9330a46fac6e18da6fd7479831287e94a6fbab1e5fa7c57 22ff554680318f9a9b01b8228233874d2d368dbaa732e3bdb60c98718f45c5be .</xml_signature>
                                  </file_info>
                                  - <file_info>
                                  <name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
                                  <nbytes>217557.000000</nbytes>
                                  <max_nbytes>50000000.000000</max_nbytes>
                                  <md5_cksum>c9de2bc4a1e2fde268aa8ccd9e843890</md5_cksum>
                                  <generated_locally />
                                  <status>0</status>
                                  <uploaded />
                                  <upload_when_present />
                                  <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                  - <signed_xml>
                                  <name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
                                  <generated_locally />
                                  <upload_when_present />
                                  <max_nbytes>50000000</max_nbytes>
                                  <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                  </signed_xml>
                                  <xml_signature>ae5726f3a4df24f905a90a917aa1064e5c7762e13faf8719c508fed1f69899cf be1233b6266a8f56f7d0748e509b54d8597d4d1818ec57c2604f8770c178cafe bd4c2bb06301c8c19d92c4d781e4e356bd874db10f57bfd981c74599fa7f65b6 185f1c92c132c12f6156618a81c2309d1d7c28b802acad57da54eddcc4945edd .</xml_signature>
                                  </file_info>

                                  Profile Thyme Lawn
                                  Forum moderator
                                  Send message
                                  Joined: Aug 5 04
                                  Posts: 1232
                                  Credit: 10,395,396
                                  RAC: 1,139
                                  Message 38972 - Posted 23 Feb 2010 8:07:48 UTC - in response to Message 38970.

                                    I\'m not a programmer, but does it matter that line 9 of each section says:

                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>

                                    with no spaces, but the 9th line from the bottom says:

                                    <url> http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler </url>

                                    with a space inside each url tag?

                                    It\'s nothing to worry about. The BOINC core client gets the upload URL from the first one. The second (inside the <signed_xml> block) is one of the mechanisms used by the server to ensure data integrity.
                                    ____________
                                    "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                                    Bill H
                                    Send message
                                    Joined: May 11 07
                                    Posts: 36
                                    Credit: 1,341,559
                                    RAC: 464
                                    Message 38973 - Posted 23 Feb 2010 8:45:08 UTC - in response to Message 38972.

                                      Not idea about the extra space in the name. Its possible that the integity check rejects if they are not both exactly the same, but that will depend on the code involved(?)

                                      If you like I can manually edit the XML file - but (if it is an issue) that wouldn\'t correct the initial script that inserted it in the first place although it would give an indication if this was a problem or not(?)

                                      Any suggestions gratefully accepted!

                                      Bill H

                                      Profile Milo Thurston
                                      Forum moderator
                                      Volunteer developer
                                      Send message
                                      Joined: Mar 2 06
                                      Posts: 253
                                      Credit: 363,646
                                      RAC: 0
                                      Message 38974 - Posted 23 Feb 2010 9:37:57 UTC

                                        Thanks for the replies.
                                        I was away yesterday with sporadic access but I\'m now taking a look at uploader.oerc.

                                        Profile Milo Thurston
                                        Forum moderator
                                        Volunteer developer
                                        Send message
                                        Joined: Mar 2 06
                                        Posts: 253
                                        Credit: 363,646
                                        RAC: 0
                                        Message 38975 - Posted 23 Feb 2010 9:58:30 UTC

                                          Result: It looks like that server is experiencing memory errors, and so I will have to shut it down for further testing.

                                          Profile mo.v
                                          Forum moderator
                                          Avatar
                                          Send message
                                          Joined: Sep 29 04
                                          Posts: 2359
                                          Credit: 7,107,484
                                          RAC: 3,869
                                          Message 38976 - Posted 23 Feb 2010 11:08:36 UTC

                                            Thanks again, Bill. The extra block you\'ve copied for us confirms that HadAM3P file #2 does indeed go to to cpdn-upload1.comlab as my list of servers on paper says.

                                            As Milo\'s found something wrong with the server that accepts the upload of file #1, I wouldn\'t be surprised if he also finds a problem with cpdn-upload1.comlab.

                                            The files stuck in the Transfers tab should come to no harm because of this wait as long as nobody keeps repeatedly pressing the Try again button while the files can\'t upload.
                                            ____________
                                            Cpdn news

                                            Bill H
                                            Send message
                                            Joined: May 11 07
                                            Posts: 36
                                            Credit: 1,341,559
                                            RAC: 464
                                            Message 38977 - Posted 23 Feb 2010 12:14:03 UTC - in response to Message 38976.

                                              Thanks for keeping me updated!

                                              I will hold off pressing the \'Try Agin\' key for as long as I am able ;-)

                                              Bill H

                                              Profile mo.v
                                              Forum moderator
                                              Avatar
                                              Send message
                                              Joined: Sep 29 04
                                              Posts: 2359
                                              Credit: 7,107,484
                                              RAC: 3,869
                                              Message 38992 - Posted 24 Feb 2010 18:45:12 UTC

                                                Last modified: 24 Feb 2010 18:48:33 UTC

                                                Bill, Milo has said that cpdn-upload1.comlab which takes the HadAM3P #2 file seems to be OK.

                                                Have your #2 files uploaded or are they still stuck in Transfers?

                                                I see from the first messages you posted that they were stuck on the morning of Sunday 21st. I have a HadSM MH which also uploads to cpdn-upload1.comlab. It successfully uploaded its file at the end of phase 3 on the evening of Sunday 21st. We\'re both in the UK so our times should be the same.

                                                I\'ve posted in the News thread about HadAM3P #1 files unable to upload to uploader.oerc. Could something different be blocking the upload of your #2 files?

                                                [FVG]bax - which files are still stuck in your Transfers tab? We need to know the final number of each file, please.
                                                ____________
                                                Cpdn news

                                                Bill H
                                                Send message
                                                Joined: May 11 07
                                                Posts: 36
                                                Credit: 1,341,559
                                                RAC: 464
                                                Message 38995 - Posted 24 Feb 2010 21:35:09 UTC - in response to Message 38992.

                                                  They are still stuck in transfers. In the meantime I am running on a second hard disk configuation as BOINC is screwing up the network connection. I switch back at intervals just to see if they will upload correctly but no joy so far...

                                                  Is there any information or anything you\'d like me to try?

                                                  Bill H

                                                  Thorsten Schmidt
                                                  Send message
                                                  Joined: Mar 19 09
                                                  Posts: 1
                                                  Credit: 177,899
                                                  RAC: 0
                                                  Message 38996 - Posted 24 Feb 2010 21:38:53 UTC

                                                    Last modified: 24 Feb 2010 21:46:38 UTC

                                                    Hi!
                                                    The following files:
                                                    hadam3p_npir_2000_2_006583729_2_1.zip (25,20 MB)
                                                    hadam3p_npir_2000_2_006583729_2_3.zip (212,36 KB),
                                                    both remain stuck in the Transfers tab.

                                                    Is there any information when the uploader.oerc is ok?

                                                    Thorsten Schmidt

                                                    Bill H
                                                    Send message
                                                    Joined: May 11 07
                                                    Posts: 36
                                                    Credit: 1,341,559
                                                    RAC: 464
                                                    Message 38997 - Posted 24 Feb 2010 21:39:25 UTC - in response to Message 38995.

                                                      Mine are all haram3p_npdh and _npdg (if that means anything) and although the transfers are all supposidly deferred for an hour or so the netwrk traffic from them is still high.

                                                      Bill H

                                                      Profile mo.v
                                                      Forum moderator
                                                      Avatar
                                                      Send message
                                                      Joined: Sep 29 04
                                                      Posts: 2359
                                                      Credit: 7,107,484
                                                      RAC: 3,869
                                                      Message 38999 - Posted 24 Feb 2010 22:52:15 UTC

                                                        Last modified: 24 Feb 2010 23:02:32 UTC

                                                        Hi Bill, Thorsten and everybody

                                                        We are posting announcements about this problem in the News thread at the top of the Number Crunching section.

                                                        While uploader.oerc is down it is normal for HadAM3P files #1 and #3 to remain stuck in Transfers. We cannot do anything to make them upload.

                                                        Bill\'s #3 files, which are small, must have successfully uploaded while uploader.oerc was working partially.

                                                        Please suspend Boinc network activity as much as possible. If you do not need it for other projects and do not need new work you can suspend it all the time at the moment. I think Boinc will still try to upload the files at intervals and will restart network activity, but only for five minutes each time. I hope that will reduce your network usage.
                                                        ____________
                                                        Cpdn news

                                                        Ingleside
                                                        Send message
                                                        Joined: Aug 5 04
                                                        Posts: 92
                                                        Credit: 8,334,928
                                                        RAC: 10,558
                                                        Message 39016 - Posted 25 Feb 2010 17:20:30 UTC - in response to Message 38999.

                                                          Last modified: 25 Feb 2010 17:21:57 UTC

                                                          Please suspend Boinc network activity as much as possible. If you do not need it for other projects and do not need new work you can suspend it all the time at the moment. I think Boinc will still try to upload the files at intervals and will restart network activity, but only for five minutes each time. I hope that will reduce your network usage.

                                                          BOINC won\'t re-enable network again of it\'s own accord if the user has disabled it...

                                                          But, if user does something active, like hiting \"update\" on a file or project, or attachs to a new project, it will open-up for network-connections for 5 minutes.

                                                          Profile mo.v
                                                          Forum moderator
                                                          Avatar
                                                          Send message
                                                          Joined: Sep 29 04
                                                          Posts: 2359
                                                          Credit: 7,107,484
                                                          RAC: 3,869
                                                          Message 39017 - Posted 25 Feb 2010 17:33:42 UTC

                                                            Bill, your two #2 files in Transfers must be blocked for a different reason. Have you recently changed anything on this computer? Firewall? AV? Which AV please? Any other new software?

                                                            This is unlikely to be the cause of the blockage as a change would probably also have affected the #3 files which did upload, but it would be useful to know.

                                                            I assume your #2 files are still stuck?

                                                            If you say there have been no recent changes, tomorrow or at the weekend one of us will explain how you can set up a Boinc debugging tool which will make your Boinc produce extra messages. The extra info should help identify the source of the problem.
                                                            ____________
                                                            Cpdn news

                                                            Bill H
                                                            Send message
                                                            Joined: May 11 07
                                                            Posts: 36
                                                            Credit: 1,341,559
                                                            RAC: 464
                                                            Message 39019 - Posted 25 Feb 2010 18:37:41 UTC - in response to Message 39017.

                                                              The AntiVirus is AVG and I have been using it for a number of years now. Of course it does update itself fairly regularly.

                                                              I am not running a software firewall at the moment. I have recently switched my router from a WG834GT to a WG834PN (two weeks ago) - but have had no problems with anything else (or other BOINC uploads). Will reconnect the old router tomorrow if you think that this may be the issue?

                                                              Bill H

                                                              Richard Haselgrove
                                                              Send message
                                                              Joined: Jan 1 07
                                                              Posts: 299
                                                              Credit: 6,878,929
                                                              RAC: 44
                                                              Message 39020 - Posted 25 Feb 2010 18:50:18 UTC - in response to Message 39019.

                                                                The AntiVirus is AVG and I have been using it for a number of years now. Of course it does update itself fairly regularly.

                                                                I am not running a software firewall at the moment. I have recently switched my router from a WG834GT to a WG834PN (two weeks ago) - but have had no problems with anything else (or other BOINC uploads). Will reconnect the old router tomorrow if you think that this may be the issue?

                                                                Bill H
                                                                Highly unlikely to be the router, and probably not AVG either.

                                                                Milo has now got the new hard disk, and installed it in the server. As soon as the RAID has synchronised, and assuming it tests out OK, he plans to put it back online - keep an eye on the Server Status page.

                                                                When the general backlog has cleared - it\'ll take a while, but I can monitor it, because I\'ve got two models (four files) stuck in the same queue - let us know what you\'ve got left that\'s still stuck (post the message log extracts that describe the problem, and the client_state extracts that identify where it\'s trying to get to - like you did before). Then we can start some tests to identify exactly what\'s especially wrong with your task/on your machine.

                                                                Sound like a plan?

                                                                Bill H
                                                                Send message
                                                                Joined: May 11 07
                                                                Posts: 36
                                                                Credit: 1,341,559
                                                                RAC: 464
                                                                Message 39021 - Posted 25 Feb 2010 18:58:39 UTC - in response to Message 39020.

                                                                  Will do.

                                                                  I would have expected a firewall problem to have blocked access but not have hogged bandwidth. Looks like a server issue but only when the file has been uploaded so write error, insufficent space etc.?

                                                                  Anyway I will try again tomorrow and see if things get any further.

                                                                  Thanks for keeping me in the loop!

                                                                  Bill H

                                                                  Bill H
                                                                  Send message
                                                                  Joined: May 11 07
                                                                  Posts: 36
                                                                  Credit: 1,341,559
                                                                  RAC: 464
                                                                  Message 39042 - Posted 27 Feb 2010 9:48:14 UTC - in response to Message 39020.

                                                                    I\'m sorry but the new disk doesn\'t seem to have done anything for my problem in uploading. It may be that the server is still very overloaded but I attach a copy of the log for the early hours of this morning showing it trying and failing to upload the completed work units. Also there should be the section of the XML file for the uploads.

                                                                    The Transfer window on BOINC shows all the units at 100% but with a retry scheduled in an hour or so...

                                                                    My computer seems to be sending the units OK (well they take enough network time) but ultimately them failing or being rejected at the server end at the very end of the upload(?). Is there any sort of server log that would say what is going on from your end?

                                                                    Thanks

                                                                    Bill H


                                                                    -----------------------------------------------------------------------------

                                                                    27/02/2010 05:15:43 climateprediction.net Sending scheduler request: To fetch work.
                                                                    27/02/2010 05:15:43 climateprediction.net Requesting new tasks for GPU
                                                                    27/02/2010 05:15:59 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                    27/02/2010 05:15:59 climateprediction.net Message from server: No work sent
                                                                    27/02/2010 05:20:42 Project communication failed: attempting access to reference site
                                                                    27/02/2010 05:20:42 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
                                                                    27/02/2010 05:20:42 climateprediction.net Backing off 35 min 40 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                    27/02/2010 05:20:42 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 05:20:44 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
                                                                    27/02/2010 05:20:44 climateprediction.net Backing off 2 hr 45 min 12 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
                                                                    27/02/2010 05:20:44 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 05:20:52 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 05:25:57 Project communication failed: attempting access to reference site
                                                                    27/02/2010 05:25:57 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
                                                                    27/02/2010 05:25:57 climateprediction.net Backing off 30 min 23 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 05:25:57 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
                                                                    27/02/2010 05:25:57 climateprediction.net Backing off 54 min 50 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 05:26:12 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 05:30:24 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 05:30:32 climateprediction.net [error] Error reported by file upload server: [hadam3p_npdh_2005_2_006583539_0_1.zip] locked by file_upload_handler PID=28679
                                                                    27/02/2010 05:30:32 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: transient upload error
                                                                    27/02/2010 05:30:32 climateprediction.net Backing off 1 hr 37 min 8 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 05:32:36 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                    27/02/2010 05:37:52 Project communication failed: attempting access to reference site
                                                                    27/02/2010 05:37:52 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
                                                                    27/02/2010 05:37:52 climateprediction.net Backing off 3 hr 6 min 35 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                    27/02/2010 05:38:18 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 06:06:13 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                    27/02/2010 06:06:13 climateprediction.net Requesting new tasks for GPU
                                                                    27/02/2010 06:06:23 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                    27/02/2010 06:06:23 climateprediction.net Message from server: No work sent
                                                                    27/02/2010 06:10:53 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                    27/02/2010 06:10:53 climateprediction.net Requesting new tasks for GPU
                                                                    27/02/2010 06:11:13 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                    27/02/2010 06:11:13 climateprediction.net Message from server: No work sent
                                                                    27/02/2010 06:20:48 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 06:25:56 Project communication failed: attempting access to reference site
                                                                    27/02/2010 06:25:56 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
                                                                    27/02/2010 06:25:56 climateprediction.net Backing off 1 hr 39 min 22 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 06:26:11 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 07:07:42 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 07:12:51 Project communication failed: attempting access to reference site
                                                                    27/02/2010 07:12:51 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
                                                                    27/02/2010 07:12:51 climateprediction.net Backing off 38 min 11 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 07:13:04 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 07:23:38 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                    27/02/2010 07:23:38 climateprediction.net Requesting new tasks for GPU
                                                                    27/02/2010 07:23:43 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                    27/02/2010 07:23:43 climateprediction.net Message from server: No work sent
                                                                    27/02/2010 07:51:03 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 07:52:38 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                    27/02/2010 07:52:38 climateprediction.net Requesting new tasks for GPU
                                                                    27/02/2010 07:52:48 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                    27/02/2010 07:52:48 climateprediction.net Message from server: No work sent
                                                                    27/02/2010 07:56:12 Project communication failed: attempting access to reference site
                                                                    27/02/2010 07:56:12 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
                                                                    27/02/2010 07:56:12 climateprediction.net Backing off 3 hr 14 min 13 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                    27/02/2010 07:56:30 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 08:05:19 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 08:05:56 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
                                                                    27/02/2010 08:10:27 Project communication failed: attempting access to reference site
                                                                    27/02/2010 08:10:27 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: HTTP error
                                                                    27/02/2010 08:10:27 climateprediction.net Backing off 2 hr 40 min 30 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                    27/02/2010 08:10:43 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 08:11:12 Project communication failed: attempting access to reference site
                                                                    27/02/2010 08:11:12 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
                                                                    27/02/2010 08:11:12 climateprediction.net Backing off 2 hr 43 min 18 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
                                                                    27/02/2010 08:11:21 Internet access OK - project servers may be temporarily down.
                                                                    27/02/2010 08:14:29 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                    27/02/2010 08:19:46 Project communication failed: attempting access to reference site
                                                                    27/02/2010 08:19:46 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: HTTP error
                                                                    27/02/2010 08:19:46 climateprediction.net Backing off 3 hr 4 min 39 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                    27/02/2010 08:20:00 Internet access OK - project servers may be temporarily down.



                                                                    -----------------------------------------------------------------------------

                                                                    <file_info>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                                                                    <nbytes>26429666.000000</nbytes>
                                                                    <max_nbytes>80000000.000000</max_nbytes>
                                                                    <md5_cksum>84ef44a0a7849a06c98874b21dd3c96b</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>1</status>
                                                                    <upload_when_present />
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    - <persistent_file_xfer>
                                                                    <num_retries>49</num_retries>
                                                                    <first_request_time>1266690720.627699</first_request_time>
                                                                    <next_request_time>1267268070.866326</next_request_time>
                                                                    <time_so_far>9910.238266</time_so_far>
                                                                    <last_bytes_xferred>26429666.000000</last_bytes_xferred>
                                                                    </persistent_file_xfer>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_1.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>80000000</max_nbytes>
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>498ba8db9391b1d6b0798689ee82ecced61e04f43c0e36cfa1db3e4d5566265c 45c007b739023f6279d8dcfef7cbfb5bb00da7c8fcf81f75cd8df8bda6cda2b7 3e1c9eefdf2fb1a549405b79db22ddcade68a1e78a43f797897249f7f7ee8252 3fb5d0db59795bd4ce7d5903380d90b96345661a3ea802c55a25438a057a82cb .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
                                                                    <nbytes>21111339.000000</nbytes>
                                                                    <max_nbytes>50000000.000000</max_nbytes>
                                                                    <md5_cksum>1284b3c4e21118afca01d7908a974477</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>1</status>
                                                                    <upload_when_present />
                                                                    <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                                                    - <persistent_file_xfer>
                                                                    <num_retries>44</num_retries>
                                                                    <first_request_time>1266690720.627699</first_request_time>
                                                                    <next_request_time>1267269866.137853</next_request_time>
                                                                    <time_so_far>12823.603690</time_so_far>
                                                                    <last_bytes_xferred>21111339.000000</last_bytes_xferred>
                                                                    </persistent_file_xfer>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_2.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>50000000</max_nbytes>
                                                                    <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>a4ce46e0b86902764275feefb343bf5b75b70dfdcf57cde3fbd01fd3b5441854 a4c522d7a0322ea254ca70a1963e1c165dbcd7268fec58eab5bf902e73300bac c31d34be91dbe89ed9330a46fac6e18da6fd7479831287e94a6fbab1e5fa7c57 22ff554680318f9a9b01b8228233874d2d368dbaa732e3bdb60c98718f45c5be .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
                                                                    <nbytes>217557.000000</nbytes>
                                                                    <max_nbytes>50000000.000000</max_nbytes>
                                                                    <md5_cksum>c9de2bc4a1e2fde268aa8ccd9e843890</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>0</status>
                                                                    <uploaded />
                                                                    <upload_when_present />
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdg_2000_2_006583538_1_3.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>50000000</max_nbytes>
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>ae5726f3a4df24f905a90a917aa1064e5c7762e13faf8719c508fed1f69899cf be1233b6266a8f56f7d0748e509b54d8597d4d1818ec57c2604f8770c178cafe bd4c2bb06301c8c19d92c4d781e4e356bd874db10f57bfd981c74599fa7f65b6 185f1c92c132c12f6156618a81c2309d1d7c28b802acad57da54eddcc4945edd .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdh_2005_2_006583539.zip</name>
                                                                    <nbytes>13594.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>ad0b9311e63eae39341d7c152f99ae2b</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/hadam3p_npdh_2005_2_006583539.zip</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>HadISST_SI_N96_2005_12_2008_01f.gz</name>
                                                                    <nbytes>1911554.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>59caa2402546b15f980de5ddf9032af7</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/HadISST_SI_N96_2005_12_2008_01f.gz</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>HadISST_SST_N96_2005_12_2008_01f.gz</name>
                                                                    <nbytes>7302546.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>b3670c2ae3962a3ea670f6b21c0b325e</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/HadISST_SST_N96_2005_12_2008_01f.gz</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>so2dms_N96_2005_12_2008_02.gz</name>
                                                                    <nbytes>2593529.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>39c720e08d7d4d62eb2b2e8713654996</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/so2dms_N96_2005_12_2008_02.gz</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>2005_12_init.gz</name>
                                                                    <nbytes>30079572.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>25bd34dea2e71348e7bc9a7f8c52b16c</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/2005_12_init.gz</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>ic19610215_14_N96.gz</name>
                                                                    <nbytes>1311925.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>4ba578c9223a90111eb90395845ba273</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/ic19610215_14_N96.gz</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
                                                                    <nbytes>26419294.000000</nbytes>
                                                                    <max_nbytes>80000000.000000</max_nbytes>
                                                                    <md5_cksum>185c7982ff7f2e20809c4f677135d7c5</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>1</status>
                                                                    <upload_when_present />
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    - <persistent_file_xfer>
                                                                    <num_retries>49</num_retries>
                                                                    <first_request_time>1266656934.528933</first_request_time>
                                                                    <next_request_time>1267269026.580180</next_request_time>
                                                                    <time_so_far>10657.860812</time_so_far>
                                                                    <last_bytes_xferred>26419294.000000</last_bytes_xferred>
                                                                    </persistent_file_xfer>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_1.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>80000000</max_nbytes>
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>40441c50412715f69240e9b884da777843fa697d3373800e866b66606cb6d9ba 2cc41fac1321c1df1addc5106514428e3af0ca4b3a4d06bfb57d79c74abb5e47 7533bc1175f8d6509d576fd174863cb189bdf3e5d94eb74f4f5d60e0263a9871 3ee88dba0278a5d6f668cddc08cd5649e3573b12862635488acc57c882d9c9a1 .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_2.zip</name>
                                                                    <nbytes>21088403.000000</nbytes>
                                                                    <max_nbytes>50000000.000000</max_nbytes>
                                                                    <md5_cksum>5b4b72ed85f186d88585e43416e61a4a</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>1</status>
                                                                    <upload_when_present />
                                                                    <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                                                    - <persistent_file_xfer>
                                                                    <num_retries>50</num_retries>
                                                                    <first_request_time>1266656934.528933</first_request_time>
                                                                    <next_request_time>1267267857.970708</next_request_time>
                                                                    <time_so_far>13629.505518</time_so_far>
                                                                    <last_bytes_xferred>21088403.000000</last_bytes_xferred>
                                                                    </persistent_file_xfer>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_2.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>50000000</max_nbytes>
                                                                    <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>29a233433c66d5cd17f3ae2ada32a21075b01cbfb3d71848e10128a0ad0590da 0d1c747ef47c146503adca4f1e72873a3e3dcd6e7511fa7b14e73491fd828071 10ef94fa9b7a0d83ec9d350c3dc8ed811c0334dc83919b84d00e6c008f66e9f7 141bf2118819aa45235a5377286313a1a00ee9323ca18c93760cddf0df64f373 .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_3.zip</name>
                                                                    <nbytes>217706.000000</nbytes>
                                                                    <max_nbytes>50000000.000000</max_nbytes>
                                                                    <md5_cksum>7cfdd97cde125f7aac02d63e7f145199</md5_cksum>
                                                                    <generated_locally />
                                                                    <status>0</status>
                                                                    <uploaded />
                                                                    <upload_when_present />
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    - <signed_xml>
                                                                    <name>hadam3p_npdh_2005_2_006583539_0_3.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>50000000</max_nbytes>
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>5eafdd3cadaf9e5cb39db42d0ad89c89006fbf31860f9d7a6573b01afb4ab1db 190645d3c5a86ffae6c013b602282592cc2c3b504b19a6004184089f28c22165 c27444b4a39bef05d1c57187df73b105a2261b17ac4e4815e32d3c4c885a8e2e 72a3b174a83c1d8f657da82b552d62219873286215b82c61e90926191c2995d0 .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadsm3fub_jr5f_006445709.zip</name>
                                                                    <nbytes>11136.000000</nbytes>
                                                                    <max_nbytes>0.000000</max_nbytes>
                                                                    <md5_cksum>988c2a91e0f2d780c74b90a91002799c</md5_cksum>
                                                                    <status>1</status>
                                                                    <url>http://climateapps2.oucs.ox.ac.uk/cpdnboinc/download/hadsm3fub_jr5f_006445709.zip</url>
                                                                    </file_info>
                                                                    - <file_info>
                                                                    <name>hadsm3fub_jr5f_006445709_8_1.zip</name>
                                                                    <nbytes>0.000000</nbytes>
                                                                    <max_nbytes>50000000.000000</max_nbytes>
                                                                    <generated_locally />
                                                                    <status>0</status>
                                                                    <upload_when_present />
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    - <signed_xml>
                                                                    <name>hadsm3fub_jr5f_006445709_8_1.zip</name>
                                                                    <generated_locally />
                                                                    <upload_when_present />
                                                                    <max_nbytes>50000000</max_nbytes>
                                                                    <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                    </signed_xml>
                                                                    <xml_signature>456b4fd01bc475145f8197f0c603a94d3c6bb57a6f43de9d432e4519da056853 1368d1666dbdf82b8ec08b70d3b002dfdea9489814a7dbc38cb19e2846962e92 51c10af51eac110e537c7c3f6c82bc1aa6e8c117a7f004672eb9bcba76186211 5cd21d830faa3f06661149b580e24f5db2ad239a19224f0605e015a3b2fe800e .</xml_signature>
                                                                    </file_info>
                                                                    - <file_info>

                                                                    Les Bayliss
                                                                    Forum moderator
                                                                    Send message
                                                                    Joined: Sep 5 04
                                                                    Posts: 5409
                                                                    Credit: 8,958,344
                                                                    RAC: 1,679
                                                                    Message 39044 - Posted 27 Feb 2010 10:09:49 UTC

                                                                      The server disks have been filled up with the hundreds of megabytes of data being uploaded.
                                                                      When this happens they shut down to protect the data from loss.
                                                                      Milo is currently moving data.

                                                                      *********************

                                                                      Below is a sample of what info is needed to identify the upload servers.
                                                                      The rest isn\'t needed.


                                                                      <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                      <signed_xml>
                                                                      <name>hadam3p_m29t_1973_2_1006324107_0_1.zip</name>

                                                                      <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url>
                                                                      <signed_xml>
                                                                      <name>hadam3p_m29t_1973_2_1006324107_0_2.zip</name>

                                                                      <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url>
                                                                      <signed_xml>
                                                                      <name>hadam3p_m29t_1973_2_1006324107_0_3.zip</name>



                                                                      ____________
                                                                      Backups: Here

                                                                      Profile mo.v
                                                                      Forum moderator
                                                                      Avatar
                                                                      Send message
                                                                      Joined: Sep 29 04
                                                                      Posts: 2359
                                                                      Credit: 7,107,484
                                                                      RAC: 3,869
                                                                      Message 39054 - Posted 27 Feb 2010 14:00:47 UTC

                                                                        Last modified: 27 Feb 2010 14:01:07 UTC

                                                                        Thanks, Les.

                                                                        Hi again, Bill

                                                                        Your two #2 files can\'t upload at the moment because their upload server, cpdn-upload1.comlab is now down. See Les\'s post in the News thread (link in my signature).

                                                                        But I would have expected your two #1 files to upload as their server, uploader.oerc, has been up since yesterday when Milo replaced the disk. I see that the attempted upload of one of these files generated a PID error (probably something wrong on the server):

                                                                        27/02/2010 05:30:24 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                        27/02/2010 05:30:32 climateprediction.net [error] Error reported by file upload server: [hadam3p_npdh_2005_2_006583539_0_1.zip] locked by file_upload_handler PID=28679


                                                                        I\'ll ask Milo about this.
                                                                        ____________
                                                                        Cpdn news

                                                                        Bill H
                                                                        Send message
                                                                        Joined: May 11 07
                                                                        Posts: 36
                                                                        Credit: 1,341,559
                                                                        RAC: 464
                                                                        Message 39055 - Posted 27 Feb 2010 15:06:59 UTC - in response to Message 39054.

                                                                          Thanks for keeping me informed, although I\'m not sure how much further we have moved in understanding the problem. Is there any more information that I can provide?

                                                                          Yes the #2 files have a connect() error which (presumably means the server isn\'t available) while the #1 files have an HTTP error, which is the one I\'ve had all along. I copy the current position as the upload is being rejected but now it doesn\'t have a PID attached.

                                                                          Bill
                                                                          ==================================================================
                                                                          27/02/2010 14:53:33 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_1.zip
                                                                          27/02/2010 14:53:33 climateprediction.net Started upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                          27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jr5f_006445709_8 using hadsm3 version 607
                                                                          27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jnfh_006440887_7 using hadsm3 version 607
                                                                          27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jnfk_006440890_0 using hadsm3 version 607
                                                                          27/02/2010 14:53:33 climateprediction.net Restarting task hadsm3fub_jneu_006440864_3 using hadsm3 version 607
                                                                          27/02/2010 14:53:33 rosetta@home Sending scheduler request: To fetch work.
                                                                          27/02/2010 14:53:33 rosetta@home Requesting new tasks for GPU
                                                                          27/02/2010 14:53:35 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_2.zip: connect() failed
                                                                          27/02/2010 14:53:35 climateprediction.net Backing off 54 min 19 sec on upload of hadam3p_npdg_2000_2_006583538_1_2.zip
                                                                          27/02/2010 14:53:35 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                          27/02/2010 14:53:38 rosetta@home Scheduler request completed: got 0 new tasks
                                                                          27/02/2010 14:54:03 Project communication failed: attempting access to reference site
                                                                          27/02/2010 14:54:10 Internet access OK - project servers may be temporarily down.
                                                                          27/02/2010 14:58:43 Project communication failed: attempting access to reference site
                                                                          27/02/2010 14:58:43 climateprediction.net Temporarily failed upload of hadam3p_npdg_2000_2_006583538_1_1.zip: HTTP error
                                                                          27/02/2010 14:58:43 climateprediction.net Backing off 1 hr 7 min 28 sec on upload of hadam3p_npdg_2000_2_006583538_1_1.zip
                                                                          27/02/2010 14:58:43 climateprediction.net Started upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                          27/02/2010 14:58:49 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_1.zip: HTTP error
                                                                          27/02/2010 14:58:49 climateprediction.net Backing off 1 hr 43 min 11 sec on upload of hadam3p_npdh_2005_2_006583539_0_1.zip
                                                                          27/02/2010 14:58:49 climateprediction.net Temporarily failed upload of hadam3p_npdh_2005_2_006583539_0_2.zip: connect() failed
                                                                          27/02/2010 14:58:49 climateprediction.net Backing off 23 min 54 sec on upload of hadam3p_npdh_2005_2_006583539_0_2.zip
                                                                          27/02/2010 14:58:51 Internet access OK - project servers may be temporarily down.

                                                                          Profile mo.v
                                                                          Forum moderator
                                                                          Avatar
                                                                          Send message
                                                                          Joined: Sep 29 04
                                                                          Posts: 2359
                                                                          Credit: 7,107,484
                                                                          RAC: 3,869
                                                                          Message 39056 - Posted 27 Feb 2010 17:43:51 UTC

                                                                            Last modified: 27 Feb 2010 17:45:12 UTC

                                                                            Here\'s the Server Status page which shows why your #2 files can\'t upload at the moment (though why they didn\'t earlier I don\'t know). It takes ages for large volumes of data to be copied off.

                                                                            Milo thinks the PID error message that appeared just once could have been because uploader.oerc is still congested, handling a big backlog of uploads.
                                                                            ____________
                                                                            Cpdn news

                                                                            Profile mo.v
                                                                            Forum moderator
                                                                            Avatar
                                                                            Send message
                                                                            Joined: Sep 29 04
                                                                            Posts: 2359
                                                                            Credit: 7,107,484
                                                                            RAC: 3,869
                                                                            Message 39064 - Posted 27 Feb 2010 21:02:49 UTC

                                                                              Bill, could we please confirm that the computer with the problem has Boinc 6.4.7? You can right-click on the tray icon to check.
                                                                              ____________
                                                                              Cpdn news

                                                                              Bill H
                                                                              Send message
                                                                              Joined: May 11 07
                                                                              Posts: 36
                                                                              Credit: 1,341,559
                                                                              RAC: 464
                                                                              Message 39066 - Posted 28 Feb 2010 6:03:00 UTC - in response to Message 39064.

                                                                                The computer is currently running 6.10.18 and was recently updated (ie after I initially had the issue).

                                                                                Bill

                                                                                Bill H
                                                                                Send message
                                                                                Joined: May 11 07
                                                                                Posts: 36
                                                                                Credit: 1,341,559
                                                                                RAC: 464
                                                                                Message 39067 - Posted 28 Feb 2010 6:29:32 UTC - in response to Message 39064.

                                                                                  Last modified: 28 Feb 2010 6:30:42 UTC

                                                                                  Just in case this helps...

                                                                                  All the servers appear to be up and working although my work isn\'t making any progress in completing.
                                                                                  The names appear to be OK (eg. hadam3p_npdg_2000_2_006583538_1_1.zip)
                                                                                  The percentage complete sits at 100%
                                                                                  The size sits at 25.21/25.21
                                                                                  Elapsed time at 2:51:47
                                                                                  Speed at 8648.45 KBps (It comes up once doesn\'t change - but different on each try)
                                                                                  Status Uploading
                                                                                  ================
                                                                                  Netstat reports Boinc connections
                                                                                  127.0.0.1:31416 to My PC (ESTABLISHED)
                                                                                  192.168.0.2:49442 to cpdb-upload1:http (FIN_WAIT_1)
                                                                                  192.168.0.2:49452 to gv-in-f147:http (CLOSE_WAIT)
                                                                                  192.168.0.2:49453 to gv-in-f147:http (CLOSE_WAIT)
                                                                                  192.168.0.2:49454 to uploader:http (ESTABLISHED)

                                                                                  then 5 mins later
                                                                                  49452 & 49453 have gone and
                                                                                  49442 is still as same status
                                                                                  49454 has moved to FIN_WAIT_1
                                                                                  plus
                                                                                  192.168.0.2:49455 to 216.239.59.106:http at CLOSE_WAIT
                                                                                  192.168.0.2:49456 to 216.239.59.106:http at CLOSE_WAIT

                                                                                  At all these time network still very active.

                                                                                  Apologies if this means nothing!

                                                                                  Bill

                                                                                  Bill H
                                                                                  Send message
                                                                                  Joined: May 11 07
                                                                                  Posts: 36
                                                                                  Credit: 1,341,559
                                                                                  RAC: 464
                                                                                  Message 39068 - Posted 28 Feb 2010 6:39:05 UTC - in response to Message 39067.

                                                                                    I run my Pc mainly on Vista but also have a Windows 7 disk. I have been using this W7 recently due to the high network load generated by the issue on Vista. The W7 Climate model has now completed and has the same symptoms.

                                                                                    Bill H

                                                                                    =================================================================
                                                                                    28/02/2010 06:32:38 Starting BOINC client version 6.10.18 for windows_x86_64
                                                                                    28/02/2010 06:32:38 log flags: file_xfer, sched_ops, task
                                                                                    28/02/2010 06:32:38 Libraries: libcurl/7.19.4 OpenSSL/0.9.8l zlib/1.2.3
                                                                                    28/02/2010 06:32:38 Data directory: D:\\ProgramData\\BOINC
                                                                                    28/02/2010 06:32:38 Running under account Bill
                                                                                    28/02/2010 06:32:38 Processor: 4 AuthenticAMD AMD Phenom(tm) II X4 945 Processor [AMD64 Family 16 Model 4 Stepping 2]
                                                                                    28/02/2010 06:32:38 Processor: 512.00 KB cache
                                                                                    28/02/2010 06:32:38 Processor features: fpu tsc pae nx sse sse2 pni 3dnow mmx
                                                                                    28/02/2010 06:32:38 OS: Microsoft Windows 7: Home Premium x64 Edition, (06.01.7600.00)
                                                                                    28/02/2010 06:32:38 Memory: 8.00 GB physical, 16.00 GB virtual
                                                                                    28/02/2010 06:32:38 Disk: 465.83 GB total, 421.89 GB free
                                                                                    28/02/2010 06:32:38 Local time is UTC +0 hours
                                                                                    28/02/2010 06:32:38 NVIDIA GPU 0: GeForce 9500 GT (driver version 19562, CUDA version 3000, compute capability 1.1, 1024MB, 88 GFLOPS peak)
                                                                                    28/02/2010 06:32:39 Not using a proxy
                                                                                    28/02/2010 06:32:39 rosetta@home URL http://boinc.bakerlab.org/rosetta/; Computer ID 1174562; resource share 100
                                                                                    28/02/2010 06:32:39 climateprediction.net URL http://climateprediction.net/; Computer ID 1022723; resource share 100
                                                                                    28/02/2010 06:32:39 rosetta@home General prefs: from rosetta@home (last modified 12-May-2007 22:12:12)
                                                                                    28/02/2010 06:32:39 rosetta@home Host location: none
                                                                                    28/02/2010 06:32:39 rosetta@home General prefs: using your defaults
                                                                                    28/02/2010 06:32:39 Preferences limit memory usage when active to 4095.59MB
                                                                                    28/02/2010 06:32:39 Preferences limit memory usage when idle to 7372.06MB
                                                                                    28/02/2010 06:32:39 Preferences limit disk usage to 100.00GB
                                                                                    28/02/2010 06:32:39 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip
                                                                                    28/02/2010 06:32:39 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip
                                                                                    28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_kdqo_006474986_9 using hadsm3 version 607
                                                                                    28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_jnyh_006441571_7 using hadsm3 version 607
                                                                                    28/02/2010 06:32:39 climateprediction.net Restarting task hadsm3fub_jnx6_006441524_8 using hadsm3 version 607
                                                                                    28/02/2010 06:32:48 rosetta@home Restarting task t345__boinc_filtered_loopbuild_threading_cst_lb_tex_IGNORE_THE_REST_16900_6203_0 using minirosetta version 205
                                                                                    28/02/2010 06:32:48 rosetta@home Sending scheduler request: To fetch work.
                                                                                    28/02/2010 06:32:48 rosetta@home Requesting new tasks for GPU
                                                                                    28/02/2010 06:32:54 rosetta@home Scheduler request completed: got 0 new tasks

                                                                                    Lockleys
                                                                                    Send message
                                                                                    Joined: Jan 13 07
                                                                                    Posts: 126
                                                                                    Credit: 4,239,086
                                                                                    RAC: 1,288
                                                                                    Message 39069 - Posted 28 Feb 2010 8:33:43 UTC

                                                                                      Last modified: 28 Feb 2010 9:30:08 UTC

                                                                                      I have been monitoring this thread since it started because it seems to parallel my own experiences, so Bill H is not alone in the behaviour of his models. I have 2 zip files for completed hadcm3istd models which repeatedly fail to upload, even though zip files for my current hadsm3fub models have been formed and uploaded in between. The first was formed last Tuesday, Feb 23rd, and the second on Friday night, Feb 26th. I too run AVG and I am using Windows 7.

                                                                                      So thanks, Bill H, for persisting with this. I suspect there other silent members out there with similar symptoms who aren\'t monitoring their uploads or messages quite as assiduously.

                                                                                      EDIT Added an extract from my message log.
                                                                                      ============================================
                                                                                      27/02/2010 08:13:19 Resuming network activity
                                                                                      27/02/2010 08:13:19 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip
                                                                                      27/02/2010 08:13:19 climateprediction.net Started upload of hadsm3fub_jpd3_006443393_8_1.zip
                                                                                      27/02/2010 08:13:19 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                                      27/02/2010 08:13:19 climateprediction.net Requesting new tasks for GPU
                                                                                      27/02/2010 08:13:35 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                                      27/02/2010 08:16:23 climateprediction.net Finished upload of hadsm3fub_jpd3_006443393_8_1.zip
                                                                                      27/02/2010 08:18:36 Project communication failed: attempting access to reference site
                                                                                      27/02/2010 08:18:36 climateprediction.net Temporarily failed upload of hadcm3istd_csap_1920_160_06020805_1_16.zip: HTTP error
                                                                                      27/02/2010 08:18:36 climateprediction.net Backing off 1 min 0 sec on upload of hadcm3istd_csap_1920_160_06020805_1_16.zip
                                                                                      27/02/2010 08:19:06 climateprediction.net Started upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip
                                                                                      27/02/2010 08:19:06 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip
                                                                                      27/02/2010 08:19:14 climateprediction.net [error] Error reported by file upload server: [hadcm3istd_csap_1920_160_06020805_1_16.zip] locked by file_upload_handler PID=32026
                                                                                      27/02/2010 08:19:14 climateprediction.net Temporarily failed upload of hadcm3istd_csap_1920_160_06020805_1_16.zip: transient upload error
                                                                                      27/02/2010 08:19:14 climateprediction.net Backing off 1 min 40 sec on upload of hadcm3istd_csap_1920_160_06020805_1_16.zip
                                                                                      27/02/2010 08:20:55 climateprediction.net Started upload of hadcm3istd_csap_1920_160_06020805_1_16.zip
                                                                                      27/02/2010 08:22:51 BOINC can\'t access Internet - check network connection or proxy configuration.
                                                                                      27/02/2010 08:24:23 climateprediction.net Temporarily failed upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip: HTTP error
                                                                                      27/02/2010 08:24:23 climateprediction.net Backing off 3 hr 58 min 29 sec on upload of hadcm3istd_cssu_1920_160_06021458_6_16.zip
                                                                                      =========================

                                                                                      Bill H
                                                                                      Send message
                                                                                      Joined: May 11 07
                                                                                      Posts: 36
                                                                                      Credit: 1,341,559
                                                                                      RAC: 464
                                                                                      Message 39070 - Posted 28 Feb 2010 8:45:29 UTC - in response to Message 39068.

                                                                                        A slightly different message set from Windows 7

                                                                                        Bill H
                                                                                        ==============================================================

                                                                                        28/02/2010 06:51:04 climateprediction.net Requesting new tasks for GPU
                                                                                        28/02/2010 06:51:25 climateprediction.net Scheduler request completed: got 0 new tasks
                                                                                        28/02/2010 06:51:25 climateprediction.net Message from server: No work sent
                                                                                        28/02/2010 06:53:53 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip
                                                                                        28/02/2010 06:54:25 Project communication failed: attempting access to reference site
                                                                                        28/02/2010 06:54:25 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip: HTTP error
                                                                                        28/02/2010 06:54:25 climateprediction.net Backing off 37 min 18 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip
                                                                                        28/02/2010 06:54:43 Internet access OK - project servers may be temporarily down.
                                                                                        28/02/2010 06:59:11 Project communication failed: attempting access to reference site
                                                                                        28/02/2010 06:59:11 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip: HTTP error
                                                                                        28/02/2010 06:59:11 climateprediction.net Backing off 28 min 58 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip
                                                                                        28/02/2010 06:59:27 Internet access OK - project servers may be temporarily down.
                                                                                        28/02/2010 07:28:09 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip
                                                                                        28/02/2010 07:31:43 climateprediction.net Started upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip
                                                                                        28/02/2010 07:33:27 Project communication failed: attempting access to reference site
                                                                                        28/02/2010 07:33:27 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip: HTTP error
                                                                                        28/02/2010 07:33:27 climateprediction.net Backing off 2 hr 46 min 30 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_2.zip
                                                                                        28/02/2010 07:33:41 Internet access OK - project servers may be temporarily down.
                                                                                        28/02/2010 07:37:01 Project communication failed: attempting access to reference site
                                                                                        28/02/2010 07:37:01 climateprediction.net Temporarily failed upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip: HTTP error
                                                                                        28/02/2010 07:37:01 climateprediction.net Backing off 1 hr 44 min 1 sec on upload of hadam3p_mmjn_1986_2_1006350381_5_1.zip
                                                                                        28/02/2010 07:37:09 Internet access OK - project servers may be temporarily down.

                                                                                        Bill H
                                                                                        Send message
                                                                                        Joined: May 11 07
                                                                                        Posts: 36
                                                                                        Credit: 1,341,559
                                                                                        RAC: 464
                                                                                        Message 39071 - Posted 28 Feb 2010 8:50:21 UTC - in response to Message 39069.

                                                                                          Last modified: 28 Feb 2010 9:14:07 UTC

                                                                                          It\'s reassuring to know that this isn\'t just a quirk of my PC and that others have the issue too. All servers are reported to be up so that isn\'t the reason and running the upload at 5:30am should (?) avoid network congestion too! Boinc IS uploading something and this is (presumably) being rejected for a good (or perhaps not so good) reason at the server end. Is there a server log file that might give a clue?

                                                                                          Still there must be a lot of systems that don\'t have this problem as it would seem that the majority of users are OK.

                                                                                          BTW it\'s not that I was monitoring uploads, more that network performance \"fell off a cliff\" so I couldn\'t ignore it! :-)

                                                                                          Cheers

                                                                                          Bill

                                                                                          Lockleys
                                                                                          Send message
                                                                                          Joined: Jan 13 07
                                                                                          Posts: 126
                                                                                          Credit: 4,239,086
                                                                                          RAC: 1,288
                                                                                          Message 39072 - Posted 28 Feb 2010 9:33:29 UTC

                                                                                            I have in fact tried transferring my models with the stuck zip uploads to my laptop which runs Windows XP and initiating the upload from there, but the result is the same. So it\'s not the PC, not the Windows version. It is the same router, though.

                                                                                            John
                                                                                            Send message
                                                                                            Joined: Feb 16 06
                                                                                            Posts: 7
                                                                                            Credit: 1,669,956
                                                                                            RAC: 0
                                                                                            Message 39073 - Posted 28 Feb 2010 10:54:48 UTC

                                                                                              Me too... BOINC 6.6.36

                                                                                              ==================

                                                                                              28/02/2010 01:21:15 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 01:26:29 Project communication failed: attempting access to reference site
                                                                                              28/02/2010 01:26:29 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error
                                                                                              28/02/2010 01:26:29 climateprediction.net Backing off 2 hr 22 min 2 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 01:26:35 Internet access OK - project servers may be temporarily down.
                                                                                              28/02/2010 03:48:32 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 03:53:47 Project communication failed: attempting access to reference site
                                                                                              28/02/2010 03:53:47 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error
                                                                                              28/02/2010 03:53:47 climateprediction.net Backing off 3 hr 8 min 39 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 03:57:43 BOINC can\'t access Internet - check network connection or proxy configuration.
                                                                                              28/02/2010 05:07:39 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                                              28/02/2010 05:07:39 climateprediction.net Not reporting or requesting tasks
                                                                                              28/02/2010 05:07:44 climateprediction.net Scheduler request completed
                                                                                              28/02/2010 07:02:28 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 07:07:39 Project communication failed: attempting access to reference site
                                                                                              28/02/2010 07:07:39 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error
                                                                                              28/02/2010 07:07:39 climateprediction.net Backing off 53 min 8 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 07:11:37 BOINC can\'t access Internet - check network connection or proxy configuration.
                                                                                              28/02/2010 08:00:49 climateprediction.net Started upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 08:06:01 Project communication failed: attempting access to reference site
                                                                                              28/02/2010 08:06:01 climateprediction.net Temporarily failed upload of hadam3p_nqq6_2003_2_006585292_1_1.zip: HTTP error
                                                                                              28/02/2010 08:06:01 climateprediction.net Backing off 3 hr 28 min 31 sec on upload of hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                              28/02/2010 08:09:42 BOINC can\'t access Internet - check network connection or proxy configuration.
                                                                                              28/02/2010 10:21:52 climateprediction.net Sending scheduler request: To send trickle-up message.
                                                                                              28/02/2010 10:21:52 climateprediction.net Not reporting or requesting tasks
                                                                                              28/02/2010 10:21:57 climateprediction.net Scheduler request completed

                                                                                              Profile mo.v
                                                                                              Forum moderator
                                                                                              Avatar
                                                                                              Send message
                                                                                              Joined: Sep 29 04
                                                                                              Posts: 2359
                                                                                              Credit: 7,107,484
                                                                                              RAC: 3,869
                                                                                              Message 39075 - Posted 28 Feb 2010 11:41:53 UTC

                                                                                                Last modified: 28 Feb 2010 11:42:14 UTC

                                                                                                Many thanks to everyone posting these reports of failed zip file uploads.

                                                                                                Lockleys, you probably know that HadCM evenly-numbered files upload to uploader.oerc as do all three HadSM files.

                                                                                                John, I can see that your HadAM3P #1 file upload\'s been failing for at least 10 hours. Have files #2 and #3 uploaded?

                                                                                                I\'ve restarted a HADSM at 32% which had been suspended so I could run beta models; that will generate a file soon and I\'ll watch it upload.
                                                                                                ____________
                                                                                                Cpdn news

                                                                                                Lockleys
                                                                                                Send message
                                                                                                Joined: Jan 13 07
                                                                                                Posts: 126
                                                                                                Credit: 4,239,086
                                                                                                RAC: 1,288
                                                                                                Message 39076 - Posted 28 Feb 2010 11:56:06 UTC

                                                                                                  Yes, my stuck zips are aiming for uploader.oerc .

                                                                                                  For reference, I\'m using BOINC 6.10.18 . If there\'s any possibility that the BOINC version could be a factor, I\'m willing to downgrade and give that a whirl.

                                                                                                  Profile mo.v
                                                                                                  Forum moderator
                                                                                                  Avatar
                                                                                                  Send message
                                                                                                  Joined: Sep 29 04
                                                                                                  Posts: 2359
                                                                                                  Credit: 7,107,484
                                                                                                  RAC: 3,869
                                                                                                  Message 39077 - Posted 28 Feb 2010 12:06:46 UTC

                                                                                                    I don\'t think the Boinc version should make any difference. Bill had 6.4.7 when his problem started; he upgraded Boinc but it made no difference.
                                                                                                    ____________
                                                                                                    Cpdn news

                                                                                                    John
                                                                                                    Send message
                                                                                                    Joined: Feb 16 06
                                                                                                    Posts: 7
                                                                                                    Credit: 1,669,956
                                                                                                    RAC: 0
                                                                                                    Message 39079 - Posted 28 Feb 2010 13:14:32 UTC

                                                                                                      # John, I can see that your HadAM3P #1 file upload\'s been failing
                                                                                                      # for at least 10 hours. Have files #2 and #3 uploaded?

                                                                                                      I\'m not certain how to check... would you like me to post the 1200 lines of log since 24/02/2010 09:59:44 when I last restarted? I can\'t see anything in there relating to an hadam3p_nqq6_2003_2_006585292_1_2.zip or _3.zip file, though this happened on Friday...

                                                                                                      26/02/2010 21:39:17 climateprediction.net Started upload of hadam3p_nj9z_2002_2_006575637_1_1.zip
                                                                                                      26/02/2010 21:39:18 climateprediction.net Finished upload of hadam3p_nj9z_2002_2_006575637_1_1.zip

                                                                                                      (I assume this is for a different WU, though). My BOINC folder contains the following zip files...

                                                                                                      F:\\Boinc>dir/s/b *.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_data_6.14_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_ni03_2002_2_006573985.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_nqq6_2003_2_006585292.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_nqq6_2003_2_006585292_1_1.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_se_6.14_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadam3p_um_6.14_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_data_6.02_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_se_6.02_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3mh_um_6.02_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3_data_6.07_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3_se_6.07_windows_intelx86.zip
                                                                                                      F:\\Boinc\\projects\\climateprediction.net\\hadsm3_um_6.07_windows_intelx86.zip
                                                                                                      F:\\Boinc\\slots\\0\\cpdnout1.zip
                                                                                                      F:\\Boinc\\slots\\0\\cpdnout2.zip
                                                                                                      F:\\Boinc\\slots\\0\\cpdnout3.zip
                                                                                                      F:\\Boinc\\slots\\0\\hadam3p_data_6.14_windows_intelx86.zip
                                                                                                      F:\\Boinc\\slots\\0\\hadam3p_ni03_2002_2_006573985.zip
                                                                                                      F:\\Boinc\\slots\\0\\hadam3p_se_6.14_windows_intelx86.zip
                                                                                                      F:\\Boinc\\slots\\0\\hadam3p_um_6.14_windows_intelx86.zip

                                                                                                      Profile mo.v
                                                                                                      Forum moderator
                                                                                                      Avatar
                                                                                                      Send message
                                                                                                      Joined: Sep 29 04
                                                                                                      Posts: 2359
                                                                                                      Credit: 7,107,484
                                                                                                      RAC: 3,869
                                                                                                      Message 39080 - Posted 28 Feb 2010 14:25:26 UTC

                                                                                                        Last modified: 28 Feb 2010 14:26:19 UTC

                                                                                                        John, thanks but I don\'t think we need 1200 lines of log!

                                                                                                        If your #2 and #3 zip files are also unable to upload you\'ll see them in the Transfers tab. If they\'ve disappeared from there they\'ve uploaded.

                                                                                                        Has the #1 zip file for task 10829668 (hadam3p_nqq6_2003_2_006585292_1) been stuck in Transfers since Friday 19 Feb?
                                                                                                        ____________
                                                                                                        Cpdn news

                                                                                                        Lockleys
                                                                                                        Send message
                                                                                                        Joined: Jan 13 07
                                                                                                        Posts: 126
                                                                                                        Credit: 4,239,086
                                                                                                        RAC: 1,288
                                                                                                        Message 39081 - Posted 28 Feb 2010 15:08:29 UTC - in response to Message 39075.

                                                                                                          Lockleys, you probably know that HadCM evenly-numbered files upload to uploader.oerc as do all three HadSM files.

                                                                                                          I guess I\'m surprised that my SM zips are loading but my CM zips are stuck. Could this be a size-related issue?

                                                                                                          Profile mo.v
                                                                                                          Forum moderator
                                                                                                          Avatar
                                                                                                          Send message
                                                                                                          Joined: Sep 29 04
                                                                                                          Posts: 2359
                                                                                                          Credit: 7,107,484
                                                                                                          RAC: 3,869
                                                                                                          Message 39082 - Posted 28 Feb 2010 15:59:02 UTC

                                                                                                            My HadSM generated its #1 file an hour ago and it uploaded immediately.

                                                                                                            Perhaps size-related. But Thorsten reported on 24 Feb that his big #1 and small #3 files were stuck (I think since 23 Feb), yet they both uploaded on 26 Feb. So as soon as Milo installed the new disk in uploader.oerc on Friday 26 it accepted large files.

                                                                                                            I\'m wondering whether all the files that remain stuck have a date-related problem; perhaps they all first tried to upload while the old uploader.oerc disk was behaving badly and before Milo took it down. That\'s just a theory.
                                                                                                            ____________
                                                                                                            Cpdn news

                                                                                                            John
                                                                                                            Send message
                                                                                                            Joined: Feb 16 06
                                                                                                            Posts: 7
                                                                                                            Credit: 1,669,956
                                                                                                            RAC: 0
                                                                                                            Message 39083 - Posted 28 Feb 2010 16:05:03 UTC

                                                                                                              Last modified: 28 Feb 2010 16:06:50 UTC

                                                                                                              # If your #2 and #3 zip files are also unable
                                                                                                              # to upload you\'ll see them in the Transfers tab.

                                                                                                              Oh, OK. They\'ve gone, then.

                                                                                                              # Has the #1 zip file for task 10829668
                                                                                                              # (hadam3p_nqq6_2003_2_006585292_1) been
                                                                                                              # stuck in Transfers since Friday 19 Feb?

                                                                                                              I guess so... that\'s the date stamp on the zip file:

                                                                                                              19/02/2010 11:28 26,414,500 hadam3p_nqq6_2003_2_006585292_1_1.zip

                                                                                                              Lockleys
                                                                                                              Send message
                                                                                                              Joined: Jan 13 07
                                                                                                              Posts: 126
                                                                                                              Credit: 4,239,086
                                                                                                              RAC: 1,288
                                                                                                              Message 39084 - Posted 28 Feb 2010 16:20:38 UTC - in response to Message 39082.

                                                                                                                I\'m wondering whether all the files that remain stuck have a date-related problem; perhaps they all first tried to upload while the old uploader.oerc disk was behaving badly and before Milo took it down. That\'s just a theory.

                                                                                                                The second of my stuck CM zips was only created 48 hours ago when the model reached 160 years. The first one is definitely from the first days of the uploadrer.oerc failure.

                                                                                                                Bill H
                                                                                                                Send message
                                                                                                                Joined: May 11 07
                                                                                                                Posts: 36
                                                                                                                Credit: 1,341,559
                                                                                                                RAC: 464
                                                                                                                Message 39085 - Posted 28 Feb 2010 16:43:47 UTC - in response to Message 39084.

                                                                                                                  Last modified: 28 Feb 2010 16:46:24 UTC

                                                                                                                  The two first models were stuck on 20/2/2010 one at 9:08 the other at 18:31, the latest was this weekend 27/2/2010 at 20:40.

                                                                                                                  They are mostly 20Mbytes+

                                                                                                                  Bill H

                                                                                                                  John
                                                                                                                  Send message
                                                                                                                  Joined: Feb 16 06
                                                                                                                  Posts: 7
                                                                                                                  Credit: 1,669,956
                                                                                                                  RAC: 0
                                                                                                                  Message 39086 - Posted 28 Feb 2010 17:46:01 UTC

                                                                                                                    I think I\'ve found the culprit, at least on my machine: AVG Anti-Virus. I think it installs a transparent http proxy which is interfering with the BOINC upload mechanism (perhaps just making it time out?).

                                                                                                                    To get my file to upload, I rebooted in \"safe mode with networking\" (to make sure AVG wasn\'t loaded -- just disabling \"Web Shield\" doesn\'t seem to be enough) and started BOINC. The file uploaded first time.

                                                                                                                    Bill H
                                                                                                                    Send message
                                                                                                                    Joined: May 11 07
                                                                                                                    Posts: 36
                                                                                                                    Credit: 1,341,559
                                                                                                                    RAC: 464
                                                                                                                    Message 39087 - Posted 28 Feb 2010 19:07:39 UTC - in response to Message 39086.

                                                                                                                      Yep - works for me too! Well done for isolating the problem.

                                                                                                                      Let\'s see what the team comes up with for longer term BOINC working?

                                                                                                                      Bill H

                                                                                                                      Lockleys
                                                                                                                      Send message
                                                                                                                      Joined: Jan 13 07
                                                                                                                      Posts: 126
                                                                                                                      Credit: 4,239,086
                                                                                                                      RAC: 1,288
                                                                                                                      Message 39088 - Posted 28 Feb 2010 19:29:26 UTC

                                                                                                                        Well done, John. Bottle of virtual champagne from me. Don\'t know whether the root cause you suggest is right or not. Don\'t terribly care at this moment. But the solution works a treat. Thanks.

                                                                                                                        Les Bayliss
                                                                                                                        Forum moderator
                                                                                                                        Send message
                                                                                                                        Joined: Sep 5 04
                                                                                                                        Posts: 5409
                                                                                                                        Credit: 8,958,344
                                                                                                                        RAC: 1,679
                                                                                                                        Message 39089 - Posted 28 Feb 2010 19:46:05 UTC

                                                                                                                          Sorry, I\'d forgotten about that.
                                                                                                                          I found out about problems with the new version of AVG some time ago. (Last year?)
                                                                                                                          As you say, it stops uploads. Even isolating the BOINC folders didn\'t help.
                                                                                                                          I think in the end I had to disable ALL active scanning to get the transfers to work.
                                                                                                                          In the end I deleted the new version and went back to the old version. When they stop updating this older version, I\'ll have to find a new brand of AV. :(
                                                                                                                          I posted about it on our other forum somewhere.


                                                                                                                          ____________
                                                                                                                          Backups: Here

                                                                                                                          Lockleys
                                                                                                                          Send message
                                                                                                                          Joined: Jan 13 07
                                                                                                                          Posts: 126
                                                                                                                          Credit: 4,239,086
                                                                                                                          RAC: 1,288
                                                                                                                          Message 39090 - Posted 28 Feb 2010 22:01:13 UTC

                                                                                                                            Turns out there\'s been an AVG Forum thread about this problem since November, mostly populated by people wanting to post large jpegs to webmail servers, but they haven\'t fixed it yet. I\'ve added my post to their thread at
                                                                                                                            http://forums.avg.com/gb-en/avg-free-forum?sec=thread&act=show&id=67699 .
                                                                                                                            Perhaps if other CPDNers add their own posts we can get AVG to increase the priority for its resolution. Otherwise, like Les, we\'ll all be looking for an alternative which for me would be a shame as me it\'s generally been pretty good.

                                                                                                                            Profile mo.v
                                                                                                                            Forum moderator
                                                                                                                            Avatar
                                                                                                                            Send message
                                                                                                                            Joined: Sep 29 04
                                                                                                                            Posts: 2359
                                                                                                                            Credit: 7,107,484
                                                                                                                            RAC: 3,869
                                                                                                                            Message 39091 - Posted 1 Mar 2010 0:34:26 UTC

                                                                                                                              Congratulations, that\'s brilliant! You must all have been sick of the sight of those stuck files.

                                                                                                                              If one of you AVG victims would like to start a new thread in Number Crunching called, for example, \'AVG may block large uploads\' and write step-by-step instructions for the solution aimed at non-tech newbies (each step on a new line) we could make it a sticky.

                                                                                                                              That would be far better than pointing other victims to this now very long thread.
                                                                                                                              ____________
                                                                                                                              Cpdn news

                                                                                                                              Les Bayliss
                                                                                                                              Forum moderator
                                                                                                                              Send message
                                                                                                                              Joined: Sep 5 04
                                                                                                                              Posts: 5409
                                                                                                                              Credit: 8,958,344
                                                                                                                              RAC: 1,679
                                                                                                                              Message 39095 - Posted 1 Mar 2010 3:11:29 UTC

                                                                                                                                I\'ve made a locked sticky about this, both on these boards, (in Number crunching), and on the alternate forum.
                                                                                                                                There\'s also a thread in Number crunching for discussion.
                                                                                                                                Finally, I\'ve made a post in News and Announcements, both here and on the alternate forum.


                                                                                                                                ____________
                                                                                                                                Backups: Here

                                                                                                                                MartinNZ
                                                                                                                                Send message
                                                                                                                                Joined: Mar 22 06
                                                                                                                                Posts: 97
                                                                                                                                Credit: 8,714,193
                                                                                                                                RAC: 4,700
                                                                                                                                Message 39115 - Posted 2 Mar 2010 22:51:49 UTC

                                                                                                                                  My previous posts on this were here:
                                                                                                                                  Results not uploading

                                                                                                                                  I\'m still sitting with transfers not moving and the list is growing. Those sitting there on 24 Feb are still there. Now 11 results at 0% and 10 at 100%. Have #1,2&3 zip files waiting at 0%, but only #1&2 showing 100%.

                                                                                                                                  I\'m not using AVG, but ESET ESS. Tried sitting with the firewall off, but that makes no difference either.

                                                                                                                                  Any thoughts?

                                                                                                                                  Regards,
                                                                                                                                  Martin
                                                                                                                                  ____________

                                                                                                                                  Profile geophi
                                                                                                                                  Forum moderator
                                                                                                                                  Send message
                                                                                                                                  Joined: Aug 7 04
                                                                                                                                  Posts: 1477
                                                                                                                                  Credit: 22,724,605
                                                                                                                                  RAC: 5,327
                                                                                                                                  Message 39118 - Posted 3 Mar 2010 1:10:42 UTC

                                                                                                                                    Last modified: 3 Mar 2010 1:11:15 UTC

                                                                                                                                    Martin,
                                                                                                                                    Did anything change on your PC or network in mid February? New versions of firewall, antivirus, anti-malware? Different networking equipment? Proxy server? Router? Other? ISP change?

                                                                                                                                    MartinNZ
                                                                                                                                    Send message
                                                                                                                                    Joined: Mar 22 06
                                                                                                                                    Posts: 97
                                                                                                                                    Credit: 8,714,193
                                                                                                                                    RAC: 4,700
                                                                                                                                    Message 39119 - Posted 3 Mar 2010 5:25:36 UTC - in response to Message 39118.

                                                                                                                                      Martin,
                                                                                                                                      Did anything change on your PC or network in mid February? New versions of firewall, antivirus, anti-malware? Different networking equipment? Proxy server? Router? Other? ISP change?


                                                                                                                                      Nope to all. Std windows (7) updates only. No updates to AV other than virus definitions. No update to BOINC. Since having the problems have changed the adsl modem, but no difference. Another of the reasons I changed the modem was that I was having problems sending emails. It turned out my ISP (vodafone nz) was having problems with their email system starting 11 Feb, but that was resolved. Related issue?

                                                                                                                                      All models seem to be running OK, & downloads of new tasks keep coming.

                                                                                                                                      Looked at doing the safe mode upload as others have done, but running BOINC as a service & this will not work in safe mode.

                                                                                                                                      Regards,
                                                                                                                                      Martin

                                                                                                                                      ____________

                                                                                                                                      Lockleys
                                                                                                                                      Send message
                                                                                                                                      Joined: Jan 13 07
                                                                                                                                      Posts: 126
                                                                                                                                      Credit: 4,239,086
                                                                                                                                      RAC: 1,288
                                                                                                                                      Message 39120 - Posted 3 Mar 2010 8:38:09 UTC

                                                                                                                                        The specific routine in AVG which was causing the problem was LinkScanner, which in AVG-speak is the bit that protects you from connecting to dodgy web sites. Obviously, CPDN isn\'t dodgy but the AVG algorithms are not yet sophisticated enough. LinkScanner sits alongside the modules for firewall and virus etc. Does ESAT ESS have something similar?

                                                                                                                                        Profile Thyme Lawn
                                                                                                                                        Forum moderator
                                                                                                                                        Send message
                                                                                                                                        Joined: Aug 5 04
                                                                                                                                        Posts: 1232
                                                                                                                                        Credit: 10,395,396
                                                                                                                                        RAC: 1,139
                                                                                                                                        Message 39121 - Posted 3 Mar 2010 9:00:45 UTC - in response to Message 39119.

                                                                                                                                          Since having the problems have changed the adsl modem, but no difference. Another of the reasons I changed the modem was that I was having problems sending emails. It turned out my ISP (vodafone nz) was having problems with their email system starting 11 Feb, but that was resolved. Related issue?

                                                                                                                                          Probably not Martin. Try creating the file cc_config.xml in your BOINC data directory containing the following:
                                                                                                                                          <cc_config>
                                                                                                                                          <log_flags>
                                                                                                                                          <http_debug>1</http_debug>
                                                                                                                                          <http_xfer_debug>1</http_xfer_debug>
                                                                                                                                          </log_flags>
                                                                                                                                          </cc_config>

                                                                                                                                          Click Advanced - Read config file in BOINC Manager and post the debug messages if you need help. To disable the debug messages either change the values to 0 and reload the config file or delete cc_config.xml and restart BOINC.
                                                                                                                                          ____________
                                                                                                                                          "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                                                                                                                                          MartinNZ
                                                                                                                                          Send message
                                                                                                                                          Joined: Mar 22 06
                                                                                                                                          Posts: 97
                                                                                                                                          Credit: 8,714,193
                                                                                                                                          RAC: 4,700
                                                                                                                                          Message 39122 - Posted 3 Mar 2010 10:42:23 UTC - in response to Message 39121.

                                                                                                                                            Thyme -

                                                                                                                                            Try creating the file cc_config.xml in your BOINC data directory .....

                                                                                                                                            This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

                                                                                                                                            3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
                                                                                                                                            3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
                                                                                                                                            3/03/2010 11:06:42 p.m. Re-read config file
                                                                                                                                            3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

                                                                                                                                            Lockleys -
                                                                                                                                            AVG which was causing the problem was LinkScanner....Does ESET ESS have something similar?

                                                                                                                                            Probably, but I wouldn\'t know. But other than definition updates, I haven\'t updated the software since it was installed in Jan.

                                                                                                                                            Regards,
                                                                                                                                            Martin
                                                                                                                                            ____________

                                                                                                                                            Profile Thyme Lawn
                                                                                                                                            Forum moderator
                                                                                                                                            Send message
                                                                                                                                            Joined: Aug 5 04
                                                                                                                                            Posts: 1232
                                                                                                                                            Credit: 10,395,396
                                                                                                                                            RAC: 1,139
                                                                                                                                            Message 39123 - Posted 3 Mar 2010 12:18:57 UTC - in response to Message 39122.

                                                                                                                                              Thyme -
                                                                                                                                              Try creating the file cc_config.xml in your BOINC data directory .....

                                                                                                                                              This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

                                                                                                                                              3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
                                                                                                                                              3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
                                                                                                                                              3/03/2010 11:06:42 p.m. Re-read config file
                                                                                                                                              3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

                                                                                                                                              Check that cc_config.xml has the 6 lines exactly as I posted Martin. Those messages suggest that some or all of the <cc_config> line is missing (e.g. I can force that error if I delete the leading \'<\' from that line of my file).

                                                                                                                                              ____________
                                                                                                                                              "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                                                                                                                                              Richard Haselgrove
                                                                                                                                              Send message
                                                                                                                                              Joined: Jan 1 07
                                                                                                                                              Posts: 299
                                                                                                                                              Credit: 6,878,929
                                                                                                                                              RAC: 44
                                                                                                                                              Message 39124 - Posted 3 Mar 2010 12:36:27 UTC - in response to Message 39123.

                                                                                                                                                Thyme -
                                                                                                                                                Try creating the file cc_config.xml in your BOINC data directory .....

                                                                                                                                                This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

                                                                                                                                                3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
                                                                                                                                                3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
                                                                                                                                                3/03/2010 11:06:42 p.m. Re-read config file
                                                                                                                                                3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

                                                                                                                                                Check that cc_config.xml has the 6 lines exactly as I posted Martin. Those messages suggest that some or all of the <cc_config> line is missing (e.g. I can force that error if I delete the leading \'<\' from that line of my file).
                                                                                                                                                Also check that the file is saved in the simplest possible text format (ANSI, not Unicode)

                                                                                                                                                transient
                                                                                                                                                Send message
                                                                                                                                                Joined: Oct 3 06
                                                                                                                                                Posts: 42
                                                                                                                                                Credit: 2,360,623
                                                                                                                                                RAC: 1,080
                                                                                                                                                Message 39127 - Posted 3 Mar 2010 16:59:30 UTC - in response to Message 39120.

                                                                                                                                                  The specific routine in AVG which was causing the problem was LinkScanner, which in AVG-speak is the bit that protects you from connecting to dodgy web sites. Obviously, CPDN isn\'t dodgy but the AVG algorithms are not yet sophisticated enough. LinkScanner sits alongside the modules for firewall and virus etc. Does ESAT ESS have something similar?


                                                                                                                                                  I use ESS myself and I do not have \'stuck\' uploads.

                                                                                                                                                  MartinNZ
                                                                                                                                                  Send message
                                                                                                                                                  Joined: Mar 22 06
                                                                                                                                                  Posts: 97
                                                                                                                                                  Credit: 8,714,193
                                                                                                                                                  RAC: 4,700
                                                                                                                                                  Message 39134 - Posted 3 Mar 2010 22:26:22 UTC - in response to Message 39124.

                                                                                                                                                    Last modified: 3 Mar 2010 22:37:43 UTC

                                                                                                                                                    Richard -

                                                                                                                                                    Also check that the file is saved in the simplest possible text format (ANSI, not Unicode)

                                                                                                                                                    Was saved as UTF-8. Now works when saved as ANSI - thanks.

                                                                                                                                                    Quick update of activity. I notice that one #3 zip file has been uploaded since yesterday. Also 5 files that were showing as 100% uploaded now showing as 0% uploaded. Now a total of 24 files waiting to finish uploading.

                                                                                                                                                    Should I stop downloading new tasks until this is sorted?

                                                                                                                                                    Typical selection of BOINC messages around a couple of failures follow. Do these provide any clues?
                                                                                                                                                    Regards,
                                                                                                                                                    Martin

                                                                                                                                                    Update: Messages added from 4/03/2010 10:56:26 am. These point to some sort of comms failure. BTW have reverted to my original adsl modem, so unless I have two dud modems, that should not be an issue.

                                                                                                                                                    4/03/2010 10:51:16 a.m. climateprediction.net Started upload of hadam3p_nij5_1999_2_006562491_3_1.zip
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle \'C:\\Program Files\\BOINC\\ca-bundle.crt\'
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
                                                                                                                                                    4/03/2010 10:51:16 a.m. climateprediction.net Started upload of hadsm3fub_js4a_006446964_4_1.zip
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: timeout on name lookup is not supported
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#0)
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: Trying 163.1.124.170...
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: timeout on name lookup is not supported
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#3)
                                                                                                                                                    4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: Trying 163.1.124.170...
                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0)
                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: uploader.oerc.ox.ac.uk
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded
                                                                                                                                                    Content-Length: 291


                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#16] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#3)
                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#16] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: uploader.oerc.ox.ac.uk
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded
                                                                                                                                                    Content-Length: 286


                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: HTTP/1.1 200 OK

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Date: Wed, 03 Mar 2010 23:51:21 GMT

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Server: Apache/2.2.13 (Linux/SUSE)

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Transfer-Encoding: chunked

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Content-Type: text/plain

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server:

                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_xfer_debug] HTTP: wrote 93 bytes
                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Expire cleared
                                                                                                                                                    4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Connection #0 to host uploader.oerc.ox.ac.uk left intact
                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: HTTP/1.1 200 OK

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Date: Wed, 03 Mar 2010 23:51:21 GMT

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Server: Apache/2.2.13 (Linux/SUSE)

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Transfer-Encoding: chunked

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Content-Type: text/plain

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server:

                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_xfer_debug] HTTP: wrote 93 bytes
                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] info: Expire cleared
                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] [ID#16] info: Connection #3 to host uploader.oerc.ox.ac.uk left intact
                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
                                                                                                                                                    4/03/2010 10:51:18 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Re-using existing connection! (#0) with host uploader.oerc.ox.ac.uk
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0)
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Re-using existing connection! (#3) with host uploader.oerc.ox.ac.uk
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#3)
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: uploader.oerc.ox.ac.uk
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded
                                                                                                                                                    Content-Length: 26423641
                                                                                                                                                    Expect: 100-continue


                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: uploader.oerc.ox.ac.uk
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded
                                                                                                                                                    Content-Length: 3084657
                                                                                                                                                    Expect: 100-continue


                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Expire cleared
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Expire cleared
                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Received header from server: HTTP/1.1 100 Continue

                                                                                                                                                    4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Received header from server: HTTP/1.1 100 Continue

                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Expire cleared
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Closing connection #0
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Expire cleared
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Closing connection #3
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached
                                                                                                                                                    4/03/2010 10:56:25 a.m. Project communication failed: attempting access to reference site
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] HTTP_OP::init_get(): http://www.google.com/
                                                                                                                                                    4/03/2010 10:56:25 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
                                                                                                                                                    4/03/2010 10:56:25 a.m. climateprediction.net Temporarily failed upload of hadam3p_nij5_1999_2_006562491_3_1.zip: HTTP error
                                                                                                                                                    4/03/2010 10:56:25 a.m. climateprediction.net Backing off 49 min 17 sec on upload of hadam3p_nij5_1999_2_006562491_3_1.zip
                                                                                                                                                    4/03/2010 10:56:25 a.m. climateprediction.net Temporarily failed upload of hadsm3fub_js4a_006446964_4_1.zip: HTTP error
                                                                                                                                                    4/03/2010 10:56:25 a.m. climateprediction.net Backing off 3 hr 57 min 22 sec on upload of hadsm3fub_js4a_006446964_4_1.zip
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #1 seems to be dead!
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Closing connection #1
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: timeout on name lookup is not supported
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: About to connect() to www.google.com port 80 (#0)
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Trying 66.249.89.147...
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connected to www.google.com (66.249.89.147) port 80 (#0)
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Sent header to server: GET / HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: www.google.com
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded


                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: HTTP/1.1 302 Found

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Location: http://www.google.co.nz/

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Cache-Control: private

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Content-Type: text/html; charset=UTF-8

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: PREF=ID=758c7ab3022b4f76:TM=1267653400:LM=1267653400:S=IegMyJDAtlwLT-sP; expires=Fri, 02-Mar-2012 21:56:40 GMT; path=/; domain=.google.com

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: NID=32=WSfjmalllQ6PCotbuvx5hD8Nc-pwMSHg2n4wUrPTTPf4GRJSvJauI6Z0UjPyuEp2i-j6VFl1kK_RxFzvJLu0FPlWl7RCOen5hUkpGpWSY8A5o4j0wYxUGOzVhu27R0t3; expires=Thu, 02-Sep-2010 21:56:40 GMT; path=/; domain=.g
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Date: Wed, 03 Mar 2010 21:56:40 GMT

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Server: gws

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Content-Length: 221

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: X-XSS-Protection: 0

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server:

                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Ignoring the response-body
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Expire cleared
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #0 to host www.google.com left intact
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Issue another request to this URL: \'http://www.google.co.nz/\'
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #2 seems to be dead!
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Expire cleared
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Closing connection #2
                                                                                                                                                    4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: timeout on name lookup is not supported
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: About to connect() to www.google.co.nz port 80 (#1)
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Trying 66.249.89.99...
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Connected to www.google.co.nz (66.249.89.99) port 80 (#1)
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Sent header to server: GET / HTTP/1.1
                                                                                                                                                    User-Agent: BOINC client (windows_x86_64 6.10.18)
                                                                                                                                                    Host: www.google.co.nz
                                                                                                                                                    Accept: */*
                                                                                                                                                    Accept-Encoding: deflate, gzip
                                                                                                                                                    Referer: http://www.google.com/
                                                                                                                                                    Content-Type: application/x-www-form-urlencoded


                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: HTTP/1.1 200 OK

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Date: Wed, 03 Mar 2010 21:56:41 GMT

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Expires: -1

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Cache-Control: private, max-age=0

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Content-Type: text/html; charset=ISO-8859-1

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: PREF=ID=c0005340c7584f40:TM=1267653401:LM=1267653401:S=4Uc0brAE-Gtg0PmW; expires=Fri, 02-Mar-2012 21:56:41 GMT; path=/; domain=.google.co.nz

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: NID=32=G6coVJD2jgbV9W1KVvTjk4jvkmyu0staPYKgowoG5dv49wWjKDVY3fk0RJgAkZt-iyHqnTpR5mVaP-bE1QXvjxHo87EEaNR3n9KISx1xIrzCnC-492Eqp_1QoOrTSBQf; expires=Thu, 02-Sep-2010 21:56:41 GMT; path=/; domain=.g
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Server: gws

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: X-XSS-Protection: 0

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Transfer-Encoding: chunked

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server:

                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 832 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 387 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1425 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 573 bytes
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Expire cleared
                                                                                                                                                    4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Connection #1 to host www.google.co.nz left intact
                                                                                                                                                    4/03/2010 10:56:28 a.m. Internet access OK - project servers may be temporarily down.
                                                                                                                                                    ____________

                                                                                                                                                    Richard Haselgrove
                                                                                                                                                    Send message
                                                                                                                                                    Joined: Jan 1 07
                                                                                                                                                    Posts: 299
                                                                                                                                                    Credit: 6,878,929
                                                                                                                                                    RAC: 44
                                                                                                                                                    Message 39136 - Posted 3 Mar 2010 22:50:36 UTC

                                                                                                                                                      Out of that lot, the significant bits are:

                                                                                                                                                      4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Received header from server: HTTP/1.1 100 Continue
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Expire cleared
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Closing connection #0
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached

                                                                                                                                                      4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Received header from server: HTTP/1.1 100 Continue
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Expire cleared
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Closing connection #3
                                                                                                                                                      4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached

                                                                                                                                                      (there are two uploads going on at once, so I\'ve swapped the order round a bit)

                                                                                                                                                      I wonder whether the people with AVG would have seen the same thing?

                                                                                                                                                      MartinNZ
                                                                                                                                                      Send message
                                                                                                                                                      Joined: Mar 22 06
                                                                                                                                                      Posts: 97
                                                                                                                                                      Credit: 8,714,193
                                                                                                                                                      RAC: 4,700
                                                                                                                                                      Message 39137 - Posted 4 Mar 2010 0:53:52 UTC

                                                                                                                                                        Currently zipped files are in the process of uploading.

                                                                                                                                                        This looks to be another AV issue.

                                                                                                                                                        Following Richards last post, I thought I\'d uninstall ESET ESS and see what happened. Previously I had disabled (from within ESS) the actions that are likely to block the uploads, but that didn\'t make any difference.

                                                                                                                                                        Currently BOINC is working through the upload files. Windows firewall is on, but no AV software. Obvously I\'m not going to hang around in this state for too long!!!

                                                                                                                                                        Now this is two sets of AV software that are blocking the uploads, but not everyone is having the same issues. E.g. transient states below that he uses the same AV software as me with no problems.

                                                                                                                                                        The AVG people said it was an upgrade, but in my case, I\'m running the same version that I was in Jan. Obviously virus definitions come through on a regular basis, and with most AV software this will include an update to dodgy sites, and I assume ESET ESS is the same. I\'ll post a message on the Wilders Security Forum (semi official ESET forum) and come back with any results.

                                                                                                                                                        Do the conspiracy theorists amongst us have any thoughts???

                                                                                                                                                        Regards,
                                                                                                                                                        Martin
                                                                                                                                                        ____________

                                                                                                                                                        Profile Thyme Lawn
                                                                                                                                                        Forum moderator
                                                                                                                                                        Send message
                                                                                                                                                        Joined: Aug 5 04
                                                                                                                                                        Posts: 1232
                                                                                                                                                        Credit: 10,395,396
                                                                                                                                                        RAC: 1,139
                                                                                                                                                        Message 39139 - Posted 4 Mar 2010 7:47:26 UTC - in response to Message 39137.

                                                                                                                                                          Do the conspiracy theorists amongst us have any thoughts???

                                                                                                                                                          I wouldn\'t class myself as a conspiracy theorist, but the messages Richard extracted from your full set indicate the file content was being blocked somewhere. The \'100 Continue\' message indicates that the server is ready to accept the file content, and the next http_debug message should be \'200 OK\' when the transfer is completed (as below from one of my systems).

                                                                                                                                                          04/03/2010 07:13:24 [http_debug] [ID#11] Received header from server: HTTP/1.1 100 Continue
                                                                                                                                                          04/03/2010 07:16:16 [http_debug] [ID#11] Received header from server: HTTP/1.1 200 OK

                                                                                                                                                          Your \'Operation too slow\' and \'Timeout was reached\' messages indicate that something was blocking the file content, and the successful uploads when you uninstalled ESET ESS appears to be conclusive on what caused that.
                                                                                                                                                          ____________
                                                                                                                                                          "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                                                                                                                                                          MartinNZ
                                                                                                                                                          Send message
                                                                                                                                                          Joined: Mar 22 06
                                                                                                                                                          Posts: 97
                                                                                                                                                          Credit: 8,714,193
                                                                                                                                                          RAC: 4,700
                                                                                                                                                          Message 39140 - Posted 4 Mar 2010 10:24:13 UTC

                                                                                                                                                            All my files have now uploaded with ESET ESS uninstalled. Indeed, it does seem that something ESET related is blocking the uploads. Odd though as had ESET for over 2 years and BOINC longer. I installed and uninstalled ESET a few times and the results were consistant.

                                                                                                                                                            Given the very public nature of the Wilders forum, I decided not to post there for the moment, but go direct to the NZ agent who has been helpful in the past. They asked for and I\'ve sent them a log file from both ESET and BOINC, so hopefully something will be tracked down. I\'ll keep you posted.

                                                                                                                                                            Thanks for the help so far. Guess I now reinstall ESET until either this is solved or more files stack up.

                                                                                                                                                            Regards, Martin
                                                                                                                                                            ____________

                                                                                                                                                            Lockleys
                                                                                                                                                            Send message
                                                                                                                                                            Joined: Jan 13 07
                                                                                                                                                            Posts: 126
                                                                                                                                                            Credit: 4,239,086
                                                                                                                                                            RAC: 1,288
                                                                                                                                                            Message 39141 - Posted 4 Mar 2010 10:36:12 UTC

                                                                                                                                                              Did you try just rebooting in Safe Mode with Networking? In case of future stuck uploads, this might be simpler than uninstalling and reinstalling ESET. It worked for me with the AVG problem.

                                                                                                                                                              MartinNZ
                                                                                                                                                              Send message
                                                                                                                                                              Joined: Mar 22 06
                                                                                                                                                              Posts: 97
                                                                                                                                                              Credit: 8,714,193
                                                                                                                                                              RAC: 4,700
                                                                                                                                                              Message 39142 - Posted 4 Mar 2010 11:23:04 UTC - in response to Message 39141.

                                                                                                                                                                Did you try just rebooting in Safe Mode with Networking? In case of future stuck uploads, this might be simpler than uninstalling and reinstalling ESET. It worked for me with the AVG problem.


                                                                                                                                                                I run BOINC as a service and only limited system services run in Safe Mode - well not that I could get it going anyway. Thanks for the thought though.

                                                                                                                                                                Regards, Martin
                                                                                                                                                                ____________

                                                                                                                                                                MartinNZ
                                                                                                                                                                Send message
                                                                                                                                                                Joined: Mar 22 06
                                                                                                                                                                Posts: 97
                                                                                                                                                                Credit: 8,714,193
                                                                                                                                                                RAC: 4,700
                                                                                                                                                                Message 39150 - Posted 5 Mar 2010 2:50:19 UTC

                                                                                                                                                                  Last modified: 5 Mar 2010 2:51:45 UTC

                                                                                                                                                                  AV update. This may have relevance to other AV software as well.

                                                                                                                                                                  The NZ distributor of ESET has studied the logs from both pieces of software and yes, it looks as though ESET ESS was blocking access to the upload servers.

                                                                                                                                                                  Now this was NOT because of a blacklisting list sent by ESET, but by the AV defense mechanism assuming something nasty was going on. To take a sample log from ESET:
                                                                                                                                                                  Packet blocked by active defence (IDS) 163.1.124.170:80

                                                                                                                                                                  It is interesting that several people noticed similar things going on with different pieces of AV software, and at the same time - when the server was down (let\'s just ignore the fact that servers have been down before without this problem.)

                                                                                                                                                                  My theory is that the AV software saw repeated demands to upload the same piece of data to the same server ad nauseam as pretty suspicious so blacklisted the upload server - and quite rightly so. This is just a theory, but it does seem fairly plausible. If correct, this may happen more often as PCs get faster and more and more packets of data are queuing up when something goes wrong (I ended up with 24 zip files).

                                                                                                                                                                  That said, there are some inconsistencies with ESET ESS that may not be ironed out until the problem occurs again. E.g. the ESET firewall settings showed no signs of the blacklisted sites, but that was after a reinstallation after all the BOINC files had been uploaded.

                                                                                                                                                                  ESET are still working on it for me and it may be that if the sites get blacklisted that can be reversed. Or, they can be added to a white list that doesn\'t get overridden by the active defence. Problem is most people wouldn\'t have a clue what to do or how to track down the problem, or even have the time to do it.

                                                                                                                                                                  If (cough, when) the server goes down again, I suppose turning off BOINC network access may stop the AV software getting suspicious - if we spot it in time.

                                                                                                                                                                  More will be posted as it comes to hand.
                                                                                                                                                                  Martin
                                                                                                                                                                  ____________

                                                                                                                                                                  Les Bayliss
                                                                                                                                                                  Forum moderator
                                                                                                                                                                  Send message
                                                                                                                                                                  Joined: Sep 5 04
                                                                                                                                                                  Posts: 5409
                                                                                                                                                                  Credit: 8,958,344
                                                                                                                                                                  RAC: 1,679
                                                                                                                                                                  Message 39154 - Posted 5 Mar 2010 9:45:33 UTC

                                                                                                                                                                    Thanks for that Martin.
                                                                                                                                                                    Having the network access set to OFF is a good idea for those that can do so.
                                                                                                                                                                    A web site white listing option would be good for ALL AVs, I think.

                                                                                                                                                                    Profile mo.v
                                                                                                                                                                    Forum moderator
                                                                                                                                                                    Avatar
                                                                                                                                                                    Send message
                                                                                                                                                                    Joined: Sep 29 04
                                                                                                                                                                    Posts: 2359
                                                                                                                                                                    Credit: 7,107,484
                                                                                                                                                                    RAC: 3,869
                                                                                                                                                                    Message 39155 - Posted 5 Mar 2010 9:48:13 UTC

                                                                                                                                                                      Martin, thanks very much for contacting ESET and for your + their investigations.
                                                                                                                                                                      ____________
                                                                                                                                                                      Cpdn news

                                                                                                                                                                      John
                                                                                                                                                                      Send message
                                                                                                                                                                      Joined: Feb 16 06
                                                                                                                                                                      Posts: 7
                                                                                                                                                                      Credit: 1,669,956
                                                                                                                                                                      RAC: 0
                                                                                                                                                                      Message 39157 - Posted 5 Mar 2010 13:21:59 UTC

                                                                                                                                                                        I\'ve had a chance to do a bit more investigation...

                                                                                                                                                                        It\'s not necessary to reboot in safe mode to get the transfer to go through, but it does seem to be necessary to temporarily disable the following AVG components

                                                                                                                                                                        * Link Scanner (all three checkboxes)
                                                                                                                                                                        * Web Shield (just the \"Enable Web Shield\" checkbox)
                                                                                                                                                                        * Resident Shield (just the \"Resident Shield active\" checkbox)

                                                                                                                                                                        If any of these is still enabled then the behaviour is that, when a transfer starts, it very rapidly (a few seconds) runs through to 100% (much too fast to be real data transfer). At the same time data *starts* uploading from the PC (you can see this in Task Manager). After a period (maybe 5-10 minutes, but I haven\'t timed it), the Transfer switches back from \"Uploading\" to \"Retry in hh:mm:ss\". Data continues flowing from the PC for a further few minutes.

                                                                                                                                                                        I think a plausible explanation is that there are several different AVG components which need to inspect network traffic. If any of these is enabled, AVG installs a transparent proxy which accepts the upload, temporarily storing it locally, and starts transferring it to the destination (perhaps inspecting it in the process). A consequence of this, however, is that after BOINC has transferred all the data (in fact to a local cache, but it doesn\'t know this) there is then a period of 15 minutes or so when it sees no traffic before the response from climateprediction.net is received. This is long enough for BOINC to time out and think the transfer has failed.

                                                                                                                                                                        Lockleys
                                                                                                                                                                        Send message
                                                                                                                                                                        Joined: Jan 13 07
                                                                                                                                                                        Posts: 126
                                                                                                                                                                        Credit: 4,239,086
                                                                                                                                                                        RAC: 1,288
                                                                                                                                                                        Message 39158 - Posted 5 Mar 2010 15:00:02 UTC - in response to Message 39157.

                                                                                                                                                                          I\'ve had a chance to do a bit more investigation...

                                                                                                                                                                          It\'s not necessary to reboot in safe mode to get the transfer to go through, but it does seem to be necessary to temporarily disable the following AVG components

                                                                                                                                                                          * Link Scanner (all three checkboxes)
                                                                                                                                                                          * Web Shield (just the \"Enable Web Shield\" checkbox)
                                                                                                                                                                          * Resident Shield (just the \"Resident Shield active\" checkbox)

                                                                                                                                                                          If any of these is still enabled then the behaviour is that, when a transfer starts, it very rapidly (a few seconds) runs through to 100% (much too fast to be real data transfer). At the same time data *starts* uploading from the PC (you can see this in Task Manager). After a period (maybe 5-10 minutes, but I haven\'t timed it), the Transfer switches back from \"Uploading\" to \"Retry in hh:mm:ss\". Data continues flowing from the PC for a further few minutes.

                                                                                                                                                                          I think a plausible explanation is that there are several different AVG components which need to inspect network traffic. If any of these is enabled, AVG installs a transparent proxy which accepts the upload, temporarily storing it locally, and starts transferring it to the destination (perhaps inspecting it in the process). A consequence of this, however, is that after BOINC has transferred all the data (in fact to a local cache, but it doesn\'t know this) there is then a period of 15 minutes or so when it sees no traffic before the response from climateprediction.net is received. This is long enough for BOINC to time out and think the transfer has failed.

                                                                                                                                                                          The curious thing to me is that the whole problem is inconsistent. Throughout all this, my computers (I have 4 running CPDN) have never blocked zip uploads for HADSM, only the zips for HADCMs. Apart from that, the symptoms and solutions seem to be identical to those experienced by other crunchers. Puzzling.

                                                                                                                                                                          Richard Haselgrove
                                                                                                                                                                          Send message
                                                                                                                                                                          Joined: Jan 1 07
                                                                                                                                                                          Posts: 299
                                                                                                                                                                          Credit: 6,878,929
                                                                                                                                                                          RAC: 44
                                                                                                                                                                          Message 39159 - Posted 5 Mar 2010 15:15:25 UTC

                                                                                                                                                                            If it\'s a proxy/timeout problem (and John\'s analysis sounds horribly plausible), then it will catch long uploads more than short ones - and the slower your (real) upload speed, the smaller the file which will get throuugh successfully. HadCM uploads are big....

                                                                                                                                                                            Bill H
                                                                                                                                                                            Send message
                                                                                                                                                                            Joined: May 11 07
                                                                                                                                                                            Posts: 36
                                                                                                                                                                            Credit: 1,341,559
                                                                                                                                                                            RAC: 464
                                                                                                                                                                            Message 39160 - Posted 6 Mar 2010 8:23:26 UTC - in response to Message 39158.

                                                                                                                                                                              Last modified: 6 Mar 2010 8:28:30 UTC

                                                                                                                                                                              Yes -I can confirm the inconsistent part. It appears only to have blocked the AM uploads on my PC. I noticed that a recent SM passed through without a problem.

                                                                                                                                                                              Bill H

                                                                                                                                                                              MartinNZ
                                                                                                                                                                              Send message
                                                                                                                                                                              Joined: Mar 22 06
                                                                                                                                                                              Posts: 97
                                                                                                                                                                              Credit: 8,714,193
                                                                                                                                                                              RAC: 4,700
                                                                                                                                                                              Message 39161 - Posted 6 Mar 2010 8:28:49 UTC

                                                                                                                                                                                I\'ve just been sitting here trying all the things ESET suggest the next time uploads were available. Nothing short of uninstalling the software works. Putting exceptions for the uploader IP addresses doen\'t work, nor does telling ESET not to block suspicous behavior.

                                                                                                                                                                                I confirm John\'s observation of the upload behaviour in post 39157, para starting \"If any of these is still enabled...\" However, I\'ve seen this many times before when the server is down. Things then revert to normal when the server comes back on line.

                                                                                                                                                                                This time however things did not revert to normal, yet before the latest server breakdown, I\'ve never had this sort of problem.

                                                                                                                                                                                Also I confirm that small files are CURRENTLY uploading, and I think I spotted a 2MB file uploading. However the 20+MB files are stuck.

                                                                                                                                                                                Back on the 3&4th March when I had large numbers of files stuck in the uploading (21 & 24 respectively), three of them were small 212KB files, and only one (hadam3p #3 212KB) file did sneek through between those two days. Perhaps it was just a question of being in a queue to upload. If I go back to 24 Feb, only files 2.94MB and over were hanging around (no, I don\'t have a brillant memory - took screen dumps.)

                                                                                                                                                                                A couple of things I wonder.

                                                                                                                                                                                1. I\'m using Win7 64bit. What about the others with the problems?
                                                                                                                                                                                2. Could a windows update have effected the AV software?

                                                                                                                                                                                I\'ll get back to ESET with more files on Monday.
                                                                                                                                                                                Till then, Martin

                                                                                                                                                                                ____________

                                                                                                                                                                                Lockleys
                                                                                                                                                                                Send message
                                                                                                                                                                                Joined: Jan 13 07
                                                                                                                                                                                Posts: 126
                                                                                                                                                                                Credit: 4,239,086
                                                                                                                                                                                RAC: 1,288
                                                                                                                                                                                Message 39162 - Posted 6 Mar 2010 8:39:36 UTC - in response to Message 39161.


                                                                                                                                                                                  1. I\'m using Win7 64bit. What about the others with the problems?
                                                                                                                                                                                  2. Could a windows update have effected the AV software?

                                                                                                                                                                                  I too use WIN7 64bit and it\'s kept up to date with updates.
                                                                                                                                                                                  Because I\'m only processing SMs just now, the problem has <gone away>.

                                                                                                                                                                                  MartinNZ
                                                                                                                                                                                  Send message
                                                                                                                                                                                  Joined: Mar 22 06
                                                                                                                                                                                  Posts: 97
                                                                                                                                                                                  Credit: 8,714,193
                                                                                                                                                                                  RAC: 4,700
                                                                                                                                                                                  Message 39163 - Posted 6 Mar 2010 10:04:44 UTC

                                                                                                                                                                                    Band width issues.
                                                                                                                                                                                    My connection is a 5GB per month service which normally suffices. Occasionally and when running the hadam3p tasks, I need to double the data limit and I sneak through.
                                                                                                                                                                                    Rather surprised today to hit my 5GB limit after 8 days!

                                                                                                                                                                                    The following is my data use since a week or so before the server issue:
                                                                                                                                                                                    Date MB
                                                                                                                                                                                    06-Feb-2010 7
                                                                                                                                                                                    07-Feb-2010 27
                                                                                                                                                                                    08-Feb-2010 74
                                                                                                                                                                                    09-Feb-2010 275
                                                                                                                                                                                    10-Feb-2010 272
                                                                                                                                                                                    11-Feb-2010 51
                                                                                                                                                                                    12-Feb-2010 137
                                                                                                                                                                                    13-Feb-2010 62
                                                                                                                                                                                    14-Feb-2010 39
                                                                                                                                                                                    15-Feb-2010 78
                                                                                                                                                                                    16-Feb-2010 54
                                                                                                                                                                                    17-Feb-2010 29
                                                                                                                                                                                    18-Feb-2010 63
                                                                                                                                                                                    19-Feb-2010 91
                                                                                                                                                                                    20-Feb-2010 230
                                                                                                                                                                                    21-Feb-2010 409
                                                                                                                                                                                    22-Feb-2010 369
                                                                                                                                                                                    23-Feb-2010 465
                                                                                                                                                                                    24-Feb-2010 376
                                                                                                                                                                                    25-Feb-2010 267
                                                                                                                                                                                    26-Feb-2010 184
                                                                                                                                                                                    Total 5205 (from 27Jan)

                                                                                                                                                                                    27-Feb-2010 625
                                                                                                                                                                                    28-Feb-2010 459
                                                                                                                                                                                    01-Mar-2010 959
                                                                                                                                                                                    02-Mar-2010 883
                                                                                                                                                                                    03-Mar-2010 768
                                                                                                                                                                                    04-Mar-2010 1155
                                                                                                                                                                                    05-Mar-2010 140
                                                                                                                                                                                    Today 372
                                                                                                                                                                                    Total 5364

                                                                                                                                                                                    The 4 March was when I uploaded all 24 files, hence the large data number. However, given that no data was supposed to be transferred while the server was down from the 20 Feb, the high traffic numbers since then do surprise me.

                                                                                                                                                                                    The inference I draw is that the data is heading out of my system , but for whatever reason, the transfer not being completed. Just something to complicate the picture.

                                                                                                                                                                                    Guess what? Just turned my BOINC network connection off ;-)
                                                                                                                                                                                    ____________

                                                                                                                                                                                    John
                                                                                                                                                                                    Send message
                                                                                                                                                                                    Joined: Feb 16 06
                                                                                                                                                                                    Posts: 7
                                                                                                                                                                                    Credit: 1,669,956
                                                                                                                                                                                    RAC: 0
                                                                                                                                                                                    Message 39164 - Posted 6 Mar 2010 16:16:03 UTC

                                                                                                                                                                                      MartinNZ said...

                                                                                                                                                                                      # Rather surprised today to hit my 5GB limit after 8 days!

                                                                                                                                                                                      I think that\'s to be expected, given my suggested diagnosis... every time an upload fails, 25MB is transferred from your system. 5GB in 8 days is about one failed upload per hour, which could easily happen if you have a few stuck uploads.

                                                                                                                                                                                      If my suggested diagnosis is right, a possible fix would be to increase BOINC\'s upload inactivity timeout... does anyone know whether this is possible?

                                                                                                                                                                                      I\'m running AVG 9.0.733 on Windows XP SP3 (32 bit), by the way.

                                                                                                                                                                                      John
                                                                                                                                                                                      Send message
                                                                                                                                                                                      Joined: Feb 16 06
                                                                                                                                                                                      Posts: 7
                                                                                                                                                                                      Credit: 1,669,956
                                                                                                                                                                                      RAC: 0
                                                                                                                                                                                      Message 39165 - Posted 6 Mar 2010 16:32:00 UTC

                                                                                                                                                                                        Oh... I\'ve just noticed that 9.0.787 is available, and have updated my systems. I won\'t know whether it\'s cured the problem until a WU completes, though.

                                                                                                                                                                                        Profile Thyme Lawn
                                                                                                                                                                                        Forum moderator
                                                                                                                                                                                        Send message
                                                                                                                                                                                        Joined: Aug 5 04
                                                                                                                                                                                        Posts: 1232
                                                                                                                                                                                        Credit: 10,395,396
                                                                                                                                                                                        RAC: 1,139
                                                                                                                                                                                        Message 39166 - Posted 6 Mar 2010 22:43:13 UTC - in response to Message 39164.

                                                                                                                                                                                          If my suggested diagnosis is right, a possible fix would be to increase BOINC\'s upload inactivity timeout... does anyone know whether this is possible?

                                                                                                                                                                                          Afraid not. The 5 minute timeout is fixed.
                                                                                                                                                                                          ____________
                                                                                                                                                                                          "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

                                                                                                                                                                                          Profile [FVG] bax
                                                                                                                                                                                          Send message
                                                                                                                                                                                          Joined: Aug 10 08
                                                                                                                                                                                          Posts: 2
                                                                                                                                                                                          Credit: 596,270
                                                                                                                                                                                          RAC: 0
                                                                                                                                                                                          Message 39171 - Posted 7 Mar 2010 12:55:36 UTC - in response to Message 39157.

                                                                                                                                                                                            I\'ve had a chance to do a bit more investigation...

                                                                                                                                                                                            It\'s not necessary to reboot in safe mode to get the transfer to go through, but it does seem to be necessary to temporarily disable the following AVG components

                                                                                                                                                                                            * Link Scanner (all three checkboxes)
                                                                                                                                                                                            * Web Shield (just the \"Enable Web Shield\" checkbox)
                                                                                                                                                                                            * Resident Shield (just the \"Resident Shield active\" checkbox)


                                                                                                                                                                                            Here I am. Another victim of AVG... solved with this workaround

                                                                                                                                                                                            Thanks ;-)

                                                                                                                                                                                            ____________

                                                                                                                                                                                            MartinNZ
                                                                                                                                                                                            Send message
                                                                                                                                                                                            Joined: Mar 22 06
                                                                                                                                                                                            Posts: 97
                                                                                                                                                                                            Credit: 8,714,193
                                                                                                                                                                                            RAC: 4,700
                                                                                                                                                                                            Message 39226 - Posted 12 Mar 2010 22:35:36 UTC

                                                                                                                                                                                              ESET ESS update. Things now work OK.

                                                                                                                                                                                              Just updated the software to v4.2.35 (first update issued by ESET since Dec 09). For the record, I did a clean install, left all settings on default and used learning mode for the firewall (Win7 64bit).

                                                                                                                                                                                              The large hadam3p files seemed to upload OK on completion with none of the drama I had before.

                                                                                                                                                                                              Will have another hadam3p task completing in 25hrs, so if you don\'t hear from me assume that one went through OK as well.

                                                                                                                                                                                              Given that uploads used to work OK, I suspect a MS update changed something which effected the AV software and that has now been fixed - but who knows. Let\'s hope AVG manage the same.

                                                                                                                                                                                              Thanks for everyone\'s help.

                                                                                                                                                                                              Regards,
                                                                                                                                                                                              Martin

                                                                                                                                                                                              ____________

                                                                                                                                                                                              MartinNZ
                                                                                                                                                                                              Send message
                                                                                                                                                                                              Joined: Mar 22 06
                                                                                                                                                                                              Posts: 97
                                                                                                                                                                                              Credit: 8,714,193
                                                                                                                                                                                              RAC: 4,700
                                                                                                                                                                                              Message 39285 - Posted 22 Mar 2010 9:42:30 UTC

                                                                                                                                                                                                AV & ESET ESS update 2.

                                                                                                                                                                                                There is a memory leak issue with Windows 7 that may affect some AV Software and the way it interacts with the CPDN large file uploads.

                                                                                                                                                                                                Updating to the latest version of ESET ESS allowed the uploads to work correctly as I mention above, but I found that my PC was slowing down considerably. I noticed my AV software process went from typically 4-6M to 117M in Task Manager.

                                                                                                                                                                                                The NZ agent for ESET suggested trying this MS Hot Fix: KB979223

                                                                                                                                                                                                As you will see in the MS notes, it relates to a memory leak originating from a process that may used by AV software to check large files. So far it seems to have fixed the memory leak on my system, just uploaded hadam3p successfully with 2 more not far away.

                                                                                                                                                                                                Regards,
                                                                                                                                                                                                Martin

                                                                                                                                                                                                ____________

                                                                                                                                                                                                Profile mo.v
                                                                                                                                                                                                Forum moderator
                                                                                                                                                                                                Avatar
                                                                                                                                                                                                Send message
                                                                                                                                                                                                Joined: Sep 29 04
                                                                                                                                                                                                Posts: 2359
                                                                                                                                                                                                Credit: 7,107,484
                                                                                                                                                                                                RAC: 3,869
                                                                                                                                                                                                Message 39292 - Posted 22 Mar 2010 13:27:30 UTC

                                                                                                                                                                                                  Thank you, Martin.
                                                                                                                                                                                                  ____________
                                                                                                                                                                                                  Cpdn news

                                                                                                                                                                                                  DJStarfox
                                                                                                                                                                                                  Send message
                                                                                                                                                                                                  Joined: Jan 27 07
                                                                                                                                                                                                  Posts: 262
                                                                                                                                                                                                  Credit: 1,170,691
                                                                                                                                                                                                  RAC: 187
                                                                                                                                                                                                  Message 39297 - Posted 22 Mar 2010 18:27:33 UTC - in response to Message 39285.

                                                                                                                                                                                                    Good link. Should be in the first service pack for win 7, when that comes out.

                                                                                                                                                                                                    I love how MSE takes 150MB RAM and other anti-virus products use that much only if there\'s a memory leak in Windows. LOL

                                                                                                                                                                                                    Lockleys
                                                                                                                                                                                                    Send message
                                                                                                                                                                                                    Joined: Jan 13 07
                                                                                                                                                                                                    Posts: 126
                                                                                                                                                                                                    Credit: 4,239,086
                                                                                                                                                                                                    RAC: 1,288
                                                                                                                                                                                                    Message 39326 - Posted 24 Mar 2010 9:53:20 UTC

                                                                                                                                                                                                      For AVG users, this problem should have been alleviated. Input from AVG was that the problem would be fixed with AVG product updates in version 9.0.785 and I am now on 9.0.791 . If any AVG user is still experiencing the problem, I suggest they escalate it with AVG once more.

                                                                                                                                                                                                      Post to thread

                                                                                                                                                                                                      Message boards : Number crunching : Upload process locked




                                                                                                                                                                                                      Copyright © 2002-2014 climateprediction.net