climateprediction.net home page
Upload process locked

Upload process locked

Message boards : Number crunching : Upload process locked
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Lockleys

Send message
Joined: 13 Jan 07
Posts: 195
Credit: 10,581,566
RAC: 0
Message 39090 - Posted: 28 Feb 2010, 22:01:13 UTC

Turns out there\'s been an AVG Forum thread about this problem since November, mostly populated by people wanting to post large jpegs to webmail servers, but they haven\'t fixed it yet. I\'ve added my post to their thread at
http://forums.avg.com/gb-en/avg-free-forum?sec=thread&act=show&id=67699 .
Perhaps if other CPDNers add their own posts we can get AVG to increase the priority for its resolution. Otherwise, like Les, we\'ll all be looking for an alternative which for me would be a shame as me it\'s generally been pretty good.
ID: 39090 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 39091 - Posted: 1 Mar 2010, 0:34:26 UTC

Congratulations, that\'s brilliant! You must all have been sick of the sight of those stuck files.

If one of you AVG victims would like to start a new thread in Number Crunching called, for example, \'AVG may block large uploads\' and write step-by-step instructions for the solution aimed at non-tech newbies (each step on a new line) we could make it a sticky.

That would be far better than pointing other victims to this now very long thread.
Cpdn news
ID: 39091 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 39095 - Posted: 1 Mar 2010, 3:11:29 UTC

I\'ve made a locked sticky about this, both on these boards, (in Number crunching), and on the alternate forum.
There\'s also a thread in Number crunching for discussion.
Finally, I\'ve made a post in News and Announcements, both here and on the alternate forum.


Backups: Here
ID: 39095 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39115 - Posted: 2 Mar 2010, 22:51:49 UTC

My previous posts on this were here:
Results not uploading

I\'m still sitting with transfers not moving and the list is growing. Those sitting there on 24 Feb are still there. Now 11 results at 0% and 10 at 100%. Have #1,2&3 zip files waiting at 0%, but only #1&2 showing 100%.

I\'m not using AVG, but ESET ESS. Tried sitting with the firewall off, but that makes no difference either.

Any thoughts?

Regards,
Martin
ID: 39115 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2167
Credit: 64,403,322
RAC: 5,085
Message 39118 - Posted: 3 Mar 2010, 1:10:42 UTC
Last modified: 3 Mar 2010, 1:11:15 UTC

Martin,
Did anything change on your PC or network in mid February? New versions of firewall, antivirus, anti-malware? Different networking equipment? Proxy server? Router? Other? ISP change?
ID: 39118 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39119 - Posted: 3 Mar 2010, 5:25:36 UTC - in response to Message 39118.  

Martin,
Did anything change on your PC or network in mid February? New versions of firewall, antivirus, anti-malware? Different networking equipment? Proxy server? Router? Other? ISP change?


Nope to all. Std windows (7) updates only. No updates to AV other than virus definitions. No update to BOINC. Since having the problems have changed the adsl modem, but no difference. Another of the reasons I changed the modem was that I was having problems sending emails. It turned out my ISP (vodafone nz) was having problems with their email system starting 11 Feb, but that was resolved. Related issue?

All models seem to be running OK, & downloads of new tasks keep coming.

Looked at doing the safe mode upload as others have done, but running BOINC as a service & this will not work in safe mode.

Regards,
Martin

ID: 39119 · Report as offensive     Reply Quote
Lockleys

Send message
Joined: 13 Jan 07
Posts: 195
Credit: 10,581,566
RAC: 0
Message 39120 - Posted: 3 Mar 2010, 8:38:09 UTC

The specific routine in AVG which was causing the problem was LinkScanner, which in AVG-speak is the bit that protects you from connecting to dodgy web sites. Obviously, CPDN isn\'t dodgy but the AVG algorithms are not yet sophisticated enough. LinkScanner sits alongside the modules for firewall and virus etc. Does ESAT ESS have something similar?
ID: 39120 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 39121 - Posted: 3 Mar 2010, 9:00:45 UTC - in response to Message 39119.  

Since having the problems have changed the adsl modem, but no difference. Another of the reasons I changed the modem was that I was having problems sending emails. It turned out my ISP (vodafone nz) was having problems with their email system starting 11 Feb, but that was resolved. Related issue?

Probably not Martin. Try creating the file cc_config.xml in your BOINC data directory containing the following:
<cc_config>
<log_flags>
<http_debug>1</http_debug>
<http_xfer_debug>1</http_xfer_debug>
</log_flags>
</cc_config>

Click Advanced - Read config file in BOINC Manager and post the debug messages if you need help. To disable the debug messages either change the values to 0 and reload the config file or delete cc_config.xml and restart BOINC.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 39121 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39122 - Posted: 3 Mar 2010, 10:42:23 UTC - in response to Message 39121.  

Thyme -
Try creating the file cc_config.xml in your BOINC data directory .....

This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
3/03/2010 11:06:42 p.m. Re-read config file
3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

Lockleys -
AVG which was causing the problem was LinkScanner....Does ESET ESS have something similar?

Probably, but I wouldn\'t know. But other than definition updates, I haven\'t updated the software since it was installed in Jan.

Regards,
Martin
ID: 39122 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 39123 - Posted: 3 Mar 2010, 12:18:57 UTC - in response to Message 39122.  

Thyme -
Try creating the file cc_config.xml in your BOINC data directory .....

This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
3/03/2010 11:06:42 p.m. Re-read config file
3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

Check that cc_config.xml has the 6 lines exactly as I posted Martin. Those messages suggest that some or all of the <cc_config> line is missing (e.g. I can force that error if I delete the leading \'<\' from that line of my file).

"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 39123 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 39124 - Posted: 3 Mar 2010, 12:36:27 UTC - in response to Message 39123.  

Thyme -
Try creating the file cc_config.xml in your BOINC data directory .....

This is the output from the BOINC messages (I assume that\'s where I pick them up.) Does it mean anything to you?

3/03/2010 11:06:42 p.m. Re-reading cc_config.xml
3/03/2010 11:06:42 p.m. Missing start tag in cc_config.xml
3/03/2010 11:06:42 p.m. Re-read config file
3/03/2010 11:06:42 p.m. log flags: file_xfer, sched_ops, task

Check that cc_config.xml has the 6 lines exactly as I posted Martin. Those messages suggest that some or all of the <cc_config> line is missing (e.g. I can force that error if I delete the leading \'<\' from that line of my file).
Also check that the file is saved in the simplest possible text format (ANSI, not Unicode)
ID: 39124 · Report as offensive     Reply Quote
transient

Send message
Joined: 3 Oct 06
Posts: 43
Credit: 8,017,057
RAC: 0
Message 39127 - Posted: 3 Mar 2010, 16:59:30 UTC - in response to Message 39120.  

The specific routine in AVG which was causing the problem was LinkScanner, which in AVG-speak is the bit that protects you from connecting to dodgy web sites. Obviously, CPDN isn\'t dodgy but the AVG algorithms are not yet sophisticated enough. LinkScanner sits alongside the modules for firewall and virus etc. Does ESAT ESS have something similar?


I use ESS myself and I do not have \'stuck\' uploads.
ID: 39127 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39134 - Posted: 3 Mar 2010, 22:26:22 UTC - in response to Message 39124.  
Last modified: 3 Mar 2010, 22:37:43 UTC

Richard -
Also check that the file is saved in the simplest possible text format (ANSI, not Unicode)

Was saved as UTF-8. Now works when saved as ANSI - thanks.

Quick update of activity. I notice that one #3 zip file has been uploaded since yesterday. Also 5 files that were showing as 100% uploaded now showing as 0% uploaded. Now a total of 24 files waiting to finish uploading.

Should I stop downloading new tasks until this is sorted?

Typical selection of BOINC messages around a couple of failures follow. Do these provide any clues?
Regards,
Martin

Update: Messages added from 4/03/2010 10:56:26 am. These point to some sort of comms failure. BTW have reverted to my original adsl modem, so unless I have two dud modems, that should not be an issue.

4/03/2010 10:51:16 a.m. climateprediction.net Started upload of hadam3p_nij5_1999_2_006562491_3_1.zip
4/03/2010 10:51:16 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle \'C:\\Program Files\\BOINC\\ca-bundle.crt\'
4/03/2010 10:51:16 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
4/03/2010 10:51:16 a.m. climateprediction.net Started upload of hadsm3fub_js4a_006446964_4_1.zip
4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: timeout on name lookup is not supported
4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#0)
4/03/2010 10:51:16 a.m. [http_debug] [ID#15] info: Trying 163.1.124.170...
4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: timeout on name lookup is not supported
4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#3)
4/03/2010 10:51:16 a.m. [http_debug] [ID#16] info: Trying 163.1.124.170...
4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0)
4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: uploader.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 291


4/03/2010 10:51:17 a.m. [http_debug] [ID#16] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#3)
4/03/2010 10:51:17 a.m. [http_debug] [ID#16] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: uploader.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 286


4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: HTTP/1.1 200 OK

4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Date: Wed, 03 Mar 2010 23:51:21 GMT

4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Server: Apache/2.2.13 (Linux/SUSE)

4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Transfer-Encoding: chunked

4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server: Content-Type: text/plain

4/03/2010 10:51:17 a.m. [http_debug] [ID#15] Received header from server:

4/03/2010 10:51:17 a.m. [http_xfer_debug] HTTP: wrote 93 bytes
4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Expire cleared
4/03/2010 10:51:17 a.m. [http_debug] [ID#15] info: Connection #0 to host uploader.oerc.ox.ac.uk left intact
4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: HTTP/1.1 200 OK

4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Date: Wed, 03 Mar 2010 23:51:21 GMT

4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Server: Apache/2.2.13 (Linux/SUSE)

4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Transfer-Encoding: chunked

4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server: Content-Type: text/plain

4/03/2010 10:51:18 a.m. [http_debug] [ID#16] Received header from server:

4/03/2010 10:51:18 a.m. [http_xfer_debug] HTTP: wrote 93 bytes
4/03/2010 10:51:18 a.m. [http_debug] [ID#16] info: Expire cleared
4/03/2010 10:51:18 a.m. [http_debug] [ID#16] info: Connection #3 to host uploader.oerc.ox.ac.uk left intact
4/03/2010 10:51:18 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
4/03/2010 10:51:18 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Re-using existing connection! (#0) with host uploader.oerc.ox.ac.uk
4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0)
4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Re-using existing connection! (#3) with host uploader.oerc.ox.ac.uk
4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#3)
4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: uploader.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 26423641
Expect: 100-continue


4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: uploader.oerc.ox.ac.uk
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded
Content-Length: 3084657
Expect: 100-continue


4/03/2010 10:51:19 a.m. [http_debug] [ID#17] info: Expire cleared
4/03/2010 10:51:19 a.m. [http_debug] [ID#18] info: Expire cleared
4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Received header from server: HTTP/1.1 100 Continue

4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Received header from server: HTTP/1.1 100 Continue

4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Expire cleared
4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Closing connection #0
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Expire cleared
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Closing connection #3
4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached
4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached
4/03/2010 10:56:25 a.m. Project communication failed: attempting access to reference site
4/03/2010 10:56:25 a.m. [http_debug] HTTP_OP::init_get(): http://www.google.com/
4/03/2010 10:56:25 a.m. [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set
4/03/2010 10:56:25 a.m. climateprediction.net Temporarily failed upload of hadam3p_nij5_1999_2_006562491_3_1.zip: HTTP error
4/03/2010 10:56:25 a.m. climateprediction.net Backing off 49 min 17 sec on upload of hadam3p_nij5_1999_2_006562491_3_1.zip
4/03/2010 10:56:25 a.m. climateprediction.net Temporarily failed upload of hadsm3fub_js4a_006446964_4_1.zip: HTTP error
4/03/2010 10:56:25 a.m. climateprediction.net Backing off 3 hr 57 min 22 sec on upload of hadsm3fub_js4a_006446964_4_1.zip
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #1 seems to be dead!
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Closing connection #1
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: timeout on name lookup is not supported
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: About to connect() to www.google.com port 80 (#0)
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Trying 66.249.89.147...
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connected to www.google.com (66.249.89.147) port 80 (#0)
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Sent header to server: GET / HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: www.google.com
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded


4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: HTTP/1.1 302 Found

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Location: http://www.google.co.nz/

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Cache-Control: private

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Content-Type: text/html; charset=UTF-8

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: PREF=ID=758c7ab3022b4f76:TM=1267653400:LM=1267653400:S=IegMyJDAtlwLT-sP; expires=Fri, 02-Mar-2012 21:56:40 GMT; path=/; domain=.google.com

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: NID=32=WSfjmalllQ6PCotbuvx5hD8Nc-pwMSHg2n4wUrPTTPf4GRJSvJauI6Z0UjPyuEp2i-j6VFl1kK_RxFzvJLu0FPlWl7RCOen5hUkpGpWSY8A5o4j0wYxUGOzVhu27R0t3; expires=Thu, 02-Sep-2010 21:56:40 GMT; path=/; domain=.g
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Date: Wed, 03 Mar 2010 21:56:40 GMT

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Server: gws

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: Content-Length: 221

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server: X-XSS-Protection: 0

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] Received header from server:

4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Ignoring the response-body
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Expire cleared
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #0 to host www.google.com left intact
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Issue another request to this URL: \'http://www.google.co.nz/\'
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Connection #2 seems to be dead!
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Expire cleared
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: Closing connection #2
4/03/2010 10:56:26 a.m. [http_debug] [ID#19] info: timeout on name lookup is not supported
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: About to connect() to www.google.co.nz port 80 (#1)
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Trying 66.249.89.99...
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Connected to www.google.co.nz (66.249.89.99) port 80 (#1)
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Sent header to server: GET / HTTP/1.1
User-Agent: BOINC client (windows_x86_64 6.10.18)
Host: www.google.co.nz
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://www.google.com/
Content-Type: application/x-www-form-urlencoded


4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: HTTP/1.1 200 OK

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Date: Wed, 03 Mar 2010 21:56:41 GMT

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Expires: -1

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Cache-Control: private, max-age=0

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Content-Type: text/html; charset=ISO-8859-1

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: PREF=ID=c0005340c7584f40:TM=1267653401:LM=1267653401:S=4Uc0brAE-Gtg0PmW; expires=Fri, 02-Mar-2012 21:56:41 GMT; path=/; domain=.google.co.nz

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Set-Cookie: NID=32=G6coVJD2jgbV9W1KVvTjk4jvkmyu0staPYKgowoG5dv49wWjKDVY3fk0RJgAkZt-iyHqnTpR5mVaP-bE1QXvjxHo87EEaNR3n9KISx1xIrzCnC-492Eqp_1QoOrTSBQf; expires=Thu, 02-Sep-2010 21:56:41 GMT; path=/; domain=.g
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Server: gws

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: X-XSS-Protection: 0

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server: Transfer-Encoding: chunked

4/03/2010 10:56:27 a.m. [http_debug] [ID#19] Received header from server:

4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 832 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 387 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1425 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 1430 bytes
4/03/2010 10:56:27 a.m. [http_xfer_debug] HTTP: wrote 573 bytes
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Expire cleared
4/03/2010 10:56:27 a.m. [http_debug] [ID#19] info: Connection #1 to host www.google.co.nz left intact
4/03/2010 10:56:28 a.m. Internet access OK - project servers may be temporarily down.
ID: 39134 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 39136 - Posted: 3 Mar 2010, 22:50:36 UTC

Out of that lot, the significant bits are:

4/03/2010 10:51:19 a.m. [http_debug] [ID#17] Received header from server: HTTP/1.1 100 Continue
4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Expire cleared
4/03/2010 10:56:25 a.m. [http_debug] [ID#17] info: Closing connection #0
4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached

4/03/2010 10:51:19 a.m. [http_debug] [ID#18] Received header from server: HTTP/1.1 100 Continue
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Operation too slow. Less than 10 bytes/sec transfered the last 300 seconds
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Expire cleared
4/03/2010 10:56:25 a.m. [http_debug] [ID#18] info: Closing connection #3
4/03/2010 10:56:25 a.m. [http_debug] HTTP error: Timeout was reached

(there are two uploads going on at once, so I\'ve swapped the order round a bit)

I wonder whether the people with AVG would have seen the same thing?
ID: 39136 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39137 - Posted: 4 Mar 2010, 0:53:52 UTC

Currently zipped files are in the process of uploading.

This looks to be another AV issue.

Following Richards last post, I thought I\'d uninstall ESET ESS and see what happened. Previously I had disabled (from within ESS) the actions that are likely to block the uploads, but that didn\'t make any difference.

Currently BOINC is working through the upload files. Windows firewall is on, but no AV software. Obvously I\'m not going to hang around in this state for too long!!!

Now this is two sets of AV software that are blocking the uploads, but not everyone is having the same issues. E.g. transient states below that he uses the same AV software as me with no problems.

The AVG people said it was an upgrade, but in my case, I\'m running the same version that I was in Jan. Obviously virus definitions come through on a regular basis, and with most AV software this will include an update to dodgy sites, and I assume ESET ESS is the same. I\'ll post a message on the Wilders Security Forum (semi official ESET forum) and come back with any results.

Do the conspiracy theorists amongst us have any thoughts???

Regards,
Martin
ID: 39137 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 39139 - Posted: 4 Mar 2010, 7:47:26 UTC - in response to Message 39137.  

Do the conspiracy theorists amongst us have any thoughts???

I wouldn\'t class myself as a conspiracy theorist, but the messages Richard extracted from your full set indicate the file content was being blocked somewhere. The \'100 Continue\' message indicates that the server is ready to accept the file content, and the next http_debug message should be \'200 OK\' when the transfer is completed (as below from one of my systems).

04/03/2010 07:13:24 [http_debug] [ID#11] Received header from server: HTTP/1.1 100 Continue
04/03/2010 07:16:16 [http_debug] [ID#11] Received header from server: HTTP/1.1 200 OK

Your \'Operation too slow\' and \'Timeout was reached\' messages indicate that something was blocking the file content, and the successful uploads when you uninstalled ESET ESS appears to be conclusive on what caused that.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 39139 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39140 - Posted: 4 Mar 2010, 10:24:13 UTC

All my files have now uploaded with ESET ESS uninstalled. Indeed, it does seem that something ESET related is blocking the uploads. Odd though as had ESET for over 2 years and BOINC longer. I installed and uninstalled ESET a few times and the results were consistant.

Given the very public nature of the Wilders forum, I decided not to post there for the moment, but go direct to the NZ agent who has been helpful in the past. They asked for and I\'ve sent them a log file from both ESET and BOINC, so hopefully something will be tracked down. I\'ll keep you posted.

Thanks for the help so far. Guess I now reinstall ESET until either this is solved or more files stack up.

Regards, Martin
ID: 39140 · Report as offensive     Reply Quote
Lockleys

Send message
Joined: 13 Jan 07
Posts: 195
Credit: 10,581,566
RAC: 0
Message 39141 - Posted: 4 Mar 2010, 10:36:12 UTC

Did you try just rebooting in Safe Mode with Networking? In case of future stuck uploads, this might be simpler than uninstalling and reinstalling ESET. It worked for me with the AVG problem.
ID: 39141 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39142 - Posted: 4 Mar 2010, 11:23:04 UTC - in response to Message 39141.  

Did you try just rebooting in Safe Mode with Networking? In case of future stuck uploads, this might be simpler than uninstalling and reinstalling ESET. It worked for me with the AVG problem.


I run BOINC as a service and only limited system services run in Safe Mode - well not that I could get it going anyway. Thanks for the thought though.

Regards, Martin
ID: 39142 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 39150 - Posted: 5 Mar 2010, 2:50:19 UTC
Last modified: 5 Mar 2010, 2:51:45 UTC

AV update. This may have relevance to other AV software as well.

The NZ distributor of ESET has studied the logs from both pieces of software and yes, it looks as though ESET ESS was blocking access to the upload servers.

Now this was NOT because of a blacklisting list sent by ESET, but by the AV defense mechanism assuming something nasty was going on. To take a sample log from ESET:
Packet blocked by active defence (IDS) 163.1.124.170:80

It is interesting that several people noticed similar things going on with different pieces of AV software, and at the same time - when the server was down (let\'s just ignore the fact that servers have been down before without this problem.)

My theory is that the AV software saw repeated demands to upload the same piece of data to the same server ad nauseam as pretty suspicious so blacklisted the upload server - and quite rightly so. This is just a theory, but it does seem fairly plausible. If correct, this may happen more often as PCs get faster and more and more packets of data are queuing up when something goes wrong (I ended up with 24 zip files).

That said, there are some inconsistencies with ESET ESS that may not be ironed out until the problem occurs again. E.g. the ESET firewall settings showed no signs of the blacklisted sites, but that was after a reinstallation after all the BOINC files had been uploaded.

ESET are still working on it for me and it may be that if the sites get blacklisted that can be reversed. Or, they can be added to a white list that doesn\'t get overridden by the active defence. Problem is most people wouldn\'t have a clue what to do or how to track down the problem, or even have the time to do it.

If (cough, when) the server goes down again, I suppose turning off BOINC network access may stop the AV software getting suspicious - if we spot it in time.

More will be posted as it comes to hand.
Martin
ID: 39150 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Number crunching : Upload process locked

©2024 climateprediction.net