climateprediction.net home page
Trickles and downloads working. Zip uploads not

Trickles and downloads working. Zip uploads not

Questions and Answers : Windows : Trickles and downloads working. Zip uploads not
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30273 - Posted: 29 Aug 2007, 18:46:30 UTC

I have recently (last week) changed from Boinc 4.45 to version 5. I am having this problem with 3 different versions of 5. I am now on version 5.10.13 having also tried 5.2.13 and 5.4.11. I connect through a HTTP Proxy and this information has been carried through from the previous config and has been double checked.

At the same time as upgrading Boinc I have started using BAM as my account manager. This is also giving trouble as I can logon through the webpage but it fails in Boinc.
I also have trouble connectings to any new projects like Rosetta and uFluids.
I realise I am probably confusing the issue but thought there may be a related issue.

ID: 30273 · Report as offensive     Reply Quote
Profile MikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 30276 - Posted: 29 Aug 2007, 19:59:23 UTC


The most likely problem is that you\'re connecting through a proxy server. Boinc doesn\'t cope with proxy servers very well.

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 30276 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 30287 - Posted: 30 Aug 2007, 7:37:37 UTC - in response to Message 30276.  

Boinc doesn\'t cope with proxy servers very well.

Not quite true. I\'m only aware of BOINC having a problem with proxy servers using NTLM authentication, but a CPDN user who was affected by that problem has confirmed to me that it was fixed for him in 5.10.13.

The best way I know of diagnosing what\'s causing the problem is to install the freeware network protocol analyser Wireshark and use it to trace the HTTP packets between BOINC and the proxy server.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 30287 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,265,043
RAC: 10,950
Message 30288 - Posted: 30 Aug 2007, 8:31:36 UTC - in response to Message 30287.  

Boinc doesn\'t cope with proxy servers very well.

Not quite true. I\'m only aware of BOINC having a problem with proxy servers using NTLM authentication, but a CPDN user who was affected by that problem has confirmed to me that it was fixed for him in 5.10.13.

The best way I know of diagnosing what\'s causing the problem is to install the freeware network protocol analyser Wireshark and use it to trace the HTTP packets between BOINC and the proxy server.

Thyme,

This issue of the proxy servers keeps re-surfacing at SETI@home, so much so that I recently accused it of being an Urban Myth and got shot down in flames for doing so.

It\'s particularly significant at SETI because the claim is that people have to drop all the way back to BOINC v4.45 if they use a proxy, and v4.45 doesn\'t handle the newer \'FLOPs count\' credit claim used at SETI. SETI crunchers are very, very sensitive about their credits, as you may know.

If you could possibly give me full chapter and verse on that v5.10.13 proxy success (proxy server in use, any special settings needed, reference from the satisfied customer - that sort of thing), so that I could take it back to SETI with some better authority, I\'d be really grateful.
ID: 30288 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30294 - Posted: 30 Aug 2007, 13:48:14 UTC - in response to Message 30288.  

I\'ll give Wireshark a go. See if it uncovers anything.
The odd thing is that the transfer seems to initially work ok. It goes all the way from 0 to 100%. Then it fails once it hits the 100% mark. All the time I can see the network activity (in and out) in the connection status icon on the system tray as though all is ok.

ID: 30294 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 30296 - Posted: 30 Aug 2007, 18:09:45 UTC - in response to Message 30288.  

This issue of the proxy servers keeps re-surfacing at SETI@home, so much so that I recently accused it of being an Urban Myth and got shot down in flames for doing so.

Why doesn\'t that surprise me? You have my sympathy Richard.
It\'s particularly significant at SETI because the claim is that people have to drop all the way back to BOINC v4.45 if they use a proxy, and v4.45 doesn\'t handle the newer \'FLOPs count\' credit claim used at SETI. SETI crunchers are very, very sensitive about their credits, as you may know.

I\'ve been using BOINC (upgrading regularly but sticking with 5.8.15 for now) via a couple of proxies running Squid for 3 years with no problems. One uses an auto config (proxy.pac) file and the other is an intercepting (aka transparent) proxy, but neither of them require authentication.
If you could possibly give me full chapter and verse on that v5.10.13 proxy success (proxy server in use, any special settings needed, reference from the satisfied customer - that sort of thing), so that I could take it back to SETI with some better authority, I\'d be really grateful.

All I know about the proxy that BOINC 5.10.13 started working with is that it uses standard NTLM authentication, but I\'ll see if I can get more info for you.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 30296 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 30297 - Posted: 30 Aug 2007, 18:40:48 UTC - in response to Message 30294.  

The odd thing is that the transfer seems to initially work ok. It goes all the way from 0 to 100%. Then it fails once it hits the 100% mark. All the time I can see the network activity (in and out) in the connection status icon on the system tray as though all is ok.

Hmmm. That\'s a bit suspicious Tony. The only time I\'ve seen that happen is when there have been problems at the server end, but I\'m not aware of any problems at the moment.

Your computer\'s result list shows that a model failed about 3 hours before your post with the following errors:
<core_client_version>5.10.13</core_client_version>
<![CDATA[
<message>
The system cannot find the path specified. (0x3) - exit code 3 (0x3)
</message>
<stderr_txt>
(null): cannot open input file dataout/atmos_restart.day
(null): cannot open input file dataout/ocean_restart.day

which suggests there might have been problems with your upgrade to 5.10.3 and leads me to suspect that your problem is with downloading the new model rather than uploading.

Could you post the messages BOINC generates for a couple of your transfer failures (you can either copy them directly from the BOINC manager messages tab or from the stdoutdae.txt file in your BOINC directory).
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 30297 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30307 - Posted: 31 Aug 2007, 13:43:22 UTC - in response to Message 30297.  
Last modified: 31 Aug 2007, 13:45:15 UTC

Thanks for taking the time to look at this.
My machine was rebooted this morning. Here are the messages since then including transfer attempts.

8/31/2007 11:52:19 AM||Starting BOINC client version 5.10.13 for windows_intelx86
8/31/2007 11:52:19 AM||log flags: task, file_xfer, sched_ops
8/31/2007 11:52:19 AM||Libraries: libcurl/7.16.1 OpenSSL/0.9.8e zlib/1.2.3
8/31/2007 11:52:19 AM||Data directory: C:\\Program Files\\BOINC
8/31/2007 11:52:21 AM||Processor: 1 GenuineIntel Intel(R) Pentium(R) M processor 1500MHz [x86 Family 6 Model 9 Stepping 5]
8/31/2007 11:52:21 AM||Processor features: fpu tsc sse mmx
8/31/2007 11:52:21 AM||Memory: 1022.92 MB physical, 1.65 GB virtual
8/31/2007 11:52:21 AM||Disk: 34.06 GB total, 2.02 GB free
8/31/2007 11:52:22 AM|climateprediction.net|URL: http://climateprediction.net/; Computer ID: 100390; location: work; project prefs: default
8/31/2007 11:52:22 AM||General prefs: from climateprediction.net (last modified 2005-01-31 18:42:58)
8/31/2007 11:52:22 AM||Host location: work
8/31/2007 11:52:22 AM||General prefs: no separate prefs for work; using your defaults
8/31/2007 11:52:22 AM||Reading preferences override file
8/31/2007 11:52:22 AM||Preferences limit memory usage when active to 511.46MB
8/31/2007 11:52:22 AM||Preferences limit memory usage when idle to 920.63MB
8/31/2007 11:52:22 AM||Preferences limit disk usage to 1.93GB
8/31/2007 11:52:23 AM||Contacting account manager at http://bam.boincstats.com/
8/31/2007 11:52:24 AM|climateprediction.net|[file_xfer] Started upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 11:52:24 AM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544
8/31/2007 11:52:29 AM||Account manager error: 0 User not found!
8/31/2007 11:53:11 AM||Project communication failed: attempting access to reference site
8/31/2007 11:53:11 AM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3pbb_aixv_05765182_1_7.zip: http error
8/31/2007 11:53:11 AM|climateprediction.net|Backing off 2 hr 17 min 4 sec on upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 11:53:25 AM||Access to reference site failed - check network connection or proxy configuration.
8/31/2007 11:56:16 AM|climateprediction.net|Task hadcm3iozn_cpp7_2000_80_35899076_7 exited with zero status but no \'finished\' file
8/31/2007 11:56:16 AM|climateprediction.net|If this happens repeatedly you may need to reset the project.
8/31/2007 11:56:17 AM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544
8/31/2007 2:10:15 PM|climateprediction.net|[file_xfer] Started upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 2:10:56 PM||Project communication failed: attempting access to reference site
8/31/2007 2:10:56 PM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3pbb_aixv_05765182_1_7.zip: http error
8/31/2007 2:10:56 PM|climateprediction.net|Backing off 3 hr 15 min 42 sec on upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 2:11:08 PM||Access to reference site failed - check network connection or proxy configuration.
8/31/2007 2:28:47 PM|climateprediction.net|Sending scheduler request: Requested by user
8/31/2007 2:28:47 PM|climateprediction.net|(not requesting new work or reporting completed tasks)
8/31/2007 2:28:52 PM|climateprediction.net|Scheduler RPC succeeded [server version 509]



You mentioned that there may have been a problem during the install.
Firstly I noticed that I could not upgrade directly from 4.45 to 5.10.13 because the 5MB install did not install a boinc.exe. There were no install errors but the boinc manager shortcuts pointed at nothing.
However by installing an earlier minor version of 5 I could then install 5.10 but the install gave the error \"Could not unregister boinc.dll\"

I am only short of completely uninstalling, rebooting and reinstalling.
However I am reluctant to do so as the project has downloaded new work.

Please let me know the proper course of action if these steps are necessary.

Thanks

ID: 30307 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 30311 - Posted: 31 Aug 2007, 16:50:59 UTC - in response to Message 30307.  

OK, the messages highlight a number of problems. I\'ve changed the order slightly so I can deal with each of them separately.
8/31/2007 11:52:23 AM||Contacting account manager at http://bam.boincstats.com/
8/31/2007 11:52:29 AM||Account manager error: 0 User not found!

I don\'t run an account manager so can\'t be absolutely sure what this means, but my guess would be that you failed to contact the BAM server or there\'s a problem with the setup at your end.
8/31/2007 11:52:24 AM|climateprediction.net|[file_xfer] Started upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 11:52:24 AM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544
8/31/2007 11:53:11 AM||Project communication failed: attempting access to reference site
8/31/2007 11:53:11 AM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3pbb_aixv_05765182_1_7.zip: http error
8/31/2007 11:53:11 AM|climateprediction.net|Backing off 2 hr 17 min 4 sec on upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 11:53:25 AM||Access to reference site failed - check network connection or proxy configuration.
8/31/2007 2:10:15 PM|climateprediction.net|[file_xfer] Started upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 2:10:56 PM||Project communication failed: attempting access to reference site
8/31/2007 2:10:56 PM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3pbb_aixv_05765182_1_7.zip: http error
8/31/2007 2:10:56 PM|climateprediction.net|Backing off 3 hr 15 min 42 sec on upload of file hadcm3pbb_aixv_05765182_1_7.zip
8/31/2007 2:11:08 PM||Access to reference site failed - check network connection or proxy configuration.

Two upload attempts (of a zip file for the model that crashed on Wednesday) failed and both times BOINC\'s network connection check (can I get to google.com) failed.
8/31/2007 11:56:16 AM|climateprediction.net|Task hadcm3iozn_cpp7_2000_80_35899076_7 exited with zero status but no \'finished\' file
8/31/2007 11:56:16 AM|climateprediction.net|If this happens repeatedly you may need to reset the project.
8/31/2007 11:56:17 AM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544

Something caused the model to automatically restart.
8/31/2007 2:28:47 PM|climateprediction.net|Sending scheduler request: Requested by user
8/31/2007 2:28:47 PM|climateprediction.net|(not requesting new work or reporting completed tasks)
8/31/2007 2:28:52 PM|climateprediction.net|Scheduler RPC succeeded [server version 509]

You did a project update and got a response from the scheduler, so you must have had a network connection at this point. What messages do you get if you go to the \"Transfers\" tab, highlight the pending upload and click \"Retry now\" after a successful project update? (You could issue more updates while the transfer\'s in progress).

I am only short of completely uninstalling, rebooting and reinstalling.
However I am reluctant to do so as the project has downloaded new work.

That\'s not going to be a problem. When you uninstall all of the data for the projects are left intact, so everything should carry on exactly where it left off. Having said that, I always stop BOINC and backup the complete BOINC directory structure before upgrading.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 30311 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 30315 - Posted: 31 Aug 2007, 20:49:34 UTC


Hmmmmm
completely uninstalling

If you mean \"delete everything, including the models, and ALL folders\", then that\'s a bit drastic.
The only thing that may need removing is BOINC.

If there was a problem with the original install of a 5.* version, try this cure. (Windows Installer Cleanup Utility.)

ID: 30315 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30356 - Posted: 4 Sep 2007, 18:35:59 UTC - in response to Message 30311.  

Hey.
I have and had already tried the the retry transfer to no avail.
I have also had it over the weekend on a different network with no firewall or proxy.
I unticked the use proxy in the settings but still encountered the same transfer issues.

I will attempt a repair as linked to by Lee Bayliss.
Fingers crossed

ID: 30356 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30370 - Posted: 5 Sep 2007, 12:08:22 UTC - in response to Message 30315.  

I removed the boinc software and then reinstalled cleanly. No errors.
But now I am worse off. Trickles are now failing. I am curios as to the meaning of the \"number of redirects hit maximum amount\" message.

Any replies can be as technical as you like.
I have been coding computer software for 11 years.


9/5/2007 12:58:42 PM||Starting BOINC client version 5.10.13 for windows_intelx86
9/5/2007 12:58:42 PM||log flags: task, file_xfer, sched_ops
9/5/2007 12:58:42 PM||Libraries: libcurl/7.16.1 OpenSSL/0.9.8e zlib/1.2.3
9/5/2007 12:58:42 PM||Data directory: C:\\Program Files\\BOINC
9/5/2007 12:58:42 PM||Processor: 1 GenuineIntel Intel(R) Pentium(R) M processor 1500MHz [x86 Family 6 Model 9 Stepping 5]
9/5/2007 12:58:42 PM||Processor features: fpu tsc sse mmx
9/5/2007 12:58:42 PM||Memory: 1022.92 MB physical, 1.65 GB virtual
9/5/2007 12:58:42 PM||Disk: 34.06 GB total, 1.70 GB free
9/5/2007 12:58:42 PM|climateprediction.net|URL: http://climateprediction.net/; Computer ID: 100390; location: work; project prefs: default
9/5/2007 12:58:42 PM||General prefs: from climateprediction.net (last modified 2005-01-31 18:42:58)
9/5/2007 12:58:42 PM||Host location: work
9/5/2007 12:58:42 PM||General prefs: no separate prefs for work; using your defaults
9/5/2007 12:58:42 PM||Reading preferences override file
9/5/2007 12:58:42 PM||Preferences limit memory usage when active to 511.46MB
9/5/2007 12:58:42 PM||Preferences limit memory usage when idle to 920.63MB
9/5/2007 12:58:42 PM||Preferences limit disk usage to 1.61GB
9/5/2007 12:58:42 PM||Contacting account manager at http://bam.boincstats.com/
9/5/2007 12:58:42 PM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544
9/5/2007 12:58:44 PM||Account manager error: 0 User not found!
9/5/2007 12:59:04 PM|climateprediction.net|Sending scheduler request: To send trickle-up message
9/5/2007 12:59:04 PM|climateprediction.net|(not requesting new work or reporting completed tasks)
9/5/2007 12:59:08 PM|climateprediction.net|Scheduler RPC succeeded [server version 509]
9/5/2007 12:59:45 PM|climateprediction.net|Sending scheduler request: Requested by user
9/5/2007 12:59:45 PM|climateprediction.net|(not requesting new work or reporting completed tasks)
9/5/2007 1:00:03 PM||Project communication failed: attempting access to reference site
9/5/2007 1:00:05 PM|climateprediction.net|Scheduler request failed: number of redirects hit maximum amount
9/5/2007 1:00:05 PM|climateprediction.net|Deferring communication for 1 min 0 sec
9/5/2007 1:00:05 PM|climateprediction.net|Reason: scheduler request failed
9/5/2007 1:00:14 PM||Suspending network activity - user request
9/5/2007 1:00:15 PM||Access to reference site failed - check network connection or proxy configuration.

ID: 30370 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30371 - Posted: 5 Sep 2007, 12:16:26 UTC - in response to Message 30311.  


Something caused the model to automatically restart.
8/31/2007 2:28:47 PM|climateprediction.net|Sending scheduler request: Requested by user
8/31/2007 2:28:47 PM|climateprediction.net|(not requesting new work or reporting completed tasks)
8/31/2007 2:28:52 PM|climateprediction.net|Scheduler RPC succeeded [server version 509]



The model sometimes experiences this when run in the from the start-up. The login scripts are very intensive coupled with a large roaming profile and roaming apps. Login can take a number of minutes.

The actual crash experienced during the last model happened while running the graphics (not screensaver mode). This happened me once before also.
My machine is Win2K SP4 DirectX 9c and patched to gills with Microsoft update using automatic SMS updates.

ID: 30371 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 30380 - Posted: 5 Sep 2007, 19:47:05 UTC

Looks like a problem with BAM. That\'d be a good place to start. (I don\'t use an account manager for my boxes, so can\'t give specifics.)

Failure to access the reference site (Google, I think) suggests an Internet connection problem. Perhaps something in the switch to/from a proxy?
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 30380 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30785 - Posted: 3 Oct 2007, 13:26:56 UTC - in response to Message 30380.  

I still do not have this solved.
Here is the latest messages log.
As you can see there is no problem accessing the reference site. The transfer also runs for 3 minutes, and by all indications sends 100% of the data. Then fails at the end.


10/3/2007 12:50:25 PM||Starting BOINC client version 5.10.20 for windows_intelx86
10/3/2007 12:50:25 PM||log flags: task, file_xfer, sched_ops
10/3/2007 12:50:25 PM||Libraries: libcurl/7.16.4 OpenSSL/0.9.8e zlib/1.2.3
10/3/2007 12:50:25 PM||Data directory: C:\\Program Files\\BOINC
10/3/2007 12:50:26 PM||Processor: 1 GenuineIntel Intel(R) Pentium(R) M processor 1500MHz [x86 Family 6 Model 9 Stepping 5]
10/3/2007 12:50:26 PM||Processor features: fpu tsc sse mmx
10/3/2007 12:50:26 PM||OS: Microsoft Windows 2000: Professional Edition, Service Pack 4, (05.00.2195.00)
10/3/2007 12:50:26 PM||Memory: 1022.92 MB physical, 1.65 GB virtual
10/3/2007 12:50:26 PM||Disk: 34.06 GB total, 754.00 MB free
10/3/2007 12:50:26 PM||Local time is UTC +0 hours
10/3/2007 12:50:27 PM|climateprediction.net|URL: http://climateprediction.net/; Computer ID: 100390; location: work; project prefs: default
10/3/2007 12:50:27 PM||General prefs: from climateprediction.net (last modified 2005-01-31 18:42:58)
10/3/2007 12:50:27 PM||Host location: work
10/3/2007 12:50:27 PM||General prefs: no separate prefs for work; using your defaults
10/3/2007 12:50:27 PM||Reading preferences override file
10/3/2007 12:50:27 PM||Preferences limit memory usage when active to 511.46MB
10/3/2007 12:50:27 PM||Preferences limit memory usage when idle to 920.63MB
10/3/2007 12:50:27 PM||Preferences limit disk usage to 0.64GB
10/3/2007 12:50:27 PM||Suspending network activity - user request
10/3/2007 12:50:31 PM|climateprediction.net|Restarting task hadcm3iozn_cpp7_2000_80_35899076_7 using hadcm3i version 544
10/3/2007 1:03:41 PM||Resuming network activity
10/3/2007 1:03:41 PM|climateprediction.net|[file_xfer] Started upload of file hadcm3iozn_cpp7_2000_80_35899076_7_1.zip
10/3/2007 1:06:23 PM||Project communication failed: attempting access to reference site
10/3/2007 1:06:23 PM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3iozn_cpp7_2000_80_35899076_7_1.zip: http error
10/3/2007 1:06:23 PM|climateprediction.net|Backing off 1 hr 23 min 17 sec on upload of file hadcm3iozn_cpp7_2000_80_35899076_7_1.zip
10/3/2007 1:06:25 PM||Access to reference site succeeded - project servers may be temporarily down.

ID: 30785 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30786 - Posted: 3 Oct 2007, 15:42:21 UTC - in response to Message 30785.  

Using a tip I found elsewhere to turn on some network debug flags I have captured the following debug output of the transfer.


10/3/2007 3:27:16 PM|climateprediction.net|[file_xfer] Started upload of file hadcm3iozn_cpp7_2000_80_35899076_7_1.zip
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Trying 48.19.199.101...
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:27:16 PM||[http_debug] [ID#0] Sent header to server: POST http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: climateapps3.oucs.ox.ac.uk
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded
Content-Length: 294


10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: HTTP/1.1 407 Proxy Authentication Required

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Date: Wed, 03 Oct 2007 14:27:18 GMT

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Content-Length: 938

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Content-Type: text/html

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Server: NetCache appliance (NetApp/5.6.2D12)

10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: HTTP/1.1 proxy connection set close!
10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Proxy-Connection: close

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Proxy-Authenticate: NTLM

10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server: Proxy-Authenticate: Basic realm=\"Enter your ID and PASSWORD\"

10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: the ioctl callback returned 0
10/3/2007 3:27:16 PM||[http_debug] [ID#0] Received header from server:

10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Expire cleared
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Closing connection #0
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Issue another request to this URL: \'http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler\'
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Trying 48.19.199.101...
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Proxy auth using Basic with user \'X106819\'
10/3/2007 3:27:16 PM||[http_debug] [ID#0] Sent header to server: POST http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
Proxy-Authorization: Basic WDEwNjgxOTpDb2xsZWVuNQ==
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: climateapps3.oucs.ox.ac.uk
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded
Content-Length: 294


10/3/2007 3:27:16 PM||[http_debug] [ID#0] info: Expire cleared
10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: HTTP/1.1 200 OK

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: Transfer-Encoding: chunked

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: Date: Wed, 03 Oct 2007 14:27:17 GMT

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: Content-Type: text/plain

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: Server: Apache/2.2.0 (Unix)

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server: Via: 1.1 njros1netcache5 (NetCache NetApp/5.6.2D12)

10/3/2007 3:27:17 PM||[http_debug] [ID#0] Received header from server:

10/3/2007 3:27:17 PM||[http_xfer_debug] HTTP: wrote 93 bytes
10/3/2007 3:27:17 PM||[http_debug] [ID#0] info: Closing connection #0
10/3/2007 3:27:18 PM||[http_debug] [ID#1] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:27:18 PM||[http_debug] [ID#1] info: Trying 48.19.199.101...
10/3/2007 3:27:18 PM||[http_debug] [ID#1] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:27:18 PM||[http_debug] [ID#1] Sent header to server: POST http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: climateapps3.oucs.ox.ac.uk
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded
Content-Length: 16471415


10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: HTTP/1.1 407 Proxy Authentication Required

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Date: Wed, 03 Oct 2007 14:30:02 GMT

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Content-Length: 938

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Content-Type: text/html

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Server: NetCache appliance (NetApp/5.6.2D12)

10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: HTTP/1.1 proxy connection set close!
10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Proxy-Connection: close

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Proxy-Authenticate: NTLM

10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server: Proxy-Authenticate: Basic realm=\"Enter your ID and PASSWORD\"

10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: the ioctl callback returned 0
10/3/2007 3:30:00 PM||[http_debug] [ID#1] Received header from server:

10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Expire cleared
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Closing connection #0
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Issue another request to this URL: \'http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler\'
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Trying 48.19.199.101...
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:30:00 PM||[http_debug] [ID#1] info: Proxy auth using NTLM with user \'X106819\'
10/3/2007 3:30:00 PM||[http_debug] [ID#1] Sent header to server: POST http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler HTTP/1.1
Proxy-Authorization: NTLM TlRMTVNTUAABAAAABoIIAAAAAAAAAAAAAAAAAAAAAAA=
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: climateapps3.oucs.ox.ac.uk
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://climateapps3.oucs.ox.ac.uk/cpdn_cgi/file_upload_handler
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded
Content-Length: 0


10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: HTTP/1.1 407 Proxy Authentication Required

10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: Date: Wed, 03 Oct 2007 14:30:03 GMT

10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: Content-Length: 938

10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: Content-Type: text/html

10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: Server: NetCache appliance (NetApp/5.6.2D12)

10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server: Proxy-Authenticate: NTLM TlRMTVNTUAACAAAACgAKACgAAAAGggEAXsqPVM6LZHIAAAAAAAAAAFBSVURFTlRJQUw=

10/3/2007 3:30:01 PM||[http_debug] [ID#1] info: the ioctl callback returned 0
10/3/2007 3:30:01 PM||[http_debug] [ID#1] Received header from server:

10/3/2007 3:30:01 PM||[http_debug] [ID#1] info: Ignoring the response-body
10/3/2007 3:30:01 PM||[http_debug] [ID#1] info: Send failure: Connection was aborted
10/3/2007 3:30:01 PM||[http_debug] [ID#1] info: Expire cleared
10/3/2007 3:30:01 PM||[http_debug] [ID#1] info: Closing connection #0
10/3/2007 3:30:01 PM||[http_debug] HTTP error: failed sending data to the peer
10/3/2007 3:30:01 PM||Project communication failed: attempting access to reference site
10/3/2007 3:30:01 PM||[http_debug] HTTP_OP::init_get(): http://www.google.com
10/3/2007 3:30:01 PM|climateprediction.net|[file_xfer] Temporarily failed upload of hadcm3iozn_cpp7_2000_80_35899076_7_1.zip: http error
10/3/2007 3:30:01 PM|climateprediction.net|Backing off 1 hr 32 min 10 sec on upload of file hadcm3iozn_cpp7_2000_80_35899076_7_1.zip
10/3/2007 3:30:01 PM||[http_debug] [ID#2] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:30:01 PM||[http_debug] [ID#2] info: Trying 48.19.199.101...
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:30:02 PM||[http_debug] [ID#2] Sent header to server: GET http://www.google.com HTTP/1.1
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: www.google.com
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded


10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: HTTP/1.1 407 Proxy Authentication Required

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Date: Wed, 03 Oct 2007 14:30:04 GMT

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Content-Length: 938

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Content-Type: text/html

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Server: NetCache appliance (NetApp/5.6.2D12)

10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: HTTP/1.1 proxy connection set close!
10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Proxy-Connection: close

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Proxy-Authenticate: NTLM

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Proxy-Authenticate: Basic realm=\"Enter your ID and PASSWORD\"

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server:

10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Closing connection #0
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Issue another request to this URL: \'http://www.google.com\'
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: About to connect() to proxy 48.19.199.101 port 8080 (#0)
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Trying 48.19.199.101...
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Connected to 48.19.199.101 (48.19.199.101) port 8080 (#0)
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Proxy auth using Basic with user \'X106819\'
10/3/2007 3:30:02 PM||[http_debug] [ID#2] Sent header to server: GET http://www.google.com HTTP/1.1
Proxy-Authorization: Basic WDEwNjgxOTpDb2xsZWVuNQ==
User-Agent: BOINC client (windows_intelx86 5.10.20)
Host: www.google.com
Pragma: no-cache
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://www.google.com
Proxy-Connection: Keep-Alive
Content-Type: application/x-www-form-urlencoded


10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: HTTP/1.1 200 OK

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Transfer-Encoding: chunked

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Date: Wed, 03 Oct 2007 14:30:02 GMT

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Content-Type: text/html; charset=ISO-8859-1

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Cache-Control: private

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Set-Cookie: PREF=ID=5c94906223986d1a:TM=1191421802:LM=1191421802:S=FxeBh2IyKArcfW16; expires=Fri, 02-Oct-2009 14:30:02 GMT; path=/; domain=.google.com

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Server: gws

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server: Via: 1.1 njros1netcache5 (NetCache NetApp/5.6.2D12)

10/3/2007 3:30:02 PM||[http_debug] [ID#2] Received header from server:

10/3/2007 3:30:02 PM||[http_xfer_debug] HTTP: wrote 4003 bytes
10/3/2007 3:30:02 PM||[http_xfer_debug] HTTP: wrote 1237 bytes
10/3/2007 3:30:02 PM||[http_debug] [ID#2] info: Closing connection #0
10/3/2007 3:30:02 PM||Access to reference site succeeded - project servers may be temporarily down.

ID: 30786 · Report as offensive     Reply Quote
Profile MikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 30787 - Posted: 3 Oct 2007, 16:59:04 UTC
Last modified: 3 Oct 2007, 17:03:45 UTC


What is your networking setup like? I see you use an NTLM proxy. Are you able to bypass it temporarily for a test? (i.e., attaching the machine to a different ISP briefly, or perhaps using a different type of proxy if there are several available). Can you be given a direct connection?

Is there a maximum transfer size set up on the proxy, and does it try to filter files such as .ZIPs?

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 30787 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30788 - Posted: 3 Oct 2007, 17:16:36 UTC - in response to Message 30787.  

I will be able to try it on a direct connection at the weekend. Hopefully I will see some success. Thanks
ID: 30788 · Report as offensive     Reply Quote
Profile MikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 30804 - Posted: 4 Oct 2007, 20:37:11 UTC



The following post discusses recent version\'s use of proxy servers and so forth:

http://boinc.berkeley.edu/dev/forum_thread.php?id=2169


I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 30804 · Report as offensive     Reply Quote
Profile old_user49274

Send message
Joined: 31 Jan 05
Posts: 18
Credit: 333,742
RAC: 0
Message 30816 - Posted: 5 Oct 2007, 16:01:45 UTC - in response to Message 30788.  

SUCCESS! I have been able to successfully transfer from a non proxy controlled DSL line through my ISP.

Now with that done, I have backed up and moved the whole of boinc from the little Pentium M it was on to a Centrino Dou machine.

This is off topic but I noticed that it runs as 2 main threads across the processors with 50% on each one. Is this the norm? Should I have done something to create a new host machine?
I will read through others posts and see if I can solve the problem.
ID: 30816 · Report as offensive     Reply Quote
1 · 2 · Next

Questions and Answers : Windows : Trickles and downloads working. Zip uploads not

©2024 climateprediction.net