climateprediction.net (CPDN) home page
Thread 'Uploads not working'

Thread 'Uploads not working'

Message boards : Number crunching : Uploads not working
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70438 - Posted: 19 Feb 2024, 9:13:32 UTC

I've been getting really slow uploads today, as in 3.6KBps slow. Dial up slow. Weird thing was that I had six uploading at once, but all at that speed each.
I tried fault finding my network and the machine itself and ended up rebooting it, but now none of the uploads will run at all, server backoff every time I try.

19/02/2024 09:08:35 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_3.zip] locked by file_upload_handler PID=914020
19/02/2024 09:08:35 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_4.zip] locked by file_upload_handler PID=922788
19/02/2024 09:08:35 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_2.zip] locked by file_upload_handler PID=910998
19/02/2024 09:08:35 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_3.zip] locked by file_upload_handler PID=914021
19/02/2024 09:08:35 | climateprediction.net | Temporarily failed upload of wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_3.zip: transient upload error
19/02/2024 09:08:35 | climateprediction.net | Backing off 03:31:35 on upload of wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_3.zip
19/02/2024 09:08:35 | climateprediction.net | Temporarily failed upload of wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_4.zip: transient upload error
19/02/2024 09:08:35 | climateprediction.net | Backing off 02:07:02 on upload of wah2_eas25_a31e_200412_24_1007_012268794_0_r1880160502_4.zip
19/02/2024 09:08:35 | climateprediction.net | Temporarily failed upload of wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_2.zip: transient upload error
19/02/2024 09:08:35 | climateprediction.net | Backing off 01:29:56 on upload of wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_2.zip
19/02/2024 09:08:35 | climateprediction.net | Temporarily failed upload of wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_3.zip: transient upload error
19/02/2024 09:08:35 | climateprediction.net | Backing off 01:31:17 on upload of wah2_eas25_a364_200512_24_1007_012268964_0_r1483356566_3.zip

I guess I'll have to wait until this sorts itself out.
ID: 70438 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4542
Credit: 19,039,635
RAC: 18,944
Message 70439 - Posted: 19 Feb 2024, 10:27:18 UTC - in response to Message 70438.  

I have one upload going through at my normal bored band speed of just under 100KB/second. My experience with the locked by file_upload_handler message is that it is caused by something interrupting the file transfer and there is nothing you can do but wait till the server takes the lock off the file. My solution is to turn off BOINC internet access for an hour or two after which on resuming network activity the files upload normally. I am not sure if this helps by preventing further attempts by the client to upload the files from extending the lock or not but psychologically it makes me feel I am doing something!
ID: 70439 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70447 - Posted: 19 Feb 2024, 20:20:35 UTC

I left them overnight and this morning they're back working again, unfortunately they're also back to this 3.6KBps nonsense as well.
ID: 70447 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4542
Credit: 19,039,635
RAC: 18,944
Message 70448 - Posted: 19 Feb 2024, 21:06:49 UTC - in response to Message 70447.  

I left them overnight and this morning they're back working again, unfortunately they're also back to this 3.6KBps nonsense as well.

Is your internet connection otherwise normal?
ID: 70448 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 70449 - Posted: 19 Feb 2024, 21:25:19 UTC - in response to Message 70447.  

If you have a cc_config.xml in your boinc data directory, what value do you have for:

<max_file_xfers_per_project>N</max_file_xfers_per_project>

The default is 2, but it can be changed. If it is something larger than 2, perhaps bring it back to 2 and see if there is any relief. It wouldn't seem like it should matter, but it's something to try.

I've had several uploads go up today, and they've all maxed out my upload limit on my ISP plan (0.5 MB/sec).
ID: 70449 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70450 - Posted: 19 Feb 2024, 22:11:41 UTC - in response to Message 70448.  

I left them overnight and this morning they're back working again, unfortunately they're also back to this 3.6KBps nonsense as well.

Is your internet connection otherwise normal?


Yes, it is. I also have WuProp running on this machine (It's a VM, my host OS is Linux which is having no network issues) and that is showing no network issues. If I use the browser on this machine it works fine with no obvious slowdown.
ID: 70450 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70451 - Posted: 19 Feb 2024, 22:40:38 UTC - in response to Message 70449.  

If you have a cc_config.xml in your boinc data directory, what value do you have for:

<max_file_xfers_per_project>N</max_file_xfers_per_project>

The default is 2, but it can be changed. If it is something larger than 2, perhaps bring it back to 2 and see if there is any relief. It wouldn't seem like it should matter, but it's something to try.

I've had several uploads go up today, and they've all maxed out my upload limit on my ISP plan (0.5 MB/sec).


I changed it to 8. Right now I have six uploads running and they're all stuck at about 3.2KBps each. It's like the transfer is being throttled at the server end on a per file basis.

I just suspended networking and ran a speed test.
I got 48Mbps down and 19Mbps up in my host OS
I'll try restarting my router and see if that helps.
ID: 70451 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70452 - Posted: 19 Feb 2024, 22:59:20 UTC - in response to Message 70451.  

Nope, same silliness continues. Uploads are starting out ok but soon drop to around 3.2KBps.

I also made sure BOINC is allowed specifically though the Windows Firewall in case that mattered.
ID: 70452 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1120
Credit: 17,202,915
RAC: 2,154
Message 70453 - Posted: 20 Feb 2024, 1:22:37 UTC - in response to Message 70438.  

I've been getting really slow uploads today, as in 3.6KBps slow. Dial up slow.

I did not catch my Windows machine during transfers, but the web site reveals pretty good upload and download speeds. It is on a fiber-optic link that can get up to 1000 Megabit/second speeds. I just measured my speeds and got these:\
DOWNLOAD 851.24 Mbps
UPLOAD 887.80 Mbps
LATENCY 3 ms
JITTER 2 ms

Computer 1512658
Computer information

Domain name 	DESKTOP-K1UQGC4
Local Standard Time 	UTC -5 hours
Created 	19 Dec 2020, 22:21:58 UTC
Total credit 	355,587
Average credit 	4,478.43
Cross project credit 	BOINCstats.com Free-DC
CPU type 	GenuineIntel
11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz [Family 6 Model 140 Stepping 1]
Number of processors 	8

Operating System 	Microsoft Windows 10
Core x64 Edition, (10.00.19045.00)
BOINC version 	7.24.1
Memory 	15.64 GB
Cache 	256 KB
Swap space 	18.02 GB
Total disk space 	460.73 GB
Free Disk Space 	303.49 GB
Measured floating point speed 	3.92 billion ops/sec
Measured integer speed 	29.31 billion ops/sec
Average upload rate 	996.93 KB/sec
Average download rate 	9770.82 KB/sec
Average turnaround time 	10.74 days

ID: 70453 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70454 - Posted: 20 Feb 2024, 1:30:43 UTC - in response to Message 70453.  

From this page, I'm getting:

Average upload rate 2.61 KB/sec
Average download rate 1979.47 KB/sec
ID: 70454 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70455 - Posted: 20 Feb 2024, 2:21:35 UTC - in response to Message 70454.  

I suspect if the work was available in Linux I wouldn't be having these issues.
ID: 70455 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,817,940
RAC: 12,877
Message 70457 - Posted: 20 Feb 2024, 4:47:45 UTC - in response to Message 70455.  

I suspect if the work was available in Linux I wouldn't be having these issues.
I suspect the issue is at the remote end, Linux tasks wouldn't make any difference. I'll get in touch with the project scientist.
---
CPDN Visiting Scientist
ID: 70457 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70458 - Posted: 20 Feb 2024, 4:51:02 UTC - in response to Message 70457.  

I suspect if the work was available in Linux I wouldn't be having these issues.
I suspect the issue is at the remote end, Linux tasks wouldn't make any difference. I'll get in touch with the project scientist.


That would be greatly appreciated, thanks.
ID: 70458 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70466 - Posted: 20 Feb 2024, 9:39:00 UTC

Just had an upload run 8.5 hours only to crash and restart.
This is ... not enjoyable.
ID: 70466 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4542
Credit: 19,039,635
RAC: 18,944
Message 70467 - Posted: 20 Feb 2024, 10:07:09 UTC - in response to Message 70466.  

Just had an upload run 8.5 hours only to crash and restart.
This is ... not enjoyable.
Odd. I just looked and all your running tasks are the wah2ri ones which means they are east Asia and not the NZ ones where there is a server issue. I am averaging 55KB/s uploading the eas tasks. I wonder if doing a traceroute on the server from your end would show anything or if any other users from Australia might check to see what speed they are getting? (I know I am probably clutching at straws here but otherwise I am out of ideas.
http://upload7.cpdn.org is the server the EAS tasks are going to.
ID: 70467 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70468 - Posted: 20 Feb 2024, 10:21:24 UTC - in response to Message 70467.  

Just had an upload run 8.5 hours only to crash and restart.
This is ... not enjoyable.
Odd. I just looked and all your running tasks are the wah2ri ones which means they are east Asia and not the NZ ones where there is a server issue. I am averaging 55KB/s uploading the eas tasks. I wonder if doing a traceroute on the server from your end would show anything or if any other users from Australia might check to see what speed they are getting? (I know I am probably clutching at straws here but otherwise I am out of ideas.
http://upload7.cpdn.org is the server the EAS tasks are going to.


C:\Users\meblo>tracert upload7.cpdn.org/
Unable to resolve target system name upload7.cpdn.org/
ID: 70468 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70469 - Posted: 20 Feb 2024, 10:30:38 UTC - in response to Message 70468.  

Second attempt:

C:\Users\meblo>tracert upload7.cpdn.org

Tracing route to upload7.cpdn.org [141.223.16.156]
over a maximum of 30 hops:

1 1 ms <1 ms 1 ms TELSTRA-GATEWAY [192.168.1.254]
2 24 ms 27 ms 22 ms 58.162.26.79
3 23 ms 20 ms 20 ms ae10.hay-ice302.sydney.telstra.net [203.50.61.113]
4 23 ms 23 ms 23 ms bundle-ether26.hay-core30.sydney.telstra.net [203.50.61.112]
5 24 ms 23 ms 23 ms bundle-ether2.oxf-gw30.sydney.telstra.net [203.50.6.106]
6 25 ms 21 ms 22 ms 203.50.13.94
7 160 ms 159 ms 158 ms 203.50.13.94
8 160 ms 158 ms 158 ms i-10604.1wlt-core02.telstraglobal.net [202.84.141.225]
9 197 ms 198 ms 199 ms i-10604.1wlt-core02.telstraglobal.net [202.84.141.225]
10 194 ms 196 ms 196 ms i-93.tlot02.bi.telstraglobal.net [202.84.253.86]
11 230 ms 220 ms 218 ms la-pom247-ge-5-0-0.kornet.net [206.223.123.44]
12 665 ms 690 ms 682 ms 112.174.87.129
13 224 ms 221 ms 224 ms 112.174.91.85
14 225 ms 224 ms 228 ms 112.174.48.1
15 * * * Request timed out.
16 229 ms 229 ms 229 ms 210.223.242.98
17 230 ms 230 ms 229 ms 141.223.180.2
18 232 ms 227 ms 226 ms 141.223.253.61
19 231 ms 231 ms 231 ms 141.223.16.93
20 231 ms 230 ms 229 ms eawah.postech.ac.kr [141.223.16.156]

Trace complete.
ID: 70469 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4542
Credit: 19,039,635
RAC: 18,944
Message 70470 - Posted: 20 Feb 2024, 10:33:40 UTC - in response to Message 70468.  
Last modified: 20 Feb 2024, 10:37:59 UTC

traceroute to upload7.cpdn.org (141.223.16.156), 64 hops max
  1   10.0.0.1  0.967ms  0.658ms  0.582ms 
  2   192.168.1.1  1.201ms  0.954ms  0.817ms 
  3   81.1.113.41  24.539ms  23.646ms  23.582ms 
  4   78.144.1.27  25.398ms  41.271ms  25.607ms 
  5   78.144.1.54  27.685ms  27.505ms  27.252ms 
  6   78.144.1.110  27.494ms  27.601ms  27.156ms 
  7   *  184.104.207.169  27.800ms  * 
  8   *  *  184.104.192.133  133.344ms 
  9   *  184.104.188.100  185.093ms  396.898ms 
 10   184.104.199.21  152.901ms  *  * 
 11   184.104.198.254  189.904ms  *  * 
 12   64.71.165.22  240.952ms  205.307ms  204.455ms 
 13   112.174.87.97  819.144ms  *  785.576ms 
 14   112.174.86.149  307.067ms  307.850ms  279.880ms 
 15   112.190.29.250  283.027ms  282.603ms  283.148ms 
 16   *  *  * 
 17   210.223.242.98  307.782ms  307.204ms  281.482ms 
 18   141.223.180.2  332.565ms  307.091ms  306.340ms 
 19   141.223.253.61  307.711ms  306.949ms  307.283ms 
Final destination is within Pohang University of Science and Technology.

Edit: You obviously posted your second attempt while I was busy posting. I am guessing the hop where the timeout occurred is where the issue is and that would be confirmed if it often happened on that hop?
ID: 70470 · Report as offensive     Reply Quote
Dark Angel

Send message
Joined: 31 May 18
Posts: 53
Credit: 4,725,987
RAC: 9,174
Message 70471 - Posted: 20 Feb 2024, 10:48:48 UTC - in response to Message 70470.  

This may or may not be relevant but my home proxy hard blocks traffic to Chinese, Russian, and Belarus IP addresses.

That IP times out often when I repeat the trace.

I changed my VM networking from Bridged to NAT to see if it makes any difference but I'll have to wait until the server unlocks the files again.
ID: 70471 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1052
Credit: 16,817,940
RAC: 12,877
Message 70472 - Posted: 20 Feb 2024, 11:13:57 UTC - in response to Message 70471.  

I changed my VM networking from Bridged to NAT to see if it makes any difference but I'll have to wait until the server unlocks the files again.
I doubt that'll make any difference as that just affects how the VM appears on the local network. The outside world only sees your router IP address, not the local IPs.
---
CPDN Visiting Scientist
ID: 70472 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Uploads not working

©2024 cpdn.org