climateprediction.net home page
Stuck upload issue
Stuck upload issue
log in

Advanced search

Message boards : Number crunching : Stuck upload issue

1 · 2 · 3 · 4 · Next
Author Message
boinc127
Send message
Joined: 5 Apr 14
Posts: 10
Credit: 237,280
RAC: 150
Message 57400 - Posted: 27 Nov 2017, 4:03:13 UTC
Last modified: 27 Nov 2017, 4:06:52 UTC

I've got a stuck upload issue. I have been trying for almost a week to upload the last 2 "trickles?" of a workunit and the final zip file, but all three refuse to upload. The workunit is here https://www.cpdn.org/cpdnboinc/result.php?resultid=20166404. The most recent attempt to upload shows:

11.26.2017 21.59.39 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.26.2017 21.59.39 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.26.2017 22.00.01 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip: connect() failed
11.26.2017 22.00.01 | climateprediction.net | Backing off 03:26:17 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.26.2017 22.00.01 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip: connect() failed
11.26.2017 22.00.01 | climateprediction.net | Backing off 04:44:45 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.26.2017 22.00.01 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.26.2017 22.00.01 | | Project communication failed: attempting access to reference site
11.26.2017 22.00.03 | | Internet access OK - project servers may be temporarily down.
11.26.2017 22.00.22 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip: connect() failed
11.26.2017 22.00.22 | climateprediction.net | Backing off 03:50:21 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.26.2017 22.00.23 | | Project communication failed: attempting access to reference site
11.26.2017 22.00.24 | | Internet access OK - project servers may be temporarily down.


I'm not sure what the issue is. The server status shows all green. Does anyone have any thoughts on the issue? Thanks in advance.

Profile geophi
Volunteer moderator
Send message
Joined: 7 Aug 04
Posts: 1691
Credit: 32,431,618
RAC: 5,759
Message 57401 - Posted: 27 Nov 2017, 7:52:33 UTC - in response to Message 57400.

It's possible the server it is being sent to is located somewhere other than oxford. The Server Status page doesn't have status for those servers. If you are running a recent version of boinc, there is an Event Log Option under the Options menu of boinc manager that is called file_xfer_debug. If you select that, debug messages will give you the server name the next time it tries to upload the files. If you answer back here with that upload server name, we can have someone check what is going on.

MossyRock
Avatar
Send message
Joined: 4 Oct 13
Posts: 21
Credit: 1,782,381
RAC: 10
Message 57405 - Posted: 27 Nov 2017, 13:31:36 UTC - in response to Message 57400.
Last modified: 27 Nov 2017, 13:39:05 UTC

I had the exact same problem with this same type of model.

See my recent thread here: https://www.cpdn.org/cpdnboinc/forum_thread.php?id=8516

You can wait for the server-end problem to be resolved at which time your files will upload, or you can abort the model showing as uploading in BM, then abort the transfers.

After waiting for days I decided to clean things up and do the aborts. If you report the server name that is having the problem perhaps the third party will fix it so your uploads will complete.

Dave Roberts
Send message
Joined: 15 Jan 11
Posts: 136
Credit: 3,465,182
RAC: 6,138
Message 57406 - Posted: 27 Nov 2017, 17:46:09 UTC

I had a similar problem a couple of months ago. Everything uploaded after about 8 days.
Very frustrating when one doesn't know where the problem lies.

boinc127
Send message
Joined: 5 Apr 14
Posts: 10
Credit: 237,280
RAC: 150
Message 57407 - Posted: 27 Nov 2017, 18:11:13 UTC

Here is the diagnostic information. It appears the upload server URL is: http://upload3.cpdn.org/cgi-bin/file_upload_handler

11.27.2017 12.06.59 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.06.59 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.27.2017 12.06.59 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.06.59 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.06.59 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.27.2017 12.06.59 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip: connect() failed
11.27.2017 12.07.21 | climateprediction.net | Backing off 05:59:18 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_9.zip
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.21 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip: connect() failed
11.27.2017 12.07.21 | climateprediction.net | Backing off 04:10:13 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_10.zip
11.27.2017 12.07.21 | climateprediction.net | [fxd] starting upload, upload_offset -1
11.27.2017 12.07.21 | climateprediction.net | Started upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.27.2017 12.07.21 | climateprediction.net | [file_xfer] URL: http://upload3.cpdn.org/cgi-bin/file_upload_handler
11.27.2017 12.07.22 | | Project communication failed: attempting access to reference site
11.27.2017 12.07.24 | | Internet access OK - project servers may be temporarily down.
11.27.2017 12.07.43 | | Project communication failed: attempting access to reference site
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] http op done; retval -107 (connect() failed)
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] file transfer status -107 (connect() failed)
11.27.2017 12.07.43 | climateprediction.net | Temporarily failed upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip: connect() failed
11.27.2017 12.07.43 | climateprediction.net | [file_xfer] project-wide xfer delay for 592.225105 sec
11.27.2017 12.07.43 | climateprediction.net | Backing off 03:47:33 on upload of wah2_eas50_n7z2_201512_10_505_010863775_0_r1596118964_out.zip
11.27.2017 12.07.44 | | Internet access OK - project servers may be temporarily down.

boinc127
Send message
Joined: 5 Apr 14
Posts: 10
Credit: 237,280
RAC: 150
Message 57421 - Posted: 1 Dec 2017, 16:40:08 UTC

Please disregard this or thank you for fixing the upload issue. It finally uploaded last night.

Harri Liljeroos
Avatar
Send message
Joined: 9 Dec 05
Posts: 41
Credit: 8,214,080
RAC: 26,835
Message 57426 - Posted: 3 Dec 2017, 12:01:10 UTC

Upload errors also on eas50 tasks for me:

39927 climateprediction.net 03-12-2017 12:00 Started upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip 39928 03-12-2017 12:00 Project communication failed: attempting access to reference site 39929 climateprediction.net 03-12-2017 12:00 Temporarily failed upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip: connect() failed 39930 climateprediction.net 03-12-2017 12:00 Backing off 03:41:37 on upload of wah2_eas50_a23q_201212_12_686_011361874_1_r1920095199_1.zip 39931 03-12-2017 12:00 Internet access OK - project servers may be temporarily down.


Four zips pending, trickles have went through.
____________

Owner
Send message
Joined: 12 Mar 06
Posts: 3
Credit: 144,515
RAC: 2
Message 57520 - Posted: 22 Dec 2017, 19:18:10 UTC - in response to Message 57401.

Hello geophi,

My URL is HTTP://upload7.cpdn.org/cpdn_cgi/file_upload_handler is also not uploading my results for climateprediction project. It is saying that it is backing off and that the servers may be temporarily down.

sincerely,
Mark(USA,Philadelphia area)

Mephist0
Send message
Joined: 21 Feb 08
Posts: 6
Credit: 6,923,966
RAC: 3,523
Message 57547 - Posted: 2 Jan 2018, 12:02:22 UTC - in response to Message 57520.

Hello geophi,

My URL is HTTP://upload7.cpdn.org/cpdn_cgi/file_upload_handler is also not uploading my results for climateprediction project. It is saying that it is backing off and that the servers may be temporarily down.

sincerely,
Mark(USA,Philadelphia area)


I guess you still have that problem?

I have the same problem.. Also upload7.cpdn.org. Anyone knows anything about this host?

Alex Plantema
Send message
Joined: 3 Sep 04
Posts: 101
Credit: 16,452,233
RAC: 41,502
Message 57548 - Posted: 2 Jan 2018, 20:30:19 UTC

It's in Korea:

D:\Gebruikers\Alex>nslookup upload7.cpdn.org
Server: fritz.box
Address: 192.168.178.1

Non-authoritative answer:
Name: upload7.cpdn.org
Address: 141.223.16.156


D:\Gebruikers\Alex>nslookup 141.223.16.156
Server: fritz.box
Address: 192.168.178.1

Name: eawah.postech.ac.kr
Address: 141.223.16.156

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1880
Credit: 2,697,685
RAC: 918
Message 57552 - Posted: 3 Jan 2018, 11:42:12 UTC

The uploads are going to be temporarily redirected to Oxford to clear the backlog on crunchers' machines. The request to do this has been sent about half an hour ago. I would guess it will happen either today or tomorrow.

For the long term on EAS tasks I have no clue about how long it will take them at the University in Korea to sort out their end.

Profile geophi
Volunteer moderator
Send message
Joined: 7 Aug 04
Posts: 1691
Credit: 32,431,618
RAC: 5,759
Message 57559 - Posted: 3 Jan 2018, 19:44:23 UTC

Let us know if this redirect works and your backlog of uploads clears.

Profile Alan K
Send message
Joined: 22 Feb 06
Posts: 213
Credit: 11,179,288
RAC: 12,959
Message 57561 - Posted: 4 Jan 2018, 9:09:57 UTC

Looks as if there is a problem with upload6 as well:

04/01/2018 07:06:57 | climateprediction.net | [file_xfer] file transfer status -184 (transient HTTP error)
04/01/2018 07:06:57 | climateprediction.net | Temporarily failed upload of wah2_cam25_a0ds_200405_18_691_011370045_1_r1231016019_17.zip: transient HTTP error
04/01/2018 07:06:57 | climateprediction.net | Backing off 03:22:47 on upload of wah2_cam25_a0ds_200405_18_691_011370045_1_r1231016019_17.zip

Doug Jenkins
Send message
Joined: 28 Aug 04
Posts: 2
Credit: 2,221,191
RAC: 3,306
Message 57563 - Posted: 5 Jan 2018, 0:33:52 UTC - in response to Message 57561.

I have been having the same problem, and have been waiting to see if the redirect fixed it. So far, no.
Here is what I am seeing:
1/4/2018 18:36:38 | climateprediction.net | [http] [ID#972] Info: Connection #1409 to host upload7.cpdn.org left intact
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] project-wide xfer delay for 20340.598773 sec
1/4/2018 18:36:38 | climateprediction.net | Backing off 04:51:07 on upload of wah2_eas50_a220_201212_12_686_011361812_0_r1839784977_1.zip
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
1/4/2018 18:36:38 | climateprediction.net | [file_xfer] project-wide xfer delay for 16206.756798 sec
1/4/2018 18:36:38 | climateprediction.net | Backing off 03:49:22 on upload of wah2_eas50_a220_201212_12_686_011361812_0_r1839784977_2.zip
____________

Mephist0
Send message
Joined: 21 Feb 08
Posts: 6
Credit: 6,923,966
RAC: 3,523
Message 57564 - Posted: 5 Jan 2018, 8:45:10 UTC - in response to Message 57552.
Last modified: 5 Jan 2018, 8:58:58 UTC

Ok great.

I just did a test now. Not working at the moment.

Only got 8 WU for eas50 .. 7,2GB data waiting for upload :) Only running on 2 computers at the moment :)

05/01/2018 09:43:05 | climateprediction.net | [fxd] starting upload, upload_offset -1
05/01/2018 09:43:05 | climateprediction.net | Started upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_11.zip
05/01/2018 09:43:05 | climateprediction.net | [file_xfer] URL: http://upload7.cpdn.org/cpdn_cgi/file_upload_handler
05/01/2018 09:43:05 | climateprediction.net | [fxd] starting upload, upload_offset -1
05/01/2018 09:43:05 | climateprediction.net | Started upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_restart.zip
05/01/2018 09:43:05 | climateprediction.net | [file_xfer] URL: http://upload7.cpdn.org/cpdn_cgi/file_upload_handler
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] http op done; retval -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | Backing off 00:05:02 on upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_11.zip
05/01/2018 09:43:06 | climateprediction.net | [file_xfer] file transfer status -224 (permanent HTTP error)
05/01/2018 09:43:06 | climateprediction.net | Backing off 00:06:55 on upload of wah2_eas50_a04d_199112_12_690_011368926_0_r1954941867_restart.zip

Mephist0
Send message
Joined: 21 Feb 08
Posts: 6
Credit: 6,923,966
RAC: 3,523
Message 57565 - Posted: 5 Jan 2018, 8:52:06 UTC

I had no idea different upload servers were used for CPDN. You learn something new every day..

That explains the speed difference in uploads :)

pwn25 WU = 2Mbit/s
cam50 WU = 25Mbit/s

:)

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1880
Credit: 2,697,685
RAC: 918
Message 57566 - Posted: 5 Jan 2018, 9:15:42 UTC

Redirect not working and problems with batch 691 both reported to project.

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1880
Credit: 2,697,685
RAC: 918
Message 57568 - Posted: 5 Jan 2018, 11:21:04 UTC

Redirect not working and problems with batch 691 both reported to project.


This is now being looked at.

Again, it would be good to get continued feedback on this so the project can know whether or not it is working. - Probably worth waiting a few hours though unless the feedback is that zips are being uploaded.

Henk Haneveld
Send message
Joined: 9 Dec 17
Posts: 2
Credit: 47,234
RAC: 652
Message 57569 - Posted: 5 Jan 2018, 11:57:12 UTC

I have just uploaded a set of files that had been stuck for close to a month.

Harri Liljeroos
Avatar
Send message
Joined: 9 Dec 05
Posts: 41
Credit: 8,214,080
RAC: 26,835
Message 57571 - Posted: 5 Jan 2018, 13:53:39 UTC

The eas50 zips have all uploaded. Well done people.
____________

1 · 2 · 3 · 4 · Next

Message boards : Number crunching : Stuck upload issue


Main page · Your account · Message boards


Copyright © 2018 climateprediction.net