climateprediction.net home page
Trickle won't upload

Trickle won't upload

Questions and Answers : Unix/Linux : Trickle won't upload
Message board moderation

To post messages, you must log in.

AuthorMessage
Richard Giles

Send message
Joined: 12 Dec 14
Posts: 5
Credit: 14,162,005
RAC: 5,698
Message 54576 - Posted: 26 Jul 2016, 10:52:28 UTC

Hi,

This task

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=19755776

has finished executing on my machine, but is marked as "in progress" on cpdn's server. There is no corresponding wah2_mex25_c1ul... directory in the climateprediction.net folder, only a couple of zip files:

-rw-r--r-- 1 boinc boinc 110305175 Jul 19 13:38 wah2_mex25_c1ul_200812_13_410_010610873_0_10.zip
-rw-r--r-- 1 boinc boinc     15139 Jul 11 05:31 wah2_mex25_c1ul_200812_13_410_010610873.zip



The "boinccmd --get-messages" command shows that the system has been trying to upload this 10th trickle several times a day. When I use boincmgr to retry the upload: uploading starts but hangs after about 70% of the file is uploaded, as confirmed by boinccmd:

$ boinccmd --get_file_transfers

======== File transfers ========
1) -----------
   name: wah2_mex25_c1ul_200812_13_410_010610873_0_10.zip
   direction: upload
   sticky: no
   xfer active: no
   time_so_far: 13472.478700
   bytes_xferred: 69337088.000000
   xfer_speed: 0.000000


Is there anything I can do? This task has consumed about 10 days of cpu time and I'd prefer it not to be wasted!

Thanks in advance.
Richard
ID: 54576 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,888,554
RAC: 1,481,373
Message 54577 - Posted: 26 Jul 2016, 11:32:29 UTC

I have two mex25 uploads in similar status.
In both cases only one upload fails, and keeps failing, and restarts over and over and gets to the same upload percent and fails again with some kind of "temporary error". one has been doing this for at least 10 days.
Other uploads same wus completed OK, one is "finished" and trying to upload an intermediate file for over a week, the other has continued to successfully upload several zips and is well on it's way to "complete" -- except for the one upload that keeps failing at the same percent upload over and over and over and --
ID: 54577 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 54585 - Posted: 27 Jul 2016, 0:30:52 UTC

I've made a sticky post at the top of the Number crunching section, called: Uploading Mexico models, that summarises the Mexico problem.

ID: 54585 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 54586 - Posted: 27 Jul 2016, 0:41:55 UTC - in response to Message 54576.  

Hi Richard

You need to be careful with describing uploads.
Trickle_ups are small files, about 8K, that don't go through the Transfers tab.
They are sent using the RPC (Remote Procedure Call), process, and they are sent to their own server at the University of Oxford.

The files that DO go through the Transfers tab, are the much larger zip files, and these go to lots of different servers in various places around the planet.

As you seem to be talking about zip files, then the sticky that I mentioned in the post before this may help.
But if you're not getting trickles showing on the Task page for one of the models, let us know.

ID: 54586 · Report as offensive     Reply Quote
Richard Giles

Send message
Joined: 12 Dec 14
Posts: 5
Credit: 14,162,005
RAC: 5,698
Message 54588 - Posted: 27 Jul 2016, 11:53:11 UTC - in response to Message 54586.  

Thanks for fix and the explanation Les. Your fix worked, so the task is now marked as completed.

Richard
ID: 54588 · Report as offensive     Reply Quote

Questions and Answers : Unix/Linux : Trickle won't upload

©2024 climateprediction.net