climateprediction.net home page
Trickle won't upload
Trickle won't upload
log in

Advanced search

Questions and Answers : Unix/Linux : Trickle won't upload

Author Message
Richard Giles
Send message
Joined: 12 Dec 14
Posts: 4
Credit: 5,186,201
RAC: 0
Message 54576 - Posted: 26 Jul 2016, 10:52:28 UTC

Hi,

This task

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=19755776

has finished executing on my machine, but is marked as "in progress" on cpdn's server. There is no corresponding wah2_mex25_c1ul... directory in the climateprediction.net folder, only a couple of zip files:

-rw-r--r-- 1 boinc boinc 110305175 Jul 19 13:38 wah2_mex25_c1ul_200812_13_410_010610873_0_10.zip -rw-r--r-- 1 boinc boinc 15139 Jul 11 05:31 wah2_mex25_c1ul_200812_13_410_010610873.zip



The "boinccmd --get-messages" command shows that the system has been trying to upload this 10th trickle several times a day. When I use boincmgr to retry the upload: uploading starts but hangs after about 70% of the file is uploaded, as confirmed by boinccmd:

$ boinccmd --get_file_transfers ======== File transfers ======== 1) ----------- name: wah2_mex25_c1ul_200812_13_410_010610873_0_10.zip direction: upload sticky: no xfer active: no time_so_far: 13472.478700 bytes_xferred: 69337088.000000 xfer_speed: 0.000000


Is there anything I can do? This task has consumed about 10 days of cpu time and I'd prefer it not to be wasted!

Thanks in advance.
Richard

Eirik Redd
Send message
Joined: 31 Aug 04
Posts: 343
Credit: 73,848,322
RAC: 147,536
Message 54577 - Posted: 26 Jul 2016, 11:32:29 UTC

I have two mex25 uploads in similar status.
In both cases only one upload fails, and keeps failing, and restarts over and over and gets to the same upload percent and fails again with some kind of "temporary error". one has been doing this for at least 10 days.
Other uploads same wus completed OK, one is "finished" and trying to upload an intermediate file for over a week, the other has continued to successfully upload several zips and is well on it's way to "complete" -- except for the one upload that keeps failing at the same percent upload over and over and over and --
____________

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6408
Credit: 16,839,542
RAC: 21,887
Message 54585 - Posted: 27 Jul 2016, 0:30:52 UTC

I've made a sticky post at the top of the Number crunching section, called: Uploading Mexico models, that summarises the Mexico problem.

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6408
Credit: 16,839,542
RAC: 21,887
Message 54586 - Posted: 27 Jul 2016, 0:41:55 UTC - in response to Message 54576.

Hi Richard

You need to be careful with describing uploads.
Trickle_ups are small files, about 8K, that don't go through the Transfers tab.
They are sent using the RPC (Remote Procedure Call), process, and they are sent to their own server at the University of Oxford.

The files that DO go through the Transfers tab, are the much larger zip files, and these go to lots of different servers in various places around the planet.

As you seem to be talking about zip files, then the sticky that I mentioned in the post before this may help.
But if you're not getting trickles showing on the Task page for one of the models, let us know.

Richard Giles
Send message
Joined: 12 Dec 14
Posts: 4
Credit: 5,186,201
RAC: 0
Message 54588 - Posted: 27 Jul 2016, 11:53:11 UTC - in response to Message 54586.

Thanks for fix and the explanation Les. Your fix worked, so the task is now marked as completed.

Richard

Questions and Answers : Unix/Linux : Trickle won't upload


Main page · Your account · Message boards


Copyright © 2017 climateprediction.net