climateprediction.net home page
trickles of finished model

trickles of finished model

Message boards : Number crunching : trickles of finished model
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 41332 - Posted: 20 Dec 2010, 15:30:38 UTC

What can one do with trickle files of a finished model?

They got stuck on one of my computers and before I could resolve congestion, model finished, uploaded all the files. When I started to flush trickle heap, finished model got reported with success.

Now I've got something like 149 trickle files that CPDN scheduler seemingly doesn't want to accept. If a running model trickles, that one gets through without any problem. If I try to send a sigle trickle file of the finished model, connection just gets dropped:

20-Dec-2010 16:19:43 [climateprediction.net] update requested by user
20-Dec-2010 16:19:44 [climateprediction.net] Sending scheduler request: Requested by user.
20-Dec-2010 16:19:44 [climateprediction.net] Not reporting or requesting tasks
20-Dec-2010 16:19:44 [---] [http] HTTP_OP::init_post(): http://climateapps2.oucs.ox.ac.uk/cpdnboinc_cgi/cgi
20-Dec-2010 16:19:45 [---] [http] [ID#1] Info:  About to connect() to climateapps2.oucs.ox.ac.uk port 80 (#2)
20-Dec-2010 16:19:45 [---] [http] [ID#1] Info:    Trying 163.1.13.17...
20-Dec-2010 16:19:45 [---] [http] [ID#1] Info:  Connected to climateapps2.oucs.ox.ac.uk (163.1.13.17) port 80 (#2)
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: POST /cpdnboinc_cgi/cgi HTTP/1.1
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: User-Agent: BOINC client (i686-pc-linux-gnu 6.12.8)
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Host: climateapps2.oucs.ox.ac.uk
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Accept: */*
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Content-Length: 15533
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server: Expect: 100-continue
20-Dec-2010 16:19:45 [---] [http] [ID#1] Sent header to server:
20-Dec-2010 16:19:45 [---] [http] [ID#1] Received header from server: HTTP/1.1 100 Continue
20-Dec-2010 16:19:45 [---] [http] [ID#1] Info:  Expire cleared
20-Dec-2010 16:19:45 [---] [http] [ID#1] Info:  Closing connection #2
20-Dec-2010 16:19:45 [---] [http] HTTP error: Failure when receiving data from the peer
20-Dec-2010 16:19:46 [---] Project communication failed: attempting access to reference site
20-Dec-2010 16:19:46 [---] [http] HTTP_OP::init_get(): http://www.google.com/
20-Dec-2010 16:19:46 [climateprediction.net] Scheduler request failed: Failure when receiving data from the peer


Any thoughts? Should I continue to nurse these orphaned trickle files or just trash them?
Metod ...
ID: 41332 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41333 - Posted: 20 Dec 2010, 22:19:16 UTC - in response to Message 41332.  
Last modified: 20 Dec 2010, 22:20:48 UTC

It is possible to send trickles, but a backup is needed from before the end. And it may also be necessary to fiddle with the client_state.xml file.
It's been a long while since I had a problem with this, so I'm a little hazy about the details.

Also, a lot of the data is in the trickles, so without it the model is incomplete.
Backups: Here
ID: 41333 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 41338 - Posted: 22 Dec 2010, 13:53:29 UTC - in response to Message 41333.  

OK, I don't have any backup from right before end of model run.

Makes me wonder: what would be so special from BOINC CC point of view when sending trickle files regarding presence of BOINC task that created those trickle files? I'd guess scheduler should accept trickle files and is free to do with them whatever desired.

A couple of trickle files again accumulated on this machine. I manually triggered connection to CPDN and those trickle files uploaded just fine. When I tried to upload a single stale trickle file, connection failed again.

Can I pack trickle files and send them via e-mail somewhere? I'd really like to deliver data, I just don't know how.
Metod ...
ID: 41338 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 41340 - Posted: 22 Dec 2010, 17:10:31 UTC
Last modified: 22 Dec 2010, 17:13:42 UTC

The trickles upload to the scheduler, whatever the type of model, but the files upload to different upload servers depending on the model type. It may be the fact that more than one server is involved that can occasionally make the process become unsynchronised.

Could you tell us which model type these orphaned trickles are from? I'm asking because some model types produce trickles containing data but others are just a message asking for credits. If your trickles don't contain data it won't be worth doing anything special because the files will be sufficient for the researchers.

If your trickles do contain data we would have to see what we can do because at the moment since Milo left CPDN has had no programmer for the servers. Well, temporarily no programmer at all(!!!). I believe that new programmers have been appointed but don't know when they'll join the project.
Cpdn news
ID: 41340 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 41341 - Posted: 22 Dec 2010, 18:46:47 UTC - in response to Message 41340.  

Could you tell us which model type these orphaned trickles are from?


It's a FAMOUS model. Trickle files are about 4.5kB each.

Metod ...
ID: 41341 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 41354 - Posted: 24 Dec 2010, 10:44:47 UTC

Hi Metod

There was a CPDN manual upload facility but it doesn't work now. I've asked the researchers about what you should do but I don't think we'll get an answer now until after the holidays.
Cpdn news
ID: 41354 · Report as offensive     Reply Quote
old_user8065

Send message
Joined: 1 Sep 04
Posts: 24
Credit: 10,865,773
RAC: 0
Message 41433 - Posted: 4 Jan 2011, 19:56:31 UTC - in response to Message 41354.  

I wonder if any of the researchers managed to look into this issue?
Metod ...
ID: 41433 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 41452 - Posted: 8 Jan 2011, 20:52:35 UTC - in response to Message 41433.  

There haven't been any programmers since the start of December, and their replacements won't arrive for a few more weeks. When they do, it's unlikely that they'll have time to fiddle with problems like this.

I think that you should just delete the files, and write it off to experience.



Backups: Here
ID: 41452 · Report as offensive     Reply Quote

Message boards : Number crunching : trickles of finished model

©2024 cpdn.org