climateprediction.net (CPDN) home page
Thread 'Long Project Woes'

Thread 'Long Project Woes'

Questions and Answers : Preferences : Long Project Woes
Message board moderation

To post messages, you must log in.

AuthorMessage
SMURLEY

Send message
Joined: 3 May 07
Posts: 10
Credit: 52,225
RAC: 0
Message 55260 - Posted: 1 Dec 2016, 18:26:30 UTC

Hi,

I keep getting "Weather at Home 2" tasks sent to my Boinc which are days long in length for processing. Last one was 3 days, current one is 11 days. These will take an incredibly long time on my PC to get through because I'm also subscribed to multiple other projects, plus it gets depressing seeing climateprediction tasks in my list that have hardly shifted in months.

There's no way to say "Only give me tasks that are less than 24 hours in length" is there?

Should I just untick the Weather At Home 2 project?
ID: 55260 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55267 - Posted: 1 Dec 2016, 20:51:54 UTC - in response to Message 55260.  

Sorry, but all climate models are big, and getting bigger, as the researchers move to more elaborate models. The w@h2 models are also their current favourite, as they can be run for different resolutions, and different number of model months/years.

But, yes, it is possible to choose which types you ask for.
It's in your preference settings on your account page.

And 3 days to a week is normal for most of the models, on most computers.
There are NO models that run for a day or less. Although that is a possibility with the w@h2 model types.

Another problem long running tasks face, is that the researchers can just give up, and issue a new batch, in the hope that they'll be run more quickly. Then they just ignore those results that come in months later.
ID: 55267 · Report as offensive     Reply Quote
SMURLEY

Send message
Joined: 3 May 07
Posts: 10
Credit: 52,225
RAC: 0
Message 55285 - Posted: 3 Dec 2016, 11:03:58 UTC - in response to Message 55267.  

Thanks for response.

Hmmm, I have suspended climateprediction project for time being in Boinc :( I'd love to contribute but I don't have the capacity really to do the long tasks justice.
ID: 55285 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 55286 - Posted: 3 Dec 2016, 14:13:38 UTC
Last modified: 3 Dec 2016, 14:16:28 UTC

I think the problem is that unless someone planning to sign up for CPDN gets round to reading the System Requirements page first they won't know that the vast majority of tasks take from a few days upwards to complete.
ID: 55286 · Report as offensive     Reply Quote
SMURLEY

Send message
Joined: 3 May 07
Posts: 10
Credit: 52,225
RAC: 0
Message 55287 - Posted: 3 Dec 2016, 14:26:16 UTC - in response to Message 55286.  

I think the problem is that unless someone planning to sign up for CPDN gets round to reading the System Requirements page first they won't know that the vast majority of tasks take from a few days upwards to complete.


Sorry :(
ID: 55287 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 55288 - Posted: 3 Dec 2016, 16:05:05 UTC

No need to be sorry, I didn't either and I haven't for World Community Grid either. What I should have suggested is that this is put on the sign up page for when you create an account.
ID: 55288 · Report as offensive     Reply Quote
SMURLEY

Send message
Joined: 3 May 07
Posts: 10
Credit: 52,225
RAC: 0
Message 55290 - Posted: 3 Dec 2016, 20:23:18 UTC - in response to Message 55288.  

No need to be sorry, I didn't either and I haven't for World Community Grid either. What I should have suggested is that this is put on the sign up page for when you create an account.


Agree :-)
ID: 55290 · Report as offensive     Reply Quote
ProfileJIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,363,583
RAC: 5,022
Message 55292 - Posted: 4 Dec 2016, 5:50:30 UTC - in response to Message 55290.  

Long? The ones that we have now aren’t long. You should have been running CPDN back in the days of the 160 year models. They took about 33,000 hours to complete on a single core 1.2 Ghz machines with 265 MB’s (that's right 1/4 of a GB) of RAM. That was about 6 months running 24/7. :)
ID: 55292 · Report as offensive     Reply Quote
SMURLEY

Send message
Joined: 3 May 07
Posts: 10
Credit: 52,225
RAC: 0
Message 55293 - Posted: 4 Dec 2016, 11:08:21 UTC - in response to Message 55292.  

Long? The ones that we have now aren’t long. You should have been running CPDN back in the days of the 160 year models. They took about 33,000 hours to complete on a single core 1.2 Ghz machines with 265 MB’s (that's right 1/4 of a GB) of RAM. That was about 6 months running 24/7. :)


LOL. Might have to give this project a break until I finish creating my supercomputer ;)
ID: 55293 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55329 - Posted: 10 Dec 2016, 6:25:48 UTC

And, just to prove me wrong, a small batch showed up half a day ago that have only taken 9.5 hours to run.
ID: 55329 · Report as offensive     Reply Quote
scott6135
Avatar

Send message
Joined: 17 Aug 24
Posts: 2
Credit: 2,549
RAC: 101
Message 71570 - Posted: 8 Oct 2024, 3:03:30 UTC

CPDN.net admin. I am not open to doing projects that are 14.5 days long. I will no longer be contributing my computer time until the work units are 24 hours or less.
ID: 71570 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 71572 - Posted: 8 Oct 2024, 9:15:25 UTC - in response to Message 71570.  

CPDN.net admin. I am not open to doing projects that are 14.5 days long. I will no longer be contributing my computer time until the work units are 24 hours or less.
Perhaps read a bit about projects before signing up to them. Most CPDN tasks are likely to take about 5 days on your machine even if the BOINC estimate is longer. As has been pointed out near the beginning of this thread, climate models are large. Splitting them into smaller tasks greatly increases the chances of errors creeping in. This does mean that CPDN is not suitable for all, particularly not machines that are only crunching for a short period of time each day.
ID: 71572 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,551,831
RAC: 17,001
Message 71576 - Posted: 8 Oct 2024, 13:03:59 UTC - in response to Message 71572.  
Last modified: 8 Oct 2024, 13:06:12 UTC

CPDN.net admin. I am not open to doing projects that are 14.5 days long. I will no longer be contributing my computer time until the work units are 24 hours or less.
Perhaps read a bit about projects before signing up to them. Most CPDN tasks are likely to take about 5 days on your machine even if the BOINC estimate is longer. As has been pointed out near the beginning of this thread, climate models are large. Splitting them into smaller tasks greatly increases the chances of errors creeping in. This does mean that CPDN is not suitable for all, particularly not machines that are only crunching for a short period of time each day.
We could split the model forecast into shorter segments if people get a kick out of seeing the boinc client progress meter move faster, similar to how WCG do it. If done correctly it would not introduce errors. However, that's a very inefficient way of running the models. It means each forecast will take considerably longer to achieve, plus moving more data between the volunteers and the servers. So that's why it's not done that way. You'll generate credit faster by letting the task run than breaking it up into smaller chunks & uploading/downloading new smaller tasks.
---
CPDN Visiting Scientist
ID: 71576 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 127
Credit: 42,339,328
RAC: 73,892
Message 71584 - Posted: 9 Oct 2024, 4:31:50 UTC - in response to Message 71572.  
Last modified: 9 Oct 2024, 4:55:37 UTC

Just saw the system requirement link above and of course it's dead after migrating to the new site. I dug out the new page: https://cpdn.org/volunteering-your-computer/system-requirements/

Updating that with an expected runtime would be helpful to set the expectations right.

Edited: Initially I thought that's out of date, but if we just consider the lightest app for "minimum requirements", that does work out. (Other than perhaps removing Mac at this point.)
ID: 71584 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 71585 - Posted: 9 Oct 2024, 7:07:46 UTC

Just saw the system requirement link above and of course it's dead after migrating to the new site. I dug out the new page: https://cpdn.org/volunteering-your-computer/system-requirements/
And that page doesn't mention the requirements for the OIFS tasks. A while ago, I had a netbook that ran at 2 and tasks took a long time on it. Well over 30 days for some tasks.
ID: 71585 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 1049
Credit: 16,551,831
RAC: 17,001
Message 71586 - Posted: 9 Oct 2024, 12:02:28 UTC - in response to Message 71585.  
Last modified: 9 Oct 2024, 12:03:34 UTC

Yes, I noticed the information on that page was out of date. I was going to mention it to Andy. He's working his way through the webpages updating them. I think the information is also best placed on the project preferences page. People are more likely to see it there.

It's very hard to give a time estimate. Depends so much on CPU and time that boinc is running.

For this particular thread though, I don't think it would have made much difference...
---
CPDN Visiting Scientist
ID: 71586 · Report as offensive     Reply Quote
scott6135
Avatar

Send message
Joined: 17 Aug 24
Posts: 2
Credit: 2,549
RAC: 101
Message 71630 - Posted: 16 Oct 2024, 3:49:05 UTC - in response to Message 71584.  

I agree with this. a correct estimation of time is always helpful when choosing tasks for donated computer time. Is there a way to dedicate time to one weather model over another or select regions?
ID: 71630 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4540
Credit: 19,039,635
RAC: 18,944
Message 71652 - Posted: 17 Oct 2024, 8:56:27 UTC - in response to Message 71630.  

Is there a way to dedicate time to one weather model over another or select regions?
Not currently. The OIFS tasks may be opt in. There should be more information from testing before they reach the main site.
ID: 71652 · Report as offensive     Reply Quote

Questions and Answers : Preferences : Long Project Woes

©2024 cpdn.org