climateprediction.net home page
HADAM3P's too much RAC weight?

HADAM3P's too much RAC weight?

Message boards : Number crunching : HADAM3P's too much RAC weight?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Thund3rb1rd

Send message
Joined: 18 Jun 05
Posts: 24
Credit: 2,500,676
RAC: 0
Message 37024 - Posted: 31 May 2009, 18:41:45 UTC

I'm sure I have the wrong attitude about this credit business, but does any of it really matter in the grand scheme of things? Is any of it effecting the science in any way? Are the models being computed incorrectly because of the amount of credit given or not given?

Or am I just being a cranky old man?

ID: 37024 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 37025 - Posted: 31 May 2009, 21:23:19 UTC

Well, of course the credits don't affect the scientific results of the individual models. However, to the extent that credits motivate some crunchers to keep going and contribute more, they probably do help to increase the overall participation levels. And that helps the researchers.

I can understand members feeling that BOINC credits are an irrelevant bore, but I can also understand the members who enjoy the spirit of competition.

We are receiving the right number of credits for every model type including HadAM3P. It's just the recent average credit calculation done by the CPDN server that's wrong if it includes HadAM3P. We'll have to bring this problem up again with Milo.

http://boinc.berkeley.edu/dev/forum_thread.php?id=3796


Cpdn news
ID: 37025 · Report as offensive     Reply Quote
Profile Milo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 37026 - Posted: 1 Jun 2009, 10:33:33 UTC - in response to Message 37025.  


We are receiving the right number of credits for every model type including HadAM3P. It's just the recent average credit calculation done by the CPDN server that's wrong if it includes HadAM3P. We'll have to bring this problem up again with Milo.


I am aware of this and would like to fix it. There are a couple of things getting in the way at the moment. The first is that I am not sure exactly where this problem lies and the second is that the entire credit process needs sorting out. Our current credit script is very slow with one particular part taking 5 hours to run and putting a heavy load on the database, and we really need to get this fixed. At the moment I'm trying some alternative means of performing the calculation.
ID: 37026 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,252,618
RAC: 10,419
Message 37029 - Posted: 1 Jun 2009, 16:42:23 UTC - in response to Message 37026.  

I am not sure exactly where this problem lies.

Am I even close to collecting on my bet?
ID: 37029 · Report as offensive     Reply Quote
Profile Milo Thurston
Volunteer moderator
Volunteer developer

Send message
Joined: 2 Mar 06
Posts: 253
Credit: 363,646
RAC: 0
Message 37033 - Posted: 2 Jun 2009, 9:32:52 UTC - in response to Message 37029.  


Am I even close to collecting on my bet?


Unfortunately not.
ID: 37033 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,252,618
RAC: 10,419
Message 37034 - Posted: 2 Jun 2009, 9:45:09 UTC - in response to Message 37033.  


Am I even close to collecting on my bet?

Unfortunately not.

Shucks. Thinking cap back on, then.
ID: 37034 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 37058 - Posted: 4 Jun 2009, 13:55:12 UTC - in response to Message 37029.  
Last modified: 4 Jun 2009, 14:39:50 UTC

I am not sure exactly where this problem lies.

Am I even close to collecting on my bet?


Is it day deprecation? Meaning a single core host producing 300 credits per day delivers this to the average credit formula:
Mon     300                             Mon   300
Tues    600                             Tues  300
Wed     900    when it should be --->   Wed   300
Thurs  1200                             Thur  300
Fri    1500 (completion)                Fri   300
Sat     300                             Sat   300

(I know these numbers don't match an actual HADAM3P run--just illustrating the point.)
ID: 37058 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 37914 - Posted: 30 Aug 2009, 18:21:15 UTC

Ahh... all is quiet on the climateapps2 board. The new scripts and hardware upgrades are working swimmingly--the admins and programmers richly deserve our appreciation and adulation.

However we still have beaucoup RAC with HADAM3P\'s!

Oh well, life is full of imperfections. It doesn\'t bother me so much because I use boincstats.com to look at monthly and weekly credit accumulations. Hopefully the newbs aren\'t too put-off by this.
ID: 37914 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 37915 - Posted: 30 Aug 2009, 18:52:58 UTC
Last modified: 30 Aug 2009, 19:02:09 UTC

I think you\'re right - beaucoup trop. Since my beta models finished and I\'ve been running more HadAM3P, my blue RAC line has jumped above the red BoincStats RAC line. That\'s even though my slower AMD is only running Mid-Holocenes. I know the blue and red RACs are calculated by different formulas, but they shouldn\'t usually be way out of sync. Un mystère inexplicable.

I certainly shouldn\'t have a CPDN RAC above 2000 because my two computers together can only manage about 1450 daily max.

I\'ve noticed btw that on my C2Duo the HadAM3Ps run noticeably faster when there\'s a Mid-Holocene on the other core and not another 3P.
Cpdn news
ID: 37915 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 37916 - Posted: 30 Aug 2009, 19:10:39 UTC


It\'s just a minor annoyance. One could even say it spices the project up a bit.

mo.v, here\'s an early congratulations on 1,000,000 credits. Nice work!

Eric
ID: 37916 · Report as offensive     Reply Quote
old_user36660

Send message
Joined: 21 Jan 05
Posts: 5
Credit: 103,467
RAC: 0
Message 37965 - Posted: 9 Sep 2009, 1:54:03 UTC

Don\'t HADAM3P use the more advanced SSE2 instruction set on cpus? If so, they do more calculations per clock and boinc might expect that they would be awarded more credit. Just my thought on this.
ID: 37965 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 37966 - Posted: 9 Sep 2009, 2:41:02 UTC

As has been posted many times, this project doesn\'t use the BOINC credits system.
Use the Advanced search, and set the Search limits to 1 year.



Backups: Here
ID: 37966 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 37974 - Posted: 9 Sep 2009, 11:59:56 UTC

For each model type there\'s a specific number of credits per trickle. HadSM and HadSM MH are essentially the same type so the number\'s the same. If you crunch faster and produce more frequent trickles you earn more credits.

The compilation is always designed to produce the highest quality model results, not to make the models run as fast as possible.

HadAM3P models receive their correct number of credits per trickle but produce incorrect, artificially inflated RAC (recent average credit) values. Milo has looked at this but cannot find the reason.
Cpdn news
ID: 37974 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 37976 - Posted: 9 Sep 2009, 15:45:37 UTC - in response to Message 37974.  
Last modified: 9 Sep 2009, 16:42:49 UTC

.....................
HadAM3P models receive their correct number of credits per trickle but produce incorrect, artificially inflated RAC (recent average credit) values. Milo has looked at this but cannot find the reason.


This may be a very naïve remark, but, if the calculation seems correct, is there any chance the \"average credit\" weighting from HadAM3P models could be entered twice in the calculation as it seems that the RAC that should be just over 1,000, displays as just over 2,000?

I was running HadAM3P exclusively and had settled at 2,350 RAC after the replacement of servers.
Then I have been running exclusively hadsm (Holocene & Slab).
The straight line of \"Total Credit\" proves the same rates of credits have been given.
But RAC has sunk over the same 16 days and is levelling off at about 1,050.

During those 16 days total credits rose from 724,600 to 731,200.
That is an increase of 6,600.
That works out at just over 400 per day.

So, how come the RAC is calculated at the average over TWO AND A HALF DAYS.
That seems absurd.

As the RAC never seems to make any sense, it does not worry me.
I just ignore it as useless.
Quite happy aligning a ruler along the total credit graph to see delays caused by late returning or crediting of trickles.

I am just very, very curious as to what \"average\" means.
A speed is reckoned as miles per hour or feet per second.
But this mysterious RAC is just a number with no meaning.
\"Credits per day\" or \"Credits per week\" would be reasonable descriptions, but they are obviously neither of these.

Keith
ID: 37976 · Report as offensive     Reply Quote
DJStarfox

Send message
Joined: 27 Jan 07
Posts: 300
Credit: 3,288,263
RAC: 26,370
Message 37977 - Posted: 9 Sep 2009, 16:49:01 UTC - in response to Message 37976.  

Well, I can tell you what RAC *should* be. It should be calculated using a moving average credits granted per day, over 7 days. The formula for this is here:
http://en.wikibooks.org/wiki/Statistics/Summary/Averages/Moving_Average

The fact that only one model miscalculates the RAC is a strange anomaly. Again, though, choose your battles. What\'s it worth time & effort to properly calculate RAC?
ID: 37977 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 37978 - Posted: 9 Sep 2009, 19:26:05 UTC - in response to Message 37977.  
Last modified: 9 Sep 2009, 19:34:49 UTC

Well, I can tell you what RAC *should* be. It should be calculated using a moving average credits granted per day, over 7 days. The formula for this is here:
http://en.wikibooks.org/wiki/Statistics/Summary/Averages/Moving_Average

The fact that only one model miscalculates the RAC is a strange anomaly. Again, though, choose your battles. What\'s it worth time & effort to properly calculate RAC?


OK. So, I enjoy mathematical puzzles, and this certainly is one.
It appears from that link, the average may be based on 10 days rather than on 7 days, but no matter.
The \"moving average\" whether \"weighted\" or not should be irrelevant in my case.
With minor fluctuations the total credits over 16 days were 400 per day.
This has remained steady in the period using HadAM3P exclusively, then running hadsm exclusively.
But the RAC has shown as 2,350 (nearly 6 times what it should) with HadAM3P.
Now settling down at just over 1,000 (still well over double what it should be) under hadsm.

So, I disagree that HadAM3P is the only model showing incorrect RAC.
It just is a more extreme example of inaccuracy, I think you must agree.

I agree with the formula to smooth out the curve, but wonder what values are taken for the weighting, and what happens at the \"near edges\" calculations that are mentioned.

It all seems to be a very complicated bit of work, when a straight average over the previous 14 or 28 days (total divided by the number of days) would give adequate smoothing anyway.
The \"adequate smoothing\" is provided by dividing the difference of the latest day added at one end and the day removed at the start of the average period, as this change is divided by 14 or by 28 depending on which of the 2 periods that I suggested are used.
And much, much simpler for computing (and more importantly, easily understood).

I wonder if the programmers might heed this, and think it might be worth considering?

Keith
ID: 37978 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 37979 - Posted: 9 Sep 2009, 19:58:09 UTC

The programmers are busy with the Hi-res models and the 1200 year models.
However: \"Your input is important to us. Please call again later.\" :)

ID: 37979 · Report as offensive     Reply Quote
old_user294426

Send message
Joined: 20 Feb 06
Posts: 158
Credit: 1,251,176
RAC: 0
Message 37980 - Posted: 9 Sep 2009, 20:57:52 UTC
Last modified: 9 Sep 2009, 21:07:26 UTC

I MUST APOLOGISE.
I miscalculated the daily rate of credits as 400.
It should have been 660 per day. I misread a date on the graph.
So the period was 10 days and not 16 days as I previously said.
That could just about at a stretch be the figure the graph will finally level out.
So, I must withdraw my comment about ALL averages being way out.
Blush, blush. Sorry for not taking care to double check my calculations.

Although, if the 10 days mentioned in the link are to be believed, the graph should already have levelled out at 660 after the 10 days had elapsed.
It is still at 1,075 after 15 days on the hadsm models (which are accurately calculated?)

Keith
ID: 37980 · Report as offensive     Reply Quote
3rkko

Send message
Joined: 12 Feb 08
Posts: 66
Credit: 4,877,652
RAC: 0
Message 37986 - Posted: 11 Sep 2009, 23:29:25 UTC - in response to Message 37980.  

The formula for RAC is:
Old_RAC * 0.5^(1/7) + Today\'s_credit * (1-0.5^(1/7)) = New_RAC

That is a weighted average so that more recent credit has a higher weight. It also means that your RAC has a half-life of 7 days.

If you start with a RAC of 2350 and your daily output is 660 credit, then according to the formula your RAC should be 974 after 17 days. Your current RAC seems to be 965, pretty close.
ID: 37986 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 37987 - Posted: 11 Sep 2009, 23:49:05 UTC - in response to Message 37977.  

What\'s it worth time & effort to properly calculate RAC?


I agree--it\'s not worth the effort. But we could probably prevent a lot of head scratching by removing RAC from this site--or at least put some math violation in the script so everyone\'s RAC shows an error or zero. It\'s meaningless, so why keep advertising it as meaningful?
ID: 37987 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : HADAM3P's too much RAC weight?

©2024 climateprediction.net