Average rating bug |
Post Reply | Page 12> |
Author | ||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
Posted: 07 Apr 2011 at 8:05am |
|
I've just noticed that there seems to be a bug with the average rating for albums. I was just browsing the top albums in death metal and noticed this.
Entombed - Clandestine - 4 ratings/ 0 reviews: 2x 5* 1x 4.5* 1x 2.5* average rating = 4.87 Obscura - Omnivium - 4 ratings/ 4 reviews: 2x 5* 2x 4.5* average rating = 4.75 The average rating for Omnivium is correct, but Clandestine should actually be 4.25
|
||
UMUR
MMA Special Collaborator Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18264 |
Post Options
Thanks(0)
|
|
Are you also taking into consideration the different weighting. Rating only has a lesser rating weight than a review and Collab reviews have a bigger weigting than non-Collab reviews.
|
||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
|
|
Yes I know that, but surely by that logic the Obscura album should be rated higher since it has 4 collab reviews and the Entombed album just has 4 ratings and no reviews?
Edited by adg211288 - 07 Apr 2011 at 8:33am |
||
UMUR
MMA Special Collaborator Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18264 |
Post Options
Thanks(0)
|
|
Yeah that�s a bit odd.
|
||
Henry Plainview
Forum Senior Member Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
Post Options
Thanks(0)
|
|
Well when I go to the page now there are 5 ratings: 2 five stars, one 4.5, one 4, and one 2.5 and the average is 4.83. However, one of the five stars is by Vic, who is a collab. That average works correct if you give his rating the 20x collab weight. I tested a few other albums around and I know at least this one is the same, so it's not just albums without reviews. Testing this was very annoying because I had to hover over names on the ratings to see who was a collab, so I don't remember which other ones I did, and I didn't do an extensive search because it's almost 3am and I couldn't be bothered. Some of my tests made no sense, but I think that was probably just mistakes on my part.
Maybe it has always been this way the whole time and nobody noticed until now? Oops. Edited by Henry Plainview - 09 Apr 2011 at 2:54am |
||
|
||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
|
|
I was under the impression that the weighting only applies if there is a review, a rating always just being a rating regardless of whose rating it is.
Actually I was also under the impression that the weighting didn't actually apply to the average shown on each album, just how the top lists on each genre page were decided, after all if the weighting applies to the average then by that logic the top album in each sub should be the one with the highest average, which isn't the case in every sub. |
||
Henry Plainview
Forum Senior Member Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
Post Options
Thanks(0)
|
|
A rating only is supposed to be 1 weight no matter who is giving it, but clearly something has gone awry. The weighting absolutely applies to the displayed average, the whole point is for the sober collab reviews to outweigh a lot of ratings only from random people so people have a more accurate picture. That's something that can be easily verified with a calculator. The placement on the list is considering the weight and the average relative to the other albums and is a little bit harder to do by hand because I think you would have to calculate the weight of every album in the list you're talking about. But your problem is that you are assuming the albums with the most weight from reviews and ratings are also the highest rated. That is clearly not always the case. i.e. The difference in weight between Ziltoid the Omniscient (with 4 collab reviews and a member review and more ratings only) and Fear of a Blank Planet (only 3 collab reviews) is greater than the .04% difference in their overall average. Edited by Henry Plainview - 09 Apr 2011 at 4:41am |
||
|
||
AtomicCrimsonRush
MMA Metal Reviewer Joined: 21 May 2010 Location: Australia Status: Offline Points: 602 |
Post Options
Thanks(0)
|
|
^^^THIS!
|
||
GLAM METAL!
|
||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
|
|
Ok, I understand it better now. Thank you Henry.
|
||
UMUR
MMA Special Collaborator Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18264 |
Post Options
Thanks(0)
|
|
I�ve always had trouble with the math, so educate me here. Is there a problem that needs to be reported or not?
|
||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
|
|
I'd say yes because going back to the two albums I posted about originally, Obscura's album has 4 collab reviews which should have 20x rating weight each, whereas the Entombed album has no reviews at all, yet clearly has a higher weight rating/placement on the list.
|
||
UMUR
MMA Special Collaborator Errors & Omissions Team / Retired Admin Joined: 25 Mar 2010 Location: Denmark Status: Offline Points: 18264 |
Post Options
Thanks(0)
|
|
I�ll PM Phil and have him have a look at this thread and see what he thinks.
|
||
Henry Plainview
Forum Senior Member Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
Post Options
Thanks(0)
|
|
Yes, it appears that some (perhaps even all) collab ratings are receiving the 20x weight even though there is no review. Only the collab reviews should be weighted 20x, everybody's rating without a review is supposed to be equal (1x). (Sorry to repeat but I thought adg's explanation was not very clear) |
||
|
||
The Angry Scotsman
MMA Special Collaborator Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
Post Options
Thanks(0)
|
|
Wait, is the issue that collab ratings without review are getting the 20X weighting?
I was wondering about that myself a while back http://www.metalmusicarchives.com/forum/forum_posts.asp?TID=1454 I took Jonas' advice and PM'd Phil and this was his exact response to me "It doesn't matter for you because you are a collaborator and the weight for rating only and full text reviews are the same. So if the the problem is collab rating onlys are getting full weight, it seems like for collabs the 20X weight is used regardless of review or not. edit: it is 5 am I dont care for math....so if there is an actual bug with the rating system itself please have it looked into. The collab weighting for non reviews though is not an issue. Edited by The Angry Scotsman - 13 Apr 2011 at 4:14am |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
adg211288
Forum Admin Group Black Metal, Prog/AG Teams Joined: 05 Nov 2010 Location: United Kingdom Status: Offline Points: 22304 |
Post Options
Thanks(0)
|
|
If collab rating only is actually worth 20x, then those averages are actually working out correctly right now, despite consistently higher ratings for Obscura and more collab reviews/ratings than Entombed. Doesn't seem right, but I guess you can't argue against the maths. So now that's cleared up I'm doubting there is a bug with the average ratings after all.
|
||
The Angry Scotsman
MMA Special Collaborator Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
Post Options
Thanks(0)
|
|
According to Phil, (and I'm pretty sure he'd know ) collabs get the 20X weight, review or rating only.
So yeah, I'll leave the math to you guys but that is the case. Guess another perk of collabhood! Of course Henry wouldn't know because he came to MMA, I assume, just to flood us with ponies Edited by The Angry Scotsman - 13 Apr 2011 at 9:45pm |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
Henry Plainview
Forum Senior Member Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
Post Options
Thanks(0)
|
|
Ok, well then why is it like that on MMA but not PA? It used to be like that on PA, but Max changed it because it's a terrible idea, so why go backwards? |
||
|
||
The Angry Scotsman
MMA Special Collaborator Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
Post Options
Thanks(0)
|
|
OK, well it is? Not sure why you have to do this, besides the fact you are Henry...if you honestly care enough (I'm sure you do) than PM an admin and inquire about it and ask to have it changed. Might not result in anything but complaining here certainly won't do much. Not like everything has to be the same anyway... |
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
The Angry Scotsman
MMA Special Collaborator Honorary Collaborator Joined: 08 Aug 2010 Location: New Jersey, US Status: Offline Points: 1076 |
Post Options
Thanks(0)
|
|
Also, I thought you were still on break from the internet???
|
||
Megadeth, Metallica, Slayer and Testament. The real Big Four of thrash metal!
Listen to doom metal, worship Satan |
||
Henry Plainview
Forum Senior Member Joined: 27 Mar 2010 Location: non-euclidean Status: Offline Points: 262 |
Post Options
Thanks(0)
|
|
Not really, I'm never going to be rating anything myself here anyway. It's just the principle, but I'm not going to waste time with personal appeals. My futile effort is better spent complaining about the new emoticons.
Too much fail. Edited by Henry Plainview - 23 Apr 2011 at 11:52pm |
||
|
||
Post Reply | Page 12> |
Tweet
|
Forum Jump | Forum Permissions You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum |