MetalMusicArchives.com Homepage
Forum Home Forum Home >Site News, Newbies, Help and Improvements >Internal news
  New Posts New Posts RSS Feed - Rating/review weights changed
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Rating/review weights changed
 Post Reply Post Reply Page  12>
Author
Message
  Topic Search Topic Search  Topic Options Topic Options
adg211288 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black Metal, Prog/AG Teams

Joined: 05 Nov 2010
Location: United Kingdom
Status: Offline
Points: 22293 		Post Options Post Options   Thanks (0) Thanks(0)   Quote adg211288 Quote  Post ReplyReply Direct Link To This Post Topic: Rating/review weights changed
    Posted: 09 Mar 2018 at 5:51am
An adjustment has been made to MMA's weight on ratings and reviews. These were originally changed to try to combat down raters but have now been set to more realistic values:

Rating only: 1, regardless of who left it.
Member review: 5
Staff (collab/metal reviewer/admin) review: 10

This was changed as we were concerned that the large weighting rates, especially for staff rating only submissions. Now every non-review rating is on a level playing field. 

On this note, MMA always needs ratings. If you've heard it, rate it! You can change your rating at any time, so don't worrying about changing opinions.


Edited by adg211288 - 10 Mar 2018 at 9:21am
Earn Money Online (NOT a scam):
GG2U

Adam's Film Corner on Quora
Back to Top
TheHeavyMetalCat View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Black and Death Metal Teams

Joined: 20 Nov 2015
Status: Offline
Points: 1781 		Post Options Post Options   Thanks (0) Thanks(0)   Quote TheHeavyMetalCat Quote  Post ReplyReply Direct Link To This Post Posted: 09 Mar 2018 at 5:59am
Excellent! The collab rating only weight was always completely overkill.

This will be an great excuse to post new versions of my sub-genre polls. I can see the pages have changed quite a bit already.
Back to Top
adg211288 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black Metal, Prog/AG Teams

Joined: 05 Nov 2010
Location: United Kingdom
Status: Offline
Points: 22293 		Post Options Post Options   Thanks (0) Thanks(0)   Quote adg211288 Quote  Post ReplyReply Direct Link To This Post Posted: 09 Mar 2018 at 6:02am
Hold off a few hours Ashley just to make sure everything is re-synced. Max has warned me that it may take an hour or two for everything to be updated. Also maybe leave the new sub-genres off for now as we're still moving and adding to them. 
Earn Money Online (NOT a scam):
GG2U

Adam's Film Corner on Quora
Back to Top
TheHeavyMetalCat View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Black and Death Metal Teams

Joined: 20 Nov 2015
Status: Offline
Points: 1781 		Post Options Post Options   Thanks (0) Thanks(0)   Quote TheHeavyMetalCat Quote  Post ReplyReply Direct Link To This Post Posted: 09 Mar 2018 at 6:07am
Okay, I'll start thinking about them at the weekend. I'm off out shortly anyway.
Back to Top
Unitron View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Honorary Collaborator

Joined: 30 Apr 2014
Location: Cypress Hill
Status: Offline
Points: 8051 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Unitron Quote  Post ReplyReply Direct Link To This Post Posted: 09 Mar 2018 at 6:54pm
Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.

Edited by Unitron - 09 Mar 2018 at 9:37pm
Back to Top
siLLy puPPy View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Prog/AG Team

Joined: 06 Oct 2013
Location: SF, CA, USA
Status: Offline
Points: 2742 		Post Options Post Options   Thanks (0) Thanks(0)   Quote siLLy puPPy Quote  Post ReplyReply Direct Link To This Post Posted: 09 Mar 2018 at 7:02pm
I kinda like this. When did the new subs get added? I just noticed them. Must have been fairly recent.
Back to Top
adg211288 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black Metal, Prog/AG Teams

Joined: 05 Nov 2010
Location: United Kingdom
Status: Offline
Points: 22293 		Post Options Post Options   Thanks (0) Thanks(0)   Quote adg211288 Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 2:11am
Originally posted by Unitron Unitron wrote:

Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.

This is just not true. There are literally two progressive metal tagged albums in the top 25, plus two Rush (progressive hard rock) albums and one Death (technical/progressive death metal) album, if you want to count those as well. 

The earliest wayback machine page I can get to load is from August last year. There were three albums that could be considered progressive then. It's not such a major difference to get upset about.

This is how the ratings should always have been. Collabs never should have had a 20x bonus for a rating only. It allowed one collab to completely dictate an album's average score and chart position if it was only regular members otherwise rating it. Everything you are seeing is because of that unfair bonus being nullified. We want more people rating things here and it was a major discouragement to normal members that their ratings basically counted for nothing if just one collab had rated the same release. 
Earn Money Online (NOT a scam):
GG2U

Adam's Film Corner on Quora
Back to Top
Nightfly View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Death, D/S/D, T/S/G Teams

Joined: 07 Apr 2010
Location: UK
Status: Offline
Points: 5079 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Nightfly Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 6:57am
Agreed, this is much fairer.
Back to Top
TheHeavyMetalCat View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Black and Death Metal Teams

Joined: 20 Nov 2015
Status: Offline
Points: 1781 		Post Options Post Options   Thanks (0) Thanks(0)   Quote TheHeavyMetalCat Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 12:07pm
Originally posted by Unitron Unitron wrote:

Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.


I'm not sure there is a visible Prog bias but does it really matter if there is? I seem to be reading an implication here that even if there is one it's something that should be censored?
Back to Top
666sharon666 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black, HM/HR/Glam Teams

Joined: 29 Dec 2010
Status: Offline
Points: 4084 		Post Options Post Options   Thanks (0) Thanks(0)   Quote 666sharon666 Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 1:39pm
These are the truer charts. The other ones were the bias ones. Collab bias that is. Everything is fair now.


Edited by 666sharon666 - 10 Mar 2018 at 1:56pm
Back to Top
Vim Fuego View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Death, T/S/G, Grind, VA Teams

Joined: 05 Jul 2015
Location: Canterbury, NZ
Status: Offline
Points: 6616 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Vim Fuego Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 2:22pm
Originally posted by adg211288 adg211288 wrote:

Originally posted by Unitron Unitron wrote:

Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.

This is just not true. There are literally two progressive metal tagged albums in the top 25, plus two Rush (progressive hard rock) albums and one Death (technical/progressive death metal) album, if you want to count those as well. 

The earliest wayback machine page I can get to load is from August last year. There were three albums that could be considered progressive then. It's not such a major difference to get upset about.

This is how the ratings should always have been. Collabs never should have had a 20x bonus for a rating only. It allowed one collab to completely dictate an album's average score and chart position if it was only regular members otherwise rating it. Everything you are seeing is because of that unfair bonus being nullified. We want more people rating things here and it was a major discouragement to normal members that their ratings basically counted for nothing if just one collab had rated the same release. 


Exactly. I was surprised how badly one negative review I did (can't even remember the band or the album) shot something out of the top 5 down to about 15. Might have been Rust in Peace? Or Opeth? Can't remember.
Back to Top
Vim Fuego View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Death, T/S/G, Grind, VA Teams

Joined: 05 Jul 2015
Location: Canterbury, NZ
Status: Offline
Points: 6616 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Vim Fuego Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 2:24pm
Originally posted by Unitron Unitron wrote:

Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.


Hardly. It could have been a lot worse. The top 5 was looking very mainstream before.
Back to Top
Unitron View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Honorary Collaborator

Joined: 30 Apr 2014
Location: Cypress Hill
Status: Offline
Points: 8051 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Unitron Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 4:17pm
Originally posted by adg211288 adg211288 wrote:

Originally posted by Unitron Unitron wrote:

Can't say I'm too fond of this, not because of collab ratings not holding as much weight, but because introducing a new system like this suddenly makes all the top albums look like it has a prog bias again. Doesn't really look too good, it was a lot more varied before.

This is how the ratings should always have been. Collabs never should have had a 20x bonus for a rating only. It allowed one collab to completely dictate an album's average score and chart position if it was only regular members otherwise rating it. Everything you are seeing is because of that unfair bonus being nullified. We want more people rating things here and it was a major discouragement to normal members that their ratings basically counted for nothing if just one collab had rated the same release. 

I completely agree, the original collab rating weight was complete overkill and this is how it should have always been, but that's not my point.

Since reviews have the highest weight (Which they should, don't get me wrong, ratings are irrelevant in the long run), it makes the albums with more reviews become the ones that are highest. And due to the first four years or so of the site being mostly run by prog fans, the majority of reviews are of prog related albums. 

Though I really didn't think about how this makes normal member ratings/reviews have a lot more pull, so hopefully this gets more people to come on and rate and review.

Originally posted by TheHeavyMetalCat TheHeavyMetalCat wrote:


I'm not sure there is a visible Prog bias but does it really matter if there is? I seem to be reading an implication here that even if there is one it's something that should be censored?

I don't think anything should be censored. I apologize for even bringing anything up, I don't know what I was trying to get at anymore.
Back to Top
DippoMagoo View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Power & Neo, Goth & Symph, Prog/AG Teams

Joined: 31 Aug 2014
Location: Canada
Status: Offline
Points: 3087 		Post Options Post Options   Thanks (0) Thanks(0)   Quote DippoMagoo Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 4:34pm
I've never been one to care about charts at all (except genre charts) but the current top 25 looks pretty well balanced to me. And yeah, the new system seems fair enough to me, though again, I generally don't pay much attention to that kind of thing anyway.
Back to Top
adg211288 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black Metal, Prog/AG Teams

Joined: 05 Nov 2010
Location: United Kingdom
Status: Offline
Points: 22293 		Post Options Post Options   Thanks (0) Thanks(0)   Quote adg211288 Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 4:53pm
Originally posted by Unitron Unitron wrote:

Since reviews have the highest weight (Which they should, don't get me wrong, ratings are irrelevant in the long run), it makes the albums with more reviews become the ones that are highest. And due to the first four years or so of the site being mostly run by prog fans, the majority of reviews are of prog related albums. 

Yes but this should be encouragement for more reviews to be written as well, at least by collabs. There's no incentive to write if you get the same bonus for just a rating only. 
Earn Money Online (NOT a scam):
GG2U

Adam's Film Corner on Quora
Back to Top
Unitron View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Honorary Collaborator

Joined: 30 Apr 2014
Location: Cypress Hill
Status: Offline
Points: 8051 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Unitron Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 5:20pm
Originally posted by adg211288 adg211288 wrote:

Originally posted by Unitron Unitron wrote:

Since reviews have the highest weight (Which they should, don't get me wrong, ratings are irrelevant in the long run), it makes the albums with more reviews become the ones that are highest. And due to the first four years or so of the site being mostly run by prog fans, the majority of reviews are of prog related albums. 

Yes but this should be encouragement for more reviews to be written as well, at least by collabs. There's no incentive to write if you get the same bonus for just a rating only. 

Yes, and I really should have organized my thoughts better before posting anything. I think the update of the weight is great, it's just due to not as many reviews of older albums being written in the past few years, the charts get a bit skewed in favor of the reviews written closer to the first few years of the site or newer releases.

I think this would be a great time to have some "classic edition" reviewers challenges.
Back to Top
Vim Fuego View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Death, T/S/G, Grind, VA Teams

Joined: 05 Jul 2015
Location: Canterbury, NZ
Status: Offline
Points: 6616 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Vim Fuego Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 6:00pm
Originally posted by Unitron Unitron wrote:


 I apologize for even bringing anything up, I don't know what I was trying to get at anymore.


You been taking the stoner part of stoner metal too seriously?Wink

For me when I lose track I can blame old age.Smile
Back to Top
Vim Fuego View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Death, T/S/G, Grind, VA Teams

Joined: 05 Jul 2015
Location: Canterbury, NZ
Status: Offline
Points: 6616 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Vim Fuego Quote  Post ReplyReply Direct Link To This Post Posted: 10 Mar 2018 at 6:01pm
Originally posted by Unitron Unitron wrote:


I think this would be a great time to have some "classic edition" reviewers challenges.


I'm definitely up for that.
Back to Top
adg211288 View Drop Down
Forum Admin Group
Forum Admin Group
Avatar
Black Metal, Prog/AG Teams

Joined: 05 Nov 2010
Location: United Kingdom
Status: Offline
Points: 22293 		Post Options Post Options   Thanks (0) Thanks(0)   Quote adg211288 Quote  Post ReplyReply Direct Link To This Post Posted: 11 Mar 2018 at 6:48am
I don't mind setting a challenge up. Exactly what kind were you thinking though? Same album for everyone? Partners swapping albums? Random different selection from a shortlist? I'd guess swapping albums would be easiest since finding a classic that not one of the participants has reviewed would be a task and a half and random selection of different albums could prove to have the same issue. 
Earn Money Online (NOT a scam):
GG2U

Adam's Film Corner on Quora
Back to Top
siLLy puPPy View Drop Down
MMA Special Collaborator
MMA Special Collaborator
Avatar
Prog/AG Team

Joined: 06 Oct 2013
Location: SF, CA, USA
Status: Offline
Points: 2742 		Post Options Post Options   Thanks (0) Thanks(0)   Quote siLLy puPPy Quote  Post ReplyReply Direct Link To This Post Posted: 11 Mar 2018 at 7:13am
Or everyone just pick a classic album they haven't reviewed yet and let loose. Of course, you would have to define exactly what constitutes "classic." I would guess its an album that appears in the top 100 but then again there are many classics that aren't popular but well-revered.
Back to Top
 Post Reply Post Reply Page  12>
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 10.16
Copyright ©2001-2013 Web Wiz Ltd.

This page was generated in 0.180 seconds.