Welcome to SP!  -
Areas & RangesMountains & RocksRoutesImagesArticlesTrip ReportsGearOtherPeoplePlans & PartnersWhat's NewForum

Changes to Voting System

Suggestions and comments about SummitPost's features, policies, and procedures. Post bugs here.
 

Re: Changes to Voting System

Postby Josh Lewis » Sun Jan 13, 2013 6:33 pm

Bubba Suess wrote:If the desire is there to simplify the voting then a like/dislike system could work if a third option was 'abstain' or something like that. Obviously that may not be the best name for it but it works for the discussion. Voting 'abstain' would not change the score but communicate to the page builder that someone has the opinion the page is coming along but needs to be improved. One could even install a mechanism that would notify someone to review their 'abstain' vote after so much time has elapsed. If the page has not improved then one can dislike it. If it has improved, one can like it.


Great point. This is in the direction I was proposing earlier. A system to push folks in the right direction when a page is alright or of lesser quality. There are a lot of great contributions to SP, however I've seen some good mountains that deserve a lot better of a job done to them. I wouldn't hesitate to use the button Bubba proposed (I'd think about it of course).

MarkDidier wrote:Page quality improves via communication with the submitter. I would recommend that for any Dislike, the voter is forced to submit a comment (or PM). Giving a submitter constructive criticism and recommendations is what will improve page quality. If the submitter does nothing, then the issue could easily be escalated to the elves for action from there. This could easily be accomplished by having the Comment box pop up with a Dislike.


Great post Mark! You hit the nail on this one. I wouldn't mind publicly saying why I thought a page needed improvements. 8) If I was worried about my reputation, I wouldn't get involved with the politics of SP. :wink:

Montana Matt wrote:Again, if someone can provide me with a mathematical equation for a system where you count a 10 vote and calculate a total score based on it, then you count a 7 vote and calculate a total score based on the 7 and the 10, and that total score isn't lower than it was when there was only a 10, I'd be happy to try implementing and testing it.


I'm pretty sure there is a way to deal with this. Make 5/10 neutral, less than 5/10 negative, and everything above 5/10 positive. In some sense TrekNature pulled this off. In this example someone voted 1/2 on my photo. This did not bring down the score. They don't have any negative points, but I'm sure they could have. With a 6/10 you could have it designed so that it's not the actual vote weight that is given, but is the one that we (SP users) see. Behind the scenes it could add the appropriate number based on your vote weight (it would be minor in this case). If this kind of a system was made, a 4/10 would do little to bring down the score. That would be a good thing! This would make it possible to down vote without being "too mean". And of course if the content is actually of poor quality you would vote less than 4/10 which would bring down the score to what it should be according to the votes.
User Avatar
Josh Lewis

 
Posts: 3098
Joined: Thu Jan 06, 2011 11:12 pm
Location: Lynnwood, Washington, United States
Thanked: 894 times in 550 posts

Re: Changes to Voting System

Postby Bubba Suess » Sun Jan 13, 2013 6:56 pm

MarkDidier wrote:And as for page scores, I take no stock in them and personally do not think they are necessary. The value of the beta submitted lies in mind of the user!

The value of the beta on a page is subjective whether the page is good or bad. The quality of a page, on the other hand, is an objective standard. Consequently there are good reasons to maintain the use of the page score. As long as only one page is permitted per peak (a good thing) the score helps measure whether the pages are good or bad. If SP is to have any quality standards there must be a mechanism for that standard to be sustained. To do this, one can either have admin nuke bad pages on their own, which is labor intensive on the elves part or permit the SP community to sink bad pages. The score permits the latter and when something sinks low enough then it is brought to the elves attention and then, usually, deleted. The mechanism for the voting is obviously something that can be improved, hence this thread, but doing away with the page score dismantles the means by which the general SP community polices the site.
User Avatar
Bubba Suess

 
Posts: 721
Joined: Tue Oct 04, 2005 9:15 pm
Location: Mount Shasta, California, United States
Thanked: 182 times in 104 posts

The following user would like to thank Bubba Suess for this post
Josh Lewis, yatsek

Re: Changes to Voting System

Postby Marmaduke » Sun Jan 13, 2013 6:59 pm

It seems like this is something that can be fixed without making it into solving a world peace isssue. Why should there be a dislike option, that would just bring on problems. If there is a photo or a page that needs work a vote of 2 or 3 let's say should still give a positive increase to the score but is sending a messsage that more work is needed. There are many pages that are good pages but not great, those pages deserve a 6 or 7 vote let's say but again the page score should go up not down. Keep it a 1 - 10 with even a 1 vote increasing the score but obviouslsy just ever so slighting with each number being weighted with a gradual increase of the percentage.
User Avatar
Marmaduke

 
Posts: 1437
Joined: Tue Feb 02, 2010 1:08 am
Location: Sonoma, California, United States
Thanked: 691 times in 531 posts

Re: Changes to Voting System

Postby Josh Lewis » Sun Jan 13, 2013 7:06 pm

@Marmaduke: Problem with that idea is that popular mountains would for sure be the top rated pages. That's some what the case right now, but at least well made pages on obscure places have a chance. In the system your proposing, a bad quality but famous mountain would have a much greater score than some of the best work posted here on SP. Trust me, this would happen.

On the bright side that system would create far less complains and less drama. :wink: But it does not have enough score integrity. That is the entire reason for having negative votes.
User Avatar
Josh Lewis

 
Posts: 3098
Joined: Thu Jan 06, 2011 11:12 pm
Location: Lynnwood, Washington, United States
Thanked: 894 times in 550 posts

Re: Changes to Voting System

Postby Scott » Sun Jan 13, 2013 7:22 pm

PERSONALLY I VOTE ONLY WHEN I LIKE, WHEN I DON'T LIKE I RATHER PREFER TO GIVE NO VOTES,


Sorry, but that's the whole problem. Most people only vote 10/10 on everything and everyone is afraid to give a "bad" vote on a page that needs work. It shouldn't be this way. Bad pages should be voted on, hopefully fixed by the maintainer (at which time the vote is raised), and if still poor quality after a long period of time, deleted.
User Avatar
Scott

 
Posts: 7943
Joined: Thu Aug 21, 2003 1:03 pm
Location: Craig, Colorado, United States
Thanked: 962 times in 507 posts

The following user would like to thank Scott for this post
Josh Lewis

Re: Changes to Voting System

Postby Bob Sihler » Sun Jan 13, 2013 8:55 pm

Montana Matt wrote:But the problem is still the following: Someone votes a 10 on a page (that's all anyone votes now). The score is calculated based on that 10. If someone else comes along and votes a 7, how could that NOT lower the score? Again, if someone can provide me with a mathematical equation for a system where you count a 10 vote and calculate a total score based on it, then you count a 7 vote and calculate a total score based on the 7 and the 10, and that total score isn't lower than it was when there was only a 10, I'd be happy to try implementing and testing it.


Matt, it isn't so much that a 7 lowers the score but that it lowers it far out of proportion to how voting 10 raises it.

Many of us are used to the 10-point academic scale, so when we think of 8, we think of 80%, a B or B-, for example. But I just went and test-voted 8 on an image with no votes (and then canceled the vote), and the score was 63.52%, what many of us think of as a D or below average. I think the voting system would have worked much better had votes corresponded to the 10-point scale and page scores been calculated as averages. I realize the point of weighting vote power based on power points was a means to combat avatars and trolls, but it also had the effect of producing what many of us are accustomed to thinking are bad scores when we voted numbers that we normally would expect to produce good scores. There are many pages that are indeed decent or pretty good that deserve a 7 or 10, but I just don't vote on them at all because the number that results looks pretty brutal.

Since that system is hopelessly broken, maybe the best thing now really is to try the like/dislike idea and see how it goes, though I agree it might be nice to consider something like an "Okay" option as well.
"Alcohol is like love. The first kiss is magic, the second is intimate, the third is routine. After that you take the girl's clothes off."

--Terry Lennox, The Long Goodbye (Raymond Chandler)
User Avatar
Bob Sihler
Forum Moderator
 
Posts: 8156
Joined: Mon Aug 23, 2004 3:20 pm
Location: Driftwood, Texas, United States
Thanked: 2440 times in 1358 posts

Re: Changes to Voting System

Postby Bob Burd » Sun Jan 13, 2013 10:11 pm

Perhaps what people are looking for is an open-ended scoring system, rather than the current 0-100%. Score would then be something like: sum(weight1*vote1, weight2*vote2,etc)
If a like/dislike were used, a like vote might be +1, a dislike vote -1.
But perhaps the 0-10 scale could be retained since any vote will now add to the score.
The goal is still the same - trying to sort good from bad. Currently, the page with the most 10 votes pops up on top. The above scoring would pretty much do the same, I think.
It's obvious when a page isn't good even if people don't vote because it has only a few votes. So it would have a lower score in either system.
I'm not sure what the advantage is of keeping scores in the 0-100% range. Does it do a better job of sorting for the very best somehow?

btw, I think weighting should be a significant factor. It offers some sort of quality check and keeps the creation of fake avatars for the sole purpose of voting. Having a waiting period on new members weighting may only delay this. I think some sort of participation (it could even be in the forums) should be a factor, aside from just voting.
User Avatar
Bob Burd
Forum Moderator
 
Posts: 4219
Joined: Sun Jul 22, 2001 10:42 pm
Location: San Jose, California, United States
Thanked: 534 times in 280 posts

Re: Changes to Voting System

Postby Bubba Suess » Sun Jan 13, 2013 10:20 pm

I don't know if my comments are helpful here, but I will go ahead and reiterate them anyway. I think the like/dislike option would work if there was a middle of the road choice. The middle choice need not be used to determine the score, but would simply be a marker indicating that the page needs to be improved. That is why I called it "abstain". In a sense, someone is not voting per se but indicating an opinion regarding quality that is in a specific point in a page's development.

There seems to be a consensus that some mid-level vote is desired, be it a third option or the current 10 point scale that exists, so finding some system that incorporates this would be key.

The 'abstain' (or whatever you want to call it) choice would simplify things since it would not have to be included in calculating the page score but would still give people the option of expressing a desire to see the page improved.
User Avatar
Bubba Suess

 
Posts: 721
Joined: Tue Oct 04, 2005 9:15 pm
Location: Mount Shasta, California, United States
Thanked: 182 times in 104 posts

The following user would like to thank Bubba Suess for this post
chugach mtn boy, Silvia Mazzani, yatsek

Re: Changes to Voting System

Postby Bubba Suess » Sun Jan 13, 2013 10:21 pm

Bob Burd wrote:I think weighting should be a significant factor. It offers some sort of quality check and keeps the creation of fake avatars for the sole purpose of voting. Having a waiting period on new members weighting may only delay this. I think some sort of participation (it could even be in the forums) should be a factor, aside from just voting.

I concur.
User Avatar
Bubba Suess

 
Posts: 721
Joined: Tue Oct 04, 2005 9:15 pm
Location: Mount Shasta, California, United States
Thanked: 182 times in 104 posts

The following user would like to thank Bubba Suess for this post
Silvia Mazzani

Re: Changes to Voting System

Postby Scott » Sun Jan 13, 2013 10:25 pm

I think weighting should be a significant factor. It offers some sort of quality check and keeps the creation of fake avatars for the sole purpose of voting. Having a waiting period on new members weighting may only delay this. I think some sort of participation (it could even be in the forums) should be a factor, aside from just voting.


I agree too.
User Avatar
Scott

 
Posts: 7943
Joined: Thu Aug 21, 2003 1:03 pm
Location: Craig, Colorado, United States
Thanked: 962 times in 507 posts

Re: Changes to Voting System

Postby Josh Lewis » Sun Jan 13, 2013 10:42 pm

Montana Matt wrote:I can't see any votes or scores on that page. Can you point me to exactly where those things are? Maybe I need to have an account and be logged in to see them?...Just created an account and still can't see the score or votes...

Anyway, without knowing how their algorithm works, you can't assume that they have something along the lines of what you're proposing. They may have implemented something similar to what SP currently does where outlying votes (votes too far away from the standard deviation) are thrown out or they have some other way of calculating the score.


So on that photo example there is a box on the left below the photo called "Photo Information". At the very bottom of that box it says "Points: 5". Most folks vote 2/2, but every now and then someone votes a 1/2. This is great! That means folks are being completely honest with their votes. Odd votes are not thrown out on TrekNature. That site is a great role model not just in the vote system, but how comments are supposed to be conducted. The site is built on being a critique. This was beneficial to me personally, people were willing to approaching me and tell me exactly what was wrong with my photos. They were nice about it too. We need more of that going on in SP. I personally don't settle for "the page is good enough". :wink:

Regarding Bubba's "abstain" idea: I think it's a great idea. I personally would like to see it. It may effect the how people vote, but it wouldn't actually be apart of the voting system. Right? (if this was actually added)
User Avatar
Josh Lewis

 
Posts: 3098
Joined: Thu Jan 06, 2011 11:12 pm
Location: Lynnwood, Washington, United States
Thanked: 894 times in 550 posts

Re: Changes to Voting System

Postby Bob Sihler » Sun Jan 13, 2013 10:47 pm

Scott wrote:
I think weighting should be a significant factor. It offers some sort of quality check and keeps the creation of fake avatars for the sole purpose of voting. Having a waiting period on new members weighting may only delay this. I think some sort of participation (it could even be in the forums) should be a factor, aside from just voting.


I agree too.


And I.
"Alcohol is like love. The first kiss is magic, the second is intimate, the third is routine. After that you take the girl's clothes off."

--Terry Lennox, The Long Goodbye (Raymond Chandler)
User Avatar
Bob Sihler
Forum Moderator
 
Posts: 8156
Joined: Mon Aug 23, 2004 3:20 pm
Location: Driftwood, Texas, United States
Thanked: 2440 times in 1358 posts

Re: Changes to Voting System

Postby Bob Sihler » Sun Jan 13, 2013 10:50 pm

Matt, Dow's 8 is not much different from my 8, but compare my 1 to a new member's 1. It is a massive difference. You're right that the academic scale that most of us are used to is a big part of the dissatisfaction with the way SP's voting system works. You either have to fix it to align with what people are accustomed to or throw it out and try something else. And since it seems you and most others here want to try something else, let's enjoy the ride!
"Alcohol is like love. The first kiss is magic, the second is intimate, the third is routine. After that you take the girl's clothes off."

--Terry Lennox, The Long Goodbye (Raymond Chandler)
User Avatar
Bob Sihler
Forum Moderator
 
Posts: 8156
Joined: Mon Aug 23, 2004 3:20 pm
Location: Driftwood, Texas, United States
Thanked: 2440 times in 1358 posts

The following user would like to thank Bob Sihler for this post
Josh Lewis

PreviousNext

Return to Site Feedback

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 0 guests

© 2006-2013 SummitPost.org. All Rights Reserved.