Honesty in voting

Suggestions and comments about SummitPost's features, policies, and procedures. Post bugs here.
User Avatar
ExcitableBoy

 
Posts: 3666
Joined: Wed Nov 09, 2005 9:33 am
Thanked: 663 times in 496 posts

Honesty in voting

by ExcitableBoy » Tue Jan 24, 2012 6:55 pm

I've noticed that many the votes on my contributions are 10/10. I'm not so naive that I believe that all of my work is perfect, that is to say no room for improvement. I always appreciate constructive critism. I often follow up with voters who give me lower than 10/10 with the person who voted. This has fomented productive discussions that ultimately improve my submissions. So please vote honesty, nobody's feelings are going to get hurt. If you have specific critisms let me have it.

Thanks,

EB

The following user would like to thank ExcitableBoy for this post
Josh Lewis

User Avatar
Marmaduke

 
Posts: 1541
Joined: Tue Feb 02, 2010 1:08 am
Thanked: 729 times in 562 posts

Re: Honesty in voting

by Marmaduke » Tue Jan 24, 2012 7:08 pm

You will always get a 10 vote but may also receive constructive critism. As you know the voting method is very poor. It's not right to give a 9 vote when that actually downplays the overall score. I would think the submission would have to be very bad to receive a 9 or less based on the way system is currently set up. It's a 10 or nothing.

The following user would like to thank Marmaduke for this post
lcarreau, Silvia Mazzani

User Avatar
goldenhopper

 
Posts: 412
Joined: Fri Mar 19, 2010 9:29 pm
Thanked: 558 times in 392 posts

Re: Honesty in voting

by goldenhopper » Tue Jan 24, 2012 7:16 pm

Only one thing worth voting for as 10/10 every time:

Praise be Allah!

Image

User Avatar
mrchad9

 
Posts: 4545
Joined: Thu Jul 02, 2009 12:01 am
Thanked: 1338 times in 911 posts

Re: Honesty in voting

by mrchad9 » Tue Jan 24, 2012 7:20 pm

Marmaduke is correct. The way the scores are calculated, if you give a 9 you might as well give a 1. To say nobody's feelings will be hurt by a 9 is incorrect. If they did a decent job, either don't vote or give them a 10, because if you give a 9 then you are putting them down under the current system.

This has been discussed at length in the past. We need a system where 7, 8, or 9 can improve the score, but not as much as a 10. However, Matt has advised that we shouldn't expect any changes with respect to this anytime soon.

/thread

The following user would like to thank mrchad9 for this post
Silvia Mazzani

User Avatar
goldenhopper

 
Posts: 412
Joined: Fri Mar 19, 2010 9:29 pm
Thanked: 558 times in 392 posts

Re: Honesty in voting

by goldenhopper » Tue Jan 24, 2012 7:32 pm

mrchad9 wrote:Marmaduke is correct.


:shock:

Image

Image

Image

Image

Sorry Duke, I had to...

User Avatar
surgent

 
Posts: 545
Joined: Wed Aug 20, 2003 2:45 pm
Thanked: 143 times in 80 posts

Re: Honesty in voting

by surgent » Tue Jan 24, 2012 8:49 pm

No system is perfect unless everyone treats it identically. Despite the tendency to either vote a 10 or not at all, the overall stratification of page scores roughly correlates with quality. The better pages get more 10 votes, so it seems.

A 1-vote is still valuable, in knocking out the occasional crap page that is submitted. However, it would be very difficult to explain the difference between a 4-vote and a 5-vote, for example.

I would lean toward fewer choices: a 1-5 scale perhaps. But getting everyone to buy into it and use it as intended will be impossible. So we use what we have. It works in the broad sense, perhaps not in the micro-sense.

The following user would like to thank surgent for this post
lcarreau, silversummit

User Avatar
mrchad9

 
Posts: 4545
Joined: Thu Jul 02, 2009 12:01 am
Thanked: 1338 times in 911 posts

Re: Honesty in voting

by mrchad9 » Tue Jan 24, 2012 9:03 pm

Matt-

Under normal circumstances it is not possible for a 9 to improve a page score, even after scripts are run. The only way a 9 can improve the score is if the score also includes other votes between 1 and 8. If a page has some quantity of 10s then a 9 will ALWAYS either lower the score, or not be counted.

The mechanism definitely does not throw out a member's vote if they always vote 1 or 10 or anything else. The only votes that are discarded are the outliers that are low (if a page has more than 10-12 votes that are 10s, then a single vote that is a 1-9 will be discarded). Similarly if a page has a couple dozen votes, then two could be discarded, etc...

I agree it is complex math that goes into the score, but as someone who has observed the impact for some time I can confirm is it not good math (as evidenced by the number of complaints about it and how it has affected people's voting). If people voted honestly (which they do) then they expect to see a 10 raise a page score, and a 9 to raise the score less. That doesn't happen.

User Avatar
Marmaduke

 
Posts: 1541
Joined: Tue Feb 02, 2010 1:08 am
Thanked: 729 times in 562 posts

Re: Honesty in voting

by Marmaduke » Tue Jan 24, 2012 9:05 pm

Montana Matt wrote:
Marmaduke wrote:It's not right to give a 9 vote when that actually downplays the overall score.

mrchad9 wrote:The way the scores are calculated, if you give a 9 you might as well give a 1.

butitsadryheat wrote:Yeah, the fact that giving a 9 actually drops the score kinda sucks.


I believe it is possible that that a vote of 9 could change the overall score of the page in a positive way.

And the main reason that anything other than a 10 drops the score is because nearly everyone always votes a 10. If people voted honestly and used the entire scale from 1 to 10, a 9 wouldn't always lower the score.

I recall that it's fairly complex ........


I'm not doing this to beat up on you Matt, truly it's to understand the system. You stated, "I believe it is possible...." Is it or not? Then your next paragraph you state, "a 9 wouldn't always lower the score" So you seem to, not be too sure then you are sure. And you state a 9 wouldn't always lower the score, it should be consistant, it should always raise the score, as should a 1 vote.

Then, "I recall..." that's not being very sure of the voting process. Can you supply a link that shows how voting works? I think most of us agree the system could use some tweaking.

User Avatar
Baarb

 
Posts: 408
Joined: Tue Jun 06, 2006 6:42 pm
Thanked: 43 times in 30 posts

Re: Honesty in voting

by Baarb » Tue Jan 24, 2012 9:11 pm

There's also the votes cast using the SP1 voting system (1-4 star) being considered in the existing mechanism somewhere. Based on how some SP1 era photos have quite low %s despite being of considerable worth I can only conclude the ethos was somewhat different back then (perhaps part of that was abuse, not sure). (Edited for clarity)
Last edited by Baarb on Tue Jan 24, 2012 10:38 pm, edited 1 time in total.

User Avatar
mrchad9

 
Posts: 4545
Joined: Thu Jul 02, 2009 12:01 am
Thanked: 1338 times in 911 posts

Re: Honesty in voting

by mrchad9 » Tue Jan 24, 2012 9:31 pm

Changing the system from 1-10 to 1-5 or 1-4 wouldn't accomplish much. What we have now is a 1 or 10 system anyway. What needs adjusting is the complex calculation mechanism. However there are other things that could and should be done to improve SP before that.

User Avatar
mvs

 
Posts: 1054
Joined: Tue Oct 23, 2001 7:44 pm
Thanked: 307 times in 123 posts

Re: Honesty in voting

by mvs » Tue Jan 24, 2012 10:17 pm

That would be really far out if the system did dampen a voters power by looking at their past voting pattern and seeing too many 1s, 10s, whatever. It would seem like we need another score by our names next to Power, which would be something like...credibility. :D

I can see it now...at the end of a month people start being mean and voting a bunch of 4,5,6s for a couple of days because they know the monthly credibility calculation is about to happen. Then it's back to treating the votes as a "Like" button, which is (like it or not) what we usually do. :p

User Avatar
Baarb

 
Posts: 408
Joined: Tue Jun 06, 2006 6:42 pm
Thanked: 43 times in 30 posts

Re: Honesty in voting

by Baarb » Tue Jan 24, 2012 10:53 pm


User Avatar
Marmaduke

 
Posts: 1541
Joined: Tue Feb 02, 2010 1:08 am
Thanked: 729 times in 562 posts

Re: Honesty in voting

by Marmaduke » Tue Jan 24, 2012 11:01 pm

You are telling us that if we ALL start voting using 7's, 8's and 9's that eventually those votes would be a positive? For the sake of arguement can you give a hypothetical? Like, if a page with a score of 90% had 10 SPers with all the same vote power, let's say 90%, vote 9's, what would happen? And if 10 more then 10 more then 10 more all voted 9 what would happen?

Because we all know that the page score goes DOWN. So how many votes would it take before the negative vote becomes a positive?

Did that make sense?

User Avatar
mrchad9

 
Posts: 4545
Joined: Thu Jul 02, 2009 12:01 am
Thanked: 1338 times in 911 posts

Re: Honesty in voting

by mrchad9 » Tue Jan 24, 2012 11:13 pm

Look at it this way...

Perhaps the system is not being used as designed, but that is because it was not designed well. If the 1000s of members here are not using it correctly, the simpler fix (should the decision be made to fix it) is to redesign the system. You just aren't going to be able to change the behaviors of 1000s of people, unless the design of the system facilitates that.

It IS possible to develop a system that promotes the voting behaviors desired. That decision just has to be made. Or a decision can made to leave the system (and behaviors) as is. Beyond that the discussion is just that and nothing more. Discussion.

Next

Return to Site Feedback

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 0 guests