Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sorting based on total score #3

Open
johnharveybc opened this issue Nov 5, 2014 · 2 comments
Open

Sorting based on total score #3

johnharveybc opened this issue Nov 5, 2014 · 2 comments

Comments

@johnharveybc
Copy link

For reddit-style metrics (voting up/down) the way total score is sorted is broken. If sorted in descending order, a total score of 9 will be shown about a total score of 64: sorting appears to be based on the first digit, as opposed to the actual numerical value. Perhaps the scores are being sorted as text, as opposed to numbers?

Screenshot: http://wiki.ubc.ca/images/4/43/Evaluate-sorting.png

(scores of 7 appear above the score of 64)

@Ardnived
Copy link
Contributor

Ardnived commented Nov 8, 2014

What is the ratio of upvotes to down votes for that article? Is the total number of votes for the other articles significantly higher? I agree, 64 vs 7 is a very high difference, but this might be because Evaluate doesn't sort directly by Up Votes vs Down Vote.

You can read about why, here;

For two-way (up/down vote) metrics, the lower bound of the Wilson Score interval is calculated. This tries to better approach the 'real' ratio, of up versus down votes, than other methods, as explained in How Not to Sort by Average Rating.

Reddit actually uses the same system.

@johnharveybc
Copy link
Author

The metric in question is one-way: there are only votes up. If you want to
have a look at the results yourself, the metric in question is 'was this
helpful' on Digital Tattoo (http://dt3.sites.olt.ubc.ca/).

The article in question (with 64 votes) has the highest number of votes on the site.

On Nov 8, 2014 9:01 AM, "Devindra Payment" [email protected] wrote:

What is the ratio of upvotes to down votes for that article? Is the total
number of votes for the other articles significantly higher? I agree, 64 vs
7 is a very high difference, but this might be because Evaluate doesn't
sort directly by Up Votes vs Down Vote.

You can read about why, here;

For two-way (up/down vote) metrics, the lower bound of the Wilson Score
interval
http://en.wikipedia.org/wiki/Binomial_proportion_confidence_interval#Wilson_score_interval
is calculated. This tries to better approach the 'real' ratio, of up versus
down votes, than other methods, as explained in How Not to Sort by
Average Rating
http://www.evanmiller.org/how-not-to-sort-by-average-rating.html.

Reddit actually uses the same system
http://www.redditblog.com/2009/10/reddits-new-comment-sorting-system.html
.


Reply to this email directly or view it on GitHub
#3 (comment).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants