-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When scores are all 0, rank is always set to 2 #623
Comments
There are some odd parts in how tie-breaking "pushes down" ranks on tie. The behavior is all in scoring.py, but that code was written by Rosina's team and just ported over to the ARS. I'm open to changing how ties are handled. |
Is |
I'd have to double check with UI about whether they're using rank, but yeah it's more complicated than an index. I believe it was intended for some tie breaking behavior with weighted mean, though it doesn't work if the tie is the whole set |
Gus just confirmed that UI team doesnt use the rank returned from ARS, they calculate rank on their end. |
What is the purpose of
rank
in the ARS results, and how is it calculated? I would expect them all to either be unique or to be 1?The text was updated successfully, but these errors were encountered: