Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set default to non normalization of the scores #59

Open
NohTow opened this issue Sep 30, 2024 · 0 comments
Open

Set default to non normalization of the scores #59

NohTow opened this issue Sep 30, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@NohTow
Copy link
Collaborator

NohTow commented Sep 30, 2024

Following JaColBERTv2.5, I added the normalization of the scores for distillation.

Yet, this setup is not really standard/well-know and so the default should be no normalization, with a proper documentation on using normalization and its potential benefits. This would avoid confusion and possible sub-optimal results if the user does not normalize the teacher scores on its end aswell.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant