You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Yet, this setup is not really standard/well-know and so the default should be no normalization, with a proper documentation on using normalization and its potential benefits. This would avoid confusion and possible sub-optimal results if the user does not normalize the teacher scores on its end aswell.
The text was updated successfully, but these errors were encountered:
Following JaColBERTv2.5, I added the normalization of the scores for distillation.
Yet, this setup is not really standard/well-know and so the default should be no normalization, with a proper documentation on using normalization and its potential benefits. This would avoid confusion and possible sub-optimal results if the user does not normalize the teacher scores on its end aswell.
The text was updated successfully, but these errors were encountered: