Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is meant by contrastive learning objective? #74

Open
majdsalman opened this issue Oct 1, 2024 · 0 comments
Open

What is meant by contrastive learning objective? #74

majdsalman opened this issue Oct 1, 2024 · 0 comments

Comments

@majdsalman
Copy link

majdsalman commented Oct 1, 2024

Having read the paper and the code I don't understand what is meant by "These judges are lightweight models fine-tuned against a contrastive learning objective.".

The loss function is a cross entropy loss and the task is a classification task (yes/no) for belonging or not belonging in a class. There is no notion in the code of maximizing the separation of these classes in the embeddings space. The phrasing adds some confusion since contrastive typically means something else.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant