Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gbert - advanced training, adaptive fine-tuning #131

Open
dominikmn opened this issue Apr 25, 2021 · 1 comment
Open

gbert - advanced training, adaptive fine-tuning #131

dominikmn opened this issue Apr 25, 2021 · 1 comment
Assignees
Labels
enhancement New feature or request Modeling

Comments

@dominikmn
Copy link
Owner

dominikmn commented Apr 25, 2021

Train gbert with a masked language model task (MLM task) making use of the 1 million unlabeled posts of the OMP data set.

Ressources

@dominikmn dominikmn changed the title gbert - advanced modeling gbert - advanced training Apr 25, 2021
@dominikmn dominikmn changed the title gbert - advanced training gbert - advanced training, adaptive fine-tuning May 16, 2021
@dominikmn
Copy link
Owner Author

dominikmn commented May 16, 2021

The first two commits 81c452d and 4a2a39a combined are an alternative solution to #125.
They are not yet related to the actual adaptive fine-tuning.

@dominikmn dominikmn self-assigned this May 16, 2021
@dominikmn dominikmn added enhancement New feature or request Modeling labels May 16, 2021
@dominikmn dominikmn removed their assignment Sep 7, 2021
@dominikmn dominikmn self-assigned this Sep 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Modeling
Projects
None yet
Development

No branches or pull requests

1 participant