Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

continue train the NER model on new dataset #19

Closed
bugface opened this issue Nov 4, 2021 · 1 comment · Fixed by #22
Closed

continue train the NER model on new dataset #19

bugface opened this issue Nov 4, 2021 · 1 comment · Fixed by #22
Assignees
Labels
enhancement New feature or request

Comments

@bugface
Copy link
Contributor

bugface commented Nov 4, 2021

currently, we do not have a train from where it left function. Every training starts from a new model (at least a new linear classification layer).

We need to implement continuing training function to support use cases like we want to train more epochs on the same data or train on new data with the exact same labels (no new labels are allowed)

@bugface bugface self-assigned this Nov 4, 2021
@bugface bugface added the enhancement New feature or request label Nov 4, 2021
@bugface bugface pinned this issue Nov 4, 2021
@bugface
Copy link
Contributor Author

bugface commented Nov 18, 2021

we also need to create a mapping (BIO) from brat config during the data preprocessing instead from training data to cover all entity types (just in case some entity types defined but never used in one training data but appeared in other training data)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
1 participant