Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

词典构建 #45

Open
tiger-jie opened this issue Oct 25, 2021 · 3 comments
Open

词典构建 #45

tiger-jie opened this issue Oct 25, 2021 · 3 comments

Comments

@tiger-jie
Copy link

请问一下词典的构建方式是怎样的呢

@v-mipeng
Copy link
Owner

这个是基于大规模未标注数据用无监督分词方法对其进行分词,根据分词结果构建词典。当然,你也可以基于领域知识扩充词典。

@tiger-jie
Copy link
Author

这个是基于大规模未标注数据用无监督分词方法对其进行分词,根据分词结果构建词典。当然,你也可以基于领域知识扩充词典。

谢谢您的回复,请问能不能考虑将训练集和验证集的标注实体当作领域词典

@v-mipeng
Copy link
Owner

对比的时候大家用一样的词典就好。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants