Coreferential Reasoning Learning for Language Representation (EMNLP20)

[hideaki-j]

Coreferential Reasoning Learning for Language Representation

Contribution summary

[Author] did [Method] to solve [Motivation] and found [Insight]

Authors

Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun, Zhiyuan Liu
(Tsinghua University, Beijing National Research Center for Information Science and Technology, Beijing Academy of Artificial Intelligence, Tencent)

Motivation

Existing method is/has/uses ...

Method

Proposed method is/has/uses ...

Mention reference prediction (MRP): this is a novel training task which is proposed to enhance coreferential reasoning ability. MRP utilizes the mention reference masking strategy to mask one of the repeated mentions and then employs a copybased training objective to predict the masked tokens by copying from other tokens in the sequence.

Results / Insight

[hideaki-j]

Related

• HuggingFace: https://huggingface.co/nielsr/coref-bert-base
• Presentation: https://slideslive.com/38938680/coreferential-reasoning-learning-for-language-representation