A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution.

Introduction

This repo contains experimental code for the paper :

"A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution."
Judicael Poumay, Ashwin ITTOO. Findings of EMNLP 2021.

The original model used for experimentation come from :

"Revisiting Joint Modeling of Cross-document Entity and Event Coreference Resolution"
Shany Barhom, Vered Shwartz, Alon Eirew, Michael Bugert, Nils Reimers and Ido Dagan. ACL 2019.

Please go to the original repo for more information on the original code.

Embeddings used

Character : https://github.com/minimaxir/char-embeddings
Word2vec : https://github.com/mmihaltz/word2vec-GoogleNews-vectors
FastText : https://pypi.org/project/FastText/
GloVe : https://nlp.stanford.edu/projects/glove/
GPT-2 : https://huggingface.co/transformers/model_doc/gpt2.html
BERT : https://pypi.org/project/bert-embedding/
Elmo : https://allennlp.org/elmo

Branches

Original model

Original : Code optimized compared to the the original repo leading to faster training time
Uses GloVe, Elmo, and a fine tuned character embedding.

Ablative models

NoStatic : Removed GloVe embedding from orignal model
NoContext : Removed Elmo embedding from orignal model
NoChar : Removed character embedding from orignal model
noctx-static : Removed Elmo and GloVe embedding from orignal model
noctx-static-char : Removed all embedding from orignal model

Comparative models

GPT-2 : Replace Elmo with GPT-2
BERT : Replace Elmo with BERT
FastText : Replace GloVe with FastText
Word2Vec : Replace GloVe with Word2Vec

Comparative ablative models

Onlybert : Removed GloVe and character embedding from orignal model + Replace Elmo with BERT
OnlyGPT : Removed GloVe and character embedding from orignal model + Replace Elmo with GPT-2
OnlyELMO : Removed GloVe and character embedding from orignal model
onlyfasttext : Removed Elmo and character embedding from orignal model + Replace GloVe with FastText
onlyword2vec : Removed Elmo and character embedding from orignal model + Replace GloVe with Word2Vec
onlyglove : Removed Elmo and character embedding from orignal model

Contact info

Contact Judicaël POUMAY at [email protected] for questions about this repository.