GERBIL 1.0.0
This version of GERBIL provides a running web service enabling the evaluation, benchmarking, publishing and archiving of entity annotation experiments. GERBIL is a community effort.
Currently, we support the following annotators
- Wikipedia Miner
- Spotlight
- TagMe 2
- KEA
- WAT
- AGDISTIS
- Babelfy
- NERD-ML
- Dexter
- NIF-based Annotator (this adapter can be used for any NIF based web service)
and the following datasets
- ACE2004
- AQUAINT
- MSNBC
- IITB
- Meij
- AIDA/CoNLL
- N3 - reuters-128
- N3 - rss-500
- KORE50
- Spotlight Corpus
- Microposts.
Furthermore, GERBIL supports six experiment types, three matchings and 6 metrics. You will never again have to write your own entity annotation benchmark system. Just write a wrapper for your annotator or dataset and let it run against state-of-the-art systems and corpora.
Join us!
Find more information at our or at http://gerbil.aksw.org.
If you have any trouble or suggestions, please file an GitHub issue.
Thank you a lot!
The GERBIL team