HIPE scorer – CLEF HIPE 2020 post-evaluation release

Changes in this release:

• the scorer is more precise as to invalid tags: only tags that are not contained in the HIPE tagset are now considered invalid (see issue #9 for more details).

HIPE scorer – CLEF HIPE 2020 pre-evaluation release

Changes in this release:

• fixes issue #8
• accepts ranked list of QIDs for EL evaluation

First release of HIPE scorer

Next version will include:

• possibility to leave out all comments lines.
• entity linking evaluation over the union of literal and metonymic linking annotations.