CaspR – Coreference Resolution Adjudication Tool


This tool was created to enable building the Marmara Turkish Coreference Corpus, where we we had to adjudicate up to ten independent annotations of the same document into one gold standard.

The tool permits a fully automatic adjudication mode with four possible objective functions (which are described in the accompanying journal article). Moreover, part of the output can be specified by the human adjudicater and the tool will create the best possible solution that fits the specifications of the human, making the tool a semi-automatic support for human adjudication. CaspR runs on the command line, uses the popular CoNLL format for Coreference Annotations, and is based on Answer Set Programming and Python.

The tool is publicly available at github.com/knowlp/caspr-coreference-tool.

The accompanying Coreference Adjudication Benchmark Dataset is available at bitbucket.org/knowlp/asp-coreference-benchmark.