LOGO du LIMSI LOGO du CNRS

Morpheval

Evaluation of the morphological quality of machine translation outputs. The automatically generated test suites in English can be translated into different target languages (Czech, Latvian, German, French). The output is then analyzed and provides three types of information:

The approach is described in the following paper:

Franck Burlot and François Yvon. 2017. Evaluating the morphological competence of machine translation systems. In Proceedings of the Second Conference on Machine Translation (WMT’17). Association for Computational Linguistics, Copenhagen, Denmark.
pdf bibtex

Version 1: Czech, Latvian

Test suite

English source sentences: download
Sentence tags: download

Running the evaluation

Evaluation scripts: follow the readme
Latvian dictionary: download

Version 2: Czech, German, French

Test suite

English source sentences: download
Sentence tags: download

Running the evaluation

Evaluation scripts: follow the readme
French dictionary: download