The University of Sheffield
QuEst++: open source tool for pipelined translation quality estimation

QuEst++ is an open source software is aimed at quality estimation (QE) for machine translation. It was developed by Pr Lucia Specia's team at the University of Sheffield and includes contributions from a number of researchers.

It has two main modules: a Java module to extract a number of word, sentence and document-level features and a Python module that interacts with the scikit-learn toolkit for machine learning. Is has also a few python and shell scripts for small things here and there.

See QuEst++ tutorial.

This software was developed as part of the QUEST, QTLaunchPad, QT21 and EXPERT projects and it also received funds from EAMT.

Versions of the software

  • Get QuEst++ from our GitHub repository (source code and basic tools - recommended for developers).
  • Get vanilla version of QuEst++ (complete JAR file with all libraries included of the stable version of the code - recommended for users).

    • License: for our Java code is BSD and for our Python code is Apache License 2.0. For pre-existing code and resources, e.g., scikit-learn, SRILM, GIZA++, Stanford and Berkeley parsers, please check their website.

    Check the current baseline, black-box, and glass-box lists of features QuEst++ can extract at sentence level.

    Be a collaborator

    Send an email to Professor Lucia Specia if you want to be a collaborator.

    Citing QuEst++

    Lucia Specia, Gustavo Henrique Paetzold and Carolina Scarton (2015): Multi-level Translation Quality Prediction with QuEst++. In the Proceedings of ACL-IJCNLP 2015 System Demonstrations, Beijing, China, pp. 115-120. [PDF][BIBTEX]