Library

MT-ComparEval: Graphical evaluation interface for Machine Translation development

Abstract The tool described in this article has been designed to help MT developers by implementing a web-based graphical user interface that allows to systematically compare and evaluate various MT engines/experiments using comparative analysis via automatic measures and statistics. The evaluation panel provides graphs, tests for statistical significance and n-gram statistics. We also present a demo server http://wmt.ufal.cz with WMT14 and WMT15 translations.

Computer ScienceLinguisticsMathematics
View graphSource

Paper

Full text

PDF

MT-ComparEval: Graphical evaluation interface for Machine Translation development

Semantic Scholar · Computer Science · 2015

Abstract

Abstract The tool described in this article has been designed to help MT developers by implementing a web-based graphical user interface that allows to systematically compare and evaluate various MT engines/experiments using comparative analysis via automatic measures and statistics. The evaluation panel provides graphs, tests for statistical significance and n-gram statistics. We also present a demo server http://wmt.ufal.cz with WMT14 and WMT15 translations.

Source of record · Semantic Scholar

References (26)

01Findings of the 2015 Workshop on Statistical Machine TranslationOndrej Bojar, Rajen Chatterjee, C. Federmann et al.2015 · WMT@EMNLP · 344 citations
02MT-EQuAl: a Toolkit for Human Assessment of Machine Translation OutputChristian Girardi, L. Bentivogli, M. Amin Farajian et al.2014 · International Conference on Computational Linguistics · 24 citations
03Findings of the 2014 Workshop on Statistical Machine TranslationOndrej Bojar, C. Buck, C. Federmann et al.2014 · WMT@ACL · 852 citations
04The ACL Anthology Network Corpus as a Resource for NLP-based BibliometricsAmjad Abu Jbara, Dragomir R. Radev2013 · 6.0k citations
05PET: a Tool for Post-editing and Assessing Machine TranslationWilker Aziz, Sheila Castilho, Lucia Specia2012 · International Conference on Language Resources and Evaluation · 163 citations
06Automatic MT Error Analysis: Hjerson Helping AddicterJ. Berka, Ondrej Bojar, Mark Fishel et al.2012 · International Conference on Language Resources and Evaluation · 19 citations
07Hjerson: An Open Source Tool for Automatic Error Classification of Machine Translation OutputMaja Popovic2011 · Prague Bulletin of Mathematical Linguistics · 92 citations
08Addicter: What Is Wrong with My Translations?Daniel Zeman, Mark Fishel, J. Berka et al.2011 · Prague Bulletin of Mathematical Linguistics · 46 citations
09Better Hypothesis Testing for Statistical Machine Translation: Controlling for Optimizer InstabilityJ. Clark, Chris Dyer, A. Lavie et al.2011 · Annual Meeting of the Association for Computational Linguistics · 515 citations
10An Experimental Management SystemPhilipp Koehn2010 · Prague Bulletin of Mathematical Linguistics · 43 citations
11Asiya: An Open Toolkit for Automatic Machine Translation (Meta-)EvaluationJ. Giménez, Lluís Màrquez i Villodre2010 · Prague Bulletin of Mathematical Linguistics · 102 citations
12Appraise: An Open-Source Toolkit for Manual Phrase-Based Evaluation of TranslationsC. Federmann2010 · International Conference on Language Resources and Evaluation · 36 citations

Scroll for more · 14 remaining

Similar papers

compare-mt: A Tool for Holistic Comparison of Language Generation SystemsGraham Neubig, Zi-Yi Dou, Junjie Hu et al.2019 · North American Chapter of the Association for Computational Linguistics · 118 citations In Library
The OPUS-MT Dashboard – A Toolkit for a Systematic Evaluation of Open Machine Translation ModelsJörg Tiedemann, Ona de Gibert2023 · Annual Meeting of the Association for Computational Linguistics · 12 citations In Library
Beyond Correlation: Interpretable Evaluation of Machine Translation MetricsStefano Perrella, Lorenzo Proietti, ‪Pere-Lluís Huguet Cabot et al.2024 In Library
Beyond Correlation: Interpretable Evaluation of Machine Translation MetricsStefano Perrella, Lorenzo Proietti, ‪Pere-Lluís Huguet Cabot et al.2024 · arXiv (Cornell University) · 13 citations In Library
An Automatic Evaluation of the WMT22 General Machine Translation TaskBenjamin Marie2022 · arXiv (Cornell University) · 4 citations In Library
MT-Telescope: An interactive platform for contrastive evaluation of MT systemsRicardo Rei, Ana C Farinha, Craig Stewart et al.2021 · Annual Meeting of the Association for Computational Linguistics · 6 citations In Library
Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation SystemsChinmay Dandekar, Wenda Xu, Xi Xu et al.2024 · arXiv (Cornell University) · 1 citation In Library
MT Evaluation in the Context of Language ComplexityDaša Munková, Michal Munk, Ľubomír Benko et al.2021 · Complexity In Library
Beyond MT metrics in specialised translation: Automated and manual evaluation of machine translation output for freelance translators and small LSPs in the context of EU documentsKrzysztof Łoboda2021 · Beyond Philology An International Journal of Linguistics Literary Studies and English Language Teaching · 2 citations In Library
An Overview on Machine Translation EvaluationLifeng Han2022 · arXiv (Cornell University) · 10 citations In Library
© 2026 NYSGPT2525 LLC