Markus Freitag

3 paper cards in Mova's library · 2020–2022

Markus Freitag wrote 3 of the papers Mova reads, in 2020–2022, most of them on Machine translation; often with George Foster, Wolfgang Macherey, Alon Lavie.

The profile is the library's match of the name; two people with one name are not always told apart.

Papers

Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust (2022)
The shared task scored submitted MT metrics on WMT22 system outputs for three pairs (English to German, English to Russian, Chinese to English) across four domains: news, social, e-commerce and chat.
Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation (2021)
The paper replaces the usual one-score human judgment with explicit error annotation. Professional translators, working with the full document, marked errors in the outputs of the ten top systems of WMT 2020 (human references included) for English-to-German and Chinese-to-English, using the MQM framework. The errors…
KoBE: Knowledge-Based Machine Translation Evaluation (2020)
KoBE is a reference-free metric. Each source sentence and each candidate translation is linked to a large multilingual knowledge base, using entity linking. The score is the recall of source entities that are linked to the same knowledge-base entry in the candidate, clipped by the number of times each entity occurs…