George Foster

3 paper cards in Mova's library · 2017–2022

George Foster wrote 3 of the papers Mova reads, in 2017–2022, most of them on Machine translation; often with Markus Freitag, Alon Lavie, André F. T. Martins.

The profile is the library's match of the name; two people with one name are not always told apart.

Papers

Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust (2022)
The shared task scored submitted MT metrics on WMT22 system outputs for three pairs (English to German, English to Russian, Chinese to English) across four domains: news, social, e-commerce and chat.
Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation (2021)
The paper replaces the usual one-score human judgment with explicit error annotation. Professional translators, working with the full document, marked errors in the outputs of the ten top systems of WMT 2020 (human references included) for English-to-German and Chinese-to-English, using the MQM framework. The errors…
A Challenge Set Approach to Evaluating Machine Translation (2017)
The paper proposes challenge sets: small, hand-written sets of English to French sentences, each built to test one structural divergence between the two languages, for example morphology that exposes agreement, stranded prepositions, double-object verbs, subcategorisation frames, idioms and WH-movement.