Who cites «Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics»
- A Critical Study of Automatic Evaluation in Sign Language Translation — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Automated evaluation of LLMs for effective machine translation of Mandarin Chinese to English — 2026 · arXiv:2603.09998
- Benchmarking Speech-to-Speech Translation Models — 2026 · arXiv:2606.03241
- Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation — 2026 · arXiv:2609.14963
- Contextual Diversity Measure (CDM) for Controllable Story Generation in Large Language Models — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
- Creativity Bias: How Machine Evaluation Struggles with Creativity in Literary Translations — 2026 · Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)
- Diagnose, Then Repair: A Two-Stage MQM-Guided Post-Editing Framework for Domain-Specific Machine Translation — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
- From Outliers to Errors: Auditing Pali-to-English LLM Translations with Multi-Reference Adjudication — 2026 · arXiv:2606.01136
- M-GATE: Multilingual Grammar, Accuracy in Translation, and Efficiency Benchmark for Large Language Models — 2026 · arXiv:2608.03803
- Mind Which Bird You Favour: Parameterizing Adequacy-Fluency Balance in Meta-Evaluation of Machine Translation — 2026 · arXiv:2609.14795
- NLG Evaluation: Past, Present, Future — 2026 · Proceedings of the 1st Symposium on Natural Language Generation Evaluations
- Referenceless Evaluation of Machine Translation Models by Ranking Performance in Romanian to English Translate-train Settings — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
- SemiAdapt: Semi-Supervised and Efficient LoRA-Based Domain Adaptation for Low-Resource Irish Machine Translation with Transformers — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
- TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation — 2026 · arXiv:2608.02975
- Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus — 2026 · arXiv:2608.12018
- Who Watches the Watchmen? Humans Disagree With Translation Metrics on Unseen Domains — 2026 · Findings of the Association for Computational Linguistics: ACL 2026
- ``Be My Cheese?'''': Cultural Nuance Benchmarking for Machine Translation in Multilingual LLMs — 2026 · Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
- Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation — 2025 · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- BLEUBERI: BLEU is a surprisingly effective reward for instruction following — 2025 · arXiv:2505.11080
- Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases — 2025 · Proceedings of the First Workshop on Large Language Model Memorization (L2M2)
- Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translation — 2025 · arXiv:2509.17349
- Context-Informed Machine Translation of Manga using Multimodal Large Language Models — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
- D\''ej\`a Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation — 2025 · arXiv:2504.11829
- Do LLMs Understand Your Translations? Evaluating Paragraph-level MT with Question Answering — 2025 · arXiv:2504.07583
- Estimating Machine Translation Difficulty — 2025 · Findings of the Association for Computational Linguistics: EMNLP 2025
- Evaluating the Feasibility of Using ChatGPT for Cross-cultural Survey Translation — 2025 · Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Long and Short Papers
- Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
- Findings of the AmericasNLP 2025 Shared Tasks on Machine Translation, Creation of Educational Material, and Translation Metrics for Indigenous Languages of the Americas — 2025 · Proceedings of the Fifth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP)
- Findings of the WAT 2025 Shared Task on Japanese-English Article-level News Translation — 2025 · Proceedings of the Twelfth Workshop on Asian Translation (WAT 2025)
- Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets — 2025 · Proceedings of the Tenth Conference on Machine Translation
- Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation — 2025 · Proceedings of the Tenth Conference on Machine Translation
- Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help — 2025 · Proceedings of the Tenth Conference on Machine Translation
- How to Evaluate Speech Translation with Source-Aware Neural MT Metrics — 2025 · arXiv:2511.03295
- Investigating Length Issues in Document-level Machine Translation — 2025 · Proceedings of Machine Translation Summit XX: Volume 1
- MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
- MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants — 2025 · Proceedings of the Tenth Conference on Machine Translation
- NHK Submission to WAT 2025: Leveraging Preference Optimization for Article-level Japanese–English News Translation — 2025 · Proceedings of the Twelfth Workshop on Asian Translation (WAT 2025)
- The Devil is in the Details: Assessing the Effects of Machine-Translation on LLM Performance in Domain-Specific Texts — 2025 · Proceedings of Machine Translation Summit XX: Volume 1
- Towards Zero-Shot Multimodal Machine Translation — 2025 · Findings of the Association for Computational Linguistics: NAACL 2025
- TransEvalnia: Reasoning-based Evaluation and Ranking of Translations — 2025 · arXiv:2507.12724
- Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Verify with Caution: The Pitfalls of Relying on Imperfect Factuality Metrics — 2025 · Findings of the Association for Computational Linguistics: ACL 2025
- Évaluation de la Robustesse des LLM : Proposition d''un Cadre Méthodologique et Développement d''un Benchmark — 2025 · Actes de l'atelier Évaluation des modèles génératifs (LLM) et challenge 2025 (EvalLLM)
- An Analysis on Automated Metrics for Evaluating Japanese-English Chat Translation — 2024 · arXiv:2412.18190
- Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics — our card · 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- COMET for Low-Resource Machine Translation Evaluation: A Case Study of English-Maltese and Spanish-Basque — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Efficient Benchmarking (of Language Models) — 2024 · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Evaluating Automatic Metrics with Incremental Machine Translation Systems — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
- Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- Finding Blind Spots in Evaluator LLMs with Interpretable Checklists — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet — 2024 · Proceedings of the Ninth Conference on Machine Translation
- Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy — 2024 · Proceedings of the Ninth Conference on Machine Translation
- Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis — 2024 · Proceedings of the Ninth Conference on Machine Translation
- Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages — 2024 · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Pushing the Limits of Zero-shot End-to-End Speech Translation — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Revisiting Meta-evaluation for Grammatical Error Correction — 2024
- Topic-guided Example Selection for Domain Adaptation in LLM-based Machine Translation — 2024 · Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
- Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languages — 2024 · arXiv:2404.02512
- À propos des difficultés de traduire automatiquement de longs documents — 2024 · Actes de la 31ème Conférence sur le Traitement Automatique des Langues Naturelles, volume 1 : articles longs et prises de position
- Adapting Machine Translation Education to the Neural Era: A Case Study of MT Quality Assessment — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Aligning Offline Metrics and Human Judgments of Value for Code Generation Models — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Analysing Mistranslation of Emotions in Multilingual Tweets by Online MT Tools — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics — 2023 · Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track
- Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation — 2023
- Calibrated Interpretation: Confidence Estimation in Semantic Parsing — 2023
- Extrinsic Evaluation of Machine Translation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet — 2023 · Proceedings of the Eighth Conference on Machine Translation
- GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 — 2023 · Proceedings of the Eighth Conference on Machine Translation
- IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Metric Score Landscape Challenge (MSLC23): Understanding Metrics'' Performance on a Wider Landscape of Translation Quality — 2023 · Proceedings of the Eighth Conference on Machine Translation
- On the Blind Spots of Model-Based Evaluation Metrics for Text Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- PE effort and neural-based automatic MT metrics: do they correlate? — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Rethinking Round-Trip Translation for Machine Translation Evaluation — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Toward Human-Like Evaluation for Natural Language Generation with Error Analysis — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Language — 2023 · Proceedings of the 20th International Conference on Natural Language Processing (ICON)
- UScore: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Boosting Code Summarization by Embedding Code Structures — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
- Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation — 2022 · Findings of the Association for Computational Linguistics: NAACL 2022
- Control Prefixes for Parameter-Efficient Text Generation — 2022 · Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
- DEMETR: Diagnosing Evaluation Metrics for Translation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- Does Summary Evaluation Survive Translation to Other Languages? — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark — 2022 · Transactions of the Association for Computational Linguistics
- Findings of the 2022 Conference on Machine Translation (WMT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Improving Both Domain Robustness and Domain Adaptability in Machine Translation — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
- Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics — 2022 · Findings of the Association for Computational Linguistics: ACL 2022
- Lack of Fluency is Hurting Your Translation Model — 2022 · arXiv:2205.11826
- MS-COMET: More and Better Human Judgements Improve Metric Performance — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/cited-by/mathur-2020-tangled-up-bleu-reevaluating-evaluation/