Who cites «Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation» · page 3
- xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection — 2024 · Transactions of the Association for Computational Linguistics
- A Critical Evaluation of Evaluations for Long-form Question Answering — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- An Experiment in Error Analysis of Real-time Speech Machine Translation Using the Example of the European Parliament's Innovation Partnership — 2023 · Proceedings of the Ninth Italian Conference on Computational Linguistics (CLiC-it 2023)
- Are Experts Needed? On Human Evaluation of Counselling Reflection Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ — 2023 · arXiv:2310.00367 · The Twelfth International Conference on Learning Representations, 2024
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models — 2023 · arXiv:2309.06085
- Barriers and enabling factors for error analysis in NLG research — 2023 · Northern European Journal of Language Technology
- Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics — 2023 · Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track
- BooookScore: A systematic exploration of book-length summarization in the era of LLMs — 2023 · arXiv:2310.00785
- Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation — 2023
- CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Empirical Assessment of kNN-MT for Real-World Translation Scenarios — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Evaluating Optimal Reference Translations — 2023 · arXiv:2311.16787
- Explaining with Contrastive Phrasal Highlighting: A Case Study in Assisting Humans to Detect Translation Differences — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Extrinsic Evaluation of Machine Translation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN — 2023 · Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
- FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation — 2023 · Transactions of the Association for Computational Linguistics
- Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Findings of the WMT 2023 Shared Task on Quality Estimation — 2023 · Proceedings of the Eighth Conference on Machine Translation
- GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 — 2023 · Proceedings of the Eighth Conference on Machine Translation
- GPTScore: Evaluate as You Desire — 2023 · arXiv:2302.04166
- How effective is machine translation on low-resource code-switching? A case study comparing human and automatic metrics — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- IOL Research's Submission for WMT 2023 Quality Estimation Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Large Language Models Are State-of-the-Art Evaluators of Translation Quality — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Leveraging GPT-4 for Automatic Translation Post-Editing — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods — 2023 · arXiv:2309.10966
- MMT's Submission for the WMT 2023 Quality Estimation Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Onception: Active Learning with Expert Advice for Real World Machine Translation — 2023 · Computational Linguistics
- PE effort and neural-based automatic MT metrics: do they correlate? — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- PaLM 2 Technical Report — 2023 · arXiv:2305.10403
- ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Prompting PaLM for Translation: Assessing Strategies and Performance — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Reward Gaming in Conditional Text Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Student''s t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce — 2023 · Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
- T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks — 2023 · arXiv:2310.00752
- Test-time Adaptation for Machine Translation Evaluation by Uncertainty Minimization — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- The Best of Both Worlds: Combining Human and Machine Translations for Multilingual Semantic Parsing with Active Learning — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation — 2023 · Proceedings of the Eighth Conference on Machine Translation
- The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics — 2023 · Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems
- The MT@BZ corpus: machine translation & legal language — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text Evaluation — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Toward Human-Like Evaluation for Natural Language Generation with Error Analysis — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Towards Explainable Evaluation Metrics for Machine Translation — 2023 · arXiv:2306.13041 · Journal of Machine Learning Research (JMLR), 2024, vol. 25, no. 75, p. 1-49
- Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors — 2023 · arXiv:2302.08975
- Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Language — 2023 · Proceedings of the 20th International Conference on Natural Language Processing (ICON)
- Towards Unsupervised Recognition of Token-level Semantic Differences in Related Documents — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Toxicity in Multilingual Machine Translation at Scale — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level — 2023 · Proceedings of the Eighth Conference on Machine Translation
- UScore: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings — 2023 · Proceedings of the Eighth Conference on Machine Translation
- A Comparison of Data Filtering Methods for Neural Machine Translation — 2022 · Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas (Volume 2: Users and Providers Track and Government Track)
- A Natural Diet: Towards Improving Naturalness of Machine Translation Output — 2022 · Findings of the Association for Computational Linguistics: ACL 2022
- A new approach to calculating BERTScore for automatic assessment of translation quality — 2022 · arXiv:2203.05598
- ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics — our card · 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task — 2022 · arXiv:2210.09683
- Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Alibaba-Translate China's Submission for WMT2022 Metrics Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- An Overview on Machine Translation Evaluation — 2022 · arXiv:2202.11027
- As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive Conditioning — 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Automatic Correction of Human Translations — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- BJTU-Toshiba's Submission to WMT22 Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Consistent Human Evaluation of Machine Translation across Language Pairs — 2022 · Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
- Disentangling Uncertainty in Machine Translation Evaluation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- Does Summary Evaluation Survive Translation to Other Languages? — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark — 2022 · Transactions of the Association for Computational Linguistics
- Evaluating Machine Translation in Cross-lingual E-Commerce Search — 2022 · Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
- Examining Large Pre-Trained Language Models for Machine Translation: What You Don''t Know about It — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Findings of the 2022 Conference on Machine Translation (WMT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Findings of the IWSLT 2022 Evaluation Campaign — 2022 · Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022)
- Findings of the WMT 2022 Shared Task on Chat Translation — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- Findings of the WMT 2022 Shared Task on Efficient Translation — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
- From COMET to COMES – Can Summary Evaluation Benefit from Translation Evaluation? — 2022 · Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems
- GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Professional Post-Editing Towards More Effective MT Evaluation — 2022 · Proceedings of the Thirteenth Language Resources and Evaluation Conference
- High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics — 2022 · Transactions of the Association for Computational Linguistics
- HilMeMe: A Human-in-the-Loop Machine Translation Evaluation Metric Looking into Multi-Word Expressions — 2022 · arXiv:2211.05201
- Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMET — 2022 · Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- MS-COMET: More and Better Human Judgements Improve Metric Performance — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/cited-by/freitag-2021-experts-errors-context-large-scale-3/