RoMe: A Robust Metric for Evaluating Natural Language Generation

Md Rashad Al Hasan Rony, Liubov Kovriguina, Debanjan Chaudhuri, Ricardo Usbeck, Jens Lehmann. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.

Natural Language Processing Techniques Topic Modeling

View graph Source

Paper

The full text of this publication is not hosted on 44B due to licensing.

Read it at OpenAlex

Automatic Metrics in Natural Language Generation: A survey of Current Evaluation PracticesPatrícia Schmidtová, Saad Mahamood, Simone Balloccu et al.2024 In Library

Evaluation and Comparison of Open-Source LLMs Using Natural Language Generation Quality MetricsDzenan Hamzic, Markus Wurzenberger, Florian Skopik et al.2024 · BigData Congress [Services Society] · 4 citations In Library

The GEM Benchmark: Natural Language Generation, its Evaluation and MetricsSebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal et al.2021 In Library

ROBBIE: Robust Bias Evaluation of Large Generative Language ModelsDavid Esiobu, Xiaoqing Tan, Saghar Hosseini et al.2023 In Library

BLEURT: Learning Robust Metrics for Text GenerationThibault Sellam, Dipanjan Das, Ankur P. Parikh2020 In Library

BLEURT: Learning Robust Metrics for Text GenerationThibault Sellam, Dipanjan Das, Ankur P. Parikh2020 · Annual Meeting of the Association for Computational Linguistics · 1.9k citations In Library

MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented GenerationMaría Andrea Cruz Blandón, Jayasimha Talur, Bruno Charron et al.2025 In Library

Beyond N-Grams: Rethinking Evaluation Metrics and Strategies for Multilingual Abstractive SummarizationItai Mondshine, Tzuf Paz-Argaman, Reut Tsarfaty2025 · Annual Meeting of the Association for Computational Linguistics · 6 citations In Library

GENIE: Toward Reproducible and Standardized Human Evaluation for Text GenerationDaniel Khashabi, Gabriel Stanovsky, Jonathan Bragg et al.2022 In Library

Patents near this paper

COMPUTERIZED METHOD OF GENERATING AND ANALYTICALLY EVALUATING MULTIPLE INSTANCES OF NATURAL LANGUAGE-GENERATED TEXTUS 9,977,826 · FAST FORWARD LABS, INC. · 2018 NATURAL POLITE LANGUAGE GENERATION SYSTEMUS 10,691,894 · DISNEY ENTERPRISES, INC. · 2020 SYSTEMS AND METHODS FOR MEASURING AUTOMATABILITY OF REPORT GENERATION USING A NATURAL LANGUAGE GENERATION SYSTEMUS 11,734,517 · YSEOP SA · 2023 LEARNED EVALUATION MODEL FOR GRADING QUALITY OF NATURAL LANGUAGE GENERATION OUTPUTSUS 11,551,002 · GOOGLE LLC · 2023 METHOD AND SYSTEM FOR ENSURING ROBUSTNESS IN NATURAL LANGUAGE UNDERSTANDINGUS 7,016,827 · INTERNATIONAL BUSINESS MACHINES CORPORATION · 2006

Source of record

OpenAlex

RoMe: A Robust Metric for Evaluating Natural Language Generation

Paper

Similar papers

Patents near this paper

Welcome.

Patents near this paper