Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track

The second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation to address complex, real-world information needs. Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries to better reflect the deep search task with the growing demand for reasoning-driven responses. Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding. The track leverages the MS MARCO V2.1 corpus and employs a multi-layered evaluation framework encompassing relevance assessment, response completeness, attribution verification, and agreement analysis. By emphasizing multi-faceted narratives and attribution-rich answers from over 150 submissions this year, the TREC 2025 RAG Track aims to foster innovation in creating trustworthy, context-aware systems for retrieval augmented generation.

Paper

References (11)

102025. The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language ModelsProceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval , SIGIR ’25,
11Response Evaluation: For relevant documents, key information units (“nuggets”) are extracted and mapped to sub-narratives to measure content coverage and answer completeness

Similar papers

© 2026 NYSGPT2525 LLC