EMBEDDING-FREE RETRIEVER-AUGMENTED GENERATION (RAG) ARCHITECTURES

A method includes obtaining an input query associated with a document and using a first generative AI model to identify whether different passages of the document are or are not relevant to the input query. The method also includes identifying at least one specific passage in the document and extracting text from the document. The extracted text includes each specific passage and portions of text preceding and following that specific passage. The method further includes generating a prompt requesting that the first generative AI model or a second generative AI model generate a response to the input query using the extracted text. Using the first generative AI model includes generating initial prompts requesting that the first generative AI model indicate whether different chunks of the document are or are not relevant to the input query and identifying relevant chunks based on results generated by the first generative AI model.