Question

A company deploys a RAG-based internal support assistant that retrieves from a document store before answering. Employees complain that answers are still frequently off-topic or incomplete, even though the source documents clearly contain the correct information. The generation model itself performs well when given the right context manually. What is the MOST likely area to investigate first to improve output quality?

Accepted Answer

The quality of the retrieval step, including how documents are chunked and how relevant passages are matched to the query

Answer

Fine-tuning the base model on a larger general-purpose dataset to increase its overall knowledge

Answer

Lowering the model's temperature setting to make responses more deterministic

Answer

Increasing the model's maximum output token limit so it can produce longer answers