Question

A financial services team uses a Bedrock Knowledge Base with the RetrieveAndGenerate API to answer customer questions about mutual fund products. Compliance requires that every generated answer must cite the source document sections it used and must decline to answer when the retrieved passages do not contain sufficient information (rather than relying on the model's general knowledge). The default responses sometimes include information not present in the retrieved chunks and omit citations. Which approach best addresses these requirements while keeping the managed RAG workflow?

Accepted Answer

Customize the knowledge base's generation prompt template to instruct the model to answer only from the retrieved search results, decline when insufficient, and reference source passages, and enable citation output in the RetrieveAndGenerate response.

Answer

Switch the knowledge base to a smaller, cheaper foundation model so it has less general knowledge to draw from, reducing the chance of unsupported statements.

Answer

Lower the temperature and top-p inference parameters to zero so the model becomes fully deterministic and never hallucinates content outside the retrieved chunks.

Answer

Increase the number of retrieved results (numberOfResults) to the maximum so the model always has enough context and therefore never needs to decline or add outside information.