Question

A financial services company wants to deploy a generative AI chatbot that answers customer questions using the company's own up-to-date policy documents, which change frequently. Leadership is concerned about the model inventing answers that are not backed by actual company documents. Which approach should the team prioritize to address this concern with the least ongoing model maintenance?

Accepted Answer

Ground the model's responses in the company's policy documents using retrieval-based grounding so answers are anchored to authoritative source content

Answer

Fine-tune a foundation model on the policy documents every time a document changes

Answer

Increase the model's output token limit so it can produce longer, more detailed responses

Answer

Lower the model temperature setting to zero so the model never produces creative output