Question

A team builds a customer-facing chatbot that answers questions about their software product using an internal knowledge base. In testing, the bot occasionally invents feature names and version numbers that don't exist, stating them with full confidence. The team wants to reduce these fabricated details while keeping answers helpful. Which change most directly addresses the root cause?

Accepted Answer

Retrieve relevant knowledge-base passages and instruct Claude to answer only from the provided passages, cite the source, and say it doesn't know when the passages don't cover the question

Answer

Raise the temperature setting so responses are more varied and less likely to repeat the same fabricated details

Answer

Increase max_tokens so Claude has room to fully explain each feature it describes

Answer

Add a system prompt telling Claude it is a highly accurate expert who never makes mistakes