Question

A retail company runs a generative AI chatbot that produces detailed product descriptions. Monthly costs have risen sharply, and finance asks the AI Transformation Leader to identify the primary factor increasing spend. The team confirms request volume is stable, but each response has grown much longer over recent releases. Which change would most directly reduce the model's per-response cost?

Accepted Answer

Instruct the model to generate more concise responses, reducing the number of output tokens per request

Answer

Fine-tune the model on the company's product catalog to improve description accuracy

Answer

Add a retrieval-augmented generation layer to ground responses in the latest catalog data

Answer

Enable multi-factor authentication for all users accessing the chatbot