Question

A retail company is planning a customer-facing chatbot that will handle a very high volume of simple, repetitive product-availability questions. During budget planning, the AI leader notices that using the largest, most capable model for every request would significantly increase monthly costs. Most queries are straightforward and do not require advanced reasoning. Which approach best controls cost while still meeting the business need?

Accepted Answer

Route the simple, high-volume queries to a smaller, less expensive model and reserve the largest model only for complex requests.

Answer

Use the largest available model for all queries to guarantee the highest possible response quality.

Answer

Fine-tune the largest model on the entire product catalog so it can answer any question type.

Answer

Increase the temperature setting so the model generates shorter, cheaper responses.