Question

A retail company is building a customer-facing chatbot on Amazon Bedrock. The chatbot must answer simple product questions with very low latency and at the lowest possible cost per request. The queries are short and do not require complex reasoning or long-form generation. The team is deciding which class of foundation model to select within Bedrock. Which selection approach best fits these requirements?

Accepted Answer

Choose a smaller, lightweight foundation model that meets the accuracy needs for simple queries at lower latency and cost.

Answer

Choose the largest, most capable frontier model available in Bedrock to guarantee answer quality regardless of cost.

Answer

Train a custom foundation model from scratch to optimize it for the retail domain.

Answer

Use a model fine-tuned only for image generation to handle the text-based chatbot queries.