Question

A GenAI team runs a customer-facing summarization service on Amazon Bedrock using Anthropic Claude on-demand throughput in us-east-1. During peak business hours, they consistently hit the per-region invocation-per-minute quota and receive ThrottlingExceptions, even though the same model is available with unused capacity in us-west-2 and eu-west-1. The team wants to increase effective throughput and reduce throttling without provisioning dedicated capacity, while still being able to track cost per environment. What is the most appropriate solution?

Accepted Answer

Create an application inference profile that routes across multiple regions, invoke the model through the profile ARN, and tag the profile to attribute cost per environment.

Answer

Purchase Provisioned Throughput in us-east-1 with enough model units to absorb the peak, then fall back to on-demand when the reservation is exhausted.

Answer

Implement exponential backoff with jitter in the client SDK so all throttled requests are retried until they succeed in us-east-1.

Answer

Submit a Service Quotas increase request for the us-east-1 invocation-per-minute limit and route all traffic to that single region.