Question

A retail company exposes a synchronous product-description generation endpoint through Amazon API Gateway backed by a Lambda function that calls the Bedrock InvokeModel API on Anthropic Claude. During a flash sale, traffic spikes cause many requests to fail with ThrottlingException errors from Bedrock, and users see HTTP 500 responses. The team is using on-demand throughput and wants to improve resilience without immediately purchasing provisioned throughput. Which combination of changes BEST reduces user-facing failures?

Accepted Answer

Implement exponential backoff with jitter and retries in the Lambda code for ThrottlingException, and add an SQS queue with an asynchronous processing path for overflow requests.

Answer

Increase the Lambda function timeout to 15 minutes so that throttled Bedrock calls have time to eventually succeed.

Answer

Enable API Gateway response caching so repeated requests return cached generations and never reach Bedrock.

Answer

Raise the Lambda reserved concurrency to the account maximum so more requests can call Bedrock simultaneously.