🔥 3-day streak
Databricks Certified Generative AI Engineer Associate97 / 145
Question 97 of 145

A GenAI engineer has deployed a custom RAG chain to a Databricks Model Serving endpoint that fronts a customer-facing chatbot. During load testing, the team observes that at high request volumes the endpoint adds noticeable per-request latency from the serving proxy layer, and they need to sustain thousands of concurrent queries with the lowest possible routing overhead. Which endpoint configuration change should the engineer make to address this?

Reviewed for accuracy · Report an issueNext question