Question

A Generative AI Engineer has built a customer-support summarization chain that calls a Databricks Foundation Model API pay-per-token endpoint using the OpenAI-compatible client. Leadership now wants the ability to switch the underlying LLM (e.g., from Llama to a Claude external model) without rewriting the application code that makes the completion calls. Which Databricks capability lets the engineer change the served model behind a stable interface so the application code stays unchanged?

Accepted Answer

Configure a Model Serving endpoint (with an external-model or foundation-model entity) and keep the application pointed at the stable endpoint name while updating the served entity

Answer

Register each candidate model in Unity Catalog and reference it by its three-level name in every request

Answer

Hardcode conditional logic in the chain that instantiates a different client library for each provider based on an environment variable

Answer

Enable provisioned throughput on the endpoint so that the model can be resized dynamically