Question

A data scientist has a Databricks Model Serving endpoint that currently routes 100% of traffic to version 3 of a registered Unity Catalog model. The team has just trained version 4 and wants to safely evaluate it in production by sending only 10% of live requests to the new version while the remaining 90% continues to hit version 3. What is the recommended way to accomplish this on the existing Model Serving endpoint?

Accepted Answer

Configure the endpoint to serve both model versions as separate served entities and set the traffic percentages in the endpoint's traffic configuration (90% to version 3, 10% to version 4).

Answer

Create a second, independent serving endpoint for version 4 and manually route 10% of client requests to it in application code.

Answer

Assign the 'champion' alias to version 3 and the 'challenger' alias to version 4; Model Serving automatically splits traffic 90/10 between aliases.

Answer

Delete the existing endpoint and recreate it with version 4 only, since Model Serving cannot host more than one model version at a time.