Question

A data science team has deployed a fraud-detection model to a Databricks Model Serving endpoint. The model is only queried during business hours, and the team wants to minimize compute costs during nights and weekends when no requests arrive, while still being able to serve requests automatically when traffic resumes. Which endpoint configuration best meets this requirement?

Accepted Answer

Enable the scale-to-zero option on the endpoint so compute is released during idle periods and provisioned again on the next request.

Answer

Set a fixed provisioned concurrency and manually delete the endpoint every evening, recreating it each morning.

Answer

Switch the deployment to a batch inference job using spark_udf scheduled with a Databricks Job.

Answer

Configure the endpoint with the maximum provisioned throughput to reduce per-request cost.