Question

A data scientist wants to start a new interactive cluster to train a scikit-learn model and track it with MLflow autologging, using libraries like TensorFlow and XGBoost without manually installing them. When creating the cluster, which choice ensures these ML libraries and MLflow come preinstalled?

Accepted Answer

Select the Databricks Runtime for Machine Learning (Databricks Runtime ML)

Answer

Select a standard Databricks Runtime and add the libraries via an init script

Answer

Select a standard Databricks Runtime and enable Photon acceleration

Answer

Select a standard Databricks Runtime and install libraries with %pip in the notebook