Question

A data scientist is setting up a new cluster to train a deep learning model with TensorFlow and track experiments with MLflow. They want an environment where common ML libraries and MLflow are preinstalled and GPU support is available without manual pip installs or configuration. Which cluster configuration best satisfies these requirements?

Accepted Answer

A cluster running the Databricks Runtime for Machine Learning (GPU variant)

Answer

A cluster running the standard Databricks Runtime, with TensorFlow and MLflow installed via a cluster-scoped init script

Answer

A cluster running the standard Databricks Runtime, installing all libraries through %pip in the notebook

Answer

A SQL warehouse configured with a GPU-backed compute profile