🔥 3-day streak
Databricks Certified Data Engineer Associate20 / 150
Question 20 of 150
A data engineer uses Auto Loader to ingest a very large backlog of JSON files that accumulated in a cloud storage location. When the stream starts, the cluster becomes overwhelmed because it tries to process an enormous number of files in a single micro-batch, causing memory pressure and slow performance. The engineer wants to limit how many files each micro-batch processes so the load is more manageable. Which option should be configured to control this behavior?
Reviewed for accuracy · Report an issueNext question