Question

A data engineer is building a Structured Streaming pipeline to ingest clickstream events from an Apache Kafka topic into a bronze Delta table. They want to continuously read new events as they arrive and write them out reliably. Which combination of API calls correctly establishes the streaming read from Kafka?

Accepted Answer

spark.readStream.format("kafka").option("kafka.bootstrap.servers", ...).option("subscribe", ...).load()

Answer

spark.read.format("kafka").option("kafka.bootstrap.servers", ...).option("subscribe", ...).load()

Answer

spark.readStream.format("cloudFiles").option("cloudFiles.format", "kafka").load(...)

Answer

spark.read.format("delta").option("subscribe", ...).load()