Question

A data engineer wants to load a batch of new Parquet files from an S3 location into an existing table using the COPY INTO command. The team plans to run this command on a nightly schedule as files arrive. Which requirement must be satisfied for COPY INTO to work correctly in this scenario?

Accepted Answer

The target table must be a Delta table; COPY INTO requires a Delta Lake target.

Answer

The source files must be JSON or CSV, since COPY INTO does not support Parquet input.

Answer

The command must be run inside a Structured Streaming query to track file arrival.

Answer

A new external table must be created on each run because COPY INTO cannot append to an existing table.