Question

A data engineer uses COPY INTO to incrementally load daily CSV files from cloud storage into an existing Delta table. This week, the upstream team added two new columns to the source files. The engineer wants COPY INTO to automatically add these new columns to the target Delta table instead of failing or ignoring them. Which approach accomplishes this?

Accepted Answer

Set the COPY_OPTIONS ('mergeSchema' = 'true') option in the COPY INTO command

Answer

Set the FORMAT_OPTIONS ('inferSchema' = 'true') option in the COPY INTO command

Answer

Add 'cloudFiles.schemaEvolutionMode' = 'addNewColumns' to the COPY INTO command

Answer

Drop and recreate the target Delta table before each COPY INTO run