Question

A data engineer creates an external table over Parquet files stored in an Amazon S3 bucket. New files are added to the bucket by an upstream process several times per hour, and the team needs the external table's metadata to reflect newly added files automatically, without manual intervention. Which configuration should the engineer implement?

Accepted Answer

Enable AUTO_REFRESH on the external table and configure S3 event notifications to an SQS queue provided by Snowflake

Answer

Schedule a task that runs COPY INTO from the external stage every few minutes to reload the files

Answer

Create a Snowpipe with auto-ingest to continuously copy the Parquet files into the external table

Answer

Run ALTER EXTERNAL TABLE ... REFRESH manually after each upstream load completes