Question

A data engineering team ingests daily nested JSON logs (~500 GB/day) into S3. Analysts query the data with Amazon Athena, filtering mostly on a small subset of columns. The team wants to reduce Athena scan costs and improve query performance while keeping storage efficient. Which AWS Glue ETL output configuration best meets these goals?

Accepted Answer

Write the output as ORC files with Snappy compression, partitioned by the columns most used in query filters.

Answer

Write the output as gzip-compressed JSON files, partitioned by ingestion date only.

Answer

Write the output as uncompressed CSV files to maximize compatibility with Athena.

Answer

Write the output as Avro files with Deflate compression to optimize columnar reads.