🔥 3-day streak
AWS Certified Data Engineer - Associate5 / 159
Question 5 of 159

A data engineer manages an Athena-based reporting pipeline that queries a QuickSight dashboard backed by S3 data in Parquet format. New data arrives hourly into date-partitioned S3 prefixes (s3://logs/year=/month=/day=/hour=/). Analysts complain that queries frequently miss the most recent hour of data even though the files exist in S3. The team currently runs a Glue crawler once per day to update partitions. The engineer needs the most operationally efficient way to ensure Athena always recognizes newly arrived partitions without manual intervention or frequent crawler runs. What should the engineer do?

Reviewed for accuracy · Report an issueNext question