Question

A data engineering team receives sales files from partners at unpredictable times throughout the day. The files are uploaded to a specific folder in a OneLake lakehouse Files section. The team wants a Fabric Data pipeline to run automatically within moments of a new file arriving, without polling on a fixed schedule. Which approach should they configure to trigger the pipeline?

Accepted Answer

Create a Fabric event-based trigger (using Real-Time hub / Fabric events) that listens for OneLake events and starts the pipeline on file creation

Answer

Configure a scheduled trigger on the pipeline set to run every 5 minutes and add a Get Metadata activity to check for new files

Answer

Enable Git integration on the workspace so that commits trigger the pipeline automatically

Answer

Use a Dataflow Gen2 with incremental refresh, which automatically detects and processes new files as they land