Question

A data engineering team wants to migrate their existing Directed Acyclic Graphs (DAGs) written in Python into Microsoft Fabric to orchestrate a complex multi-stage ETL process that includes calls to external REST APIs and dependencies across multiple Fabric items. They require native support for their current DAG definitions with minimal rewriting. Which Fabric capability should they configure to meet this requirement?

Accepted Answer

Create an Apache Airflow job in the workspace and upload the existing DAG files

Answer

Create a Data pipeline and use the Web activity to replicate each DAG task manually

Answer

Configure a Dataflow Gen2 with sequential query dependencies to mimic the DAG structure

Answer

Use a notebook with the Fabric REST API and mssparkutils to chain notebook executions