Question

A data engineer runs a Fabric data pipeline that uses a Copy activity to load data from an on-premises SQL Server through a gateway into a lakehouse. The pipeline occasionally fails because of brief network interruptions to the gateway, but reruns succeed without any changes. The engineer wants the pipeline to automatically recover from these intermittent failures without manual intervention, while still alerting the team if the failures persist. What should the engineer configure first?

Accepted Answer

Set the Copy activity's retry count and retry interval so the activity automatically attempts the transfer again after transient failures.

Answer

Wrap the Copy activity inside a ForEach activity to loop the load multiple times until it succeeds.

Answer

Increase the Copy activity's Degree of copy parallelism to reduce the time the network is in use.

Answer

Replace the pipeline with a Dataflow Gen2 that reads from the same on-premises source.