Question

A data engineering team has a Lakeflow Job with a cron schedule that runs a nightly ETL pipeline. Due to an upstream source system undergoing a two-week maintenance window, the team wants to temporarily stop the scheduled runs but keep the job definition, task configuration, and schedule intact so they can resume it later without recreating anything. What is the recommended action?

Accepted Answer

Pause the schedule on the job; unpause it after the maintenance window ends

Answer

Delete the job and re-create it with the same configuration after two weeks

Answer

Set the job's maximum concurrent runs to 0 to block all runs temporarily

Answer

Change the trigger type from scheduled to continuous so it stops firing on the cron