Question

A data engineer has a Lakeflow Job configured with a job-level parameter named 'process_date' whose default value is set to the current date. The job runs automatically each morning on a schedule. One morning, the scheduled run fails because of an upstream data delay. Later that day, the source data for the previous day becomes available, and the engineer needs to manually trigger the job to reprocess that specific earlier date without permanently changing the job's default configuration. What is the most appropriate way to accomplish this?

Accepted Answer

Use 'Run now with different parameters' and supply the desired value for 'process_date' for that single manual run.

Answer

Edit the job definition to hard-code the earlier date as the default, run the job, then edit it back afterward.

Answer

Create a brand-new job that duplicates all tasks but with the earlier date, then delete it after the run completes.

Answer

Change the job's schedule to a cron expression matching the earlier date so the run uses that date automatically.