Question

A media company runs a streaming Dataflow pipeline that ingests events from Pub/Sub, enriches them, and writes results to BigQuery. Leadership requires that if the primary region (us-central1) suffers a full regional outage, the pipeline can resume processing with minimal data loss and an RTO of under one hour. Which design best satisfies this disaster recovery requirement?

Accepted Answer

Configure Pub/Sub with message retention and snapshots, store pipeline templates and state in multi-region resources, and maintain infrastructure-as-code to relaunch the Dataflow job in a secondary region (us-east1) with BigQuery configured for the corresponding location.

Answer

Deploy the Dataflow job in a single region with autoscaling enabled and rely on Dataflow's automatic worker rescheduling within the region.

Answer

Increase the Pub/Sub acknowledgment deadline to the maximum and enable exactly-once delivery so no messages are lost during an outage.

Answer

Take hourly manual exports of BigQuery tables to Cloud Storage in another region so data can be restored after the outage.