Question

A logistics company receives IoT telemetry from delivery trucks. Sensors publish location updates every 5 seconds to a Pub/Sub topic, and the analytics team needs a dashboard that reflects truck positions with no more than 30 seconds of delay. Separately, each night a partner uploads a large CSV file of completed-delivery records to a Cloud Storage bucket, which must be joined with the telemetry and loaded into BigQuery once per day. You must design the ingestion approach. Which combination correctly matches processing modes to these two workloads?

Accepted Answer

Run a streaming Dataflow pipeline reading from Pub/Sub for telemetry, and a separate scheduled batch Dataflow pipeline reading the nightly CSV from Cloud Storage.

Answer

Run a single streaming Dataflow pipeline that reads Pub/Sub and polls the Cloud Storage bucket continuously so both workloads share the same job.

Answer

Run both workloads as scheduled batch Dataflow jobs, reading Pub/Sub with a windowed batch export every 30 seconds and the CSV nightly.

Answer

Run a streaming Dataflow pipeline for the CSV file using a Cloud Storage notification trigger, and a nightly batch job that reads accumulated Pub/Sub messages.