Question

A data engineering team is building an orchestration layer for a high-volume event pipeline. For each incoming clickstream event, a short-lived workflow validates the payload, invokes a Lambda function for enrichment, and writes the result to a Kinesis Data Stream. The pipeline must handle roughly 50,000 workflow executions per second, each completing in under 3 seconds, and the team wants the lowest possible cost while requiring at-least-once execution semantics. Which AWS Step Functions configuration best meets these requirements?

Accepted Answer

Use an Express workflow with the asynchronous (ASYNC) invocation type to achieve high throughput at low cost with at-least-once execution semantics.

Answer

Use a Standard workflow because it guarantees exactly-once execution and full visual execution history for every clickstream event.

Answer

Use a Standard workflow with a Map state to batch multiple events into a single execution and reduce per-execution charges.

Answer

Use an Express workflow with the synchronous (SYNC) invocation type to guarantee exactly-once processing for each event.