Question

A real-time analytics team ingests raw semi-structured device telemetry into a bronze table in an Eventhouse (KQL database). They need each newly ingested row to be automatically parsed, enriched with a derived severity column, and written to a curated silver table with zero additional orchestration and the lowest possible latency after ingestion. The transformation logic is a KQL query. What should they implement?

Accepted Answer

A KQL update policy on the silver table that runs the transformation query against the bronze source table during ingestion

Answer

A scheduled Dataflow Gen2 that reads the bronze table every 5 minutes and appends transformed rows to the silver table

Answer

A materialized view over the bronze table that deduplicates and projects the enriched columns

Answer

A Spark structured streaming job that reads the bronze KQL table and writes the transformed output to the silver table