Question

A retail company wants to generate personalized product description summaries for all 500,000 items in their catalog. The summaries will be displayed on product pages but only need to be refreshed once per week when the catalog is updated. The engineering team is deciding how to design the generative AI serving approach. Which design best fits these business requirements?

Accepted Answer

Run a scheduled batch inference job weekly that generates all summaries and stores them in a table the product pages read from

Answer

Deploy a real-time model serving endpoint and call it synchronously each time a product page is loaded by a customer

Answer

Deploy a streaming pipeline that continuously regenerates every product summary as new customer traffic arrives

Answer

Fine-tune a dedicated model per product category and serve each through its own low-latency endpoint