Question

A product team uses a foundation model to convert customer feedback into structured JSON with fields for sentiment, category, and priority. Using a simple instruction prompt, the model returns correct content but with inconsistent key names, varying capitalization, and occasionally missing fields. The team cannot change the model and wants a fast prompt-only fix that enforces a consistent output structure. What should they do?

Accepted Answer

Add a few example input-output pairs showing the exact desired JSON structure directly in the prompt

Answer

Fine-tune the model on thousands of labeled JSON examples to lock in the format

Answer

Increase the model's temperature so it explores more formatting variations

Answer

Set up a Retrieval Augmented Generation pipeline to pull formatting rules from a document store