Question

You build a Foundry agent that generates detailed compliance summaries. Users report that longer summaries are being cut off mid-sentence, and the response metadata shows a finish_reason of 'length'. The prompt and system instructions are well within the model's context window. Which change most directly resolves the truncated output?

Accepted Answer

Increase the max_tokens (max output tokens) parameter for the completion request

Answer

Lower the temperature parameter to make the output more deterministic

Answer

Reduce the top_p value to constrain token sampling diversity

Answer

Add a stop sequence to force the model to end responses cleanly