Question

A product team is building a customer-support assistant on a large language model. During long conversations, the assistant starts to 'forget' details the customer mentioned near the beginning of the chat. An engineer explains this is due to a limit on how much text the model can consider at once. Which core gen AI concept is the engineer describing?

Accepted Answer

The context window — the maximum amount of input and output text (measured in tokens) the model can process in a single interaction

Answer

An embedding — a numeric vector representation of text used to measure semantic similarity

Answer

A hallucination — content the model generates that is fluent but factually incorrect

Answer

A prompt template — a reusable structure for formatting instructions sent to the model