Question

A product manager is reviewing documentation for a large language model and wants to explain to non-technical stakeholders what a 'token' is when the model processes text. Which explanation is most accurate?

Accepted Answer

A token is a chunk of text (such as a word or part of a word) that the model reads and generates as its basic unit of processing.

Answer

A token is the numeric password used to authenticate API requests to the model service.

Answer

A token is the complete conversation history that the model keeps in memory during a session.

Answer

A token is a single character of text, so every letter and space counts as exactly one token.