Back to vocabulary

Term definition

Token

AI models process text in tokens (roughly word-pieces) and bill and limit work by token count, not by character.

Example

A long word like "hamburger" can be two or three tokens.