Token

Simple

A piece of text — a word or part of one — that AI uses to read and count.

Business

The unit of text processing; the cost and speed of every AI request are measured in tokens.

Tech

A subword unit from a BPE/SentencePiece vocabulary; ~4 Latin chars, ~1–2 Cyrillic; APIs bill per input and output token.

Related terms

All glossary terms