Tag view

#tokens

Cross-subject tag search for related interview cards.

Clear

Results update as you type. Press / to jump straight into search.

Tagged with tokens

1 card

Artificial Intelligence Easy Theory

What are tokens in LLM systems?

Tokens are the chunks of text a model processes, and they drive both context window limits and usage cost.

  • Not exactly words
  • Context windows are token-based
  • Cost often scales with token count

What are tokens in LLM systems?