Back to search

What are tokens in LLM systems?

Tokens are the chunks of text a model processes, and they drive both context window limits and usage cost.

Artificial Intelligence Easy Theory

What are tokens in LLM systems?

Tokens are the chunks of text a model processes, and they drive both context window limits and usage cost.

  • Not exactly words
  • Context windows are token-based
  • Cost often scales with token count

What are tokens in LLM systems?