What are tokens in LLM systems?
Tokens are the chunks of text a model processes, and they drive both context window limits and usage cost.
- Not exactly words
- Context windows are token-based
- Cost often scales with token count
What are tokens in LLM systems?