What is model context window?
The context window is the maximum amount of tokenized input and working context a model can handle in one interaction.
- Includes prompt and retrieved context
- Longer is useful but not free
- Too much context can still hurt quality
What is model context window?