Context Window
The maximum span of tokens or model state that a language model can directly consider while generating or scoring a sequence.
Related Concepts
- KV Cache
- Tokenization
- Retrieval-Augmented Generation
- Attention
The maximum span of tokens or model state that a language model can directly consider while generating or scoring a sequence.