Top-k Sampling
A decoding strategy that restricts token sampling to the k highest-probability candidates at each generation step.
Related Concepts
- Top-p Sampling
- Temperature
- Beam Search
- Logit
A decoding strategy that restricts token sampling to the k highest-probability candidates at each generation step.