Logit
An unnormalized model score that is converted into a probability distribution, commonly through softmax, before token selection.
Related Concepts
- Softmax
- Temperature
- Top-k Sampling
- Top-p Sampling
An unnormalized model score that is converted into a probability distribution, commonly through softmax, before token selection.