Softmax
A normalization function that converts a vector of real-valued scores into a probability distribution whose components sum to one.
Related Concepts
- Logit
- Attention
- Cross-Entropy
- Temperature
A normalization function that converts a vector of real-valued scores into a probability distribution whose components sum to one.