Temperature
A sampling parameter that rescales token logits before probability normalization, controlling the sharpness and randomness of generated output.
Related Concepts
- Logit
- Top-k Sampling
- Top-p Sampling
- Tokenization
A sampling parameter that rescales token logits before probability normalization, controlling the sharpness and randomness of generated output.