Shannon Entropy
A measure of average information uncertainty in a probability distribution, commonly expressed in bits when logarithms use base two.
Related Concepts
- Binary Entropy
- Compression
- Information Theory
- Randomness
A measure of average information uncertainty in a probability distribution, commonly expressed in bits when logarithms use base two.