Information Entropy
Information entropy is Shannon's measure of uncertainty in a probability distribution, commonly expressed in bits.
Definition
Information entropy is Shannon's measure of uncertainty in a probability distribution, commonly expressed in bits.
Technical Context
Entropy is not a measure of semantic meaning, truth, or importance. It is fundamental to compression, channel capacity, and coding theory.