A Mathematical Theory of Communication
- The paper addresses the problem of quantifying communication in a rigorous mathematical way, especially how to measure information and the limits of reliable transmission over a noisy channel. - It introduces a mathematical framework for communication, including the concepts of entropy as a measure of uncertainty and channel capacity as the maximum reliable rate of transmission. - The key result is a foundational theory showing that communication systems can be analyzed and optimized using these measures, establishing precise limits on coding and transmission. - This matters because it created the field of information theory and underpins modern digital communication, data compression, and error-correcting codes.
The foundational paper of information theory, defining entropy and channel capacity.