Coding theory: Difference between revisions

Revision as of 13:40, 27 April 2025

Latest revision as of 08:44, 19 June 2025

Line 27:

{{excerpt|History of information theory}}

Shannon’s paper focuses on the problem of how best to best encode the [[information]] a sender wants to transmit. In this fundamental work he used tools in probability theory, developed by [[Norbert Wiener]], which were in their nascent stages of being applied to communication theory at that time. Shannon developed [[information entropy]] as a measure for the uncertainty in a message while essentially inventing the field of [[information theory]].

The [[binary Golay code]] was developed in 1949. It is an error-correcting code capable of correcting up to three errors in each 24-bit word, and detecting a fourth.