Data processing inequality: Difference between revisions

Revision as of 18:37, 18 November 2015

Revision as of 18:55, 21 December 2015

Line 1:

The '''Data processing inequality''' is an [[information theory|information theoretic]] concept which states that the information content of a signal cannot be increased via a local physical operation. This can be expressed concisely as 'post-processing cannot increase information'.<ref name= BeaudryArxiv>{{cite journal|last1=Beaudry|first1=Normand|title=An intuitive proof of the data processing inequality|journal=arXiv|date=2012}}</ref> As explained by ''Kinney and Atwal'', the DPI means that information is generally lost (never gained) when transmitted through a noisy channel.<ref>{{cite journal|pmid=24550517 | doi=10.1073/pnas.1309933111 | volume=111 | title=Equitability, mutual information, and the maximal information coefficient. | date=Mar 2014 | journal=Proc Natl Acad Sci U S A | pages=3354–9}}</ref>

==Example==