Markov model: Difference between revisions

Revision as of 19:47, 20 April 2019

Revision as of 08:27, 8 May 2019

Line 19:

{{main|Markov chain}}

The simplest Markov model is the [[Markov chain]]. It models the state of a system with a [[random variable]] that changes through time.<ref name=":0" /> In this context, the Markov property suggests that the distribution for this variable depends only on the distribution of previous state. An example use of a Markov chain is [[Markov chain Monte Carlo|Markov Chain monte Carlo]], which uses the Markov property to prove that a particular method for performing a [[random walk]] will sample from the [[joint distribution]].

==Hidden Markov model==