Content deleted Content added
TakuyaMurata (talk | contribs) |
|||
Line 51:
where <math> x </math> is the number of element at the state <math> n </math>, <math>\xi_i</math> are [[Independent and identically distributed random variables|i.i.d.]] [[random variable]]s (usually with mean 0) and where <math>\mathbf{1}_B</math> is the indicator function. For the simple case of [[Bernoulli distribution|coin flips]] this models the different levels of a [[Galton board]].
== Composition of Markov Kernels
Given measurable spaces <math>(X, \mathcal A)</math>, <math>(Y, \mathcal B) </math> we consider a Markov kernel <math>\kappa: \mathcal B \times X \to [0,1]</math> as a morphism <math>\kappa: X \to Y</math>. Intuitively, rather than assigning to each <math>x \in X</math> a sharply defined point <math> y \in Y</math> the kernel assigns a "fuzzy" point in <math>Y</math> which is only known with some level of uncertainty, much like actual physical measurements. If we have a third measurable space <math>(Z, \mathcal C)</math>, and probability kernels <math>\kappa: X \to Y</math> and <math>\lambda: Y \to Z</math>, we can define a composition <math>\lambda \circ \kappa : X \to Z</math> by the [[Chapman-Kolmogorov equation]]
:<math>(\lambda \circ \kappa) (dz|x) = \int_Y \lambda(dz | y)\kappa(dy|x)</math>.
The composition is associative by the Monotone Convergence Theorem and the identity function considered as a Markov kernel (i.e. the delta measure <math> \kappa_{1}(dx'|x) = \delta_x(dx')</math>) is the unit for this composition.
This composition defines the structure of a [[category (mathematics)|category]] on the measurable spaces with Markov kernels as morphisms, first defined by Lawvere
== Probability Space defined by Probability Distribution and a Markov Kernel==
| |||