Exchangeable random variables

An exchangeable sequence of random variables is a sequence X₁, X₂, X₃, ... of random variables such that for any finite permutation σ of the indices 1, 2, 3, ..., i.e. any permutation σ that leaves all but finitely many indices fixed, the joint probability distribution of the permuted sequence

${\displaystyle X_{\sigma (1)},X_{\sigma (2)},X_{\sigma (3)},\dots }$

is the same as the joint probability distribution of the original sequence.

A sequence E₁, E₂, E₃, ... of events is said to be exchangeble precisely if the sequence of its indicator functions is exchangeable.

Independent and identically distributed random variables are exchangeable.

The distribution function F_X1,...,Xn(x₁, ... ,x_n) of a finite sequence of exchangeable random variables is symmetric in its arguments x₁, ... ,x_n.

Examples

• Any weighted average of iid sequences of random variables is exchangeble. See in particular de Finetti's theorem.

• Suppose an urn contains n red and m blue marbles. Suppose marbles are drawn without replacement until the urn is empty. Let X_i be the indicator random variable of the event that the ith marble drawn is red. Then {X_i}_i=1,...n is an exchangeable sequence. This sequence cannot be extended to any longer exchangeable sequence.

Properties

• Covariance: for exchangeable sequence ${\displaystyle \{X_{i}\}_{i=1,\ldots ,n}}$ , ${\displaystyle Cov(X_{i},X_{j})=const\geq -1/(n-1)}$ . For an infinite exchangeable sequence, ${\displaystyle Cov(X_{i},X_{j})=const\geq 0}$ .

See also

• Hewitt-Savage zero-one law
• de Finetti's theorem

References

• Spizzichino, Fabio Subjective probability models for lifetimes. Monographs on Statistics and Applied Probability, 91. Chapman & Hall/CRC, Boca Raton, FL, 2001. xx+248 pp. ISBN 1-58488-060-0