Stochastic convergence

Stochastic convergence is a mathematical concept intended to formalize the idea that a sequence of essentially random or unpredictable events sometimes tends to settle into a pattern.

Four different varieties of stochastic convergence are noted:

• Almost sure convergence
• Convergence in probability
• Convergence in distribution
• Convergence in nth order mean

Almost sure convergence

Example 1

Consider a short-lived animal of some species. We may note the exact amount of food the animal consumes day by day. This sequence of numbers will be unpredictable in advance, but we may be quite certain that one day the number will be zero, and stay zero forever after.

Example 2

Consider an immortal man who starts tomorrow to toss seven coins once every morning. Each afternoon, he donates a random amount of money to a certain charity. The first time the result is all tails, however, he will stop permanently.

Let $X_{1},X_{2},...$ be the day by day amounts the charity receives from this guy.

We may be almost sure that one day this amount will be zero, and stay zero forever after that.

However, given any finite number of days, there is a nonzero probability the terminating condition has still not occurred.

Formal definition

Let $\scriptstyle X_{0},X_{1},...$ be an infinite sequence of stochastic variables defined over a subset of R.

Then the actual outcomes will be an ordinary sequence of real numbers.

If the probability that this sequence will converge to a given real number a equals 1, then we say the original sequence of stochastic variables has almost sure convergence to a.

In more compact notation:

If $P(\lim _{i\to \infty }X_{i}=a)=1$ for some a, then the sequence has almost sure convergence to a.

Convergence in probability

Example

We may keep tossing a die an infinite number of times and at every toss note the average outcome so far. The exact number thus obtained after each toss will be unpredictable, but for a fair die, it will tend to get closer and closer to the arithmetic average of 1,2,3,4,5 and 6, i.e. 3.5.

Formal definition

Let $\scriptstyle X_{0},X_{1},...$ be an infinite sequence of stochastic variables defined over a subset of R.

If there exists a real number a such that $\lim _{i\to \infty }P(|X_{i}-a|>\varepsilon )=0$ for all $\varepsilon >0$, then the sequence has almost sure convergence to a.

Relations between the different modes of convergence

• If a stochastic sequence has almost sure convergence, then it also has convergence in probability.
• If a stochastic sequence has convergence in probability, then it also has convergence in distribution.
• If a stochastic sequence has convergence in (n+1)th order mean, then it also has convergence in nth order mean (n>0).
• If a stochastic sequence has convergence in nth order mean, then it also has convergence in probability.

See also

• Stochastic differential equations

Related topics

• Probability
• Probability theory
• Stochastic variable
• Differential equations
• Stochastic modeling