stochastic processes
Martingales
You should know: probability measure, conditional expectation
Overview
A martingale is a stochastic process whose future expected value, given all past information, equals its current value. Martingales model fair games: knowing the full history of a fair coin game gives no advantage for predicting future net winnings. Doob's theory of martingales provides powerful convergence theorems and inequalities that underpin modern probability, stochastic calculus, and mathematical finance.
Intuition
A martingale is a model of a fair game. If {X_n} tracks your wealth in a fair casino, then no matter how long you have played and what happened, your expected future wealth equals your current wealth. Geometrically, the martingale property says the process has no 'drift' — conditional expectations project forward without bias.
Formal Definition
Let (Ω, F, P) be a probability space with filtration {F_n}_{n≥0} (an increasing sequence of sub-σ-algebras). A sequence {X_n} is a martingale with respect to {F_n} if:
Adaptedness and integrability
Martingale property
Notation
| Notation | Meaning |
|---|---|
| Filtration: increasing sequence of σ-algebras representing information up to time n | |
| Martingale adapted to the filtration | |
| Running maximum of the martingale |
Properties
Submartingale
Condition: Models a game favourable to the player; convex functions of martingales are submartingales by Jensen
Supermartingale
Condition: Models a game unfavourable to the player
Optional stopping theorem
Condition: T bounded or {X_{n∧τ}} uniformly integrable
Doob's maximal inequality
Condition: X submartingale, λ > 0
Doob's L^p inequality
Condition: X non-negative submartingale, p > 1
Theorems
Applications
Worked Examples
Martingale property: E[S_{n+1}|F_n] = S_n + E[X_{n+1}|F_n] = S_n + E[X_{n+1}] = S_n + 0 = S_n.
τ is a bounded stopping time (actually finite a.s. by recurrence). By the optional stopping theorem:
S_τ takes values a (with probability p) and -b (with probability 1-p), so:
Answer: P(reaching a before -b) = b/(a+b), confirming the classical gambler's ruin formula.
Practice Problems
Prove that if {M_n} is a martingale and φ is convex, then {φ(M_n)} is a submartingale (assuming integrability).
A gambler plays a fair game starting with $k, stopping at $0 (ruin) or $N (success). Use martingale theory to find the probability of reaching $N before ruin.
State and prove Doob's upcrossing inequality, and deduce the martingale convergence theorem.
Common Mistakes
Any bounded stopping time can be used in optional stopping without further conditions
Optional stopping requires either τ bounded or {X_{n∧τ}} uniformly integrable. Counterexample: doubling strategy in a fair game with τ = first win reaches E[S_τ] = 1 ≠ 0 = E[S_0] when τ is only a.s. finite but not bounded.
A martingale converges in L¹ whenever it converges a.s.
A.s. convergence does not imply L¹ convergence without uniform integrability. The process can converge a.s. to 0 while E[|X_n|] → ∞.
Historical Background
The term 'martingale' originally referred to a betting strategy of doubling stakes after each loss. Lévy (1935) introduced martingales in the context of conditional expectations, and Doob (1940–1953) developed the systematic theory including optional stopping, convergence theorems, and maximal inequalities. Martingales became central to mathematical finance through the work of Harrison, Kreps, and Pliska (1979–1981).
- 1935
Lévy introduces conditional expectations as a proto-martingale notion
Paul Lévy
- 1940
Doob develops martingale theory and the optional stopping theorem
Joseph Doob
- 1953
Doob's monograph Stochastic Processes systematises the theory
Joseph Doob
- 1979
Harrison–Kreps: equivalent martingale measures and no-arbitrage in finance
Michael Harrison, David Kreps
Summary
- A martingale satisfies E[X_{n+1}|F_n] = X_n a.s., modelling a fair game.
- Doob's maximal and L^p inequalities control the running maximum of a martingale.
- Convergence theorem: L¹-bounded martingales converge a.s.
- Optional stopping: E[X_τ] = E[X_0] under uniform integrability of {X_{n∧τ}}.
- Martingales are the foundation of risk-neutral pricing in mathematical finance.
References
- BookWilliams, D. (1991). Probability with Martingales. Cambridge University Press.
- BookDurrett, R. (2019). Probability: Theory and Examples (5th ed.). Cambridge University Press.
Mathematics