Introduction to Functional Analysis — Mathematics Knowledge System

Overview

Functional analysis is the branch of mathematics concerned with the study of vector spaces equipped with a topology—typically induced by a norm or inner product—and the linear operators acting between them. It unifies and vastly generalises the classical theories of ordinary and partial differential equations, Fourier analysis, and linear algebra. The central objects are infinite-dimensional normed spaces (Banach and Hilbert spaces), bounded linear operators between them, and the dual spaces of continuous linear functionals. Three cornerstone theorems—the Hahn–Banach theorem, the open mapping theorem, and the uniform boundedness principle—give the field its distinctive flavour and power.

Intuition

Think of finite-dimensional linear algebra, then let the dimension grow to infinity. Most familiar facts survive: linearity, operator composition, eigenvalues. But new phenomena appear: an operator can be injective without being surjective, a set can be closed and bounded without being compact, and a sequence can converge weakly without converging in norm. Functional analysis supplies the precise language to handle these subtleties. The norm topology controls 'strong' convergence; the weak topology controls convergence tested against all bounded linear functionals—like asking whether the shadow of a vector converges rather than the vector itself.

Formal Definition

Definition

A normed vector space is a vector space (X) over (mathbb{R}) (or (mathbb{C})) together with a norm (|cdot|: X o [0,infty)) satisfying positive definiteness, absolute homogeneity, and the triangle inequality. A Banach space is a complete normed space. A bounded linear operator (T: X o Y) between normed spaces satisfies (|Tx| le C|x|) for all (x in X); the operator norm is (|T| = sup_{|x|=1}|Tx|). The dual space (X^*) consists of all bounded linear functionals (f: X o mathbb{R}), itself a Banach space.

\|T\| = \sup_{x \neq 0} \frac{\|Tx\|_Y}{\|x\|_X}

Operator norm

X^* = \mathcal{B}(X, \mathbb{R}) = \{ f: X \to \mathbb{R} \mid f \text{ linear and bounded} \}

Dual space

\|f\|_{X^*} = \sup_{\|x\| \le 1} |f(x)|

Dual norm

Properties

Completeness is preserved under closed subspaces

A closed subspace of a Banach space is itself a Banach space.

Dual of a normed space is always Banach

X^* \text{ is a Banach space for any normed space } X.

Theorems

Theorem 1.1: Uniform Boundedness Principle (Banach–Steinhaus)

Let X be a Banach space and Y a normed space. If \{T_\alpha\} \subset \mathcal{B}(X,Y) satisfies \sup_\alpha \|T_\alpha x\| < \infty for every x \in X, then \sup_\alpha \|T_\alpha\| < \infty.

Theorem 1.2: Riesz Representation (Hilbert space)

For every bounded linear functional f on a Hilbert space H, there exists a unique y \in H such that f(x) = \langle x, y \rangle for all x \in H, and \|f\| = \|y\|.

Worked Examples

Check linearity: $\delta_n(\alpha x + \beta y) = \alpha x_n + \beta y_n = \alpha \delta_n(x) + \beta \delta_n(y)$. ✓
Bound: $|\delta_n(x)| = |x_n| \le \sup_k |x_k| = \|x\|_{\ell^\infty}$, so $\|\delta_n\| \le 1$.
$|\delta_n(x)| \le \|x\|_{\ell^\infty}$
Attainment: take $e_n$ (sequence with 1 in position $n$, 0 elsewhere). Then $\|e_n\|_{\ell^\infty} = 1$ and $|\delta_n(e_n)| = 1$, giving $\|\delta_n\| \ge 1$.
Hence $\|\delta_n\| = 1$.

Answer: Each evaluation functional $\delta_n$ is bounded with operator norm 1.

Practice Problems

Difficulty 7/10

Prove that if $X$ is a Banach space and $M \subset X$ is a finite-dimensional subspace, then $M$ is closed.

Difficulty 8/10

Show that the shift operator $S: \ell^2 \to \ell^2$, $S(x_1, x_2, \ldots) = (0, x_1, x_2, \ldots)$, is bounded with $\|S\| = 1$ but is not surjective.

Difficulty 9/10

Prove that in an infinite-dimensional Banach space $X$, the closed unit ball $B = \{x : \|x\| \le 1\}$ is not compact.

Common Mistakes

Common Mistake

Confusing weak convergence with norm convergence

Weak convergence ($f(x_n) \to f(x)$ for all $f \in X^*$) does not imply norm convergence $\|x_n - x\| \to 0$, even in Hilbert spaces.

Common Mistake

Assuming bounded implies compact in infinite dimensions

Boundedness plus closedness gives compactness only in finite-dimensional spaces. In infinite dimensions one needs additional compactness criteria (e.g., the Arzelà–Ascoli theorem, or relative compactness in $L^p$).

Quiz

Summary

Functional analysis studies infinite-dimensional normed (Banach/Hilbert) spaces and bounded linear operators between them.
The dual space $X^*$ of bounded linear functionals is always a Banach space, regardless of whether $X$ is complete.
Three cornerstone theorems are: Hahn–Banach (extension), open mapping (surjective operators are open), and uniform boundedness (Banach–Steinhaus).
Compactness fails for closed bounded sets in infinite dimensions—Riesz's lemma constructs sequences with no convergent subsequence.
Weak convergence (against all functionals) is strictly weaker than norm convergence and is the correct notion for many applications in PDEs and optimization.

References

BookRudin, W. Functional Analysis. 2nd ed., McGraw-Hill, 1991.
BookBrezis, H. Functional Analysis, Sobolev Spaces and Partial Differential Equations. Springer, 2011.
WebsiteWikipedia — Functional analysis