Mathematics.

matrix decompositions

Symmetric Matrices

Linear Algebra30 minDifficulty5 out of 10

You should know: matrices, eigenvalues and eigenvectors

Overview

A symmetric matrix is a square matrix equal to its own transpose (A = Aᵀ), meaning the entry in row i, column j always matches the entry in row j, column i. Symmetric matrices are exceptionally well-behaved: the spectral theorem guarantees that every real symmetric matrix has only real eigenvalues and possesses a full set of orthogonal (or orthonormal, after scaling) eigenvectors, so it is always diagonalizable — no defective cases exist. This makes symmetric matrices the workhorse of applications from covariance matrices in statistics to stiffness matrices in engineering, all of which are symmetric by construction.

Intuition

Symmetric matrices behave like a 'balanced' stretching machine: they never introduce rotation without a matching mirror-image effect, so their fundamental stretching directions (eigenvectors) can always be chosen mutually perpendicular. This is why a symmetric matrix's spectral decomposition A = QΛQᵀ looks so clean — Q is an orthogonal 'change of perspective' to the natural axes, Λ does pure independent stretching along those axes, and Qᵀ changes back. Contrast this with a general (non-symmetric) matrix, whose eigenvectors can be skewed relative to each other or even fail to exist in full.

Formal Definition

Definition

A real n×n matrix A is symmetric if it equals its transpose. The spectral theorem states:

A=A    aij=aji for all i,jA = A^\top \iff a_{ij} = a_{ji} \ \text{for all } i,j
Symmetry condition
A=A    all eigenvalues of A are realA = A^\top \implies \text{all eigenvalues of } A \text{ are real}
Real eigenvalues
A=QΛQ,QQ=I, Λ=diag(λ1,,λn)A = Q\Lambda Q^\top, \quad Q^\top Q = I, \ \Lambda = \operatorname{diag}(\lambda_1,\ldots,\lambda_n)
Spectral decomposition (Q orthogonal)

Worked Examples

  1. Check A = Aᵀ: the (1,2) and (2,1) entries both equal 1, so A is symmetric.

    A=(2112)=AA^\top = \begin{pmatrix}2&1\\1&2\end{pmatrix} = A
  2. Eigenvalues from det(A-λI) = (2-λ)²-1 = 0 give λ=1 and λ=3 (both real, as guaranteed).

    λ1=1, λ2=3\lambda_1 = 1, \ \lambda_2 = 3
  3. Eigenvector for λ=1: (A-I)v=0 → [[1,1],[1,1]]v=0 → v=(1,-1). For λ=3: (A-3I)v=0 → [[-1,1],[1,-1]]v=0 → v=(1,1). These are orthogonal: (1,-1)·(1,1)=0.

    v1=(1,1), v2=(1,1),v1v2=0v_1=(1,-1),\ v_2=(1,1),\quad v_1 \cdot v_2 = 0

Answer: Eigenvalues 1 and 3 with orthogonal eigenvectors (1,-1) and (1,1) — confirming the spectral theorem's guarantee.

Practice Problems

Difficulty 4/10

Is A = [[0,5],[5,0]] symmetric? Find its eigenvalues.

Difficulty 6/10

Find the eigenvectors of A = [[0,5],[5,0]] for λ=5 and λ=-5, and verify they are orthogonal.

Difficulty 6/10

In statistics, a covariance matrix Σ is always symmetric. Why does this guarantee that Principal Component Analysis (PCA) can always find orthogonal directions of maximum variance?

Quiz

A matrix A is symmetric when:
The spectral theorem guarantees that every real symmetric matrix:
In the spectral decomposition A = QΛQᵀ, the matrix Q is:

Summary

  • A symmetric matrix satisfies A = Aᵀ, meaning entries mirror across the main diagonal.
  • The spectral theorem guarantees real eigenvalues and orthogonal eigenvectors for every real symmetric matrix.
  • Every symmetric matrix diagonalizes as A = QΛQᵀ with Q orthogonal — the basis for PCA and stress/vibration analysis.

References