Mathematics.

vector spaces

Vector Space

Linear Algebra40 minDifficulty5 out of 10

Overview

A vector space is a set of objects (vectors) that can be added together and scaled by numbers, obeying a short list of intuitive rules — and nothing else is required. This abstraction is what makes linear algebra so widely applicable: arrows in the plane, polynomials, matrices, and even functions all form vector spaces, so any theorem proven about vector spaces in general applies to all of them at once.

Intuition

Think of arrows in the plane: you can add two arrows tip-to-tail to get a new arrow, and you can stretch or shrink an arrow by a number. A vector space is just any collection of objects — not necessarily arrows — where 'adding two of them' and 'scaling one by a number' make sense and behave the way you'd expect (order doesn't matter when adding, scaling by 1 does nothing, etc.). Polynomials fit this pattern (you can add two polynomials, or scale one by 3), and so do matrices, and so do many other things that don't look like arrows at all.

Formal Definition

Definition

A vector space V over a field F (usually ℝ) is a set with two operations, vector addition and scalar multiplication, satisfying eight axioms:

∀u,v,w∈V: (u+v)+w=u+(v+w)\forall u,v,w \in V:\ (u+v)+w = u+(v+w)

Associativity of addition

∃ 0∈V: v+0=v ∀v\exists\, 0 \in V:\ v + 0 = v\ \forall v

Additive identity exists

∀v∈V, ∃(−v): v+(−v)=0\forall v \in V,\ \exists (-v):\ v+(-v)=0

Additive inverses exist

∀a,b∈F,v∈V: a(bv)=(ab)v\forall a,b \in F, v \in V:\ a(bv) = (ab)v

Compatibility of scalar multiplication

1⋅v=v1 \cdot v = v

Identity element of scalar multiplication

Notation

NotationMeaning
VVThe vector space itself
F\mathbb{F}The scalar field (typically ℝ or ℂ)
0\mathbf{0}The zero vector, the additive identity

Properties

Closure under addition

u,v∈V⇒u+v∈Vu, v \in V \Rightarrow u+v \in V

Closure under scalar multiplication

a∈F, v∈V⇒av∈Va \in F,\ v \in V \Rightarrow av \in V

Commutativity of addition

u+v=v+uu+v = v+u

Theorems

Theorem 1: Uniqueness of the zero vector
Theadditiveidentity0inavectorspaceisunique.The additive identity 0 in a vector space is unique.

Applications

Feature vectors in machine learning — every data point represented as a list of numbers — form a vector space, which is why linear algebra underlies most of ML.

Worked Examples

  1. Check closure: sum of two 2x2 matrices is a 2x2 matrix; scalar times a 2x2 matrix is a 2x2 matrix.

    A+B∈M2×2,cA∈M2×2A+B \in M_{2\times 2},\quad cA \in M_{2\times 2}

  2. The zero matrix serves as the additive identity, and -A as the additive inverse of A.

    A+(−A)=0A + (-A) = 0

Answer: Yes — all eight vector space axioms hold.

Practice Problems

Difficulty 4/10

Which of the following is NOT a vector space (under standard addition/scalar multiplication)?

Difficulty 5/10

In signal processing, the set of all discrete signals of length n forms a vector space. What is its dimension, and what does a 'basis' correspond to?

Difficulty 4/10

Screen colors are represented as (R, G, B) triples. In what sense is this a vector space, and what does adding two color vectors do?

Common Mistakes

Common Mistake

Assuming vectors must be arrows with magnitude and direction.

Vectors are ANY objects satisfying the vector space axioms — polynomials, matrices, and functions are all vectors in their respective spaces, even though they don't look like arrows.

Quiz

Which property is required for a set with addition and scalar multiplication to be a vector space?

Flashcards

1 / 2

Historical Background

Hermann Grassmann introduced an early abstract theory of extended magnitudes in 1844, prefiguring vector spaces, though it was largely ignored at the time due to its dense notation. Giuseppe Peano gave the first modern axiomatic definition of a vector space in 1888, in Calcolo Geometrico. The theory was fully absorbed into mainstream mathematics in the early 20th century as part of the broader axiomatization movement.

  1. 1844

    Grassmann publishes Die lineale Ausdehnungslehre, an early abstract theory

    Hermann Grassmann

  2. 1888

    Peano gives the modern axiomatic definition of a vector space

    Giuseppe Peano

Summary

  • A vector space is a set closed under vector addition and scalar multiplication, satisfying 8 axioms.
  • Vectors don't need to be geometric arrows — polynomials, matrices, and functions all form vector spaces.
  • The zero vector (additive identity) is unique in every vector space.
  • This abstraction lets a single theorem apply to arrows, matrices, and function spaces simultaneously.

References

  1. WebsiteWikipedia — Vector space