Operators §
Operators are the maps between the spaces of the Spaces page — the “derivatives” and “integrals” of functional analysis. They are where the real work happens: solving equations, finding eigenvalues, and decomposing functions all reduce to understanding a linear map and its spectrum. This page covers bounded operators and the operator norm, unbounded (densely defined) operators, adjoints, compact operators, and the spectral theorem.
Authoritative sources
Bounded operators and the operator norm §
Definition. A linear map between normed spaces is bounded if some constant satisfies for every ; equivalently, is continuous. Its operator norm is .
Details
Bounded is the same as continuous §
For a linear map, the two notions coincide. If is continuous at , then for small , and scaling gives it for all . Conversely, the estimate shows continuity everywhere. So “bounded” is just “continuous” wearing a linear hat.
Example. On , the diagonal map has (attained on the first basis vector). The shift is an isometry, so .
The space of operators is itself a Banach space §
The set of all bounded operators , with the operator norm, is a Banach space whenever is. This is important: it means you can take limits of operators, apply fixed-point theorems to them, and treat “operators” as first-class points of a space.
Example problem
Problem. Compute the operator norm of , .
Solution
, so . The norm is , attained at any unit vector (e.g. ). ∎
Unbounded operators §
Definition. An unbounded operator on a Hilbert space is a linear map defined only on a dense subspace (its domain), not on all of .
Details
Why operators must sometimes be unbounded §
Many natural operations are not bounded. Differentiation is the prime example: on , the map is unbounded, because a sequence of functions can have arbitrarily small size while their derivatives do not. Yet differentiation is central to physics and PDEs, so functional analysis needs a home for it: the densely defined, unbounded operator.
Example. The momentum operator in quantum mechanics is on a suitable domain in . It is unbounded but densely defined, and (on the right domain) self-adjoint — which is exactly what makes its spectrum (the possible measured momenta) real.
The domain is part of the operator §
Two operators with the same formula but different domains are different operators. This is why “densely defined” matters: it is the condition that lets the adjoint (below) exist.
Example problem
Problem. Show that differentiation on is unbounded.
Solution
Take . Then , so for all . But , so . No constant can bound , so is unbounded. ∎
The adjoint §
Definition. The adjoint of a bounded operator is the unique bounded operator with for all . On a Hilbert space , is defined by . An operator is self-adjoint if .
Details
The adjoint turns the inner product around §
The adjoint is the operator that lets you “move across the inner product.” In finite dimensions this is just the conjugate transpose of a matrix. The identity is the whole definition; everything else follows from it.
Example. If is the matrix , then . If is multiplication by a function on , then is multiplication by .
Self-adjoint means real spectrum §
A self-adjoint operator has only real eigenvalues: if with , then , so . This is why observables in quantum mechanics are modeled by self-adjoint operators — their measured values are real.
Example problem
Problem. Let be a self-adjoint operator on a Hilbert space and a unit eigenvector with eigenvalue . Show is real.
Solution
. Since , . Hence , so . ∎
Compact operators §
Definition. A bounded operator on a normed space is compact if the image of the unit ball has compact closure; equivalently, every bounded sequence has a subsequence such that converges.
Details
Compact means “almost finite rank” §
In finite dimensions every operator is compact. In infinite dimensions, compact operators are the ones that behave like finite-rank operators: they squeeze an infinite-dimensional ball into something “small” (with compact closure). The key structural fact is that every compact operator on a Banach space is the norm-limit of finite-rank operators, so compact operators are the infinite-dimensional shadow of matrices.
Examples.
- Every finite-rank operator is compact.
- An integral operator with a square-integrable kernel (a Hilbert–Schmidt operator) is compact on .
Why compactness matters §
The spectrum of a compact operator is “discrete”: except possibly for , it consists of eigenvalues of finite multiplicity that accumulate only at . This is what makes the eigenvalue expansions of Fourier theory and the spectral theorem for compact operators so clean, and it is the reason integral equations can be solved by expanding in eigenfunctions.
Example problem
Problem. Show that every finite-rank operator is compact.
Solution
Let with and . The range of lies in the finite-dimensional span of . The image of the unit ball is a bounded subset of this finite-dimensional space, and in finite dimensions bounded sets have compact closure (Heine–Borel). Hence is compact. ∎
The spectral theorem §
Definition. The spectral theorem says that a normal operator on a Hilbert space (in particular a self-adjoint one) can be “diagonalized”: there is a measure space and a function such that is unitarily equivalent to multiplication by , and the spectrum of is the essential range of .
Details
From diagonalizing a matrix §
In finite dimensions, a normal matrix is unitarily diagonalizable: with diagonal. The spectral theorem is the infinite-dimensional version of exactly this statement. The “diagonal entries” become a function , the “basis of eigenvectors” becomes a measure space, and “diagonalizing” becomes “multiplication by .”
The projection-valued measure §
The precise form: to a self-adjoint there is a unique projection-valued measure on the Borel sets of such that
The spectrum of is the support of . This formula is the infinite-dimensional replacement for (eigenvalues times projections).
Consequences §
- Real spectrum: a self-adjoint operator has real spectrum (the integral is over ).
- Functional calculus: for any Borel function , you can define . This lets you write (the time-evolution operator in quantum mechanics) and .
- Eigenfunction expansions: when the spectrum is discrete (compact case), the formula reduces to an expansion in eigenfunctions, as in Fourier series.
Example problem
Problem. Let be a self-adjoint operator with . Show that for every unit vector .
Solution
By the spectral theorem, where is a probability measure (the spectral measure of ). Since , the spectrum lies in , so is supported there. An average of values in lies in , hence . ∎
Quiz §
Example problem
Problem. Let be a compact self-adjoint operator on a Hilbert space with not in its spectrum. Show that is invertible and that is bounded.
Solution
Since is compact and self-adjoint, the spectral theorem gives with real eigenvalues and orthogonal projections . If , then (the eigenvalues cannot accumulate at without being in the spectrum). Define . Then , so is bounded, and . ∎