Technopedia

The technologist’s encyclopedia

Operators

Operators are the maps between the spaces of the Spaces page — the “derivatives” and “integrals” of functional analysis. They are where the real work happens: solving equations, finding eigenvalues, and decomposing functions all reduce to understanding a linear map and its spectrum. This page covers bounded operators and the operator norm, unbounded (densely defined) operators, adjoints, compact operators, and the spectral theorem.

Authoritative sources

Bounded operators and the operator norm

Definition. A linear map T:X→YT : X \to Y between normed spaces is bounded if some constant MM satisfies ∥Tx∥≤M∥x∥\|Tx\| \leq M\|x\| for every xx; equivalently, TT is continuous. Its operator norm is ∥T∥=sup⁡∥x∥≤1∥Tx∥\|T\| = \sup_{\|x\| \leq 1} \|Tx\|.

Details

Bounded is the same as continuous

For a linear map, the two notions coincide. If TT is continuous at 00, then ∥Tx∥≤M∥x∥\|Tx\| \leq M\|x\| for small xx, and scaling gives it for all xx. Conversely, the estimate ∥Tx−Tx0∥=∥T(x−x0)∥≤M∥x−x0∥\|Tx - Tx_0\| = \|T(x - x_0)\| \leq M\|x - x_0\| shows continuity everywhere. So “bounded” is just “continuous” wearing a linear hat.

Example. On ℓ2\ell^2, the diagonal map T(x1,x2,… )=(x1,x2/2,x3/3,… )T(x_1, x_2, \dots) = (x_1, x_2/2, x_3/3, \dots) has ∥T∥=1\|T\| = 1 (attained on the first basis vector). The shift S(x1,x2,… )=(0,x1,x2,… )S(x_1, x_2, \dots) = (0, x_1, x_2, \dots) is an isometry, so ∥S∥=1\|S\| = 1.

The space of operators is itself a Banach space

The set B(X,Y)\mathcal{B}(X, Y) of all bounded operators X→YX \to Y, with the operator norm, is a Banach space whenever YY is. This is important: it means you can take limits of operators, apply fixed-point theorems to them, and treat “operators” as first-class points of a space.

unit ball of X T(unit ball): bounded
Example problem

Problem. Compute the operator norm of T:R2→R2T : \mathbb{R}^2 \to \mathbb{R}^2, T(a,b)=(a+b,a−b)T(a, b) = (a + b, a - b).

Solution

∥T(a,b)∥2=(a+b)2+(a−b)2=2a2+2b2=2∥(a,b)∥2\|T(a,b)\|^2 = (a+b)^2 + (a-b)^2 = 2a^2 + 2b^2 = 2\|(a,b)\|^2, so ∥T(a,b)∥=2 ∥(a,b)∥\|T(a,b)\| = \sqrt{2}\,\|(a,b)\|. The norm is ∥T∥=2\|T\| = \sqrt{2}, attained at any unit vector (e.g. (1,0)(1, 0)). ∎

Unbounded operators

Definition. An unbounded operator AA on a Hilbert space HH is a linear map defined only on a dense subspace D(A)⊂H\mathcal{D}(A) \subset H (its domain), not on all of HH.

Details

Why operators must sometimes be unbounded

Many natural operations are not bounded. Differentiation is the prime example: on L2([0,1])L^2([0,1]), the map Af=f′A f = f' is unbounded, because a sequence of functions can have arbitrarily small L2L^2 size while their derivatives do not. Yet differentiation is central to physics and PDEs, so functional analysis needs a home for it: the densely defined, unbounded operator.

Example. The momentum operator in quantum mechanics is A=−iℏ d/dxA = -i\hbar\, d/dx on a suitable domain in L2(R)L^2(\mathbb{R}). It is unbounded but densely defined, and (on the right domain) self-adjoint — which is exactly what makes its spectrum (the possible measured momenta) real.

The domain is part of the operator

Two operators with the same formula but different domains are different operators. This is why “densely defined” matters: it is the condition that lets the adjoint (below) exist.

Example problem

Problem. Show that differentiation Af=f′A f = f' on D(A)=C1([0,1])⊂L2([0,1])\mathcal{D}(A) = C^1([0,1]) \subset L^2([0,1]) is unbounded.

Solution

Take fn(x)=sin⁡(nπx)f_n(x) = \sin(n \pi x). Then ∥fn∥22=∫01sin⁡2(nπx) dx=1/2\|f_n\|_2^2 = \int_0^1 \sin^2(n\pi x)\,dx = 1/2, so ∥fn∥2=1/2\|f_n\|_2 = 1/\sqrt{2} for all nn. But fn′(x)=nπcos⁡(nπx)f_n'(x) = n\pi \cos(n\pi x), so ∥Afn∥2=nπ/2→∞\|A f_n\|_2 = n\pi/\sqrt{2} \to \infty. No constant MM can bound ∥Afn∥≤M∥fn∥\|A f_n\| \leq M\|f_n\|, so AA is unbounded. ∎

The adjoint

Definition. The adjoint T∗T^* of a bounded operator T:X→YT : X \to Y is the unique bounded operator T∗:Y∗→X∗T^* : Y^* \to X^* with ⟨Tx,y∗⟩=⟨x,T∗y∗⟩\langle Tx, y^* \rangle = \langle x, T^* y^* \rangle for all x,y∗x, y^*. On a Hilbert space HH, T∗:H→HT^* : H \to H is defined by ⟨Tx,y⟩=⟨x,T∗y⟩\langle Tx, y \rangle = \langle x, T^* y \rangle. An operator is self-adjoint if T=T∗T = T^*.

Details

The adjoint turns the inner product around

The adjoint is the operator that lets you “move TT across the inner product.” In finite dimensions this is just the conjugate transpose of a matrix. The identity ⟨Tx,y⟩=⟨x,T∗y⟩\langle Tx, y \rangle = \langle x, T^* y \rangle is the whole definition; everything else follows from it.

Example. If TT is the matrix (0100)\begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix}, then T∗=(0010)T^* = \begin{pmatrix} 0 & 0 \\ 1 & 0 \end{pmatrix}. If TT is multiplication by a function gg on L2L^2, then T∗T^* is multiplication by g‾\overline{g}.

Self-adjoint means real spectrum

A self-adjoint operator has only real eigenvalues: if Tx=λxT x = \lambda x with ∥x∥=1\|x\| = 1, then λ=⟨Tx,x⟩=⟨x,T∗x⟩=⟨Tx,x⟩‾=λ‾\lambda = \langle Tx, x \rangle = \langle x, T^* x \rangle = \overline{\langle Tx, x \rangle} = \overline{\lambda}, so λ∈R\lambda \in \mathbb{R}. This is why observables in quantum mechanics are modeled by self-adjoint operators — their measured values are real.

<Tx, y> <x, T* y> =
Example problem

Problem. Let TT be a self-adjoint operator on a Hilbert space and xx a unit eigenvector with eigenvalue λ\lambda. Show λ\lambda is real.

Solution

λ=λ⟨x,x⟩=⟨λx,x⟩=⟨Tx,x⟩\lambda = \lambda \langle x, x \rangle = \langle \lambda x, x \rangle = \langle Tx, x \rangle. Since T=T∗T = T^*, ⟨Tx,x⟩=⟨x,T∗x⟩=⟨x,Tx⟩=⟨Tx,x⟩‾=λ‾\langle Tx, x \rangle = \langle x, T^* x \rangle = \langle x, Tx \rangle = \overline{\langle Tx, x \rangle} = \overline{\lambda}. Hence λ=λ‾\lambda = \overline{\lambda}, so λ∈R\lambda \in \mathbb{R}. ∎

Compact operators

Definition. A bounded operator TT on a normed space is compact if the image of the unit ball has compact closure; equivalently, every bounded sequence (xn)(x_n) has a subsequence such that (Txnk)(T x_{n_k}) converges.

Details

Compact means “almost finite rank”

In finite dimensions every operator is compact. In infinite dimensions, compact operators are the ones that behave like finite-rank operators: they squeeze an infinite-dimensional ball into something “small” (with compact closure). The key structural fact is that every compact operator on a Banach space is the norm-limit of finite-rank operators, so compact operators are the infinite-dimensional shadow of matrices.

Examples.

Why compactness matters

The spectrum of a compact operator is “discrete”: except possibly for 00, it consists of eigenvalues of finite multiplicity that accumulate only at 00. This is what makes the eigenvalue expansions of Fourier theory and the spectral theorem for compact operators so clean, and it is the reason integral equations can be solved by expanding in eigenfunctions.

unit ball image: "small" (compact closure)
Example problem

Problem. Show that every finite-rank operator is compact.

Solution

Let Tx=∑k=1nφk(x) ykT x = \sum_{k=1}^n \varphi_k(x)\, y_k with φk∈X∗\varphi_k \in X^* and yk∈Yy_k \in Y. The range of TT lies in the finite-dimensional span of y1,…,yny_1, \dots, y_n. The image of the unit ball is a bounded subset of this finite-dimensional space, and in finite dimensions bounded sets have compact closure (Heine–Borel). Hence TT is compact. ∎

The spectral theorem

Definition. The spectral theorem says that a normal operator TT on a Hilbert space (in particular a self-adjoint one) can be “diagonalized”: there is a measure space and a function ff such that TT is unitarily equivalent to multiplication by ff, and the spectrum of TT is the essential range of ff.

Details

From diagonalizing a matrix

In finite dimensions, a normal matrix is unitarily diagonalizable: T=UΛU∗T = U \Lambda U^* with Λ\Lambda diagonal. The spectral theorem is the infinite-dimensional version of exactly this statement. The “diagonal entries” become a function ff, the “basis of eigenvectors” becomes a measure space, and “diagonalizing” becomes “multiplication by ff.”

The projection-valued measure

The precise form: to a self-adjoint TT there is a unique projection-valued measure EE on the Borel sets of R\mathbb{R} such that

T=∫Rλ dE(λ).T = \int_{\mathbb{R}} \lambda \, dE(\lambda).

The spectrum of TT is the support of EE. This formula is the infinite-dimensional replacement for T=∑λiPiT = \sum \lambda_i P_i (eigenvalues times projections).

Consequences

lambda_1 lambda_2 lambda_3 T = sum of (eigenvalue x projection)
Example problem

Problem. Let TT be a self-adjoint operator with ∥T∥≤1\|T\| \leq 1. Show that ⟨Tx,x⟩∈[−1,1]\langle Tx, x \rangle \in [-1, 1] for every unit vector xx.

Solution

By the spectral theorem, ⟨Tx,x⟩=∫Rλ dμx(λ)\langle Tx, x \rangle = \int_{\mathbb{R}} \lambda \, d\mu_x(\lambda) where μx\mu_x is a probability measure (the spectral measure of xx). Since ∥T∥≤1\|T\| \leq 1, the spectrum lies in [−1,1][-1, 1], so μx\mu_x is supported there. An average of values in [−1,1][-1, 1] lies in [−1,1][-1, 1], hence ⟨Tx,x⟩∈[−1,1]\langle Tx, x \rangle \in [-1, 1]. ∎

Quiz

Example problem

Problem. Let TT be a compact self-adjoint operator on a Hilbert space with 00 not in its spectrum. Show that TT is invertible and that T−1T^{-1} is bounded.

Solution

Since TT is compact and self-adjoint, the spectral theorem gives T=∑nλnPnT = \sum_n \lambda_n P_n with real eigenvalues λn→0\lambda_n \to 0 and orthogonal projections PnP_n. If 0∉σ(T)0 \notin \sigma(T), then inf⁡n∣λn∣=m>0\inf_n |\lambda_n| = m > 0 (the eigenvalues cannot accumulate at 00 without 00 being in the spectrum). Define T−1=∑nλn−1PnT^{-1} = \sum_n \lambda_n^{-1} P_n. Then ∥T−1∥=sup⁡n∣λn−1∣=1/m<∞\|T^{-1}\| = \sup_n |\lambda_n^{-1}| = 1/m < \infty, so T−1T^{-1} is bounded, and T−1T=TT−1=IT^{-1} T = T T^{-1} = I. ∎