Mathematics · Book 3 · Bachelor Year 1

University Mathematics — Year 1

University Mathematics — Year 1 · Bachelor Year 1

23Euclidean Spaces

Adding an inner product to a real vector space buys the geometric notions — lengths, angles, orthogonality, distances — and one theorem that towers over the chapter: every subspace admits an orthogonal projection, computable by Gram–Schmidt, realizing the shortest distance. The plane isometries close the chapter and the year’s geometry.

Throughout, EE is a real vector space.

23.1 Inner products

Definition 23.1

An inner product on EE is a map ⟨⋅,⋅⟩ ⁣:E×E→R\langle\cdot,\cdot\rangle \colon E \times E \to \R that is bilinear, symmetric, and positive definite (⟨x,x⟩>0\langle x, x\rangle > 0 for x≠0x \neq 0). A finite-dimensional space so equipped is a Euclidean space. The norm of xx is ∥x∥=⟨x,x⟩\norm{x} = \sqrt{\langle x, x\rangle}, and d(x,y)=∥x−y∥d(x, y) = \norm{x - y}.

Example 23.2

On Rn\R^n: the canonical product ⟨x,y⟩=∑xiyi\langle x, y\rangle = \sum x_i y_i. On C([a, b])C(\intcc{a}{b}): ⟨f,g⟩=∫abfg\langle f, g \rangle = \int_a^b fg (positive definiteness is Theorem 15.7 (4)). On Rn[X]\R_n[X]: ⟨P,Q⟩=∫01PQ\langle P, Q\rangle = \int_0^1 PQ, or ∑iP(xi)Q(xi)\sum_{i} P(x_i)Q(x_i) over n+1n+1 distinct points.

Example 23.3 (The angle between two polynomials)

Once an inner product is chosen, any two nonzero vectors have an angle, via cos⁡θ=⟨x,y⟩∥x∥ ∥y∥\cos\theta = \frac{\langle x, y\rangle}{\norm x\,\norm y} (a legitimate cosine by Cauchy–Schwarz). For XX and X2X^2 in ∫01\int_0^1:

⟨X,X2⟩=14,∥X∥=13,∥X2∥=15,cos⁡θ=1/41/15=154≈0.968:\langle X, X^2\rangle = \frac14, \qquad \norm X = \frac1{\sqrt3}, \qquad \norm{X^2} = \frac1{\sqrt5}, \qquad \cos\theta = \frac{1/4}{1/\sqrt{15}} = \frac{\sqrt{15}}{4} \approx 0.968 :

an angle of about 14.514.5 degrees — on [0, 1]\intcc{0}{1}, the graphs of xx and x2x^2 are “nearly parallel” in the quadratic-mean sense, which is why removing that shared direction (Gram–Schmidt, below) leaves only the small correction X2−X+16X^2 - X + \frac16.

Theorem 23.4 (Cauchy–Schwarz; norm properties)

For all x,y∈Ex, y \in E:

∣⟨x,y⟩∣≤∥x∥ ∥y∥,\abs{\langle x, y\rangle} \leq \norm x\, \norm y ,

with equality iff x,yx, y are proportional. Consequently ∥⋅∥\norm\cdot satisfies the triangle inequality ∥x+y∥≤∥x∥+∥y∥\norm{x + y} \leq \norm x + \norm y (and ∥λx∥=∣λ∣∥x∥\norm{\lambda x} = \abs\lambda \norm x, ∥x∥=0  ⟺  x=0\norm x = 0 \iff x = 0). Moreover:

∥x+y∥2=∥x∥2+2⟨x,y⟩+∥y∥2,⟨x,y⟩=14(∥x+y∥2−∥x−y∥2).\norm{x+y}^2 = \norm x^2 + 2\langle x, y\rangle + \norm y^2, \qquad \langle x, y \rangle = \tfrac14\bigl(\norm{x+y}^2 - \norm{x-y}^2\bigr) .

Proof. If y=0y = 0, everything is trivial. Otherwise the quadratic t↦∥x+ty∥2=∥x∥2+2t⟨x,y⟩+t2∥y∥2t \mapsto \norm{x + ty}^2 = \norm x^2 + 2t\langle x, y\rangle + t^2 \norm y^2 is ≥0\geq 0 for all tt: its discriminant is ≤0\leq 0, which is Cauchy–Schwarz; equality means a double root t0t_0, i.e. x+t0y=0x + t_0 y = 0 (definiteness): proportionality. Triangle inequality: expand,

∥x+y∥2=∥x∥2+2⟨x,y⟩+∥y∥2≤∥x∥2+2∥x∥ ∥y∥+∥y∥2=(∥x∥+∥y∥)2,\norm{x + y}^2 = \norm x^2 + 2\langle x, y\rangle + \norm y^2 \leq \norm x^2 + 2\norm x\,\norm y + \norm y^2 = \bigl(\norm x + \norm y\bigr)^2 ,

the middle step being Cauchy–Schwarz; equality forces ⟨x,y⟩=∥x∥∥y∥\langle x, y\rangle = \norm x\norm y, the positive equality case, i.e. proportionality with nonnegative ratio — geometrically, the triangle degenerates only when the two vectors point the same way. The last two identities are direct expansions (the second, the polarization identity, recovers the product from the norm). ∎

23.2 Orthogonality

Definition 23.5

x⊥yx \perp y when ⟨x,y⟩=0\langle x, y \rangle = 0. A family is orthogonal when its vectors are pairwise orthogonal, orthonormal when moreover each has norm 11. The orthogonal complement of a subspace FF is

F⊥={x∈E:∀y∈F, ⟨x,y⟩=0},F^{\perp} = \{x \in E : \forall y \in F,\ \langle x, y\rangle = 0\},

a subspace of EE.

Proposition 23.6

(Pythagoras) If x⊥yx \perp y then ∥x+y∥2=∥x∥2+∥y∥2\norm{x+y}^2 = \norm x^2 + \norm y^2. An orthogonal family of nonzero vectors is free. In an orthonormal basis (e1,…,en)(e_1, \dots, e_n), coordinates and products are

x=∑i⟨x,ei⟩ ei,⟨x,y⟩=∑i⟨x,ei⟩⟨y,ei⟩,∥x∥2=∑i⟨x,ei⟩2.x = \sum_{i} \langle x, e_i\rangle\, e_i, \qquad \langle x, y \rangle = \sum_i \langle x, e_i\rangle \langle y, e_i\rangle, \qquad \norm x^2 = \sum_i \langle x, e_i\rangle^2 .

Proof. Pythagoras: expand. Freeness: take ⟨ ⋅ ,xj⟩\langle\,\cdot\,, x_j\rangle of a null combination: λj∥xj∥2=0\lambda_j \norm{x_j}^2 = 0. Coordinates: write x=∑λieix = \sum \lambda_i e_i and take the product with eje_j: λj=⟨x,ej⟩\lambda_j = \langle x, e_j\rangle; the two formulas follow by bilinearity. ∎

Example 23.7 (Orthonormal coordinates, with a Parseval check)

Expand x=(1,2,3)x = (1, 2, 3) in the orthonormal basis of Exercise 23.3,

e1=12(1,1,0),e2=16(1,−1,2),e3=13(−1,1,1).e_1 = \tfrac{1}{\sqrt2}(1,1,0), \quad e_2 = \tfrac{1}{\sqrt6}(1,-1,2), \quad e_3 = \tfrac{1}{\sqrt3}(-1,1,1).

No system to solve — three inner products:

⟨x,e1⟩=32,⟨x,e2⟩=1−2+66=56,⟨x,e3⟩=−1+2+33=43.\langle x, e_1\rangle = \frac{3}{\sqrt2}, \qquad \langle x, e_2\rangle = \frac{1 - 2 + 6}{\sqrt6} = \frac{5}{\sqrt6}, \qquad \langle x, e_3\rangle = \frac{-1 + 2 + 3}{\sqrt3} = \frac{4}{\sqrt3}.

Certification by the norm formula of the proposition:

92+256+163=27+25+326=14=∥x∥2=1+4+9.\frac{9}{2} + \frac{25}{6} + \frac{16}{3} = \frac{27 + 25 + 32}{6} = 14 = \norm{x}^2 = 1 + 4 + 9 .

This sum-of-squared-coordinates check (a finite Parseval identity) costs seconds and catches sign and normalization errors with near certainty — make it a habit whenever an orthonormal expansion is computed; its infinite-dimensional version, for the Fourier coefficients of Example 23.14, is a theorem of the Year 3 volume.

Theorem 23.8 (Gram–Schmidt)

Every Euclidean space has orthonormal bases. Explicitly, from any basis (v1,…,vn)(v_1, \dots, v_n), the recipe

wk=vk−∑i=1k−1⟨vk,ei⟩ ei,ek=wk∥wk∥w_k = v_k - \sum_{i=1}^{k-1} \langle v_k, e_i\rangle\, e_i , \qquad e_k = \frac{w_k}{\norm{w_k}}

produces an orthonormal basis (e1,…,en)(e_1, \dots, e_n) with Vect⁡(e1,…,ek)=Vect⁡(v1,…,vk)\operatorname{Vect}(e_1, \dots, e_k) = \operatorname{Vect}(v_1, \dots, v_k) for every kk.

Proof. Induction on kk. Assuming (e1,…,ek−1)(e_1, \dots, e_{k-1}) orthonormal spanning Vect⁡(v1,…,vk−1)\operatorname{Vect}(v_1, \dots, v_{k-1}): the vector wkw_k is orthogonal to each eje_j (j<kj < k) by construction (⟨wk,ej⟩=⟨vk,ej⟩−⟨vk,ej⟩\langle w_k, e_j \rangle = \langle v_k, e_j\rangle - \langle v_k, e_j\rangle), and wk≠0w_k \neq 0 since vk∉Vect⁡(v1,…,vk−1)v_k \notin \operatorname{Vect}(v_1, \dots, v_{k-1}). Normalizing keeps orthogonality; the span statement holds since eke_k is a combination of vkv_k and earlier eie_i’s, invertibly. ∎

Example 23.9 (Gram–Schmidt on polynomials, in full)

Orthonormalize (1,X,X2)(1, X, X^2) in R2[X]\R_2[X] with ⟨P,Q⟩=∫01PQ\langle P, Q\rangle = \int_0^1 PQ. Step 1: ∥1∥2=1\norm{1}^2 = 1, so e1=1e_1 = 1. Step 2: w2=X−⟨X,1⟩ 1=X−12w_2 = X - \langle X, 1\rangle\,1 = X - \frac12, and ∥w2∥2=∫01(x−12)2 ⁣dx=112\norm{w_2}^2 = \int_0^1\bigl(x - \frac12\bigr)^2 \dd x = \frac1{12}: e2=12 (X−12)e_2 = \sqrt{12}\,\bigl(X - \frac12\bigr). Step 3: ⟨X2,e1⟩=13\langle X^2, e_1\rangle = \frac13 and

⟨X2,e2⟩=12∫01x2(x−12) ⁣dx=1212,sow3=X2−13−(X−12)=X2−X+16.\langle X^2, e_2\rangle = \sqrt{12}\int_0^1 x^2\Bigl(x - \frac12\Bigr)\dd x = \frac{\sqrt{12}}{12}, \qquad\text{so}\qquad w_3 = X^2 - \frac13 - \Bigl(X - \frac12\Bigr) = X^2 - X + \frac16 .

Its norm was computed in Exercise 23.9: ∥w3∥2=1180\norm{w_3}^2 = \frac1{180}, whence e3=180 (X2−X+16)e_3 = \sqrt{180}\,\bigl(X^2 - X + \frac16\bigr). The polynomials 11, X−12X - \frac12, X2−X+16X^2 - X + \frac16 are, up to scale, the first Legendre polynomials of the interval [0, 1]\intcc{0}{1}; the construction continues one degree at a time, each new polynomial orthogonal to all its predecessors. Note how the algorithm recycles earlier work: the projection subtracted at step 3 is exactly the best affine approximation of X2X^2 found in Example 23.12 — Gram–Schmidt is iterated orthogonal projection.

Theorem 23.10 (Orthogonal projection)

Let FF be a subspace of the Euclidean space EE. Then

E=F⊕F⊥,E = F \oplus F^{\perp},

and the associated projection pFp_F onto FF (the orthogonal projection) is given, in any orthonormal basis (e1,…,ek)(e_1, \dots, e_k) of FF, by pF(x)=∑i⟨x,ei⟩eip_F(x) = \sum_i \langle x, e_i\rangle e_i. It realizes the distance to FF: for all y∈Fy \in F,

∥x−pF(x)∥≤∥x−y∥,\norm{x - p_F(x)} \leq \norm{x - y},

with equality only for y=pF(x)y = p_F(x); one writes d(x,F)=∥x−pF(x)∥d(x, F) = \norm{x - p_F(x)}.

Proof. Take an orthonormal basis (ei)i≤k(e_i)_{i \leq k} of FF (Theorem 23.8 inside FF) and set π(x)=∑⟨x,ei⟩ei∈F\pi(x) = \sum \langle x, e_i\rangle e_i \in F. Then x−π(x)⊥ejx - \pi(x) \perp e_j for each jj (same cancellation as above), hence x−π(x)∈F⊥x - \pi(x) \in F^\perp: E=F+F⊥E = F + F^\perp. And F∩F⊥={0}F \cap F^\perp = \{0\}: such a vector satisfies ⟨x,x⟩=0\langle x, x\rangle = 0. So the sum is direct and π=pF\pi = p_F.

Distance: for y∈Fy \in F, decompose x−y=(x−pF(x))+(pF(x)−y)x - y = (x - p_F(x)) + (p_F(x) - y), orthogonal pieces (F⊥F^\perp and FF); Pythagoras:

∥x−y∥2=∥x−pF(x)∥2+∥pF(x)−y∥2≥∥x−pF(x)∥2,\norm{x - y}^2 = \norm{x - p_F(x)}^2 + \norm{p_F(x) - y}^2 \geq \norm{x - p_F(x)}^2,

equality iff y=pF(x)y = p_F(x). ∎

Example 23.11 (Projections never lengthen)

Applying Pythagoras to the split x=pF(x)+(x−pF(x))x = p_F(x) + (x - p_F(x)):

∥pF(x)∥2=∥x∥2−∥x−pF(x)∥2≤∥x∥2,\norm{p_F(x)}^2 = \norm x^2 - \norm{x - p_F(x)}^2 \leq \norm x^2 ,

with equality iff x∈Fx \in F. In an orthonormal basis (e1,…,ek)(e_1, \dots, e_k) of FF this reads ∑i≤k⟨x,ei⟩2≤∥x∥2\sum_{i \leq k}\langle x, e_i\rangle^2 \leq \norm x^2 (a Bessel inequality): however many orthonormal directions one measures, the squared coordinates never exceed the squared length — compare the exact equality of Example 23.7 when the family is a full basis. This one-line inequality is what makes Fourier coefficients summable in the Year 3 volume; here it already explains why adding more basis functions to a least squares fit can only decrease the residual.

Example 23.12 (Best quadratic approximation)

In C([0, 1])C(\intcc{0}{1}) with ⟨f,g⟩=∫01fg\langle f, g\rangle = \int_0^1 fg, the polynomial of degree ≤1\leq 1 closest to f(x)=x2f(x) = x^2 in the associated (quadratic mean) distance is pF(f)p_F(f) where F=R1[X]F = \R_1[X]. Gram–Schmidt on (1,X)(1, X): e1=1e_1 = 1, w2=X−12w_2 = X - \frac12, ∥w2∥2=∫01(x−12)2=112\norm{w_2}^2 = \int_0^1 (x - \frac12)^2 = \frac{1}{12}, e2=12 (X−12)e_2 = \sqrt{12}\,(X - \tfrac12). Then

pF(f)=⟨f,e1⟩e1+⟨f,e2⟩e2=13+12(∫01x2(x−12) ⁣dx)(X−12)=X−16,p_F(f) = \langle f, e_1\rangle e_1 + \langle f, e_2\rangle e_2 = \frac13 + 12\Bigl(\int_0^1 x^2\bigl(x - \tfrac12\bigr)\dd x\Bigr)\bigl(X - \tfrac12\bigr) = X - \frac{1}{6},

using ∫01x2(x−12) ⁣dx=14−16=112\int_0^1 x^2(x - \frac12)\dd x = \frac14 - \frac16 = \frac{1}{12}. The “least squares” idea in one line of linear algebra.

Method 23.13 (Three routes to a distance d(x,F)d(x, F))

  1. Orthonormal basis of FF: then pF(x)=∑i⟨x,ei⟩eip_F(x) = \sum_i \langle x, e_i\rangle e_i and, by Pythagoras,

    d(x,F)2=∥x∥2−∥pF(x)∥2=∥x∥2−∑i⟨x,ei⟩2,d(x, F)^2 = \norm{x}^2 - \norm{p_F(x)}^2 = \norm x^2 - \sum_i \langle x, e_i\rangle^2 ,

    often cheaper than computing x−pF(x)x - p_F(x) itself.

  2. Normal equations: with any generating family of FF, solve ⟨x−p,vj⟩=0\langle x - p, v_j\rangle = 0 for the coefficients of pp (Exercise 23.5) — no orthonormalization needed.
  3. Through the complement: if F⊥F^\perp is smaller than FF (e.g. FF a hyperplane, F⊥F^\perp a line Vect⁡(n)\operatorname{Vect}(n)), project onto F⊥F^\perp instead:

    d(x,F)=∥pF⊥(x)∥=∣⟨x,n⟩∣∥n∥,d(x, F) = \norm{p_{F^\perp}(x)} = \frac{\abs{\langle x, n\rangle}}{\norm n} ,

    which is the classical distance-to-a-plane formula (Exercise 25.8 uses it).

Route 3 is a special case of a general reflex: always project onto whichever of FF, F⊥F^\perp has the smaller dimension.

Example 23.14 (Trigonometric orthogonality: a Fourier preview)

On C([0, 2π])C(\intcc{0}{2\pi}) with ⟨f,g⟩=1π∫02πfg\langle f, g\rangle = \frac1\pi\int_0^{2\pi} fg, the family

(12, cos⁡x, sin⁡x, cos⁡2x, sin⁡2x, … )\Bigl(\frac{1}{\sqrt2},\ \cos x,\ \sin x,\ \cos 2x,\ \sin 2x,\ \dots\Bigr)

is orthonormal: for instance ⟨cos⁡px,cos⁡qx⟩=1π∫02πcos⁡pxcos⁡qx  ⁣dx=0\langle \cos px, \cos qx\rangle = \frac1\pi\int_0^{2\pi}\cos px\cos qx\,\dd x = 0 for p≠qp \neq q (linearize the product into 12[cos⁡(p−q)x+cos⁡(p+q)x]\frac12[\cos(p{-}q)x + \cos(p{+}q)x] and integrate over full periods), while 1π∫02πcos⁡2px  ⁣dx=1\frac1\pi\int_0^{2\pi}\cos^2 px\,\dd x = 1. The orthogonal projection onto the span of the first 2N+12N + 1 of these functions therefore has coordinates ⟨f,ei⟩\langle f, e_i\rangle — integrals against cosines and sines. These are the Fourier coefficients of ff, and the projection is its best quadratic-mean trigonometric approximation; the Year 3 volume studies their convergence. Orthogonality is doing all the work: the formulas for the coefficients are Theorem 23.10 verbatim.

23.3 Isometries of the plane

Definition 23.15

An endomorphism uu of a Euclidean space is an isometry (or orthogonal map) when it preserves the norm: ∥u(x)∥=∥x∥\norm{u(x)} = \norm x for all xx — equivalently (polarization) it preserves the inner product; equivalently its matrix AA in an orthonormal basis satisfies ATA=IA^{\mathsf T} A = I. Isometries form a group, the orthogonal group O(E)O(E).

Example 23.16 (Recognizing an isometry at sight)

Is A=15(3−443)A = \dfrac15\begin{pmatrix} 3 & -4\\ 4 & 3\end{pmatrix} orthogonal? Columns: norms 159+16=1\frac15\sqrt{9 + 16} = 1 and 1516+9=1\frac15\sqrt{16 + 9} = 1; product 125(3⋅(−4)+4⋅3)=0\frac1{25}(3\cdot(-4) + 4\cdot3) = 0. Yes — and det⁡A=9+1625=1\det A = \frac{9 + 16}{25} = 1, so it is the rotation RθR_\theta with cos⁡θ=35\cos\theta = \frac35, sin⁡θ=45\sin\theta = \frac45 (the “33-44-55 rotation”, whose angle is no remarkable fraction of π\pi). By contrast B=12(1101)B = \frac{1}{\sqrt2}\begin{pmatrix} 1 & 1\\ 0 & 1\end{pmatrix} has unit determinant-scaled look but non-unit first column (12\frac1{\sqrt2}): not orthogonal — determinant ±1\pm1 alone certifies nothing, the columns must be checked.

Theorem 23.17 (Plane isometries)

In an orthonormal basis of a Euclidean plane, the matrices of isometries are exactly

Rθ=(cos⁡θ−sin⁡θsin⁡θcos⁡θ)(rotation of angle θ, det⁡=1),R_\theta = \begin{pmatrix} \cos\theta & -\sin\theta\\ \sin\theta & \cos\theta \end{pmatrix} \quad (\text{rotation of angle } \theta,\ \det = 1),
Sθ=(cos⁡θsin⁡θsin⁡θ−cos⁡θ)(det⁡=−1),S_\theta = \begin{pmatrix} \cos\theta & \sin\theta\\ \sin\theta & -\cos\theta \end{pmatrix} \quad (\det = -1),

the latter being the reflection in the line making angle θ2\frac\theta2 with the first basis vector.

Proof. Let A=(acbd)A = \begin{pmatrix} a & c\\ b & d\end{pmatrix} with ATA=IA^{\mathsf T}A = I: columns are unit and orthogonal. The first column is (cos⁡θ,sin⁡θ)(\cos\theta, \sin\theta) for some θ\theta; the second, unit and orthogonal to it, is ±(−sin⁡θ,cos⁡θ)\pm(-\sin\theta, \cos\theta). The sign ++ gives RθR_\theta; the sign −- gives SθS_\theta. One checks Sθ2=IS_\theta^2 = I and that the vector (cos⁡θ2,sin⁡θ2)(\cos\frac\theta2, \sin\frac\theta2) is fixed while its orthogonal is reversed: a reflection. (And RαRβ=Rα+βR_\alpha R_\beta = R_{\alpha+\beta}: the rotation group is the angle group — compare Theorem 3.7.) ∎

Two reflections make a rotation: reflecting M = (2, 0.5) in the x-axis, then in the line y = x, lands at (-0.5, 2) — the image of M under the rotation of angle π2 about the origin, twice the angle π4 between the axes. The weekend problem turns this picture into the composition law of all plane isometries.
Two reflections make a rotation: reflecting M=(2,0.5)M = (2, 0.5) in the xx-axis, then in the line y=xy = x, lands at (−0.5,2)(-0.5, 2) — the image of MM under the rotation of angle π2\frac\pi2 about the origin, twice the angle π4\frac\pi4 between the axes. The weekend problem turns this picture into the composition law of all plane isometries.

Remark 23.18 (Common pitfalls)

The projection formula needs an orthonormal basis: for a merely generating family (vi)(v_i) of FF, the sum ∑i⟨x,vi⟩vi\sum_i\langle x, v_i\rangle v_i is not pF(x)p_F(x) (test F=R2F = \R^2, v1=e1v_1 = e_1, v2=e1+e2v_2 = e_1 + e_2); with a non-orthonormal family, solve the normal equations instead (Method 23.13 (2)). Orthogonal families must avoid 00 to be free: the zero vector is orthogonal to everything, including itself — freeness in Proposition 23.6 requires nonzero vectors. F⊥F^\perp depends on the inner product: in R1[X]\R_1[X], the complement of Vect⁡(X)\operatorname{Vect}(X) for ∫01PQ\int_0^1 PQ is not the constants but Vect⁡(1−32X)\operatorname{Vect}(1 - \frac32 X) — compute ∫01x(1−32x)=12−12=0\int_0^1 x(1 - \frac32 x) = \frac12 - \frac12 = 0; “perpendicular” is meaningless until the product is named. Do not expand ∥x+y∥\norm{x + y} linearly: the correct identity is ∥x+y∥2=∥x∥2+2⟨x,y⟩+∥y∥2\norm{x+y}^2 = \norm x^2 + 2\langle x, y\rangle + \norm y^2; the cross term vanishes only under orthogonality (Pythagoras), and the triangle inequality is an inequality. Sending unit vectors to unit vectors is not enough: u(x,y)=(x+y, 0)u(x, y) = (x + y,\ 0) maps both canonical basis vectors to the unit vector (1,0)(1, 0), yet ∥u(1,1)∥=2≠2\norm{u(1,1)} = 2 \neq \sqrt2: no isometry. The definition demands ∥u(x)∥=∥x∥\norm{u(x)} = \norm x for all xx; in matrix terms ATA=IA^{\mathsf T}A = I, i.e. columns that are unit and pairwise orthogonal — both conditions, checked together.

Remark 23.19 (Where the inner product goes)

Orthogonal projection is the most applied theorem of the chapter: it underlies least squares (the weekend problem of Chapter 25 builds regression lines on it), Fourier coefficients (Example 23.14), and the normal equations of Exercise 23.5, which numerical analysis solves at scale. The classification Rθ/SθR_\theta / S_\theta is completed below: the weekend problem classifies all distance-preserving transformations of the plane, linear or not, and their finite groups — the mathematics of rosettes and regular polygons. In the Year 2 volume the inner product meets eigenvalue theory (symmetric matrices, quadratic forms); in Year 3, infinite-dimensional Euclidean geometry becomes Hilbert space theory.

Remark 23.20 (Perspectives inside Book 3)

Two bridges leave this chapter. Backward, to the linear algebra: the Gram matrix of Exercise 23.11 packages inner products into the determinant machinery of Chapter 22, and orthogonal projection is the special projector of Chapter 20 whose kernel is F⊥F^\perp — all its algebra (p2=pp^2 = p, s=2p−ids = 2p - \mathrm{id}) applies verbatim, now with the bonus that ∥x−p(x)∥\norm{x - p(x)} is a distance. Forward, to analysis: Chapter 24 measures arc length with this chapter’s norm and classifies nothing without its isometries; Chapter 25 reads the gradient through Cauchy–Schwarz (steepest ascent) and closes the volume with least squares, which is Theorem 23.10 applied to a data vector in Rn\R^n. The inner product is the point where the book’s algebra and its analysis finally meet.

23.4 Exercises

Exercise 23.1 ★

In R3\R^3 canonical: compute ⟨u,v⟩\langle u, v\rangle, ∥u∥\norm u, ∥v∥\norm v and the angle between u=(1,2,2)u = (1, 2, 2) and v=(2,−2,1)v = (2, -2, 1). Verify Cauchy–Schwarz numerically.

Solution

Solution of Exercise 23.1.

⟨u,v⟩=2−4+2=0\langle u, v\rangle = 2 - 4 + 2 = 0; ∥u∥=∥v∥=3\norm u = \norm v = 3. The vectors are orthogonal: the angle is π2\frac\pi2. Cauchy–Schwarz: ∣0∣≤9\abs 0 \leq 9, comfortably.

Exercise 23.2 ★

Prove the parallelogram identity ∥x+y∥2+∥x−y∥2=2∥x∥2+2∥y∥2\norm{x+y}^2 + \norm{x-y}^2 = 2\norm x^2 + 2\norm y^2 in any Euclidean space, and use it to show that the sup norm on R2\R^2, ∥(x,y)∥∞=max⁡(∣x∣,∣y∣)\norm{(x,y)}_\infty = \max(\abs x, \abs y), does not come from an inner product.

Solution

Solution of Exercise 23.2.

Expand both squared norms with the identity of Theorem 23.4 and add: the cross terms cancel.

Sup norm: take x=(1,0)x = (1, 0), y=(0,1)y = (0, 1). Then ∥x+y∥∞=∥x−y∥∞=1\norm{x + y}_\infty = \norm{x - y}_\infty = 1 and the identity would require 1+1=2(1)+2(1)=41 + 1 = 2(1) + 2(1) = 4: false. A norm violating the parallelogram identity comes from no inner product.

Exercise 23.3 ★

Apply Gram–Schmidt to ((1,1,0),(1,0,1),(0,1,1))\bigl((1,1,0), (1,0,1), (0,1,1)\bigr) in canonical R3\R^3.

Solution

Solution of Exercise 23.3.

e1=12(1,1,0)e_1 = \frac{1}{\sqrt 2}(1,1,0).

w2=(1,0,1)−⟨(1,0,1),e1⟩e1=(1,0,1)−12(1,1,0)=(12,−12,1)w_2 = (1,0,1) - \langle (1,0,1), e_1\rangle e_1 = (1,0,1) - \frac{1}{2}(1,1,0) = \bigl(\tfrac12, -\tfrac12, 1\bigr); ∥w2∥=32\norm{w_2} = \sqrt{\tfrac32}, so e2=16(1,−1,2)e_2 = \frac{1}{\sqrt 6}(1, -1, 2).

w3=(0,1,1)−⟨⋅,e1⟩e1−⟨⋅,e2⟩e2=(0,1,1)−12(1,1,0)−16(1,−1,2)=(−23,23,23)w_3 = (0,1,1) - \langle\cdot, e_1\rangle e_1 - \langle\cdot, e_2\rangle e_2 = (0,1,1) - \frac12 (1,1,0) - \frac16(1,-1,2) = \bigl(-\tfrac23, \tfrac23, \tfrac23\bigr); normalizing, e3=13(−1,1,1)e_3 = \frac{1}{\sqrt 3}(-1, 1, 1).

(Check: pairwise products vanish; each has norm 11.)

Exercise 23.4 ★

In R3\R^3, let F=Vect⁡((1,1,1))F = \operatorname{Vect}\bigl((1,1,1)\bigr). Determine F⊥F^\perp (equation and basis), the matrix of pFp_F in the canonical basis, and d((1,2,3),F)d\bigl((1, 2, 3), F\bigr).

Solution

Solution of Exercise 23.4.

F⊥={(x,y,z):x+y+z=0}F^\perp = \{(x,y,z) : x + y + z = 0\}, basis ((1,−1,0),(1,0,−1))\bigl((1,-1,0), (1,0,-1)\bigr). With e=13(1,1,1)e = \frac{1}{\sqrt3}(1,1,1): pF(x)=⟨x,e⟩e=x1+x2+x33 (1,1,1)p_F(x) = \langle x, e\rangle e = \frac{x_1 + x_2 + x_3}{3}\,(1,1,1), so

Mat⁡(pF)=13(111111111).\operatorname{Mat}(p_F) = \frac13 \begin{pmatrix} 1&1&1\\ 1&1&1\\ 1&1&1\end{pmatrix}.

For x=(1,2,3)x = (1,2,3): pF(x)=(2,2,2)p_F(x) = (2,2,2) and d(x,F)=∥(1,2,3)−(2,2,2)∥=∥(−1,0,1)∥=2d(x, F) = \norm{(1,2,3) - (2,2,2)} = \norm{(-1,0,1)} = \sqrt 2.

Exercise 23.5 ★★

(Normal equations) Let F=Vect⁡((1,0,1),(0,1,1))⊆R3F = \operatorname{Vect}\bigl((1,0,1),(0,1,1)\bigr) \subseteq \R^3 and x=(1,1,4)x = (1, 1, 4). Compute pF(x)p_F(x) by solving ⟨x−p,v⟩=0\langle x - p, v \rangle = 0 for the two generators (p=α(1,0,1)+β(0,1,1)p = \alpha(1,0,1) + \beta(0,1,1)), then d(x,F)d(x, F). Why is Gram–Schmidt unnecessary here?

Solution

Solution of Exercise 23.5.

Let p=α(1,0,1)+β(0,1,1)=(α,β,α+β)p = \alpha(1,0,1) + \beta(0,1,1) = (\alpha, \beta, \alpha + \beta). Orthogonality of x−px - p to the generators:

⟨x−p,(1,0,1)⟩=(1−α)+(4−α−β)=0,⟨x−p,(0,1,1)⟩=(1−β)+(4−α−β)=0,\langle x - p, (1,0,1)\rangle = (1 - \alpha) + (4 - \alpha - \beta) = 0, \qquad \langle x - p, (0,1,1)\rangle = (1 - \beta) + (4 - \alpha - \beta) = 0,

i.e. 2α+β=52\alpha + \beta = 5 and α+2β=5\alpha + 2\beta = 5: α=β=53\alpha = \beta = \frac53. So pF(x)=(53,53,103)p_F(x) = \bigl(\frac53, \frac53, \frac{10}{3}\bigr) and

d(x,F)=∥x−p∥=∥(−23,−23,23)∥=23.d(x, F) = \norm{x - p} = \norm{\bigl(-\tfrac23, -\tfrac23, \tfrac23\bigr)} = \frac{2}{\sqrt 3} .

Gram–Schmidt is unnecessary because the defining property of the projection — x−p⊥Fx - p \perp F — is itself a linear system (“normal equations”) on the coefficients in any generating family.

Exercise 23.6 ★★

For ff continuous on [0, 1]\intcc{0}{1}, prove

(∫01f) ⁣2≤∫01f2,\Bigl(\int_0^1 f\Bigr)^{\!2} \leq \int_0^1 f^2 ,

with the case of equality, as an instance of Cauchy–Schwarz in C([0, 1])C(\intcc{0}{1}). Then prove (∑i=1nai)2≤n∑ai2\bigl(\sum_{i=1}^n a_i\bigr)^2 \leq n \sum a_i^2 for reals aia_i.

Solution

Solution of Exercise 23.6.

Cauchy–Schwarz with g=1g = 1:

(∫01f⋅1)2≤∫01f2⋅∫0112=∫01f2,\Bigl(\int_0^1 f \cdot 1\Bigr)^2 \leq \int_0^1 f^2 \cdot \int_0^1 1^2 = \int_0^1 f^2 ,

equality iff ff is proportional to 11, i.e. constant. Discrete version: in Rn\R^n with x=(a1,…,an)x = (a_1, \dots, a_n), y=(1,…,1)y = (1, \dots, 1): (∑ai)2≤∥x∥2 ∥y∥2=n∑ai2\bigl(\sum a_i\bigr)^2 \leq \norm x^2\, \norm y^2 = n \sum a_i^2, equality iff all aia_i equal.

Exercise 23.7 ★★

Prove that for every subspace FF of a Euclidean space: (F⊥)⊥=F(F^{\perp})^{\perp} = F and dim⁡F⊥=dim⁡E−dim⁡F\dim F^{\perp} = \dim E - \dim F.

Solution

Solution of Exercise 23.7.

By Theorem 23.10, E=F⊕F⊥E = F \oplus F^\perp, so dimensions add: dim⁡F⊥=dim⁡E−dim⁡F\dim F^\perp = \dim E - \dim F. Inclusion F⊆(F⊥)⊥F \subseteq (F^\perp)^\perp is immediate (vectors of FF are orthogonal to everything in F⊥F^\perp). Dimensions: dim⁡(F⊥)⊥=dim⁡E−dim⁡F⊥=dim⁡F\dim(F^\perp)^\perp = \dim E - \dim F^\perp = \dim F; an inclusion with equal (finite) dimensions is an equality (Theorem 19.14).

Exercise 23.8 ★★

Identify the plane isometries of matrices

A=12(1−111),B=15(344−3)A = \frac{1}{\sqrt 2}\begin{pmatrix} 1 & -1\\ 1 & 1\end{pmatrix}, \qquad B = \frac{1}{5}\begin{pmatrix} 3 & 4\\ 4 & -3\end{pmatrix}

(type, angle or axis). Compute A8A^8 and B2B^2 without multiplying matrices.

Solution

Solution of Exercise 23.8.

AA: columns unit, determinant +1+1: a rotation, with cos⁡θ=12\cos\theta = \frac{1}{\sqrt2}, sin⁡θ=12\sin\theta = \frac{1}{\sqrt2}: θ=π4\theta = \frac\pi4. Hence A8=R8π/4=R2π=IA^8 = R_{8\pi/4} = R_{2\pi} = I.

BB: determinant 125(−9−16)=−1\frac{1}{25}(-9 - 16) = -1: a reflection SθS_\theta with cos⁡θ=35\cos\theta = \frac35, sin⁡θ=45\sin\theta = \frac45; its axis makes the angle θ2\frac\theta2 with the xx-axis, i.e. the line directed by (cos⁡θ2,sin⁡θ2)\bigl(\cos\frac\theta2, \sin\frac\theta2\bigr) — concretely the axis is Vect⁡((2,1))\operatorname{Vect}\bigl((2, 1)\bigr), since B(2,1)T=15(6+4,8−3)T=(2,1)TB(2,1)^{\mathsf T} = \frac15(6+4, 8-3)^{\mathsf T} = (2,1)^{\mathsf T}. As a reflection, B2=IB^2 = I.

Exercise 23.9 ★★★

(Minimum as a projection) Compute

min⁡(a,b)∈R2∫01(x2−a−bx)2 ⁣dx,\min_{(a, b) \in \R^2} \int_0^1 \bigl(x^2 - a - bx\bigr)^2 \dd x ,

using Example 23.12: the minimum is ∥f−pF(f)∥2\norm{f - p_F(f)}^2 for f=X2f = X^2, F=R1[X]F = \R_1[X].

Solution

Solution of Exercise 23.9.

The quantity is ∥f−(a+bX)∥2\norm{f - (a + bX)}^2 in C([0, 1])C(\intcc{0}{1}) with the integral inner product: minimal exactly at the orthogonal projection a+bX=pF(f)=X−16a + bX = p_F(f) = X - \frac16 (Example 23.12). The minimum is

∥f−pF(f)∥2=∫01(x2−x+16) ⁣2 ⁣dx.\norm{f - p_F(f)}^2 = \int_0^1 \Bigl(x^2 - x + \frac16\Bigr)^{\!2} \dd x .

Expand: ∫01(x2−x+16)2=∫01(x4−2x3+43x2−13x+136) ⁣dx=15−12+49−16+136=1180\int_0^1 (x^2 - x + \frac16)^2 = \int_0^1 \bigl(x^4 - 2x^3 + \frac{4}{3}x^2 - \frac13 x + \frac{1}{36}\bigr)\dd x = \frac15 - \frac12 + \frac49 - \frac16 + \frac{1}{36} = \frac{1}{180}. So the minimum equals 1180\dfrac{1}{180}.

Exercise 23.10 ★★★

Let uu be an isometry of a Euclidean space EE. Prove that ker⁡(u−id)⊥im⁡(u−id)\ker(u - \mathrm{id}) \perp \operatorname{im}(u - \mathrm{id}), and deduce E=ker⁡(u−id)⊕im⁡(u−id)E = \ker(u - \mathrm{id}) \oplus \operatorname{im}(u - \mathrm{id}). (Compute ⟨x−u(x),y⟩\langle x - u(x), y\rangle for u(y)=yu(y) = y, using preservation of the product.)

Solution

Solution of Exercise 23.10.

Let y∈ker⁡(u−id)y \in \ker(u - \mathrm{id}) (i.e. u(y)=yu(y) = y) and x∈Ex \in E. Then, using preservation of the inner product (⟨u(a),u(b)⟩=⟨a,b⟩\langle u(a), u(b)\rangle = \langle a, b\rangle):

⟨x−u(x), y⟩=⟨x,y⟩−⟨u(x),y⟩=⟨x,y⟩−⟨u(x),u(y)⟩=⟨x,y⟩−⟨x,y⟩=0:\langle x - u(x),\, y\rangle = \langle x, y\rangle - \langle u(x), y\rangle = \langle x, y\rangle - \langle u(x), u(y)\rangle = \langle x, y\rangle - \langle x, y\rangle = 0 :

every vector of im⁡(u−id)\operatorname{im}(u - \mathrm{id}) is orthogonal to every fixed vector.

Therefore im⁡(u−id)⊆ker⁡(u−id)⊥\operatorname{im}(u - \mathrm{id}) \subseteq \ker(u - \mathrm{id})^{\perp}, and by rank–nullity plus Exercise 23.7, both have dimension dim⁡E−dim⁡ker⁡(u−id)\dim E - \dim\ker(u - \mathrm{id}): they are equal. Then E=ker⁡(u−id)⊕ker⁡(u−id)⊥=ker⁡(u−id)⊕im⁡(u−id)E = \ker(u - \mathrm{id}) \oplus \ker(u - \mathrm{id})^\perp = \ker(u - \mathrm{id}) \oplus \operatorname{im}(u - \mathrm{id}).

Exercise 23.11 ★★

(Gram matrix) For vectors v1,…,vkv_1, \dots, v_k of a Euclidean space, let G=(⟨vi,vj⟩)1≤i,j≤kG = \bigl(\langle v_i, v_j\rangle\bigr)_{1 \leq i, j \leq k} be their Gram matrix.

  1. Prove that (v1,…,vk)(v_1, \dots, v_k) is free if and only if GG is invertible. (If Gc=0Gc = 0, compute ∥∑icivi∥2\norm{\sum_i c_i v_i}^2.)
  2. Compute the Gram matrix of (1,X,X2)(1, X, X^2) in R2[X]\R_2[X] with ⟨P,Q⟩=∫01PQ\langle P, Q\rangle = \int_0^1 PQ, recognize the Hilbert matrix H3H_3 of the weekend problem of Chapter 22, and conclude freeness from det⁡H3=12160≠0\det H_3 = \frac1{2160} \neq 0.
Solution

Solution of Exercise 23.11.

  1. Suppose Gc=0Gc = 0 for a column c=(c1,…,ck)Tc = (c_1, \dots, c_k)^{\mathsf T}. Then

    ∥∑icivi∥2=∑i,jcicj⟨vi,vj⟩=cTG c=0,\Bigl\lVert\sum_i c_i v_i\Bigr\rVert^2 = \sum_{i,j} c_i c_j \langle v_i, v_j\rangle = c^{\mathsf T} G\, c = 0,

    so ∑icivi=0\sum_i c_i v_i = 0. If the family is free this forces c=0c = 0: GG is invertible. Conversely, a nontrivial relation ∑jcjvj=0\sum_j c_j v_j = 0 gives, taking the product with each viv_i, the nontrivial relation Gc=0Gc = 0: GG singular. Freeness   ⟺  det⁡G≠0\iff \det G \neq 0.

  2. ⟨Xi−1,Xj−1⟩=∫01xi+j−2 ⁣dx=1i+j−1\langle X^{i-1}, X^{j-1}\rangle = \int_0^1 x^{i+j-2}\dd x = \frac{1}{i+j-1}: the Gram matrix of (1,X,X2)(1, X, X^2) is exactly the Hilbert matrix H3H_3, whose determinant 12160\frac1{2160} was computed in the weekend problem of Chapter 22: nonzero, so the monomials are free — as expected, but now certified by a number.

Exercise 23.12 ★★★

Let uu be an endomorphism of a Euclidean space EE whose matrix AA in an orthonormal basis is both orthogonal (ATA=IA^{\mathsf T}A = I) and symmetric (AT=AA^{\mathsf T} = A).

  1. Show A2=IA^2 = I, and deduce (via Theorem 20.15) that E=ker⁡(u−id)⊕ker⁡(u+id)E = \ker(u - \mathrm{id}) \oplus \ker(u + \mathrm{id}).
  2. Show that the two subspaces are orthogonal, so that uu is the orthogonal symmetry with respect to F=ker⁡(u−id)F = \ker(u - \mathrm{id}): reflection through FF. (For u(x)=xu(x) = x and u(y)=−yu(y) = -y, compute ⟨x,y⟩\langle x, y\rangle two ways.)
  3. Classify the plane case: which matrices of Theorem 23.17 are symmetric, and what are the corresponding maps?
Solution

Solution of Exercise 23.12.

  1. A2=AA=ATA=IA^2 = A A = A^{\mathsf T} A = I, so u2=idu^2 = \mathrm{id}: uu is a symmetry, and Theorem 20.15 (2) gives E=ker⁡(u−id)⊕ker⁡(u+id)E = \ker(u - \mathrm{id}) \oplus \ker(u + \mathrm{id}).
  2. Let u(x)=xu(x) = x and u(y)=−yu(y) = -y. Since uu preserves the inner product,

    ⟨x,y⟩=⟨u(x),u(y)⟩=⟨x,−y⟩=−⟨x,y⟩,\langle x, y\rangle = \langle u(x), u(y)\rangle = \langle x, -y\rangle = -\langle x, y\rangle ,

    so ⟨x,y⟩=0\langle x, y\rangle = 0: the two eigenspaces are orthogonal, ker⁡(u+id)=F⊥\ker(u + \mathrm{id}) = F^\perp for F=ker⁡(u−id)F = \ker(u - \mathrm{id}), and uu is the orthogonal symmetry with respect to FF.

  3. RθR_\theta is symmetric iff −sin⁡θ=sin⁡θ-\sin\theta = \sin\theta, i.e. θ∈{0,π}\theta \in \{0, \pi\}: the maps ±id\pm\mathrm{id} (identity and central symmetry). Every SθS_\theta is symmetric: the line reflections. These are exactly the orthogonal symmetries of the plane, with FF equal to the whole plane, {0}\{0\}, or the reflection axis.

23.5 Problem: plane isometries and Leonardo’s theorem

Problem 23.1

An isometry of the plane is any map f ⁣:R2→R2f \colon \R^2 \to \R^2 preserving distances: ∥f(x)−f(y)∥=∥x−y∥\norm{f(x) - f(y)} = \norm{x - y} for all x,yx, y — no linearity assumed. This problem proves that such maps are exactly the translations, rotations, reflections and glide reflections (the classification of plane isometries), computes their compositions, and determines all their finite groups: Leonardo’s theorem, the mathematics behind rosette patterns. From Part II on we identify R2\R^2 with C\C (Chapter 3): the canonical inner product is ⟨z,w⟩=Re⁡(zw‾)\langle z, w\rangle = \operatorname{Re}(z\conj w) and the norm is the modulus.

Part I — Every isometry is affine.

  1. Check that translations ta(x)=x+at_a(x) = x + a, linear isometries, and all their compositions are isometries, and that the isometries form a group under composition.
  2. Let ff be an isometry with f(0)=0f(0) = 0. Show that ff preserves norms, then — by polarization, Theorem 23.4 — that ⟨f(x),f(y)⟩=⟨x,y⟩\langle f(x), f(y)\rangle = \langle x, y\rangle for all x,yx, y.
  3. Still with f(0)=0f(0) = 0: expand ∥f(x+y)−f(x)−f(y)∥2\norm{f(x + y) - f(x) - f(y)}^2 and ∥f(λx)−λf(x)∥2\norm{f(\lambda x) - \lambda f(x)}^2 using question 2, and conclude that ff is linear: f∈O(R2)f \in O(\R^2).
  4. Deduce that every isometry ff writes uniquely as f=ta∘gf = t_a \circ g with a=f(0)a = f(0) and gg a linear isometry (the linear part of ff).
  5. Call ff direct if det⁡g=1\det g = 1, indirect if det⁡g=−1\det g = -1. Show that the linear part of a composition is the composition of the linear parts, and state the resulting sign rule (direct/indirect compose like +1/−1+1/-1).

Part II — The four types. Via Theorem 23.17, the linear isometries of C\C are z↦azz \mapsto az and z↦az‾z \mapsto a\conj z with ∣a∣=1\abs a = 1; so every plane isometry is

f(z)=az+b(direct)orf(z)=az‾+b(indirect),∣a∣=1.f(z) = a z + b \quad (\text{direct}) \qquad\text{or}\qquad f(z) = a\conj z + b \quad (\text{indirect}), \qquad \abs a = 1 .
  1. Verify the dictionary: RθR_\theta is z↦eiθzz \mapsto \eu^{\iu\theta}z and SθS_\theta is z↦eiθz‾z \mapsto \eu^{\iu\theta}\conj z (check both on 11 and i\iu).
  2. (Direct case) Let f(z)=az+bf(z) = az + b, ∣a∣=1\abs a = 1. Show: if a=1a = 1, ff is a translation; if a≠1a \neq 1, ff has the unique fixed point z0=b/(1−a)z_0 = b/(1 - a) and f(z)−z0=a(z−z0)f(z) - z_0 = a(z - z_0): a rotation of center z0z_0 and angle arg⁡a\arg a.
  3. (Indirect case) Let f(z)=az‾+bf(z) = a\conj z + b, and v=ab‾+bv = a\conj b + b. Show f∘f=tvf \circ f = t_v and f∘tv=tv∘ff \circ t_v = t_v \circ f. If v=0v = 0: show that the midpoint of zz and f(z)f(z) is a fixed point, and that ff is a reflection in a line. If v≠0v \neq 0: show that r=t−v/2∘fr = t_{-v/2}\circ f is a reflection whose axis is parallel to vv, so that f=tv/2∘rf = t_{v/2} \circ r is a glide reflection. Conclude: every plane isometry is a translation, a rotation, a reflection or a glide reflection (the classification of plane isometries).
  4. (Compositions) Show: the composition of rotations of angles α\alpha and β\beta is a rotation of angle α+β\alpha + \beta (a translation if α+β∈2πZ\alpha + \beta \in 2\pi\Z); the composition of two reflections is a rotation of angle twice the angle between the axes (a translation if the axes are parallel).
  5. Deduce that every plane isometry is a composition of at most three reflections.

Part III — Three identifications.

  1. Classify completely f(z)=iz‾+1+if(z) = \iu\conj z + 1 + \iu: type, axis, glide vector.
  2. Let ff be the rotation of angle π2\frac\pi2 about 00 and gg the rotation of angle π2\frac\pi2 about 11. Compute g∘fg \circ f in the form z↦az+bz \mapsto az + b and identify it (type, center, angle).
  3. Let r1(z)=z‾r_1(z) = \conj z (reflection in the real axis) and r2(z)=iz‾r_2(z) = \iu\conj z (reflection in the line y=xy = x). Compute r2∘r1r_2 \circ r_1 and check question 9 on this example.

Part IV — Finite groups: Leonardo’s theorem. Let GG be a finite group of plane isometries.

  1. Show that isometries preserve barycenters: if λ1+⋯+λm=1\lambda_1 + \dots + \lambda_m = 1 and f=ta∘gf = t_a \circ g (gg linear), then f(∑iλixi)=∑iλif(xi)f\bigl(\sum_i \lambda_i x_i\bigr) = \sum_i \lambda_i f(x_i).
  2. Set c=1∣G∣∑g∈Gg(x0)c = \frac{1}{\abs G}\sum_{g \in G} g(x_0) for any chosen x0x_0. Show that every h∈Gh \in G fixes cc: a finite group of isometries has a common fixed point.
  3. Deduce that, after conjugating by t−ct_{-c}, one may assume G⊆O(R2)G \subseteq O(\R^2). Let G+={g∈G:det⁡g=1}G^{+} = \{g \in G : \det g = 1\}; show that either G=G+G = G^{+} or G+G^{+} has exactly index 22 in GG (exhibit a bijection G+→G∖G+G^+ \to G \setminus G^+).
  4. Show that a finite group of rotations about cc is cyclic: among its elements pick the rotation Rθ0R_{\theta_0} of smallest angle θ0∈(0, 2π)\theta_0 \in \intoo{0}{2\pi}, and use euclidean division of angles to prove that it generates; conclude θ0=2πn\theta_0 = \frac{2\pi}n and G+={Rθ0 k}≅CnG^{+} = \{R_{\theta_0}^{\,k}\} \cong C_n.
  5. Suppose G≠G+G \neq G^{+} and pick a reflection s∈Gs \in G. Show G=G+∪sG+G = G^{+} \cup sG^{+}, that srs=r−1s r s = r^{-1} for every rotation r∈G+r \in G^{+}, and that all nn elements of sG+sG^{+} are reflections: GG is the dihedral group DnD_n of order 2n2n.
  6. Conclude (Leonardo’s theorem): every finite group of isometries of the plane is cyclic CnC_n or dihedral DnD_n.

Part V — Dividends, and synthesis.

  1. Show directly that a finite group of isometries can contain no translation and no glide reflection other than the identity (consider the powers of such an element).
  2. Let PnP_n be the regular nn-gon with vertices the nn-th roots of unity (n≥3n \geq 3). Show that its symmetry group is exactly DnD_n: the nn rotations z↦ωkzz \mapsto \omega^k z and the nn reflections z↦ωkz‾z \mapsto \omega^k \conj z, ω=e2iπ/n\omega = \eu^{2\iu\pi/n}, and no others.
  3. Exhibit plane figures whose symmetry groups are C1C_1, D1D_1, D2D_2 and C3C_3 respectively.
  4. List the eight elements of the symmetry group of the square with vertices ±1,±i\pm1, \pm\iu as maps z↦ωkzz \mapsto \omega^k z or z↦ωkz‾z \mapsto \omega^k\conj z, and give the axis of each of the four reflections.
  5. Let f,gf, g be rotations of the same angle θ∉2πZ\theta \notin 2\pi\Z about distinct centers c1≠c2c_1 \neq c_2. Compute f∘g−g∘ff\circ g - g\circ f pointwise and show f∘g≠g∘ff\circ g \neq g\circ f; show moreover that (f∘g)∘(g∘f)−1(f \circ g)\circ(g\circ f)^{-1} is a nontrivial translation, so that any group containing ff and gg is infinite — a second explanation of the single center in Leonardo’s theorem.
  6. Synthesis, in four sentences: which two structural results reduce arbitrary isometries to linear algebra (questions 3–4) and arbitrary finite groups to subgroups of O(2)O(2) (question 15); what the complete list of plane isometries is and which invariants (direct/indirect, fixed points) separate the four types; why the composition rules of question 9 make reflections the generators of everything; and what Leonardo’s theorem adds on the finite scale. Name the two theorems proved in Parts II and IV.
Solution

Solution of Problem 23.1.

1. ∥ta(x)−ta(y)∥=∥x−y∥\norm{t_a(x) - t_a(y)} = \norm{x - y}; a linear isometry preserves norms, hence distances (∥g(x)−g(y)∥=∥g(x−y)∥=∥x−y∥\norm{g(x) - g(y)} = \norm{g(x - y)} = \norm{x-y}); and a composition of distance-preserving maps preserves distances. Every isometry is injective (distinct points stay at positive distance) and, by the classification below, bijective; identity and inverses are isometries: a group.

2. ∥f(x)∥=∥f(x)−f(0)∥=∥x−0∥=∥x∥\norm{f(x)} = \norm{f(x) - f(0)} = \norm{x - 0} = \norm x. Polarization:

⟨f(x),f(y)⟩=∥f(x)∥2+∥f(y)∥2−∥f(x)−f(y)∥22=∥x∥2+∥y∥2−∥x−y∥22=⟨x,y⟩.\langle f(x), f(y)\rangle = \frac{\norm{f(x)}^2 + \norm{f(y)}^2 - \norm{f(x) - f(y)}^2}{2} = \frac{\norm x^2 + \norm y^2 - \norm{x - y}^2}{2} = \langle x, y\rangle .

3. Expanding with question 2 (each product of ff’s equals the product of the arguments):

∥f(x+y)−f(x)−f(y)∥2=∥x+y∥2+∥x∥2+∥y∥2−2⟨x+y,x⟩−2⟨x+y,y⟩+2⟨x,y⟩=0,\begin{align*} \norm{f(x+y) - f(x) - f(y)}^2 &= \norm{x+y}^2 + \norm x^2 + \norm y^2\\ &\quad - 2\langle x+y, x\rangle - 2\langle x+y, y\rangle + 2\langle x, y\rangle = 0 , \end{align*}

as a direct check shows; similarly ∥f(λx)−λf(x)∥2=∥λx∥2−2λ⟨λx,x⟩+λ2∥x∥2=0\norm{f(\lambda x) - \lambda f(x)}^2 = \norm{\lambda x}^2 - 2\lambda\langle \lambda x, x\rangle + \lambda^2\norm x^2 = 0. So f(x+y)=f(x)+f(y)f(x + y) = f(x) + f(y) and f(λx)=λf(x)f(\lambda x) = \lambda f(x): ff is linear, and norm-preserving: f∈O(R2)f \in O(\R^2).

4. Set a=f(0)a = f(0) and g=t−a∘fg = t_{-a}\circ f: an isometry fixing 00, hence a linear isometry (question 3), and f=ta∘gf = t_a \circ g. Uniqueness: ta∘g=ta′∘g′t_a \circ g = t_{a'}\circ g' evaluated at 00 gives a=a′a = a', then g=g′g = g'.

5. (ta∘g)∘(ta′∘g′)=ta+g(a′)∘(g∘g′)(t_a\circ g)\circ(t_{a'}\circ g') = t_{a + g(a')}\circ(g\circ g'), since g ta′=tg(a′) gg\,t_{a'} = t_{g(a')}\,g for linear gg. So the linear part of a composition is g∘g′g \circ g', and det⁡(gg′)=det⁡gdet⁡g′\det(gg') = \det g \det g': direct∘\circdirect == indirect∘\circindirect == direct, direct∘\circindirect == indirect — the sign rule of ±1\pm1.

6. z↦eiθzz \mapsto \eu^{\iu\theta}z sends 11 to (cos⁡θ,sin⁡θ)(\cos\theta, \sin\theta) and i\iu to ieiθ=(−sin⁡θ,cos⁡θ)\iu\eu^{\iu\theta} = (-\sin\theta, \cos\theta): the columns of RθR_\theta. And z↦eiθz‾z \mapsto \eu^{\iu\theta}\conj z sends 11 to (cos⁡θ,sin⁡θ)(\cos\theta, \sin\theta) and i\iu to −ieiθ=(sin⁡θ,−cos⁡θ)-\iu\eu^{\iu\theta} = (\sin\theta, -\cos\theta): the columns of SθS_\theta.

7. a=1a = 1: f=tbf = t_b. a≠1a \neq 1: the fixed-point equation az0+b=z0az_0 + b = z_0 has the unique solution z0=b/(1−a)z_0 = b/(1 - a), and then

f(z)−z0=az+b−(az0+b)=a(z−z0):f(z) - z_0 = az + b - (az_0 + b) = a(z - z_0):

in the frame centered at z0z_0, ff is the multiplication by a=eiarg⁡aa = \eu^{\iu\arg a}: the rotation of center z0z_0 and angle arg⁡a\arg a.

8. f(f(z))=a(az‾+b)‾+b=aa‾ z+ab‾+b=z+vf(f(z)) = a\conj{(a\conj z + b)} + b = a\conj a\,z + a\conj b + b = z + v: f2=tvf^2 = t_v. Commutation: f(z+v)=az‾+av‾+bf(z + v) = a\conj z + a\conj v + b and av‾=a(ab‾+b)‾=b+ab‾=va\conj v = a\conj{(a\conj b + b)} = b + a\conj b = v, so f∘tv=tv∘ff\circ t_v = t_v\circ f.

Case v=0v = 0: f2=idf^2 = \mathrm{id}. For any zz, the midpoint m=z+f(z)2m = \frac{z + f(z)}2 satisfies (isometries being affine, Part I) f(m)=f(z)+f2(z)2=mf(m) = \frac{f(z) + f^2(z)}{2} = m: fixed points exist. Conjugating by the translation to a fixed point, ff becomes a linear indirect isometry, i.e. some SθS_\theta (Theorem 23.17): a reflection in a line.

Case v≠0v \neq 0: r=t−v/2∘fr = t_{-v/2}\circ f is indirect and

r2=t−v/2 f t−v/2 f=t−v/2 t−v/2 f2=t−v tv=idr^2 = t_{-v/2}\,f\,t_{-v/2}\,f = t_{-v/2}\,t_{-v/2}\,f^2 = t_{-v}\,t_v = \mathrm{id}

(using the commutation), so rr is a reflection, and f=tv/2∘rf = t_{v/2}\circ r. Its axis is parallel to vv: rr commutes with tvt_v (both ff and tv/2t_{v/2} do), so tvt_v maps the axis (the fixed line of rr) to itself, forcing vv to direct it. Hence ff is a glide reflection with glide vector v/2v/2. Every isometry is now classified: translation or rotation (direct), reflection or glide reflection (indirect).

9. Rotations f(z)=az+bf(z) = az + b, g(z)=a′z+b′g(z) = a'z + b' with a=eiαa = \eu^{\iu\alpha}, a′=eiβa' = \eu^{\iu\beta}: g∘f(z)=a′az+(a′b+b′)g\circ f(z) = a'az + (a'b + b') has linear coefficient ei(α+β)\eu^{\iu(\alpha+\beta)}: a rotation of angle α+β\alpha + \beta by question 7, or a translation when ei(α+β)=1\eu^{\iu(\alpha+\beta)} = 1. Reflections ri(z)=aiz‾+bir_i(z) = a_i\conj z + b_i with ai=eiθia_i = \eu^{\iu\theta_i} (axis at angle θi/2\theta_i/2):

r2∘r1(z)=a2a1‾ z+(a2b1‾+b2),r_2\circ r_1(z) = a_2\conj{a_1}\,z + (a_2\conj{b_1} + b_2),

direct with angle θ2−θ1=2(θ22−θ12)\theta_2 - \theta_1 = 2\bigl(\tfrac{\theta_2}2 - \tfrac{\theta_1}2\bigr): twice the angle between the axes; parallel axes (θ1=θ2\theta_1 = \theta_2) give a translation.

10. A rotation of center cc and angle θ\theta is the product of two reflections in lines through cc making angle θ/2\theta/2 (question 9, read backwards); a translation tvt_v is the product of two reflections in parallel lines orthogonal to vv at distance ∥v∥/2\norm v/2; a reflection is one reflection; a glide reflection is a reflection composed with a translation, hence three. Maximum: three.

11. a=ia = \iu, b=1+ib = 1 + \iu: v=ab‾+b=i(1−i)+1+i=(1+i)+(1+i)=2+2i≠0v = a\conj b + b = \iu(1 - \iu) + 1 + \iu = (1 + \iu) + (1 + \iu) = 2 + 2\iu \neq 0: a glide reflection with glide vector v/2=1+iv/2 = 1 + \iu. The reflection r=t−(1+i)∘fr = t_{-(1+\iu)}\circ f is r(z)=iz‾r(z) = \iu\conj z, whose axis is the line at angle 12arg⁡i=π4\frac12\arg\iu = \frac\pi4: the line y=xy = x. So ff is the glide reflection of axis y=xy = x and vector (1,1)(1, 1).

12. f(z)=izf(z) = \iu z and g(z)=1+i(z−1)=iz+1−ig(z) = 1 + \iu(z - 1) = \iu z + 1 - \iu, so

g∘f(z)=i(iz)+1−i=−z+1−i:g\circ f(z) = \iu(\iu z) + 1 - \iu = -z + 1 - \iu :

linear coefficient −1=eiπ-1 = \eu^{\iu\pi}, a rotation of angle π\pi (a half-turn), of center z0=1−i1−(−1)=1−i2z_0 = \frac{1 - \iu}{1 - (-1)} = \frac{1 - \iu}{2}.

13. r2∘r1(z)=i z‾‾=izr_2\circ r_1(z) = \iu\,\conj{\conj z} = \iu z: the rotation of angle π2\frac\pi2 about 00. The axes (the real axis, angle 00; the line y=xy = x, angle π4\frac\pi4) meet at angle π4\frac\pi4, and twice that is π2\frac\pi2: question 9 confirmed.

14. With f=ta∘gf = t_a\circ g, gg linear, and ∑iλi=1\sum_i \lambda_i = 1:

f(∑iλixi)=a+∑iλi g(xi)=∑iλi(a+g(xi))=∑iλif(xi).f\Bigl(\sum_i \lambda_i x_i\Bigr) = a + \sum_i \lambda_i\,g(x_i) = \sum_i \lambda_i\bigl(a + g(x_i)\bigr) = \sum_i \lambda_i f(x_i) .

15. For h∈Gh \in G, using question 14 (the coefficients 1∣G∣\frac1{\abs G} sum to 11):

h(c)=1∣G∣∑g∈Gh(g(x0))=1∣G∣∑g′∈Gg′(x0)=c,h(c) = \frac{1}{\abs G}\sum_{g \in G} h\bigl(g(x_0)\bigr) = \frac{1}{\abs G}\sum_{g' \in G} g'(x_0) = c ,

because g↦hgg \mapsto hg is a bijection of GG onto itself.

16. The conjugates t−c g tct_{-c}\,g\,t_{c} (g∈Gg \in G) form a group of isometries fixing 00, hence of linear isometries (question 3): a finite subgroup of O(R2)O(\R^2). If some s∈Gs \in G is indirect, the map g↦sgg \mapsto sg sends G+G^+ injectively into G∖G+G\setminus G^+ and h↦s−1hh \mapsto s^{-1}h is its inverse (sign rule of question 5): ∣G∣=2 ∣G+∣\abs G = 2\,\abs{G^+}; otherwise G=G+G = G^+.

17. If G+={id}G^{+} = \{\mathrm{id}\}, it is C1C_1. Otherwise write its elements as RθR_\theta, θ∈[0, 2π)\theta \in \intco{0}{2\pi}, and let θ0\theta_0 be the smallest positive angle occurring. For Rθ∈G+R_\theta \in G^{+}, euclidean division θ=kθ0+ρ\theta = k\theta_0 + \rho with 0≤ρ<θ00 \leq \rho < \theta_0 gives Rρ=RθRθ0−k∈G+R_\rho = R_\theta R_{\theta_0}^{-k} \in G^{+}, so ρ=0\rho = 0 by minimality: G+=⟨Rθ0⟩G^{+} = \langle R_{\theta_0}\rangle. Dividing 2π2\pi by θ0\theta_0 the same way shows 2π=nθ02\pi = n\theta_0: G+≅CnG^{+} \cong C_n, generated by the rotation of angle 2πn\frac{2\pi}n.

18. G=G+∪sG+G = G^{+} \cup sG^{+} by the counting of question 16. With s(z)=az‾s(z) = a\conj z and r(z)=ωzr(z) = \omega z (linear forms, after question 16; ∣a∣=∣ω∣=1\abs a = \abs\omega = 1):

srs(z)=a ω az‾‾=aω‾a‾ z=ω‾ z=r−1(z).s r s(z) = a\,\conj{\omega\,a\conj z} = a\conj\omega\conj a\,z = \conj\omega\,z = r^{-1}(z) .

Each element srksr^k of sG+sG^{+} is indirect and satisfies (srk)2=(srks) rk=r−krk=id(sr^k)^2 = (sr^ks)\,r^k = r^{-k}r^k = \mathrm{id}: an involutive indirect isometry fixing cc, i.e. a reflection. So GG consists of nn rotations and nn reflections with the relations rn=s2=idr^n = s^2 = \mathrm{id}, srs=r−1srs = r^{-1}: the dihedral group DnD_n.

19. Combining: a finite group of plane isometries fixes a point cc (question 15), reduces to a finite subgroup of O(2)O(2) (question 16), and is CnC_n if it contains only rotations (question 17), DnD_n otherwise (question 18): Leonardo’s theorem.

20. A translation tv≠idt_v \neq \mathrm{id} has powers tkvt_{kv}, all distinct (kvkv pairwise distinct for v≠0v \neq 0): infinite order. A glide reflection ff has f2=tvf^2 = t_v with v≠0v \neq 0: again infinite order. Neither fits in a finite group — consistently with questions 15–19, which produced only rotations and reflections.

21. The 2n2n maps preserve the vertex set: ωkωj=ωk+j\omega^k \omega^j = \omega^{k+j} and ωkωj‾=ωk−j\omega^k\conj{\omega^j} = \omega^{k-j}; being isometries, they preserve the polygon (segments go to segments). Conversely, a symmetry preserves the barycenter 00 of the vertices (question 14), hence is linear, and permutes the vertices (they are the points of the polygon at maximal distance from 00). A linear isometry sending the vertex 11 to ωk\omega^k is z↦ωkzz \mapsto \omega^k z if direct, z↦ωkz‾z \mapsto \omega^k\conj z if indirect (its matrix is determined by one column and the sign): at most 2n2n symmetries, so exactly the DnD_n above.

22. C1C_1: a scalene triangle (no nontrivial symmetry). D1D_1: an isoceles, non-equilateral triangle (one reflection). D2D_2: a non-square rectangle (identity, the half-turn about the center, the two axis reflections). C3C_3: a triskelion — three congruent bent arms attached at 120120-degree intervals; the bend kills every reflection but leaves the rotations of order 33.

23. With ω=i\omega = \iu: the rotations z↦zz \mapsto z, iz\iu z, −z-z, −iz-\iu z (angles 0,π2,π,3π20, \frac\pi2, \pi, \frac{3\pi}2), and the reflections

z↦z‾ (axis y=0),iz‾ (y=x),−z‾ (x=0),−iz‾ (y=−x):z \mapsto \conj z \ (\text{axis } y = 0), \quad \iu\conj z \ (y = x), \quad -\conj z \ (x = 0), \quad -\iu\conj z \ (y = -x):

the two diagonals and the two medians of the square — the dihedral group D4D_4, of order 88.

24. Write a=eiθ≠1a = \eu^{\iu\theta} \neq 1: f(z)=az+c1(1−a)f(z) = az + c_1(1 - a) and g(z)=az+c2(1−a)g(z) = az + c_2(1 - a). Then

f∘g(z)−g∘f(z)=(1−a)(ac2+c1−ac1−c2)=−(1−a)2(c2−c1)≠0,f\circ g(z) - g\circ f(z) = (1-a)\bigl(ac_2 + c_1 - ac_1 - c_2\bigr) = -(1 - a)^2(c_2 - c_1) \neq 0 ,

so fg≠gff g \neq g f. Both compositions have linear coefficient a2a^2, so (fg)∘(gf)−1(fg)\circ(gf)^{-1} has linear coefficient 11: it is the translation by fg(z)−gf(z)fg(z) - gf(z), the nonzero constant above. A group containing ff and gg contains this translation and all its powers: it is infinite. Two rotation centers are one too many for a finite group — the geometric heart of Leonardo’s theorem.

25. (i) Questions 3–4 show every distance-preserving map is affine with orthogonal linear part, and question 15 pins every finite group to a fixed point: both results convert metric geometry into linear algebra at the origin. (ii) The complete list is translation, rotation, reflection, glide reflection; the determinant of the linear part separates direct from indirect, and the existence of fixed points separates the two types within each parity. (iii) By question 9, two reflections compose to any rotation or translation, so reflections generate the whole group — at most three suffice for any isometry. (iv) On the finite scale only two families survive, the cyclic and dihedral groups, which is why rosette ornaments come in exactly two kinds (with or without mirror axes). Part II proved the classification of plane isometries; Part IV proved Leonardo’s theorem.

Terms defined in this chapter

See all 395 terms in the glossary