Mathematics · Book 3 · Bachelor Year 1

University Mathematics — Year 1

University Mathematics — Year 1 · Bachelor Year 1

20Linear Maps

The maps worth studying between vector spaces are those compatible with the structure: linear maps. Their two fundamental subspaceskernel and image — measure injectivity and surjectivity, and in finite dimension the rank–nullity theorem binds their sizes into one conservation law. Projections and symmetries, then linear forms and hyperplanes, close the chapter.

20.1 Definitions and first properties

Definition 20.1

Let E,FE, F be KK-vector spaces. A map u ⁣:EFu \colon E \to F is linear when

x,yE, λK,u(x+λy)=u(x)+λu(y).\forall x, y \in E,\ \forall \lambda \in K, \qquad u(x + \lambda y) = u(x) + \lambda u(y).

Then u(0)=0u(0) = 0 and u(λixi)=λiu(xi)u(\sum \lambda_i x_i) = \sum \lambda_i u(x_i). The set L(E,F)\mathcal{L}(E, F) of linear maps is itself a vector space; composition of linear maps is linear, and bilinear in the pair. An endomorphism is a linear EEE \to E; an isomorphism is a bijective linear map (its inverse is then automatically linear); u1u^{-1} of an isomorphism, compositions of isomorphisms, are isomorphisms.

Proof that the inverse is linear. Let uu be linear bijective, y,yFy, y' \in F and λK\lambda \in K. Put x=u1(y)x = u^{-1}(y) and x=u1(y)x' = u^{-1}(y'). Then

u(x+λx)=u(x)+λu(x)=y+λy,u\bigl(x + \lambda x'\bigr) = u(x) + \lambda u(x') = y + \lambda y' ,

and applying u1u^{-1} to both ends: u1(y+λy)=x+λx=u1(y)+λu1(y)u^{-1}(y + \lambda y') = x + \lambda x' = u^{-1}(y) + \lambda\,u^{-1}(y'). Nothing about u1u^{-1} was computed: linearity transports through the defining property of uu alone — a pattern worth remembering, as structure often rides along bijections for free.

Proposition 20.2 (A linear map is known on a basis)

Let (e1,,en)(e_1, \dots, e_n) be a basis of EE and (v1,,vn)(v_1, \dots, v_n) arbitrary vectors of FF. There is exactly one linear map u ⁣:EFu \colon E \to F with u(ei)=viu(e_i) = v_i for all ii. Moreover:

u injective    (vi) free;u surjective    (vi) generates F.u \text{ injective} \iff (v_i) \text{ free}; \qquad u \text{ surjective} \iff (v_i) \text{ generates } F .

Proof. Existence/uniqueness: every xx has unique coordinates x=λieix = \sum \lambda_i e_i (Proposition 18.15); linearity forces u(x)=λiviu(x) = \sum \lambda_i v_i, and this formula does define a linear map.

Injectivity: by Proposition 20.5 below, uu is injective iff its kernel is trivial. Now u(λiei)=0u\bigl(\sum\lambda_i e_i\bigr) = 0 means exactly λivi=0\sum\lambda_i v_i = 0. If (vi)(v_i) is free, this forces every λi=0\lambda_i = 0, i.e. the kernel reduces to 00: injective. If (vi)(v_i) is linked, a nontrivial relation λivi=0\sum\lambda_i v_i = 0 produces the nonzero vector λiei\sum\lambda_i e_i in the kernel ((ei)(e_i) is free): not injective. The two conditions match term for term.

Surjectivity: the image of uu is the set of all λivi\sum\lambda_i v_i, i.e. exactly Vect(v1,,vn)\operatorname{Vect}(v_1, \dots, v_n), which equals FF iff the family generates.

Definition 20.3 (Kernel and image)

For uL(E,F)u \in \mathcal{L}(E, F):

keru={xE:u(x)=0}E,imu=u(E)F,\ker u = \{x \in E : u(x) = 0\} \subseteq E, \qquad \operatorname{im} u = u(E) \subseteq F ,

both subspaces (direct verification with the criterion).

Method 20.4 (Kernel and image, in practice)

Kernel: write u(x)=0u(x) = 0 as a system on the coordinates (or coefficients) of xx, solve, and parametrize — the kernel comes out with a basis attached (Method 19.10). Image: it is the span of the images of any generating family of EE — usually a basis, so imu=Vect(u(e1),,u(en))\operatorname{im} u = \operatorname{Vect}\bigl(u(e_1), \dots, u(e_n)\bigr); then eliminate redundant images to extract a basis. Shortcut: compute whichever of the two is easier and get the other’s dimension for free by rank–nullity (Theorem 20.7); when a plausible candidate subspace for the image is known, comparing dimensions upgrades the easy inclusion to equality (Theorem 19.14). Both shortcuts are used in Example 20.11 below.

Proposition 20.5

uu is injective     \iff keru={0}\ker u = \{0\}; uu is surjective     \iff imu=F\operatorname{im} u = F.

Proof. As for groups (Proposition 7.11): u(x)=u(y)    u(xy)=0    xykeruu(x) = u(y) \iff u(x - y) = 0 \iff x - y \in \ker u. The second point is the definition.

20.2 The rank–nullity theorem

Definition 20.6

The rank of uL(E,F)u \in \mathcal{L}(E, F) (with EE finite-dimensional) is rku=dimimu\operatorname{rk} u = \dim \operatorname{im} u — also the rank of the family (u(e1),,u(en))\bigl(u(e_1), \dots, u(e_n)\bigr) for any basis (ei)(e_i) of EE.

Theorem 20.7 (Rank–nullity)

Let EE be finite-dimensional and uL(E,F)u \in \mathcal{L}(E, F). Then

dimE=dimkeru+rku.\dim E = \dim \ker u + \operatorname{rk} u .

More precisely, if SS is any supplementary subspace of keru\ker u in EE, then uu restricts to an isomorphism from SS onto imu\operatorname{im} u.

Proof. Let SS satisfy E=keruSE = \ker u \oplus S (Theorem 19.14), and let v ⁣:Simuv \colon S \to \operatorname{im} u be the restriction of uu.

vv is injective: kerv=Skeru={0}\ker v = S \cap \ker u = \{0\}.

vv is surjective: any u(x)u(x) with x=k+sx = k + s (kkeruk \in \ker u, sSs \in S) equals u(s)=v(s)u(s) = v(s).

So vv is an isomorphism; an isomorphism sends a basis to a basis (Proposition 20.2), so dimS=dimimu\dim S = \dim\operatorname{im} u, and dimE=dimkeru+dimS\dim E = \dim\ker u + \dim S concludes.

Example 20.8 (Building a map to specification)

Construct uL(R3)u \in \mathcal{L}(\R^3) with keru=Vect(1,1,1)\ker u = \operatorname{Vect}(1,1,1) and imu={z=0}\operatorname{im} u = \{z = 0\}. Sanity first: rank–nullity demands 1+2=31 + 2 = 3 — consistent, so a solution may exist. Choose a basis adapted to the kernel, say ((1,1,1), e1, e2)\bigl((1,1,1),\ e_1,\ e_2\bigr) (Example 19.7), and prescribe images (Proposition 20.2):

u(1,1,1)=0,u(e1)=e1,u(e2)=e2.u(1,1,1) = 0, \qquad u(e_1) = e_1, \qquad u(e_2) = e_2 .

Then keruVect(1,1,1)\ker u \supseteq \operatorname{Vect}(1,1,1) and imu=Vect(e1,e2)={z=0}\operatorname{im} u = \operatorname{Vect}(e_1, e_2) = \{z = 0\}; rank–nullity forces dimkeru=1\dim\ker u = 1, so the kernel is exactly the prescribed line. Explicitly, decomposing (x,y,z)=z(1,1,1)+(xz)e1+(yz)e2(x, y, z) = z(1,1,1) + (x - z)e_1 + (y - z)e_2:

u(x,y,z)=(xz, yz, 0).u(x, y, z) = (x - z,\ y - z,\ 0).

The recipe generalizes: a linear map with prescribed kernel NN and image II exists exactly when dimN+dimI=dimE\dim N + \dim I = \dim E — necessity is rank–nullity, sufficiency is this construction.

Corollary 20.9

If dimE=dimF\dim E = \dim F (finite), then for uL(E,F)u \in \mathcal{L}(E, F):

u injective    u surjective    u bijective.u \text{ injective} \iff u \text{ surjective} \iff u \text{ bijective}.

In particular this holds for endomorphisms in finite dimension. (It fails in infinite dimension: on K[X]K[X], the derivative is surjective but not injective, and PXPP \mapsto XP is injective but not surjective.)

Proof. Injective     dimkeru=0    rku=dimE=dimF    imu=F\iff \dim\ker u = 0 \iff \operatorname{rk} u = \dim E = \dim F \iff \operatorname{im} u = F (a subspace of full dimension is everything, Theorem 19.14)     \iff surjective.

Example 20.10 (Interpolation, structurally)

Fix distinct x0,,xnx_0, \dots, x_n and let u ⁣:Rn[X]Rn+1u \colon \R_n[X] \to \R^{n+1}, P(P(x0),,P(xn))P \mapsto (P(x_0), \dots, P(x_n)): linear. Its kernel is {P:degPn, n+1 roots}={0}\{P : \deg P \leq n,\ n+1 \text{ roots}\} = \{0\} (Corollary 8.8). Equal dimensions n+1n + 1: uu is an isomorphism — existence and uniqueness of the Lagrange interpolant (Theorem 8.23) in one line.

The same one-line pattern handles data mixing values and derivatives: v ⁣:R3[X]R4v \colon \R_3[X] \to \R^4, P(P(0),P(0),P(1),P(1))P \mapsto \bigl(P(0), P'(0), P(1), P'(1)\bigr) is linear, and its kernel consists of degree-3\leq 3 polynomials with double roots at 00 and 11, i.e. divisible by X2(X1)2X^2(X-1)^2 of degree 44: only P=0P = 0. Equal dimensions again: every quadruple of data (P(0),P(0),P(1),P(1))(P(0), P'(0), P(1), P'(1)) is realized by exactly one cubic — Hermite interpolation, granted by a kernel computation before any formula is written (the weekend problem of Chapter 22 meets its determinant).

Example 20.11 (Rank–nullity at work: the difference operator)

Let Δ ⁣:Rn[X]Rn[X]\Delta \colon \R_n[X] \to \R_n[X], PP(X+1)P(X)P \mapsto P(X+1) - P(X): linear. Kernel: if ΔP=0\Delta P = 0, then P(0)=P(1)=P(2)=P(0) = P(1) = P(2) = \dots, so PP(0)P - P(0) has infinitely many roots and vanishes (Corollary 8.8): kerΔ\ker\Delta is the line of constants. Rank–nullity: rkΔ=(n+1)1=n\operatorname{rk}\Delta = (n + 1) - 1 = n. Since degΔP<degP\deg \Delta P < \deg P for nonconstant PP (the top terms cancel), imΔRn1[X]\operatorname{im}\Delta \subseteq \R_{n-1}[X], which has dimension exactly nn: the inclusion is an equality. Conclusion, with no computation of preimages: every polynomial QQ of degree n1\leq n - 1 is a difference Q=P(X+1)P(X)Q = P(X+1) - P(X) — the discrete antiderivative exists. (Compare the weekend problem of Chapter 18, where Δ\Delta was inverted explicitly in the binomial basis.)

Example 20.12 (Rank bookkeeping along a composition)

On R2[X]\R_2[X], compose the derivative D(P)=PD(P) = P' (rank 22: image R1[X]\R_1[X], kernel the constants) with itself. Then DD=D2D \circ D = D^2 maps PPP \mapsto P'', with image R0[X]\R_0[X]: rank 11. Compare with the general bounds: the crude one gives rkD2min(2,2)=2\operatorname{rk} D^2 \leq \min(2, 2) = 2; the exact formula of Exercise 20.12 accounts for the loss precisely,

rkD2=rkDdim(kerDimD)=21=1,\operatorname{rk} D^2 = \operatorname{rk} D - \dim\bigl(\ker D \cap \operatorname{im} D\bigr) = 2 - 1 = 1 ,

since the constants (kernel of the outer DD) sit inside R1[X]\R_1[X] (image of the inner DD) with dimension 11. Rank is lost exactly where the outer kernel ambushes the inner image — the sentence to remember when composition ranks misbehave.

Example 20.13 (Kernel and image of the Euler operator)

On Rn[X]\R_n[X], let u(P)=XPu(P) = X\,P' (linear: differentiation and multiplication by XX are). Kernel: XP=0XP' = 0 forces P=0P' = 0 (a product of polynomials vanishes only if one factor does), so keru\ker u is the line of constants. Image: on the monomial basis,

u(Xk)=kXk(k=0,1,,n),u(X^k) = k\,X^{k} \qquad (k = 0, 1, \dots, n),

so imu=Vect(X,2X2,,nXn)=Vect(X,X2,,Xn)\operatorname{im} u = \operatorname{Vect}(X, 2X^2, \dots, nX^n) = \operatorname{Vect}(X, X^2, \dots, X^n): the polynomials with zero constant term. Check against rank–nullity: rku=(n+1)1=n\operatorname{rk} u = (n + 1) - 1 = n, which is indeed the dimension found. Two remarks worth keeping. First, here imukeru=Rn[X]\operatorname{im} u \oplus \ker u = \R_n[X] — but that is a happy accident of this operator, not a theorem: for the shift-like v(P)=Pv(P) = P' on R1[X]\R_1[X], kerv=imv=R0[X]\ker v = \operatorname{im} v = \R_0[X] and the sum is not direct. Second, the relation u(Xk)=kXku(X^k) = kX^k says each monomial is merely rescaled by uu — a basis adapted to the map, the germ of the eigenvalue idea developed in the Year 2 volume.

20.3 Projections and symmetries

Definition 20.14

Let E=FGE = F \oplus G. The projection onto FF along GG maps x=f+gx = f + g (unique decomposition) to p(x)=fp(x) = f; the associated symmetry is s(x)=fgs(x) = f - g. Both are linear, and s=2pids = 2p - \mathrm{id}.

Theorem 20.15 (Algebraic characterization)

  1. An endomorphism pp is a projection (onto some FF along some GG) if and only if pp=pp \circ p = p; then F=imp=ker(pid)F = \operatorname{im} p = \ker(p - \mathrm{id}) and G=kerpG = \ker p.
  2. An endomorphism ss is a symmetry if and only if ss=ids \circ s = \mathrm{id}; then E=ker(sid)ker(s+id)E = \ker(s - \mathrm{id}) \oplus \ker(s + \mathrm{id}).

Proof. (1) A projection satisfies p(f+g)=fp(f + g) = f and p(f)=fp(f) = f: p2=pp^2 = p. Conversely, let p2=pp^2 = p; set F=impF = \operatorname{im} p, G=kerpG = \ker p. Every xx writes x=p(x)+(xp(x))x = p(x) + (x - p(x)) with p(x)Fp(x) \in F and p(xp(x))=p(x)p2(x)=0p\bigl(x - p(x)\bigr) = p(x) - p^2(x) = 0: E=F+GE = F + G. If yFGy \in F \cap G: y=p(z)y = p(z) and p(y)=0p(y) = 0, so y=p(z)=p2(z)=p(y)=0y = p(z) = p^2(z) = p(y) = 0: direct sum, and pp is the projection onto FF along GG. Finally on FF: y=p(z)y = p(z) gives p(y)=yp(y) = y, so Fker(pid)F \subseteq \ker(p - \mathrm{id}), and conversely p(y)=yp(y) = y puts yy in the image.

(2) The correspondence s=2pids = 2p - \mathrm{id}, p=s+id2p = \frac{s + \mathrm{id}}2 is a bijection between endomorphisms, and under it

s2=4p24p+id=id    4p2=4p    p2=p:s^2 = 4p^2 - 4p + \mathrm{id} = \mathrm{id} \iff 4p^2 = 4p \iff p^2 = p :

symmetries correspond exactly to projections. Translating the subspaces: s(x)=x    p(x)=xs(x) = x \iff p(x) = x, so ker(sid)=imp=F\ker(s - \mathrm{id}) = \operatorname{im} p = F; and s(x)=x    2p(x)=0    xkerp=Gs(x) = -x \iff 2p(x) = 0 \iff x \in \ker p = G, so ker(s+id)=G\ker(s + \mathrm{id}) = G. The direct sum E=FGE = F \oplus G of point (1) becomes the announced decomposition into the fixed vectors and the reversed vectors of ss.

Example 20.16 (A projection and its symmetry, explicitly)

In R2\R^2, project onto F=Vect(1,1)F = \operatorname{Vect}(1,1) along G=Vect(0,1)G = \operatorname{Vect}(0,1). Decompose (x,y)=a(1,1)+b(0,1)(x, y) = a(1,1) + b(0,1): the first coordinate gives a=xa = x, the second b=yxb = y - x. Hence

p(x,y)=(x,x),s(x,y)=2p(x,y)(x,y)=(x, 2xy).p(x, y) = (x, x), \qquad s(x, y) = 2p(x,y) - (x,y) = (x,\ 2x - y).

Check the algebra: p(p(x,y))=p(x,x)=(x,x)p(p(x,y)) = p(x,x) = (x,x), and s(s(x,y))=s(x,2xy)=(x,2x(2xy))=(x,y)s(s(x,y)) = s(x, 2x - y) = (x, 2x - (2x - y)) = (x, y). Geometrically, ss is the “oblique reflection” across the line y=xy = x in the vertical direction: it fixes FF pointwise and reverses GG. Had we projected onto the same FF along G=Vect(1,1)G' = \operatorname{Vect}(1,-1) instead, the formula would change to p(x,y)=(x+y2,x+y2)p'(x,y) = \bigl(\frac{x+y}2, \frac{x+y}2\bigr): a projection is determined by its image and its kernel, never by the image alone.

The projection onto F = Vect(1,1) along G = Vect(0,1) and its symmetry, on the point M = (2,\ 0.5): sliding vertically, M hits F at p(M) = (2,2) and lands at s(M) = 2p(M) - M = (2,\ 3.5), as far above F (measured along G) as M was below.
The projection onto F=Vect(1,1)F = \operatorname{Vect}(1,1) along G=Vect(0,1)G = \operatorname{Vect}(0,1) and its symmetry, on the point M=(2, 0.5)M = (2,\ 0.5): sliding vertically, MM hits FF at p(M)=(2,2)p(M) = (2,2) and lands at s(M)=2p(M)M=(2, 3.5)s(M) = 2p(M) - M = (2,\ 3.5), as far above FF (measured along GG) as MM was below.

20.4 Linear forms and hyperplanes

Definition 20.17

A linear form on EE is a linear map φ ⁣:EK\varphi \colon E \to K. A hyperplane of EE (dimE=n\dim E = n) is a subspace of dimension n1n - 1.

Example 20.18 (An evaluation form and its hyperplane)

On R2[X]\R_2[X], the evaluation φ(P)=P(2)\varphi(P) = P(2) is a linear form, nonzero (φ(1)=1\varphi(1) = 1). Its kernel is the hyperplane of polynomials vanishing at 22, i.e. (factor theorem, Theorem 8.7) the multiples of X2X - 2 within R2[X]\R_2[X]:

kerφ=Vect(X2, X(X2)),dim=2.\ker\varphi = \operatorname{Vect}\bigl(X - 2,\ X(X - 2)\bigr), \qquad \dim = 2 .

In coordinates on (1,X,X2)(1, X, X^2), φ(a+bX+cX2)=a+2b+4c\varphi(a + bX + cX^2) = a + 2b + 4c: every linear form on a finite-dimensional space is, once a basis is fixed, a fixed linear expression in the coordinates — forms are “row vectors”, as Chapter 21 will make literal, and the coefficient row here, (1,2,4)(1, 2, 4), is a Vandermonde row: evaluation forms are how the interpolation theory of Chapter 22’s weekend problem enters linear algebra.

Theorem 20.19

The hyperplanes of EE are exactly the kernels of nonzero linear forms. Two nonzero forms have the same kernel if and only if they are proportional.

Proof. If φ0\varphi \neq 0: rkφ=1\operatorname{rk}\varphi = 1 (image a nonzero subspace of KK), so dimkerφ=n1\dim\ker\varphi = n - 1: a hyperplane. Conversely, let HH be a hyperplane, (e1,,en1)(e_1, \dots, e_{n-1}) a basis of HH completed by ene_n: the form “last coordinate” has kernel HH.

Proportional forms share their kernel. Conversely, suppose kerφ=kerψ=H\ker\varphi = \ker\psi = H and pick aHa \notin H: every xx writes x=h+λax = h + \lambda a (as E=HKaE = H \oplus Ka), and

φ(x)=λφ(a),ψ(x)=λψ(a):\varphi(x) = \lambda \varphi(a), \qquad \psi(x) = \lambda\psi(a):

so φ=φ(a)ψ(a)ψ\varphi = \frac{\varphi(a)}{\psi(a)}\,\psi.

Example 20.20

In KnK^n, a hyperplane is a solution set {a1x1++anxn=0}\{a_1 x_1 + \dots + a_n x_n = 0\} with not all aia_i zero — the familiar equation of a plane through the origin in R3\R^3. In function spaces, evaluation forms PP(1)P \mapsto P(1) or f01ff \mapsto \int_0^1 f define hyperplanes of Rn[X]\R_n[X], of C([0,1])C(\intcc{0}{1}) (cf. Exercise 19.6).

Example 20.21 (One hyperplane, worked three ways)

Take φ(x,y,z)=x2y+3z\varphi(x, y, z) = x - 2y + 3z on R3\R^3 and H=kerφH = \ker\varphi. Basis: solve x=2y3zx = 2y - 3z:

(2y3z, y, z)=y(2,1,0)+z(3,0,1),(2y - 3z,\ y,\ z) = y\,(2, 1, 0) + z\,(-3, 0, 1),

two free vectors: dimH=2\dim H = 2, a hyperplane, as Theorem 20.19 predicts from φ0\varphi \neq 0. Supplementary line: any vector outside HH spans one, e.g. a=(1,0,0)a = (1, 0, 0) (φ(a)=10\varphi(a) = 1 \neq 0); the decomposition of an arbitrary vv is explicit:

v=(vφ(v)a)H+φ(v)aVect(a),v = \underbrace{\bigl(v - \varphi(v)\,a\bigr)}_{\in\,H} + \underbrace{\varphi(v)\,a}_{\in\,\operatorname{Vect}(a)},

since φ(vφ(v)a)=φ(v)φ(v)φ(a)=0\varphi\bigl(v - \varphi(v)a\bigr) = \varphi(v) - \varphi(v)\varphi(a) = 0. Proportionality: if ψ(x,y,z)=2x+4y6z\psi(x,y,z) = -2x + 4y - 6z, then ψ=2φ\psi = -2\varphi and both have kernel HH; conversely, any form vanishing on HH is a multiple of φ\varphi (Exercise 20.8) — the equation of a hyperplane is unique up to scale, a fact used constantly for planes in geometry.

Remark 20.22 (Common pitfalls)

Kernel and image live in different spaces: keruE\ker u \subseteq E, imuF\operatorname{im} u \subseteq F; the sum keru+imu\ker u + \operatorname{im} u only makes sense for endomorphisms, and even then it need not be direct (u(x,y)=(y,0)u(x, y) = (y, 0) has keru=imu\ker u = \operatorname{im} u; Exercise 20.7 characterizes when directness holds). u2=0u^2 = 0 does not mean u=0u = 0: the same u(x,y)=(y,0)u(x,y) = (y, 0) squares to zero without vanishing — what u2=0u^2 = 0 really says is imukeru\operatorname{im} u \subseteq \ker u (Exercise 20.5). Injective     \iff surjective needs equal finite dimensions: on K[X]K[X], the derivative is surjective and not injective, PXPP \mapsto XP injective and not surjective (Corollary 20.9); and between spaces of different dimensions, one implication is simply impossible (rkumin(dimE,dimF)\operatorname{rk} u \leq \min(\dim E, \dim F)). Prescribing images works on a basis, not on any family: demanding u(1,0)=au(1, 0) = a, u(0,1)=bu(0, 1) = b, u(1,1)=cu(1, 1) = c overdetermines uu unless c=a+bc = a + b; a linear map is free on a basis, enslaved everywhere else. Rank is not preserved by composition: it can only drop, rk(vu)min(rku,rkv)\operatorname{rk}(vu) \leq \min(\operatorname{rk} u, \operatorname{rk} v) (Exercise 20.4), with exact loss measured in Exercise 20.12.

Remark 20.23 (Where these maps go)

Linear maps are about to become matrices: once bases are fixed, Chapter 21 encodes every uL(E,F)u \in \mathcal{L}(E, F) by a rectangular array, and composition becomes the matrix product — rank–nullity then drives the theory of linear systems in Chapter 22. Projections return in Chapter 23 in their most useful special case, the orthogonal projection, where the kernel is chosen perpendicular to the image. The weekend problem below pushes the projector algebra as far as first-year tools reach, up to Fitting’s lemma; the Year 2 volume goes further with the trace and with eigenvalue theory, for which projectors onto stable subspaces are the basic building blocks.

Remark 20.24 (Perspectives inside Book 3: rank–nullity three more times)

The conservation law dimE=dimkeru+rku\dim E = \dim\ker u + \operatorname{rk} u will be re-read three times before the volume ends. In Chapter 22 it becomes the shape of solution sets: a compatible system with pp unknowns and rank rr has a solution set of dimension prp - rkernel dimension in disguise. In Chapter 23 it splits orthogonally, dimF+dimF=dimE\dim F + \dim F^\perp = \dim E, and powers every distance computation. In the weekend problem of Chapter 25, it is the accountant of least squares: nn observations, 22 fitted parameters, n2n - 2 residual dimensions, and the Pythagorean identity b2=p2+bp2\norm b^2 = \norm p^2 + \norm{b - p}^2 is rank–nullity’s Euclidean shadow. One theorem, four costumes.

20.5 Exercises

Exercise 20.1

Which maps are linear?

  1. R2R2\R^2 \to \R^2, (x,y)(x+y,x2y)(x, y) \mapsto (x + y, x - 2y);
  2. R2R\R^2 \to \R, (x,y)xy(x, y) \mapsto xy;
  3. R[X]R[X]\R[X] \to \R[X], PP+XPP \mapsto P' + XP;
  4. F(R,R)R\mathcal{F}(\R,\R) \to \R, ff(3)f \mapsto f(3).
Solution

Solution of Exercise 20.1.

(1) Linear: coordinates are linear expressions. (2) Not linear: u(2(1,1))=42=2u(1,1)u(2(1,1)) = 4 \neq 2 = 2u(1,1). (3) Linear: differentiation and multiplication by XX are, and sums of linear maps are. (4) Linear: evaluation respects pointwise operations.

Exercise 20.2

Let u ⁣:R3R3u \colon \R^3 \to \R^3, (x,y,z)(x+yz,  2x+y+z,  3x+2y)(x,y,z) \mapsto (x + y - z,\; 2x + y + z,\; 3x + 2y). Determine keru\ker u (basis, dimension), rku\operatorname{rk} u, and a basis of imu\operatorname{im} u. Is uu injective? surjective?

Solution

Solution of Exercise 20.2.

Kernel: solve x+yz=0x + y - z = 0, 2x+y+z=02x + y + z = 0, 3x+2y=03x + 2y = 0. From the third, y=3x2y = -\frac{3x}{2}; the first gives z=x+y=x2z = x + y = -\frac x2; check in the second: 2x3x2x2=02x - \frac{3x}{2} - \frac x2 = 0: satisfied. So keru=Vect((2,3,1))\ker u = \operatorname{Vect}\bigl((2, -3, -1)\bigr) (taking x=2x = 2), dimension 11.

Rank–nullity: rku=31=2\operatorname{rk} u = 3 - 1 = 2. Image: spanned by the images of the canonical basis, u(e1)=(1,2,3)u(e_1) = (1,2,3), u(e2)=(1,1,2)u(e_2) = (1,1,2), u(e3)=(1,1,0)u(e_3) = (-1,1,0); the first two are free, and the rank is 22: basis ((1,2,3),(1,1,2))\bigl((1,2,3), (1,1,2)\bigr).

Not injective (ker{0}\ker \neq \{0\}), not surjective (rank 2<32 < 3): consistent with Corollary 20.9.

Exercise 20.3

Let u ⁣:Rn[X]Rn[X]u \colon \R_n[X] \to \R_n[X], PPPP \mapsto P - P'. Prove that uu is an isomorphism: once via keru\ker u, once by exhibiting the inverse (consider P+P+P+P + P' + P'' + \dots).

Solution

Solution of Exercise 20.3.

Kernel: P=PP = P' forces degP=degP\deg P = \deg P' unless P=0P = 0; but degP<degP\deg P' < \deg P for P0P \neq 0: so keru={0}\ker u = \{0\}, and uu, an injective endomorphism of the finite-dimensional Rn[X]\R_n[X], is an isomorphism (Corollary 20.9).

Inverse: let v(P)=P+P+P++P(n)v(P) = P + P' + P'' + \dots + P^{(n)} (a finite sum on Rn[X]\R_n[X]). Then

v(u(P))=k=0n(PP)(k)=k=0nP(k)k=0nP(k+1)=PP(n+1)=P,v\bigl(u(P)\bigr) = \sum_{k=0}^{n} (P - P')^{(k)} = \sum_{k=0}^{n} P^{(k)} - \sum_{k=0}^{n} P^{(k+1)} = P - P^{(n+1)} = P ,

telescoping, since P(n+1)=0P^{(n+1)} = 0. So v=u1v = u^{-1}.

Exercise 20.4

Let uL(E,F)u \in \mathcal{L}(E, F) and vL(F,G)v \in \mathcal{L}(F, G), spaces finite-dimensional. Prove:

rk(vu)min(rku, rkv).\operatorname{rk}(v \circ u) \leq \min\bigl(\operatorname{rk} u,\ \operatorname{rk} v\bigr).
Solution

Solution of Exercise 20.4.

im(vu)=v(imu)imv\operatorname{im}(v \circ u) = v(\operatorname{im} u) \subseteq \operatorname{im} v: rank rkv\leq \operatorname{rk} v. And vv restricted to imu\operatorname{im} u has image im(vu)\operatorname{im}(vu) with rank–nullity inside imu\operatorname{im} u: rk(vu)dimimu=rku\operatorname{rk}(vu) \leq \dim\operatorname{im} u = \operatorname{rk} u.

Exercise 20.5 ★★

Let uu be an endomorphism of EE (finite-dimensional) with u2=0u^2 = 0. Prove that imukeru\operatorname{im} u \subseteq \ker u, hence rkudimE2\operatorname{rk} u \leq \frac{\dim E}{2}. For E=R2E = \R^2, give an example with equality.

Solution

Solution of Exercise 20.5.

u2=0u^2 = 0 means u(u(x))=0u(u(x)) = 0 for all xx: every u(x)u(x) lies in keru\ker u, i.e. imukeru\operatorname{im} u \subseteq \ker u. Then rank–nullity:

dimE=dimkeru+rku2rku.\dim E = \dim\ker u + \operatorname{rk} u \geq 2\operatorname{rk} u .

Equality example in R2\R^2: u(x,y)=(y,0)u(x, y) = (y, 0): u2=0u^2 = 0, rku=1=dimE2\operatorname{rk} u = 1 = \frac{\dim E}{2}.

Exercise 20.6 ★★

Let p,qp, q be projections of EE with pq=qpp \circ q = q \circ p. Prove that pqp \circ q is a projection, with

im(pq)=impimq,ker(pq)=kerp+kerq.\operatorname{im}(pq) = \operatorname{im} p \cap \operatorname{im} q , \qquad \ker (pq) = \ker p + \ker q .
Solution

Solution of Exercise 20.6.

(pq)2=pqpq=ppqq=pq(pq)^2 = pqpq = ppqq = pq (commutation): a projection (Theorem 20.15).

Image: im(pq)imp\operatorname{im}(pq) \subseteq \operatorname{im} p, and =im(qp)imq= \operatorname{im}(qp) \subseteq \operatorname{im} q: contained in the intersection. Conversely, if ximpimqx \in \operatorname{im} p \cap \operatorname{im} q, then p(x)=xp(x) = x and q(x)=xq(x) = x (fixed points characterize the image of a projection), so pq(x)=xpq(x) = x: xim(pq)x \in \operatorname{im}(pq).

Kernel: kerpker(qp)=ker(pq)\ker p \subseteq \ker(qp) = \ker(pq) and likewise kerqker(pq)\ker q \subseteq \ker(pq): the sum is contained. Conversely, let pq(x)=0pq(x) = 0, and write

x=q(x)kerp+(xq(x))kerq:x = \underbrace{q(x)}_{\in\, \ker p} + \underbrace{(x - q(x))}_{\in\, \ker q} :

the first term satisfies p(q(x))=0p(q(x)) = 0, so it lies in kerp\ker p; the second is in kerq\ker q since q(xq(x))=q(x)q2(x)=0q(x - q(x)) = q(x) - q^2(x) = 0. Hence xkerp+kerqx \in \ker p + \ker q.

Exercise 20.7 ★★

Let uL(E)u \in \mathcal{L}(E), EE finite-dimensional. Prove the equivalence of:

  1. E=keruimuE = \ker u \oplus \operatorname{im} u;
  2. keru=keru2\ker u = \ker u^2;
  3. imu=imu2\operatorname{im} u = \operatorname{im} u^2.
Solution

Solution of Exercise 20.7.

Note first the general inclusions kerukeru2\ker u \subseteq \ker u^2 and imu2imu\operatorname{im} u^2 \subseteq \operatorname{im} u, and by rank–nullity, (2)     \iff (3) (equal kernels     \iff equal ranks     \iff equal images, given the inclusions).

(1 \Rightarrow 2): let u2(x)=0u^2(x) = 0; then u(x)keruimu={0}u(x) \in \ker u \cap \operatorname{im} u = \{0\}, so xkerux \in \ker u.

(2 \Rightarrow 1): by Grassmann and rank–nullity, dim(keru+imu)=dimkeru+rkudim(keruimu)=dimEdim(keruimu)\dim(\ker u + \operatorname{im} u) = \dim\ker u + \operatorname{rk} u - \dim(\ker u \cap \operatorname{im} u) = \dim E - \dim(\ker u \cap \operatorname{im} u): the sum is EE iff the intersection is {0}\{0\}. Let ykeruimuy \in \ker u \cap \operatorname{im} u: y=u(x)y = u(x) and u(y)=0u(y) = 0, so u2(x)=0u^2(x) = 0, so (by (2)) u(x)=0u(x) = 0: y=0y = 0. Hence E=keruimuE = \ker u \oplus \operatorname{im} u.

Exercise 20.8 ★★

Let φ,ψ\varphi, \psi be linear forms on EE with kerφkerψ\ker\varphi \subseteq \ker\psi. Prove ψ=λφ\psi = \lambda\varphi for some λK\lambda \in K (including the degenerate cases).

Solution

Solution of Exercise 20.8.

If φ=0\varphi = 0: then kerφ=Ekerψ\ker\varphi = E \subseteq \ker\psi forces ψ=0=0φ\psi = 0 = 0\cdot\varphi. If φ0\varphi \neq 0: kerφ\ker\varphi is a hyperplane; pick akerφa \notin \ker\varphi. Set λ=ψ(a)φ(a)\lambda = \frac{\psi(a)}{\varphi(a)}. The form ψλφ\psi - \lambda\varphi vanishes on kerφ\ker\varphi (both do, by the inclusion) and at aa: it vanishes on kerφKa=E\ker\varphi \oplus Ka = E. So ψ=λφ\psi = \lambda\varphi.

Exercise 20.9 ★★★

Let uL(E)u \in \mathcal{L}(E) with dimE=n\dim E = n, and suppose un=0u^n = 0 but un10u^{n-1} \neq 0 (a maximally nilpotent endomorphism). Pick xx with un1(x)0u^{n-1}(x) \neq 0; prove that (x,u(x),,un1(x))\bigl(x, u(x), \dots, u^{n-1}(x)\bigr) is a basis of EE. (Apply powers of uu to a null combination, starting with un1u^{n-1}.)

Solution

Solution of Exercise 20.9.

Suppose λ0x+λ1u(x)++λn1un1(x)=0\lambda_0 x + \lambda_1 u(x) + \dots + \lambda_{n-1} u^{n-1}(x) = 0. Apply un1u^{n-1}: all terms with a factor unu^{\geq n} die, leaving λ0un1(x)=0\lambda_0 u^{n-1}(x) = 0, so λ0=0\lambda_0 = 0. Apply un2u^{n-2} to the remaining relation: λ1un1(x)=0\lambda_1 u^{n-1}(x) = 0, so λ1=0\lambda_1 = 0; and so on. The family is free; being of size n=dimEn = \dim E, it is a basis (Proposition 19.8). (In this basis, uu acts as a shift — the model of maximal nilpotence.)

Exercise 20.10 ★★★

Let fL(Rn)f \in \mathcal{L}(\R^n) with ff=idf \circ f = -\mathrm{id}.

  1. Prove that ff is an isomorphism and that no x0x \neq 0 satisfies f(x)=λxf(x) = \lambda x with λR\lambda \in \R.
  2. Prove that nn is even. Hint: pick x10x_1 \neq 0; show Vect(x1,f(x1))\operatorname{Vect}(x_1, f(x_1)) is a plane stable under ff; choose x2x_2 outside it and iterate, proving that (x1,f(x1),x2,f(x2),)\bigl(x_1, f(x_1), x_2, f(x_2), \dots\bigr) stays free.
Solution

Solution of Exercise 20.10.

  1. ff=idf \circ f = -\mathrm{id} is bijective, so ff is (Proposition 1.26 adapted: ff has the two-sided inverse f-f). If f(x)=λxf(x) = \lambda x with x0x \neq 0: applying ff, x=λ2x-x = \lambda^2 x, so λ2=1\lambda^2 = -1: impossible in R\R.
  2. Build the family greedily. Take x10x_1 \neq 0: (x1,f(x1))(x_1, f(x_1)) is free by (1). If Vect\operatorname{Vect} of the current family (x1,f(x1),,xk,f(xk))\bigl(x_1, f(x_1), \dots, x_k, f(x_k)\bigr), call it VkV_k — a subspace stable under ff (each generator maps to another generator or its negative: f(f(xi))=xif(f(x_i)) = -x_i) — is not all of EE, choose xk+1Vkx_{k+1} \notin V_k. Claim: the enlarged family is free. Suppose αxk+1+βf(xk+1)+v=0\alpha x_{k+1} + \beta f(x_{k+1}) + v = 0 with vVkv \in V_k and (α,β)(0,0)(\alpha, \beta) \neq (0,0). Apply ff: αf(xk+1)βxk+1+f(v)=0\alpha f(x_{k+1}) - \beta x_{k+1} + f(v) = 0 with f(v)Vkf(v) \in V_k. Eliminate f(xk+1)f(x_{k+1}) between the two relations (multiply the first by α\alpha, the second by β-\beta, and add):

    (α2+β2)xk+1Vk,(\alpha^2 + \beta^2)\, x_{k+1} \in V_k ,

    and α2+β20\alpha^2 + \beta^2 \neq 0 forces xk+1Vkx_{k+1} \in V_k: contradiction. So the construction continues, adding vectors two at a time, until Vk=EV_k = E: the final family is a basis of even size, and nn is even.

Exercise 20.11 ★★

Let u,vL(E,F)u, v \in \mathcal{L}(E, F), spaces finite-dimensional. Prove the two-sided bound

rkurkv    rk(u+v)    rku+rkv.\abs{\operatorname{rk} u - \operatorname{rk} v} \;\leq\; \operatorname{rk}(u + v) \;\leq\; \operatorname{rk} u + \operatorname{rk} v .

(For the upper bound, compare im(u+v)\operatorname{im}(u+v) with imu+imv\operatorname{im} u + \operatorname{im} v; for the lower one, apply the upper bound cleverly.)

Solution

Solution of Exercise 20.11.

Upper bound: for every xx, (u+v)(x)=u(x)+v(x)imu+imv(u + v)(x) = u(x) + v(x) \in \operatorname{im} u + \operatorname{im} v, so

rk(u+v)dim(imu+imv)rku+rkv\operatorname{rk}(u + v) \leq \dim(\operatorname{im} u + \operatorname{im} v) \leq \operatorname{rk} u + \operatorname{rk} v

(Grassmann, Theorem 19.18). Lower bound: apply the upper bound to the pair (u+v,v)(u + v, -v), whose sum is uu:

rkurk(u+v)+rk(v)=rk(u+v)+rkv,\operatorname{rk} u \leq \operatorname{rk}(u + v) + \operatorname{rk}(-v) = \operatorname{rk}(u + v) + \operatorname{rk} v,

so rkurkvrk(u+v)\operatorname{rk} u - \operatorname{rk} v \leq \operatorname{rk}(u+v); exchanging uu and vv gives the absolute value.

Exercise 20.12 ★★★

(Frobenius’ inequality) Let uL(E,F)u \in \mathcal{L}(E, F), wL(F,G)w \in \mathcal{L}(F, G) and vL(G,H)v \in \mathcal{L}(G, H), all spaces finite-dimensional. Prove the exact formula

rk(vw)=rkwdim(kervimw),\operatorname{rk}(v \circ w) = \operatorname{rk} w - \dim\bigl(\ker v \cap \operatorname{im} w\bigr),

and deduce Frobenius’ inequality

rk(vw)+rk(wu)    rkw+rk(vwu).\operatorname{rk}(v \circ w) + \operatorname{rk}(w \circ u) \;\leq\; \operatorname{rk} w + \operatorname{rk}(v \circ w \circ u) .

Check that the case w=idFw = \mathrm{id}_F is Sylvester’s inequality, proved in matrix form in Exercise 21.10.

Solution

Solution of Exercise 20.12.

Exact formula. Let vv' be the restriction of vv to the subspace imw\operatorname{im} w. Its image is v(w(F))=im(vw)v(w(F)) = \operatorname{im}(v \circ w), and its kernel is kervimw\ker v \cap \operatorname{im} w. Rank–nullity for vv' on the space imw\operatorname{im} w:

rkw=dimimw=rk(vw)+dim(kervimw).\operatorname{rk} w = \dim\operatorname{im} w = \operatorname{rk}(v \circ w) + \dim(\ker v \cap \operatorname{im} w) .

Frobenius. Apply the exact formula twice, to ww and to wuw \circ u:

rkwrk(vw)=dim(kervimw),rk(wu)rk(vwu)=dim(kervim(wu)).\operatorname{rk} w - \operatorname{rk}(vw) = \dim\bigl(\ker v \cap \operatorname{im} w\bigr), \qquad \operatorname{rk}(wu) - \operatorname{rk}(vwu) = \dim\bigl(\ker v \cap \operatorname{im}(wu)\bigr) .

Since im(wu)imw\operatorname{im}(w \circ u) \subseteq \operatorname{im} w, the second intersection is contained in the first, and its dimension is no larger:

rk(wu)rk(vwu)    rkwrk(vw),\operatorname{rk}(wu) - \operatorname{rk}(vwu) \;\leq\; \operatorname{rk} w - \operatorname{rk}(vw) ,

which rearranges into Frobenius’ inequality. With w=idFw = \mathrm{id}_F (rank dimF\dim F, and imidF=F\operatorname{im}\, \mathrm{id}_F = F): rkv+rkudimF+rk(vu)\operatorname{rk} v + \operatorname{rk} u \leq \dim F + \operatorname{rk}(vu), Sylvester’s inequality — proved again, in matrix form, in Exercise 21.10.

20.6 Problem: projector calculus and Fitting’s lemma

Problem 20.1

Projections are the endomorphisms that direct sums produce, and conversely: every identity E=F1FkE = F_1 \oplus \dots \oplus F_k is secretly a family of projectors summing to the identity. This problem develops that dictionary — the algebra of one projector, of two, of kk — then applies the same stabilization ideas to an arbitrary endomorphism and proves Fitting’s lemma: every endomorphism of a finite-dimensional space splits into a nilpotent part and an invertible part. Throughout, EE is a KK-vector space of dimension nn, and projector means pL(E)p \in \mathcal{L}(E) with p2=pp^2 = p (Theorem 20.15).

Part I — The algebra around one projector. Let pp be a projector, p0p \neq 0, pidp \neq \mathrm{id}.

  1. Show that idp\mathrm{id} - p is a projector and identify im(idp)\operatorname{im}(\mathrm{id} - p) and ker(idp)\ker(\mathrm{id} - p).
  2. Compute (λid+μp)2(\lambda\,\mathrm{id} + \mu\,p)^2 and determine all pairs (λ,μ)K2(\lambda, \mu) \in K^2 for which λid+μp\lambda\,\mathrm{id} + \mu\,p is a projector.
  3. Show that the plane Vect(id,p)\operatorname{Vect}(\mathrm{id}, p) of L(E)\mathcal{L}(E) is stable under composition, and that for every polynomial QK[X]Q \in K[X],

    Q(p)=Q(0)id+(Q(1)Q(0))p.Q(p) = Q(0)\,\mathrm{id} + \bigl(Q(1) - Q(0)\bigr)\,p .
  4. Determine for which (λ,μ)(\lambda, \mu) the map λid+μp\lambda\,\mathrm{id} + \mu\,p is invertible, and give its inverse in the form αid+βp\alpha\,\mathrm{id} + \beta\,p. Interpret the answer through the action of λid+μp\lambda\,\mathrm{id} + \mu\,p on imp\operatorname{im} p and on kerp\ker p.
  5. Let pp' be another projector with the same image imp=imp\operatorname{im} p' = \operatorname{im} p. Show that pp=pp\,p' = p' and pp=pp'\,p = p. What do these identities say about composing projections onto the same subspace along different kernels?

Part II — Two projectors. Let p,qp, q be projectors of EE; assume the characteristic is not 22 (true for K=R,CK = \R, \C).

  1. Suppose p+qp + q is a projector. Expanding (p+q)2(p + q)^2, show pq+qp=0pq + qp = 0; composing with pp on the left, then on the right, deduce pq=qppq = qp, and conclude pq=qp=0pq = qp = 0.
  2. Conversely, suppose pq=qp=0pq = qp = 0. Show that p+qp + q is a projector, with

    im(p+q)=impimq,ker(p+q)=kerpkerq.\operatorname{im}(p + q) = \operatorname{im} p \oplus \operatorname{im} q, \qquad \ker(p + q) = \ker p \cap \ker q .
  3. Show that pqp - q is a projector if and only if pq=qp=qpq = qp = q. (Apply questions 6–7 to idp\mathrm{id} - p and qq.)
  4. Show the geometric meaning of pq=qp=qpq = qp = q: it holds if and only if imqimp\operatorname{im} q \subseteq \operatorname{im} p and kerpkerq\ker p \subseteq \ker q. (One then writes qpq \leq p: “qq projects onto less, along more”.)
  5. Now let p,qp, q commute. Recall from Exercise 20.6 that pqpq is the projector onto impimq\operatorname{im} p \cap \operatorname{im} q along kerp+kerq\ker p + \ker q. Show that r=p+qpqr = p + q - pq is a projector with

    imr=imp+imq,kerr=kerpkerq.\operatorname{im} r = \operatorname{im} p + \operatorname{im} q, \qquad \ker r = \ker p \cap \ker q .

    (Consider idr=(idp)(idq)\mathrm{id} - r = (\mathrm{id} - p)(\mathrm{id} - q).)

Part III — Decompositions of the identity.

  1. Let E=F1FkE = F_1 \oplus \dots \oplus F_k and, for x=x1++xkx = x_1 + \dots + x_k (unique decomposition, xiFix_i \in F_i), set pi(x)=xip_i(x) = x_i. Show that each pip_i is a projector, that pipj=0p_i p_j = 0 for iji \neq j, and that p1++pk=idp_1 + \dots + p_k = \mathrm{id}; identify impi\operatorname{im} p_i and kerpi\ker p_i.
  2. Conversely, let p1,,pkL(E)p_1, \dots, p_k \in \mathcal{L}(E) satisfy p1++pk=idp_1 + \dots + p_k = \mathrm{id} and pipj=0p_i p_j = 0 for all iji \neq j. Show that each pip_i is a projector and that E=imp1impkE = \operatorname{im} p_1 \oplus \dots \oplus \operatorname{im} p_k.
  3. Two projectors with p+q=idp + q = \mathrm{id}: show that pq=qp=0pq = qp = 0 holds automatically.
  4. Three projectors with p+q+r=idp + q + r = \mathrm{id}: show that p+qp + q is a projector, and deduce from question 6 that all pairwise products vanish — hence E=impimqimrE = \operatorname{im} p \oplus \operatorname{im} q \oplus \operatorname{im} r, with no hypothesis on the products.
  5. For kk projectors with p1++pk=idp_1 + \dots + p_k = \mathrm{id}: show first that for any subspaces, dim(F1++Fk)dimF1++dimFk\dim (F_1 + \dots + F_k) \leq \dim F_1 + \dots + \dim F_k, with equality if and only if the sum is direct; then show E=imp1++impkE = \operatorname{im} p_1 + \dots + \operatorname{im} p_k, and prove that if moreover irkpin\sum_i \operatorname{rk} p_i \leq n, the sum is direct and pipj=0p_i p_j = 0 for iji \neq j.

Part IV — Iterated kernels: Fitting’s lemma. Let uL(E)u \in \mathcal{L}(E), dimE=n\dim E = n.

  1. Show the two chains, valid for every k0k \geq 0:

    kerukkeruk+1,imuk+1imuk.\ker u^k \subseteq \ker u^{k+1}, \qquad \operatorname{im} u^{k+1} \subseteq \operatorname{im} u^k .
  2. Show that if kerur=kerur+1\ker u^{r} = \ker u^{r+1} for some rr, then keruk=kerur\ker u^{k} = \ker u^{r} for all krk \geq r; state and prove the analogous stabilization for images.
  3. Deduce that there is a smallest integer rr with kerur=kerur+1\ker u^{r} = \ker u^{r+1}, that rnr \leq n, and that images stabilize at the same rr.
  4. (Fitting’s lemma) Prove that

    E  =  kerurimur.E \;=\; \ker u^{r} \,\oplus\, \operatorname{im} u^{r} .
  5. Show that both subspaces are stable under uu, that the restriction of uu to kerur\ker u^{r} is nilpotent, and that the restriction of uu to imur\operatorname{im} u^{r} is an isomorphism of imur\operatorname{im} u^{r}: every endomorphism is, on a canonical direct sum, “nilpotent plus invertible”.
  6. Let π\pi be the projector onto kerur\ker u^{r} along imur\operatorname{im} u^{r}. Show that πu=uπ\pi \circ u = u \circ \pi.

Part V — A worked case, and synthesis.

  1. Let u(x,y,z)=(y,0,z)u(x, y, z) = (y, 0, z) on R3\R^3. Compute u2u^2 and u3u^3, determine the stabilization index rr, the subspaces kerur\ker u^{r} and imur\operatorname{im} u^{r}, the Fitting projector π\pi, and verify on the formulas that πu=uπ\pi u = u\pi and that uu is nilpotent on one factor, bijective on the other.
  2. Show the equivalences: uu nilpotent     \iff kerur=E\ker u^{r} = E     \iff π=id\pi = \mathrm{id}; and deduce that a nilpotent endomorphism of an nn-dimensional space always satisfies un=0u^{n} = 0 (the nilpotency index never exceeds the dimension).
  3. (Uniqueness) Suppose E=ABE = A \oplus B with A,BA, B stable under uu, the restriction uAu|_A nilpotent and uBu|_B bijective. Prove A=kerurA = \ker u^{r} and B=imurB = \operatorname{im} u^{r}: the Fitting decomposition is unique.
  4. Synthesis, in four sentences: what dictionary Part III establishes between direct sums and families of projectors; why question 14 needed no product hypotheses while question 15 needed a rank hypothesis (and which Year 2 tool, the trace, removes it); in what sense Fitting’s lemma is the stabilized version of Exercise 20.7; and what the two factors of Fitting become in the eigenvalue theory of the Year 2 volume. Name the theorem proved in Part IV.
Solution

Solution of Problem 20.1.

1. (idp)2=id2p+p2=idp(\mathrm{id} - p)^2 = \mathrm{id} - 2p + p^2 = \mathrm{id} - p: a projector. If y=xp(x)y = x - p(x), then p(y)=p(x)p2(x)=0p(y) = p(x) - p^2(x) = 0, and conversely xkerpx \in \ker p gives x=(idp)(x)x = (\mathrm{id} - p)(x): im(idp)=kerp\operatorname{im}(\mathrm{id} - p) = \ker p. And (idp)(x)=0    p(x)=x    ximp(\mathrm{id} - p)(x) = 0 \iff p(x) = x \iff x \in \operatorname{im} p (fixed points, Theorem 20.15): ker(idp)=imp\ker(\mathrm{id} - p) = \operatorname{im} p.

2. (λid+μp)2=λ2id+(2λμ+μ2)p(\lambda\,\mathrm{id} + \mu p)^2 = \lambda^2\,\mathrm{id} + (2\lambda\mu + \mu^2)\,p. The pair (id,p)(\mathrm{id}, p) is free in L(E)\mathcal{L}(E): p=cidp = c\, \mathrm{id} would give c2=cc^2 = c, so p=0p = 0 or id\mathrm{id}, excluded. Identifying coefficients, the map is a projector iff λ2=λ\lambda^2 = \lambda and 2λμ+μ2=μ2\lambda\mu + \mu^2 = \mu. For λ=0\lambda = 0: μ{0,1}\mu \in \{0, 1\}. For λ=1\lambda = 1: μ2+μ=0\mu^2 + \mu = 0, μ{0,1}\mu \in \{0, -1\}. Exactly four projectors in the plane: 00, pp, id\mathrm{id}, idp\mathrm{id} - p.

3. (λid+μp)(λid+μp)=λλid+(λμ+μλ+μμ)p(\lambda\,\mathrm{id} + \mu p)(\lambda'\,\mathrm{id} + \mu' p) = \lambda\lambda'\,\mathrm{id} + (\lambda\mu' + \mu\lambda' + \mu\mu')\,p: the plane is stable under composition. Since pk=pp^k = p for every k1k \geq 1, for Q=kakXkQ = \sum_k a_k X^k:

Q(p)=a0id+(k1ak)p=Q(0)id+(Q(1)Q(0))p.Q(p) = a_0\,\mathrm{id} + \Bigl(\sum_{k \geq 1} a_k\Bigr) p = Q(0)\,\mathrm{id} + \bigl(Q(1) - Q(0)\bigr)\,p .

4. On imp\operatorname{im} p (where pp acts as the identity), λid+μp\lambda\,\mathrm{id} + \mu p multiplies by λ+μ\lambda + \mu; on kerp\ker p, by λ\lambda. As E=impkerpE = \operatorname{im} p \oplus \ker p, the map is bijective iff λ0\lambda \neq 0 and λ+μ0\lambda + \mu \neq 0. Solving λα=1\lambda\alpha = 1, λβ+μα+μβ=0\lambda\beta + \mu\alpha + \mu\beta = 0 in the composition rule of question 3:

(λid+μp)1=1λidμλ(λ+μ)p,(\lambda\,\mathrm{id} + \mu p)^{-1} = \frac1\lambda\,\mathrm{id} - \frac{\mu}{\lambda(\lambda + \mu)}\,p ,

whose action is by 1/λ1/\lambda on kerp\ker p and 1/(λ+μ)1/(\lambda + \mu) on imp\operatorname{im} p, as it must be.

5. Write F=imp=impF = \operatorname{im} p = \operatorname{im} p'. For every xx, p(x)Fp'(x) \in F and pp fixes FF pointwise: p(p(x))=p(x)p(p'(x)) = p'(x), i.e. pp=pp\,p' = p'; symmetrically pp=pp'\,p = p. When two projections share their image, the one applied first decides: its output already lies in FF, where the outer projection acts as the identity and changes nothing.

6. (p+q)2=p2+pq+qp+q2=(p+q)+pq+qp(p + q)^2 = p^2 + pq + qp + q^2 = (p + q) + pq + qp, so p+qp + q projector forces pq+qp=0pq + qp = 0. Compose on the left with pp: pq+pqp=0pq + pqp = 0; on the right with pp: pqp+qp=0pqp + qp = 0. Subtracting, pq=qppq = qp; then pq+qp=2pq=0pq + qp = 2pq = 0 and the characteristic is not 22: pq=qp=0pq = qp = 0.

7. With pq=qp=0pq = qp = 0, the same expansion gives (p+q)2=p+q(p + q)^2 = p + q. Image: im(p+q)imp+imq\operatorname{im}(p + q) \subseteq \operatorname{im} p + \operatorname{im} q always. Conversely, for ximpx \in \operatorname{im} p: q(x)=q(p(x))=0q(x) = q(p(x)) = 0, so (p+q)(x)=p(x)=x(p + q)(x) = p(x) = x and xim(p+q)x \in \operatorname{im}(p+q); same for imq\operatorname{im} q. Directness: ximpimqx \in \operatorname{im} p \cap \operatorname{im} q gives x=p(x)=p(q(x))=0x = p(x) = p(q(x)) = 0. Kernel: if p(x)+q(x)=0p(x) + q(x) = 0, applying pp gives p(x)+p(q(x))=p(x)=0p(x) + p(q(x)) = p(x) = 0, and applying qq gives q(x)=0q(x) = 0: ker(p+q)=kerpkerq\ker(p + q) = \ker p \cap \ker q (the reverse inclusion is clear).

8. pqp - q is a projector iff id(pq)=(idp)+q\mathrm{id} - (p - q) = (\mathrm{id} - p) + q is one (question 1 twice). By questions 6–7 applied to the projectors idp\mathrm{id} - p and qq, this holds iff (idp)q=q(idp)=0(\mathrm{id} - p)q = q(\mathrm{id} - p) = 0, i.e. iff pq=qpq = q and qp=qqp = q.

9. pq=qpq = q means pp fixes every q(x)q(x), i.e. imqker(pid)=imp\operatorname{im} q \subseteq \ker(p - \mathrm{id}) = \operatorname{im} p. And qp=qqp = q means q((idp)(x))=0q\bigl((\mathrm{id} - p)(x)\bigr) = 0 for all xx, i.e. qq vanishes on im(idp)=kerp\operatorname{im}(\mathrm{id} - p) = \ker p: kerpkerq\ker p \subseteq \ker q. Both steps are equivalences: the order qpq \leq p says qq projects onto a smaller image, along a larger kernel.

10. Expanding, (idp)(idq)=idpq+pq=idr(\mathrm{id} - p)(\mathrm{id} - q) = \mathrm{id} - p - q + pq = \mathrm{id} - r. The projectors idp\mathrm{id} - p and idq\mathrm{id} - q commute, so by Exercise 20.6 their product idr\mathrm{id} - r is the projector onto im(idp)im(idq)=kerpkerq\operatorname{im}(\mathrm{id} - p) \cap \operatorname{im}(\mathrm{id} - q) = \ker p \cap \ker q along ker(idp)+ker(idq)=imp+imq\ker(\mathrm{id} - p) + \ker(\mathrm{id} - q) = \operatorname{im} p + \operatorname{im} q. By question 1, r=id(idr)r = \mathrm{id} - (\mathrm{id} - r) is then the projector with imr=imp+imq\operatorname{im} r = \operatorname{im} p + \operatorname{im} q and kerr=kerpkerq\ker r = \ker p \cap \ker q.

11. pip_i is well defined (uniqueness of the decomposition) and linear (the decomposition of x+λyx + \lambda y is the sum of the decompositions, again by uniqueness). For xiFix_i \in F_i the decomposition is xix_i itself, so pi(xi)=xip_i(x_i) = x_i: pi2=pip_i^2 = p_i, and pj(xi)=0p_j(x_i) = 0 for jij \neq i: pipj=0p_i p_j = 0 (pj(x)Fjp_j(x) \in F_j). Summing the components, ipi=id\sum_i p_i = \mathrm{id}. Finally impi=Fi\operatorname{im} p_i = F_i and kerpi=jiFj\ker p_i = \bigoplus_{j \neq i} F_j.

12. pi=piid=pijpj=pi2+jipipj=pi2p_i = p_i \circ \mathrm{id} = p_i\sum_j p_j = p_i^2 + \sum_{j \neq i} p_i p_j = p_i^2: each pip_i is a projector. Every x=id(x)=ipi(x)x = \mathrm{id}(x) = \sum_i p_i(x) lies in iimpi\sum_i \operatorname{im} p_i: the images sum to EE. Directness: suppose y1++yk=0y_1 + \dots + y_k = 0 with yiimpiy_i \in \operatorname{im} p_i, so pi(yi)=yip_i(y_i) = y_i. Apply pjp_j: pj(yi)=pjpi(yi)=0p_j (y_i) = p_j p_i (y_i) = 0 for iji \neq j, so 0=pj(yi)=yj0 = p_j\bigl(\sum y_i\bigr) = y_j, for every jj. Hence E=iimpiE = \bigoplus_i \operatorname{im} p_i.

13. q=idpq = \mathrm{id} - p, and question 1 gives pq=pp2=0=qppq = p - p^2 = 0 = qp directly: for two projectors, summing to the identity already forces orthogonality of the pair.

14. p+q=idrp + q = \mathrm{id} - r with rr a projector, and (idr)(\mathrm{id} - r) is a projector (question 1): so p+qp + q is a projector, and question 6 gives pq=qp=0pq = qp = 0. By symmetry (q+r=idpq + r = \mathrm{id} - p and p+r=idqp + r = \mathrm{id} - q), all pairwise products vanish, and question 12 concludes: E=impimqimrE = \operatorname{im} p \oplus \operatorname{im} q \oplus \operatorname{im} r, automatically.

15. Lemma. By induction with Grassmann (Theorem 19.18):

dim(F1++Fk)dim(F1++Fk1)+dimFkidimFi.\dim(F_1 + \dots + F_k) \leq \dim(F_1 + \dots + F_{k-1}) + \dim F_k \leq \dots \leq \sum_i \dim F_i .

If the total is an equality, each step is: (F1++Fj1)Fj={0}(F_1 + \dots + F_{j-1}) \cap F_j = \{0\} for every jj, and a relation y1++yk=0y_1 + \dots + y_k = 0 (yiFiy_i \in F_i) collapses from the right: yk(F1++Fk1)Fk={0}y_k \in (F_1 + \dots + F_{k-1}) \cap F_k = \{0\}, then yk1=0y_{k-1} = 0, etc.: the sum is direct. Conversely a direct sum has additive dimensions (concatenate bases). Application: x=ipi(x)x = \sum_i p_i(x) shows E=iimpiE = \sum_i \operatorname{im} p_i, so nirkpin \leq \sum_i \operatorname{rk} p_i; the hypothesis gives equality, hence directness. Products: fix jj and yimpjy \in \operatorname{im} p_j. Then y=ipi(y)y = \sum_i p_i(y) with pi(y)impip_i(y) \in \operatorname{im} p_i, while y=yy = y is also a decomposition (component jj alone); uniqueness forces pi(y)=0p_i(y) = 0 for iji \neq j. Applied to y=pj(x)y = p_j(x): pipj=0p_i p_j = 0.

16. If uk(x)=0u^k(x) = 0 then uk+1(x)=u(0)=0u^{k+1}(x) = u(0) = 0. And imuk+1=uk(u(E))uk(E)=imuk\operatorname{im} u^{k+1} = u^k\bigl(u(E)\bigr) \subseteq u^k(E) = \operatorname{im} u^k.

17. Assume kerur=kerur+1\ker u^{r} = \ker u^{r+1} and let xkerur+2x \in \ker u^{r+2}: then u(x)kerur+1=keruru(x) \in \ker u^{r+1} = \ker u^{r}, so ur+1(x)=0u^{r+1}(x) = 0: xkerur+1x \in \ker u^{r+1}. With question 16, kerur+1=kerur+2\ker u^{r+1} = \ker u^{r+2}, and by induction all later kernels coincide with kerur\ker u^{r}. For images: rank–nullity gives dimimuk=ndimkeruk\dim\operatorname{im} u^k = n - \dim\ker u^k, so the image dimensions freeze exactly when the kernel dimensions do, and with the inclusions of question 16, equal dimensions mean equal subspaces (Theorem 19.14).

18. The sequence (dimkeruk)k\bigl(\dim\ker u^k\bigr)_k is nondecreasing with values in [ ⁣[0,n] ⁣]\intint{0}{n}; it cannot increase strictly n+1n + 1 times, so some dimkerur=dimkerur+1\dim\ker u^{r} = \dim\ker u^{r+1} with rnr \leq n, hence kerur=kerur+1\ker u^{r} = \ker u^{r+1} (inclusion plus equal dimension). Take rr smallest; question 17 freezes everything from rr on, images included.

19. Intersection: let xkerurimurx \in \ker u^{r} \cap \operatorname{im} u^{r}, say x=ur(y)x = u^{r}(y) with ur(x)=0u^{r}(x) = 0. Then u2r(y)=0u^{2r}(y) = 0, and keru2r=kerur\ker u^{2r} = \ker u^{r} (question 17), so x=ur(y)=0x = u^{r}(y) = 0. Dimensions: rank–nullity for uru^{r} gives dimkerur+dimimur=n\dim\ker u^{r} + \dim\operatorname{im} u^{r} = n; with trivial intersection, Grassmann makes the sum a subspace of dimension nn: E=kerurimurE = \ker u^{r} \oplus \operatorname{im} u^{r}.

20. Stability: ur(u(x))=u(ur(x))=0u^{r}(u(x)) = u(u^{r}(x)) = 0 for xkerurx \in \ker u^{r}; and u(ur(y))=ur(u(y))imuru(u^{r}(y)) = u^{r}(u(y)) \in \operatorname{im} u^{r}. On N=kerurN = \ker u^{r}: (uN)r=0(u|_N)^{r} = 0 by definition of NN: nilpotent. On I=imurI = \operatorname{im} u^{r}: ker(uI)=keruIkerurI={0}\ker(u|_I) = \ker u \cap I \subseteq \ker u^{r} \cap I = \{0\}, so uIu|_I is an injective endomorphism of the finite-dimensional II, hence bijective (Corollary 20.9).

21. Let x=a+bx = a + b with aNa \in N, bIb \in I. Then u(x)=u(a)+u(b)u(x) = u(a) + u(b) with u(a)Nu(a) \in N and u(b)Iu(b) \in I (question 20): this is the decomposition of u(x)u(x), so π(u(x))=u(a)=u(π(x))\pi(u(x)) = u(a) = u(\pi(x)): πu=uπ\pi u = u\pi.

22. u2(x,y,z)=u(y,0,z)=(0,0,z)u^2(x,y,z) = u(y, 0, z) = (0, 0, z) and u3(x,y,z)=u(0,0,z)=(0,0,z)=u2(x,y,z)u^3(x,y,z) = u(0,0,z) = (0,0,z) = u^2(x,y,z). Kernels: keru={y=z=0}=Vect(e1)\ker u = \{y = z = 0\} = \operatorname{Vect}(e_1), keru2={z=0}=Vect(e1,e2)\ker u^2 = \{z = 0\} = \operatorname{Vect}(e_1, e_2), keru3=keru2\ker u^3 = \ker u^2: stabilization at r=2r = 2. Images: imu=Vect(e1,e3)\operatorname{im} u = \operatorname{Vect}(e_1, e_3), imu2=Vect(e3)\operatorname{im} u^2 = \operatorname{Vect}(e_3). Fitting: R3=Vect(e1,e2)Vect(e3)\R^3 = \operatorname{Vect}(e_1, e_2) \oplus \operatorname{Vect}(e_3), and π(x,y,z)=(x,y,0)\pi(x, y, z) = (x, y, 0). Check: πu(x,y,z)=π(y,0,z)=(y,0,0)\pi u(x,y,z) = \pi(y, 0, z) = (y, 0, 0) and uπ(x,y,z)=u(x,y,0)=(y,0,0)u\pi(x,y,z) = u(x, y, 0) = (y, 0, 0): equal. On the first factor u(x,y,0)=(y,0,0)u(x, y, 0) = (y, 0, 0), whose square is 00: nilpotent; on the second u(0,0,z)=(0,0,z)u(0,0,z) = (0,0,z): the identity, bijective.

23. If um=0u^m = 0 then kerum=E\ker u^m = E; since kernels are frozen from rr on, kerur=kerumax(m,r)=E\ker u^{r} = \ker u^{\max(m, r)} = E. Conversely kerur=E\ker u^{r} = E means ur=0u^{r} = 0. And kerur=E    \ker u^{r} = E \iff the Fitting projector is onto EE along {0}\{0\}, i.e. π=id\pi = \mathrm{id}. Finally rnr \leq n (question 18) gives: every nilpotent endomorphism satisfies un=0u^{n} = 0 — the nilpotency index never exceeds the dimension.

24. Let mm be a nilpotency index of uAu|_A: Akerumkerumax(m,r)=kerurA \subseteq \ker u^{m} \subseteq \ker u^{\max(m,r)} = \ker u^{r}. Since uBu|_B is bijective, B=u(B)=uk(B)imukB = u(B) = u^{k}(B) \subseteq \operatorname{im} u^{k} for every kk, in particular BimurB \subseteq \operatorname{im} u^{r}. Then

n=dimA+dimBdimkerur+dimimur=n:n = \dim A + \dim B \leq \dim\ker u^{r} + \dim\operatorname{im} u^{r} = n :

both inclusions are equalities of dimensions, hence of subspaces: A=kerurA = \ker u^{r}, B=imurB = \operatorname{im} u^{r}.

25. (i) Part III is a dictionary: splittings E=F1FkE = F_1 \oplus \dots \oplus F_k correspond exactly to families of projectors with pi=id\sum p_i = \mathrm{id} and pipj=0p_i p_j = 0, the FiF_i being the images. (ii) For k=3k = 3 the complements idpi\mathrm{id} - p_i are themselves projectors, which closed the argument with no extra hypothesis; for general kk one needs irkpin\sum_i \operatorname{rk} p_i \leq n, an inequality the Year 2 trace gives for free (trp=rkp\operatorname{tr} p = \operatorname{rk} p for a projector, and traces add up to trid=n\operatorname{tr} \mathrm{id} = n). (iii) Exercise 20.7 is Fitting’s lemma in the already-stabilized case r1r \leq 1; in general one lets the kernel and image chains freeze, which takes at most nn steps. (iv) In the Year 2 volume, applied to uλidu - \lambda\, \mathrm{id}, the nilpotent factor becomes the generalized eigenspace at λ\lambda and the projectors of Part III become the spectral projectors of the reduction theory. The theorem of Part IV is Fitting’s lemma.