University Mathematics — Year 1 · Bachelor Year 1
20Linear Maps
The maps worth studying between vector spaces are those compatible with the structure: linear maps. Their two fundamental subspaces — kernel and image — measure injectivity and surjectivity, and in finite dimension the rank–nullity theorem binds their sizes into one conservation law. Projections and symmetries, then linear forms and hyperplanes, close the chapter.
20.1 Definitions and first properties
Definition 20.1
Let be -vector spaces. A map is linear when
Then and . The set of linear maps is itself a vector space; composition of linear maps is linear, and bilinear in the pair. An endomorphism is a linear ; an isomorphism is a bijective linear map (its inverse is then automatically linear); of an isomorphism, compositions of isomorphisms, are isomorphisms.
Proof that the inverse is linear. Let be linear bijective, and . Put and . Then
and applying to both ends: . Nothing about was computed: linearity transports through the defining property of alone — a pattern worth remembering, as structure often rides along bijections for free. ∎
Proposition 20.2 (A linear map is known on a basis)
Let be a basis of and arbitrary vectors of . There is exactly one linear map with for all . Moreover:
Proof. Existence/uniqueness: every has unique coordinates (Proposition 18.15); linearity forces , and this formula does define a linear map.
Injectivity: by Proposition 20.5 below, is injective iff its kernel is trivial. Now means exactly . If is free, this forces every , i.e. the kernel reduces to : injective. If is linked, a nontrivial relation produces the nonzero vector in the kernel ( is free): not injective. The two conditions match term for term.
Surjectivity: the image of is the set of all , i.e. exactly , which equals iff the family generates. ∎
Definition 20.3 (Kernel and image)
For :
both subspaces (direct verification with the criterion).
Method 20.4 (Kernel and image, in practice)
Kernel: write as a system on the coordinates (or coefficients) of , solve, and parametrize — the kernel comes out with a basis attached (Method 19.10). Image: it is the span of the images of any generating family of — usually a basis, so ; then eliminate redundant images to extract a basis. Shortcut: compute whichever of the two is easier and get the other’s dimension for free by rank–nullity (Theorem 20.7); when a plausible candidate subspace for the image is known, comparing dimensions upgrades the easy inclusion to equality (Theorem 19.14). Both shortcuts are used in Example 20.11 below.
Proposition 20.5
is injective ; is surjective .
Proof. As for groups (Proposition 7.11): . The second point is the definition. ∎
20.2 The rank–nullity theorem
Definition 20.6
The rank of (with finite-dimensional) is — also the rank of the family for any basis of .
Theorem 20.7 (Rank–nullity)
Let be finite-dimensional and . Then
More precisely, if is any supplementary subspace of in , then restricts to an isomorphism from onto .
Proof. Let satisfy (Theorem 19.14), and let be the restriction of .
is injective: .
is surjective: any with (, ) equals .
So is an isomorphism; an isomorphism sends a basis to a basis (Proposition 20.2), so , and concludes. ∎
Example 20.8 (Building a map to specification)
Construct with and . Sanity first: rank–nullity demands — consistent, so a solution may exist. Choose a basis adapted to the kernel, say (Example 19.7), and prescribe images (Proposition 20.2):
Then and ; rank–nullity forces , so the kernel is exactly the prescribed line. Explicitly, decomposing :
The recipe generalizes: a linear map with prescribed kernel and image exists exactly when — necessity is rank–nullity, sufficiency is this construction.
Corollary 20.9
If (finite), then for :
In particular this holds for endomorphisms in finite dimension. (It fails in infinite dimension: on , the derivative is surjective but not injective, and is injective but not surjective.)
Proof. Injective (a subspace of full dimension is everything, Theorem 19.14) surjective. ∎
Example 20.10 (Interpolation, structurally)
Fix distinct and let , : linear. Its kernel is (Corollary 8.8). Equal dimensions : is an isomorphism — existence and uniqueness of the Lagrange interpolant (Theorem 8.23) in one line.
The same one-line pattern handles data mixing values and derivatives: , is linear, and its kernel consists of degree- polynomials with double roots at and , i.e. divisible by of degree : only . Equal dimensions again: every quadruple of data is realized by exactly one cubic — Hermite interpolation, granted by a kernel computation before any formula is written (the weekend problem of Chapter 22 meets its determinant).
Example 20.11 (Rank–nullity at work: the difference operator)
Let , : linear. Kernel: if , then , so has infinitely many roots and vanishes (Corollary 8.8): is the line of constants. Rank–nullity: . Since for nonconstant (the top terms cancel), , which has dimension exactly : the inclusion is an equality. Conclusion, with no computation of preimages: every polynomial of degree is a difference — the discrete antiderivative exists. (Compare the weekend problem of Chapter 18, where was inverted explicitly in the binomial basis.)
Example 20.12 (Rank bookkeeping along a composition)
On , compose the derivative (rank : image , kernel the constants) with itself. Then maps , with image : rank . Compare with the general bounds: the crude one gives ; the exact formula of Exercise 20.12 accounts for the loss precisely,
since the constants (kernel of the outer ) sit inside (image of the inner ) with dimension . Rank is lost exactly where the outer kernel ambushes the inner image — the sentence to remember when composition ranks misbehave.
Example 20.13 (Kernel and image of the Euler operator)
On , let (linear: differentiation and multiplication by are). Kernel: forces (a product of polynomials vanishes only if one factor does), so is the line of constants. Image: on the monomial basis,
so : the polynomials with zero constant term. Check against rank–nullity: , which is indeed the dimension found. Two remarks worth keeping. First, here — but that is a happy accident of this operator, not a theorem: for the shift-like on , and the sum is not direct. Second, the relation says each monomial is merely rescaled by — a basis adapted to the map, the germ of the eigenvalue idea developed in the Year 2 volume.
20.3 Projections and symmetries
Definition 20.14
Let . The projection onto along maps (unique decomposition) to ; the associated symmetry is . Both are linear, and .
Theorem 20.15 (Algebraic characterization)
- An endomorphism is a projection (onto some along some ) if and only if ; then and .
- An endomorphism is a symmetry if and only if ; then .
Proof. (1) A projection satisfies and : . Conversely, let ; set , . Every writes with and : . If : and , so : direct sum, and is the projection onto along . Finally on : gives , so , and conversely puts in the image.
(2) The correspondence , is a bijection between endomorphisms, and under it
symmetries correspond exactly to projections. Translating the subspaces: , so ; and , so . The direct sum of point (1) becomes the announced decomposition into the fixed vectors and the reversed vectors of . ∎
Example 20.16 (A projection and its symmetry, explicitly)
In , project onto along . Decompose : the first coordinate gives , the second . Hence
Check the algebra: , and . Geometrically, is the “oblique reflection” across the line in the vertical direction: it fixes pointwise and reverses . Had we projected onto the same along instead, the formula would change to : a projection is determined by its image and its kernel, never by the image alone.
20.4 Linear forms and hyperplanes
Definition 20.17
A linear form on is a linear map . A hyperplane of () is a subspace of dimension .
Example 20.18 (An evaluation form and its hyperplane)
On , the evaluation is a linear form, nonzero (). Its kernel is the hyperplane of polynomials vanishing at , i.e. (factor theorem, Theorem 8.7) the multiples of within :
In coordinates on , : every linear form on a finite-dimensional space is, once a basis is fixed, a fixed linear expression in the coordinates — forms are “row vectors”, as Chapter 21 will make literal, and the coefficient row here, , is a Vandermonde row: evaluation forms are how the interpolation theory of Chapter 22’s weekend problem enters linear algebra.
Theorem 20.19
The hyperplanes of are exactly the kernels of nonzero linear forms. Two nonzero forms have the same kernel if and only if they are proportional.
Proof. If : (image a nonzero subspace of ), so : a hyperplane. Conversely, let be a hyperplane, a basis of completed by : the form “last coordinate” has kernel .
Proportional forms share their kernel. Conversely, suppose and pick : every writes (as ), and
so . ∎
Example 20.20
In , a hyperplane is a solution set with not all zero — the familiar equation of a plane through the origin in . In function spaces, evaluation forms or define hyperplanes of , of (cf. Exercise 19.6).
Example 20.21 (One hyperplane, worked three ways)
Take on and . Basis: solve :
two free vectors: , a hyperplane, as Theorem 20.19 predicts from . Supplementary line: any vector outside spans one, e.g. (); the decomposition of an arbitrary is explicit:
since . Proportionality: if , then and both have kernel ; conversely, any form vanishing on is a multiple of (Exercise 20.8) — the equation of a hyperplane is unique up to scale, a fact used constantly for planes in geometry.
Remark 20.22 (Common pitfalls)
Kernel and image live in different spaces: , ; the sum only makes sense for endomorphisms, and even then it need not be direct ( has ; Exercise 20.7 characterizes when directness holds). does not mean : the same squares to zero without vanishing — what really says is (Exercise 20.5). Injective surjective needs equal finite dimensions: on , the derivative is surjective and not injective, injective and not surjective (Corollary 20.9); and between spaces of different dimensions, one implication is simply impossible (). Prescribing images works on a basis, not on any family: demanding , , overdetermines unless ; a linear map is free on a basis, enslaved everywhere else. Rank is not preserved by composition: it can only drop, (Exercise 20.4), with exact loss measured in Exercise 20.12.
Remark 20.23 (Where these maps go)
Linear maps are about to become matrices: once bases are fixed, Chapter 21 encodes every by a rectangular array, and composition becomes the matrix product — rank–nullity then drives the theory of linear systems in Chapter 22. Projections return in Chapter 23 in their most useful special case, the orthogonal projection, where the kernel is chosen perpendicular to the image. The weekend problem below pushes the projector algebra as far as first-year tools reach, up to Fitting’s lemma; the Year 2 volume goes further with the trace and with eigenvalue theory, for which projectors onto stable subspaces are the basic building blocks.
Remark 20.24 (Perspectives inside Book 3: rank–nullity three more times)
The conservation law will be re-read three times before the volume ends. In Chapter 22 it becomes the shape of solution sets: a compatible system with unknowns and rank has a solution set of dimension — kernel dimension in disguise. In Chapter 23 it splits orthogonally, , and powers every distance computation. In the weekend problem of Chapter 25, it is the accountant of least squares: observations, fitted parameters, residual dimensions, and the Pythagorean identity is rank–nullity’s Euclidean shadow. One theorem, four costumes.
20.5 Exercises
Exercise 20.1 ★
- , ;
- , ;
- , ;
- , .
Solution
Solution of Exercise 20.1.
(1) Linear: coordinates are linear expressions. (2) Not linear: . (3) Linear: differentiation and multiplication by are, and sums of linear maps are. (4) Linear: evaluation respects pointwise operations.
Exercise 20.2 ★
Let , . Determine (basis, dimension), , and a basis of . Is injective? surjective?
Solution
Solution of Exercise 20.2.
Kernel: solve , , . From the third, ; the first gives ; check in the second: : satisfied. So (taking ), dimension .
Rank–nullity: . Image: spanned by the images of the canonical basis, , , ; the first two are free, and the rank is : basis .
Not injective (), not surjective (rank ): consistent with Corollary 20.9.
Exercise 20.3 ★
Let , . Prove that is an isomorphism: once via , once by exhibiting the inverse (consider ).
Solution
Solution of Exercise 20.3.
Kernel: forces unless ; but for : so , and , an injective endomorphism of the finite-dimensional , is an isomorphism (Corollary 20.9).
Inverse: let (a finite sum on ). Then
telescoping, since . So .
Exercise 20.4 ★
Let and , spaces finite-dimensional. Prove:
Exercise 20.5 ★★
Let be an endomorphism of (finite-dimensional) with . Prove that , hence . For , give an example with equality.
Solution
Solution of Exercise 20.5.
means for all : every lies in , i.e. . Then rank–nullity:
Equality example in : : , .
Exercise 20.6 ★★
Let be projections of with . Prove that is a projection, with
Solution
Solution of Exercise 20.6.
(commutation): a projection (Theorem 20.15).
Image: , and : contained in the intersection. Conversely, if , then and (fixed points characterize the image of a projection), so : .
Kernel: and likewise : the sum is contained. Conversely, let , and write
the first term satisfies , so it lies in ; the second is in since . Hence .
Exercise 20.7 ★★
Let , finite-dimensional. Prove the equivalence of:
- ;
- ;
- .
Solution
Solution of Exercise 20.7.
Note first the general inclusions and , and by rank–nullity, (2) (3) (equal kernels equal ranks equal images, given the inclusions).
(1 2): let ; then , so .
(2 1): by Grassmann and rank–nullity, : the sum is iff the intersection is . Let : and , so , so (by (2)) : . Hence .
Exercise 20.8 ★★
Let be linear forms on with . Prove for some (including the degenerate cases).
Solution
Solution of Exercise 20.8.
If : then forces . If : is a hyperplane; pick . Set . The form vanishes on (both do, by the inclusion) and at : it vanishes on . So .
Exercise 20.9 ★★★
Let with , and suppose but (a maximally nilpotent endomorphism). Pick with ; prove that is a basis of . (Apply powers of to a null combination, starting with .)
Solution
Solution of Exercise 20.9.
Suppose . Apply : all terms with a factor die, leaving , so . Apply to the remaining relation: , so ; and so on. The family is free; being of size , it is a basis (Proposition 19.8). (In this basis, acts as a shift — the model of maximal nilpotence.)
Exercise 20.10 ★★★
Let with .
- Prove that is an isomorphism and that no satisfies with .
- Prove that is even. Hint: pick ; show is a plane stable under ; choose outside it and iterate, proving that stays free.
Solution
Solution of Exercise 20.10.
- is bijective, so is (Proposition 1.26 adapted: has the two-sided inverse ). If with : applying , , so : impossible in .
Build the family greedily. Take : is free by (1). If of the current family , call it — a subspace stable under (each generator maps to another generator or its negative: ) — is not all of , choose . Claim: the enlarged family is free. Suppose with and . Apply : with . Eliminate between the two relations (multiply the first by , the second by , and add):
and forces : contradiction. So the construction continues, adding vectors two at a time, until : the final family is a basis of even size, and is even.
Exercise 20.11 ★★
Let , spaces finite-dimensional. Prove the two-sided bound
(For the upper bound, compare with ; for the lower one, apply the upper bound cleverly.)
Solution
Solution of Exercise 20.11.
Upper bound: for every , , so
(Grassmann, Theorem 19.18). Lower bound: apply the upper bound to the pair , whose sum is :
so ; exchanging and gives the absolute value.
Exercise 20.12 ★★★
(Frobenius’ inequality) Let , and , all spaces finite-dimensional. Prove the exact formula
and deduce Frobenius’ inequality
Check that the case is Sylvester’s inequality, proved in matrix form in Exercise 21.10.
Solution
Solution of Exercise 20.12.
Exact formula. Let be the restriction of to the subspace . Its image is , and its kernel is . Rank–nullity for on the space :
Frobenius. Apply the exact formula twice, to and to :
Since , the second intersection is contained in the first, and its dimension is no larger:
which rearranges into Frobenius’ inequality. With (rank , and ): , Sylvester’s inequality — proved again, in matrix form, in Exercise 21.10.
20.6 Problem: projector calculus and Fitting’s lemma
Problem 20.1
Projections are the endomorphisms that direct sums produce, and conversely: every identity is secretly a family of projectors summing to the identity. This problem develops that dictionary — the algebra of one projector, of two, of — then applies the same stabilization ideas to an arbitrary endomorphism and proves Fitting’s lemma: every endomorphism of a finite-dimensional space splits into a nilpotent part and an invertible part. Throughout, is a -vector space of dimension , and projector means with (Theorem 20.15).
Part I — The algebra around one projector. Let be a projector, , .
- Show that is a projector and identify and .
- Compute and determine all pairs for which is a projector.
Show that the plane of is stable under composition, and that for every polynomial ,
- Determine for which the map is invertible, and give its inverse in the form . Interpret the answer through the action of on and on .
- Let be another projector with the same image . Show that and . What do these identities say about composing projections onto the same subspace along different kernels?
Part II — Two projectors. Let be projectors of ; assume the characteristic is not (true for ).
- Suppose is a projector. Expanding , show ; composing with on the left, then on the right, deduce , and conclude .
Conversely, suppose . Show that is a projector, with
- Show that is a projector if and only if . (Apply questions 6–7 to and .)
- Show the geometric meaning of : it holds if and only if and . (One then writes : “ projects onto less, along more”.)
Now let commute. Recall from Exercise 20.6 that is the projector onto along . Show that is a projector with
(Consider .)
Part III — Decompositions of the identity.
- Let and, for (unique decomposition, ), set . Show that each is a projector, that for , and that ; identify and .
- Conversely, let satisfy and for all . Show that each is a projector and that .
- Two projectors with : show that holds automatically.
- Three projectors with : show that is a projector, and deduce from question 6 that all pairwise products vanish — hence , with no hypothesis on the products.
- For projectors with : show first that for any subspaces, , with equality if and only if the sum is direct; then show , and prove that if moreover , the sum is direct and for .
Part IV — Iterated kernels: Fitting’s lemma. Let , .
Show the two chains, valid for every :
- Show that if for some , then for all ; state and prove the analogous stabilization for images.
- Deduce that there is a smallest integer with , that , and that images stabilize at the same .
(Fitting’s lemma) Prove that
- Show that both subspaces are stable under , that the restriction of to is nilpotent, and that the restriction of to is an isomorphism of : every endomorphism is, on a canonical direct sum, “nilpotent plus invertible”.
- Let be the projector onto along . Show that .
Part V — A worked case, and synthesis.
- Let on . Compute and , determine the stabilization index , the subspaces and , the Fitting projector , and verify on the formulas that and that is nilpotent on one factor, bijective on the other.
- Show the equivalences: nilpotent ; and deduce that a nilpotent endomorphism of an -dimensional space always satisfies (the nilpotency index never exceeds the dimension).
- (Uniqueness) Suppose with stable under , the restriction nilpotent and bijective. Prove and : the Fitting decomposition is unique.
- Synthesis, in four sentences: what dictionary Part III establishes between direct sums and families of projectors; why question 14 needed no product hypotheses while question 15 needed a rank hypothesis (and which Year 2 tool, the trace, removes it); in what sense Fitting’s lemma is the stabilized version of Exercise 20.7; and what the two factors of Fitting become in the eigenvalue theory of the Year 2 volume. Name the theorem proved in Part IV.
Solution
Solution of Problem 20.1.
1. : a projector. If , then , and conversely gives : . And (fixed points, Theorem 20.15): .
2. . The pair is free in : would give , so or , excluded. Identifying coefficients, the map is a projector iff and . For : . For : , . Exactly four projectors in the plane: , , , .
3. : the plane is stable under composition. Since for every , for :
4. On (where acts as the identity), multiplies by ; on , by . As , the map is bijective iff and . Solving , in the composition rule of question 3:
whose action is by on and on , as it must be.
5. Write . For every , and fixes pointwise: , i.e. ; symmetrically . When two projections share their image, the one applied first decides: its output already lies in , where the outer projection acts as the identity and changes nothing.
6. , so projector forces . Compose on the left with : ; on the right with : . Subtracting, ; then and the characteristic is not : .
7. With , the same expansion gives . Image: always. Conversely, for : , so and ; same for . Directness: gives . Kernel: if , applying gives , and applying gives : (the reverse inclusion is clear).
8. is a projector iff is one (question 1 twice). By questions 6–7 applied to the projectors and , this holds iff , i.e. iff and .
9. means fixes every , i.e. . And means for all , i.e. vanishes on : . Both steps are equivalences: the order says projects onto a smaller image, along a larger kernel.
10. Expanding, . The projectors and commute, so by Exercise 20.6 their product is the projector onto along . By question 1, is then the projector with and .
11. is well defined (uniqueness of the decomposition) and linear (the decomposition of is the sum of the decompositions, again by uniqueness). For the decomposition is itself, so : , and for : (). Summing the components, . Finally and .
12. : each is a projector. Every lies in : the images sum to . Directness: suppose with , so . Apply : for , so , for every . Hence .
13. , and question 1 gives directly: for two projectors, summing to the identity already forces orthogonality of the pair.
14. with a projector, and is a projector (question 1): so is a projector, and question 6 gives . By symmetry ( and ), all pairwise products vanish, and question 12 concludes: , automatically.
15. Lemma. By induction with Grassmann (Theorem 19.18):
If the total is an equality, each step is: for every , and a relation () collapses from the right: , then , etc.: the sum is direct. Conversely a direct sum has additive dimensions (concatenate bases). Application: shows , so ; the hypothesis gives equality, hence directness. Products: fix and . Then with , while is also a decomposition (component alone); uniqueness forces for . Applied to : .
16. If then . And .
17. Assume and let : then , so : . With question 16, , and by induction all later kernels coincide with . For images: rank–nullity gives , so the image dimensions freeze exactly when the kernel dimensions do, and with the inclusions of question 16, equal dimensions mean equal subspaces (Theorem 19.14).
18. The sequence is nondecreasing with values in ; it cannot increase strictly times, so some with , hence (inclusion plus equal dimension). Take smallest; question 17 freezes everything from on, images included.
19. Intersection: let , say with . Then , and (question 17), so . Dimensions: rank–nullity for gives ; with trivial intersection, Grassmann makes the sum a subspace of dimension : .
20. Stability: for ; and . On : by definition of : nilpotent. On : , so is an injective endomorphism of the finite-dimensional , hence bijective (Corollary 20.9).
21. Let with , . Then with and (question 20): this is the decomposition of , so : .
22. and . Kernels: , , : stabilization at . Images: , . Fitting: , and . Check: and : equal. On the first factor , whose square is : nilpotent; on the second : the identity, bijective.
23. If then ; since kernels are frozen from on, . Conversely means . And the Fitting projector is onto along , i.e. . Finally (question 18) gives: every nilpotent endomorphism satisfies — the nilpotency index never exceeds the dimension.
24. Let be a nilpotency index of : . Since is bijective, for every , in particular . Then
both inclusions are equalities of dimensions, hence of subspaces: , .
25. (i) Part III is a dictionary: splittings correspond exactly to families of projectors with and , the being the images. (ii) For the complements are themselves projectors, which closed the argument with no extra hypothesis; for general one needs , an inequality the Year 2 trace gives for free ( for a projector, and traces add up to ). (iii) Exercise 20.7 is Fitting’s lemma in the already-stabilized case ; in general one lets the kernel and image chains freeze, which takes at most steps. (iv) In the Year 2 volume, applied to , the nilpotent factor becomes the generalized eigenspace at and the projectors of Part III become the spectral projectors of the reduction theory. The theorem of Part IV is Fitting’s lemma.