University Mathematics — Year 1 · Bachelor Year 1
22Determinants and Linear Systems
The determinant condenses into one scalar the answer to “are these vectors a basis?” — and, geometrically, measures the volume they span. We characterize it by its properties (multilinear, alternating, normalized), compute it in dimensions and and by cofactor expansion in general, and put it to work on linear systems, alongside the all-purpose algorithm: Gaussian elimination.
22.1 The determinant
Theorem 22.1 (Characterization)
There is exactly one map , viewed as a function of the columns, that is:
- linear in each column (the others fixed);
- alternating: swapping two columns changes the sign (hence two equal columns give );
- normalized: .
For and :
(the rule of Sarrus: products of descending diagonals minus ascending ones).
Proof. Admitted at this level. ∎
Remark 22.2
For : expanding by bilinearity on the canonical columns gives the formula, which conversely satisfies the axioms — a complete proof; is identical with more terms. The general case (existence via the sum over permutations, uniqueness by the same expansion) demands the signature of a permutation and is deferred to the second year; we freely use the axioms and the consequences below.
The expansion in full, since it is the template: with columns and , bilinearity gives
and alternation kills the repeated pairs while flipping : the whole map collapses to by normalization. Uniqueness is visible in the computation itself — the axioms left no choice at any step — and this is exactly the scaled-uniqueness fact used in the proof of the product rule below.
Theorem 22.3 (Properties)
For :
- adding to a column a multiple of another does not change the determinant; multiplying a column by multiplies it by (so );
- ;
- is invertible the columns form a basis of ; and then ;
- — so every column rule is also a row rule;
- the determinant of a triangular matrix is the product of its diagonal entries.
Proof. (1) By linearity, where the second determinant has two equal columns: zero.
(2) Fix and consider as a function of the columns of : since has columns , is multilinear and alternating in the . We admit, with Theorem 22.1, its uniqueness statement in scaled form: every multilinear alternating map of the columns equals . Here , so .
(3) If is invertible: , so and the inverse formula holds. If is not invertible, its columns are linked (Corollary 20.9 and Proposition 20.2); expressing one column through the others and expanding by linearity leaves determinants with two equal columns: . The basis statement is Proposition 19.8.
(4) Admitted with the general construction (it is immediate on the permutation formula); we record it to use row operations.
(5) If some diagonal entry vanishes, the first columns are linked for some (rank considerations) and product. Otherwise, clear each column below-and-left by operations of type (1) — possible in the triangular shape — reaching the diagonal matrix, whose determinant is the product of the entries by multilinearity from . ∎
Example 22.4 (The rules, checked on numbers)
Take () and (). Then
Multiplicativity and transpose-invariance confirmed — while the false additivity fails on the same pair:
Thirty seconds of arithmetic of this kind, after any determinant identity is invoked, is the cheapest error insurance available.
Example 22.5 (Determinants as areas)
The parallelogram spanned by and has base and height : area . And
the determinant is the signed area of the parallelogram of its columns. The axioms retell the geometry: adding a multiple of one column to the other is a shear, sliding the parallelogram parallel to a side without changing base or height (operation (1) of Theorem 22.3); scaling a column scales the area; swapping the columns flips the orientation, whence the sign, . In the same reading gives signed volumes, and becomes the universal volume-scaling factor of linear maps — the fact behind the change-of-variables formula for multiple integrals in the Year 2 volume.
Theorem 22.6 (Cofactor expansion)
Let and the determinant of with row and column deleted. Then, for any fixed column (or row, by transposition):
Proof. Admitted at this level. ∎
Example 22.7
Expanding along the first column:
Strategy: create zeros first (row/column operations), then expand along the emptiest line.
Example 22.8 (The cofactor inverse, once by hand)
For : . The nine cofactors assemble into
the formula quoted in Exercise 22.8. Check one row-column pair: (row of )(column of ) , and against column : . Nine determinants for one inverse: already at this size, row reduction (Exercise 22.3) is cheaper — the cofactor formula’s value is theoretical (integrality in Exercise 22.8, differentiability of the inverse in later volumes), not computational.
Example 22.9 (The block-triangular rule, in size )
Claim: for blocks. Clear the -block by column operations: adding to columns suitable combinations of columns removes when is invertible (solve for the combination coefficients ), leaving ; then cofactor expansion along the first column, twice, gives for this block-diagonal shape. If is not invertible, its columns are linked, so the first two columns of the big matrix are linked (their bottom halves are zero): both sides vanish. The rule extends to any block sizes by the same two-case argument — and it is the engine of Exercise 22.10.
Example 22.10 (A determinant, strategically)
Every row sums to : the operation makes the first column constant, and factoring leaves ones. Then () clears the first column:
the last determinant expanding along its first row: . Moral: one well-chosen operation (spotting the constant row sum) beats sixteen cofactors.
Method 22.11 (Choosing a determinant strategy)
Scan the matrix before computing anything.
- Constant row or column sums: add everything into one line, factor the common value (Example 22.10, Exercise 22.7).
- Repetitive structure: subtract neighboring rows or columns to create zeros; staircase patterns collapse toward triangular form, whose determinant is read on the diagonal.
- Isolated zeros: expand along the emptiest line (Example 22.7); recursive families (tridiagonal, Exercise 22.6) yield recurrences this way.
- A parameter: the determinant is a polynomial in it; find its roots by spotting the degenerate values (equal rows, proportional columns), then pin the polynomial down by degree and leading coefficient. For the matrix of Exercise 22.7: gives three equal rows (rank , a double root), makes the rows sum to zero (one more root); the determinant has degree in with leading term (the anti-diagonal product , whose Sarrus sign is ), so it must be — no expansion needed, and the two methods check each other.
Example 22.12 (Vandermonde determinant)
For scalars :
Proof sketch (detailed in Exercise 22.5): column operations from the right clear the first row, and factoring each remaining row reduces to . Nonzero iff the are pairwise distinct — the determinant behind Lagrange interpolation (Example 20.10).
22.2 Linear systems
Definition 22.13
A linear system of equations in unknowns is with , ; it is homogeneous when . Its solution set, when nonempty, is : a particular solution plus the general homogeneous solution — an affine subspace of dimension (rank–nullity).
Example 22.14 (The affine structure, made visible)
Solve
Subtracting the equations: , so and . The solutions form the line
the particular solution (the choice ) plus the kernel line of the associated homogeneous system — check: and . Geometrically, two non-parallel planes of intersect along a line, and the dimension count knew it before we solved anything. Changing the particular solution (say : ) changes the description, not the line: an affine subspace has many origins and one direction.
Theorem 22.15 (Square Cramer systems)
If , the system has the unique solution , whose coordinates are
Proof. Uniqueness and existence are the invertibility. For the formula: write (columns of ); then, by multilinearity and alternation,
every term except having a repeated column. ∎
Example 22.16 (Cramer with a parameter, in full)
For , solve
The determinant is . Generic case : Cramer gives
one clean solution for each admissible (check at : , obviously right). Degenerate cases: at the equations read and : incompatible; at they read and , i.e. and : incompatible again. The vanishing of the determinant announces that something degenerates, but never says what — empty or infinite must be decided by looking at the right-hand side. Note also how the formulas signal their own limits: as , ; the solution point runs away as the two lines become parallel.
Method 22.17 (Gaussian elimination on systems)
Row-reduce the augmented matrix to echelon form.
- If a pivot appears in the last column ( line): no solution.
- Otherwise, the unknowns split into pivot unknowns and free unknowns (parameters); back-substitution expresses the former in the latter: the solution set is an affine subspace of dimension number of free unknowns.
Cramer’s formulas are for theory and small systems; elimination is the practical algorithm.
Example 22.18 (A discussion with parameter)
For , consider
The matrix has determinant (computed in Exercise 22.7 by adding all columns to the first). For : unique solution (by symmetry). For : one equation repeated thrice, a plane of solutions. For : adding the three equations gives , no solution.
Remark 22.19 (Common pitfalls)
The determinant is not linear in the matrix: (already ); it is linear in each column separately, which is a different thing entirely. Scaling: , not — each of the columns is scaled. Row operations are not all free: preserves the determinant, but a swap changes the sign and multiplies it by — bookkeeping errors here are the classic source of wrong signs in elimination-based computations. A zero determinant is the beginning, not the end: it says “rank ” but not which rank; only further work (echelon form, or the minors of Exercise 22.12) locates it — cf. the case vs in Example 22.18. Cramer needs invertibility: when the formulas are meaningless, and the system may perfectly well have (infinitely many) solutions. Only square matrices have determinants: for a rectangular system, elimination is the only tool.
Remark 22.20 (Where determinants go)
Three lives await this scalar. Geometric: is the area or volume scaling factor of the associated map — made precise for the plane in Chapter 23 and, as the Jacobian of a change of variables, in the multiple integrals of the Year 2 volume. Algebraic: , the characteristic polynomial, opens eigenvalue theory in Year 2 — the identity of the Chapter 21 weekend problem is its first shadow. Analytic: determinants of special matrices (Vandermonde, Cauchy, Gram) decide when interpolation, decomposition and projection problems are well posed; the weekend problem below evaluates the first two families completely.
Remark 22.21 (Perspectives inside Book 3)
This chapter closes the linear-algebra spine of the volume, and its two remaining chapters cash the dividends. In Chapter 23: the Gram matrix tests freeness by a determinant (Exercise 23.11), and the plane isometries split into rotations and reflections along the sign of their determinant — the classification of the weekend problem there runs on it. In Chapter 25: the Monge quantity is the determinant of the symmetric matrix of second derivatives, and the normal equations of least squares are a Cramer system whose matrix is a Gram (hence moment) matrix — invertible precisely by the Vandermonde-flavored criteria established here. When those chapters assert “invertible” or “positive”, the receipts are in this one.
22.3 Exercises
Exercise 22.1 ★
Compute:
Solution
Solution of Exercise 22.1.
.
Second: , (on the original rows) give rows : two equal rows, determinant . (Sarrus confirms: .)
Third: it is Vandermonde with (Example 22.12): .
Exercise 22.2 ★
For which is the family a basis of ?
Solution
Solution of Exercise 22.2.
The determinant equals (add all columns to the first, factor) times
(clear with , and expand), giving . Basis .
Exercise 22.3 ★
Solve by Cramer’s rule:
Solution
Solution of Exercise 22.3.
First system: ; , . Check: ; .
Second system: after and , the rows become , , , so
Cramer, replacing columns by :
(the numerators computed the same way). Check: ; ; .
Exercise 22.4 ★
Solve by Gaussian elimination, describing the solution set:
Exercise 22.5 ★★
Prove the Vandermonde formula of Example 22.12 by induction on , with the column operations performed from down to .
Solution
Solution of Exercise 22.5.
Induction; is empty product . For the step, perform for (in this order, so each operation uses a not-yet-modified column). The first row becomes ; in row , the -th entry becomes . Expanding along the first row and factoring out of each row :
and the induction hypothesis completes the product .
Exercise 22.6 ★★
(Tridiagonal) Let be the determinant with on the diagonal, on the two adjacent diagonals, elsewhere. Expanding along the first row, prove and compute (, ).
Solution
Solution of Exercise 22.6.
Expanding along the first row: ; the second determinant, expanded along its first column, is . So , i.e. : the differences are constant, equal to . Hence . (Check: , and the case is Example 22.7: .)
Exercise 22.7 ★★
Complete Example 22.18: compute the determinant by the operation , and carry out the full discussion of the system.
Solution
Solution of Exercise 22.7.
makes the first column constant ; factor it:
(expand along the first column: the single entry carries sign , and the remaining determinant is ).
Discussion. : Cramer system; by the symmetry of the equations, , and each equation gives : unique solution . : the three equations all read : solutions form the affine plane . : summing the three equations gives : empty solution set.
Exercise 22.8 ★★
Let with integer entries. Prove that has an inverse with integer entries if and only if . (For the direct sense, take determinants; for the converse, admit — or prove for via cofactors — that with integer cofactor matrix.)
Solution
Solution of Exercise 22.8.
() If has integer entries: with both determinants integers (sums of products of entries): two integers with product are both .
() The cofactor formula (checked for by direct expansion, admitted in general) has with integer entries (each cofactor is an integer determinant); dividing by keeps integers.
Exercise 22.9 ★★★
Compute the determinant of the matrix (Exercise 21.9), i.e. with on the diagonal and elsewhere. (Add all columns to the first, factor, then clear.) Recover the invertibility condition , .
Solution
Solution of Exercise 22.9.
Add all columns to the first: each entry of the new first column is ; factor it out, so that the first column is all ones. Then the row operations () clear every entry below the top-left and leave on the diagonal and elsewhere in those rows: the matrix is upper triangular with diagonal . Hence
nonzero iff and : the condition of Exercise 21.9.
Exercise 22.10 ★★★
Let . Prove that
by block column and row operations (, then , in block form), assuming the natural block-triangular rule — proved for blocks in Example 22.9.
Solution
Solution of Exercise 22.10.
Block operations (each a composition of the corresponding scalar operations, allowed by Theorem 22.3 (1)):
using the block-triangular rule for the last step.
Exercise 22.11 ★★
(Circulant of order ) Let and
Prove that , and factor completely over using :
(Start with ; for the complex form, note that the column almost behaves like an eigenvector.)
Solution
Solution of Exercise 22.11.
makes the first column constant ; factor it out, then , :
and expanding, . Over , with and :
whence the complete factorization. (Structurally: the column satisfies , and similarly for and : the three factors are the three “eigenvalues” of the circulant, a story systematized in the Year 2 volume.)
Exercise 22.12 ★★★
(Rank and minors) Let . Prove that equals the largest size of an invertible submatrix of (a submatrix keeps the entries at the crossings of chosen rows and chosen columns). (If , select free columns, then free rows of the resulting block; conversely, an invertible submatrix forces the corresponding columns of to be free.)
Solution
Solution of Exercise 22.12.
Write .
An invertible submatrix exists. Choose free columns of and let be the matrix they form: . Since row rank equals column rank (Theorem 21.13), has free rows; keeping those rows yields an submatrix of of rank , i.e. invertible.
No larger one does. Let be an invertible submatrix, taken from columns and rows of . If a combination of the corresponding full columns vanishes, then reading only the rows gives on the columns of , so all ( invertible): the columns of are free, and .
Hence is exactly the largest size of an invertible submatrix.
22.4 Problem: Cauchy’s double alternant
Problem 22.1
Two determinants rule the applications of this chapter: the Vandermonde determinant, evaluated in Exercise 22.5, and the Cauchy determinant , evaluated here. Around them this problem collects the alternant toolbox: polynomial column tricks, interpolation by Cramer, the Hilbert matrix, the discriminant of a cubic, and the method of alternating polynomials. Throughout, denotes the Vandermonde value.
Part I — The Vandermonde toolbox.
- Compute , and recall why interpolation at pairwise distinct nodes is a Cramer system.
(Polynomial alternant) Let be monic with . Prove
column operations replace each power column by any monic staircase, for free.
Apply question 2 to the binomial polynomials : prove that for integers ,
the product of all pairwise differences of integers is divisible by the superfactorial .
- Prove (powers now starting at ).
(Moment matrix) Let where . Prove that for the matrix , deduce
and conclude: real numbers are pairwise distinct if and only if their moment matrix is invertible, and always.
Part II — Interpolation revisited. Nodes , values .
- Write the conditions “ interpolates” as a linear system in the with matrix , and recover from the existence and uniqueness of the interpolant (compare the two earlier proofs, Theorem 8.23 and Example 20.10).
By Cramer’s rule and cofactor expansion of the relevant determinant along its last column, prove that the leading coefficient of the interpolant is
(Confluent Vandermonde) Compute
and interpret: the data determine a unique when (Hermite interpolation).
- Find the unique with , , , and check your answer against question 8.
Part III — The Cauchy determinant. Let and be scalars with for all , and
- Compute by hand and put it in the form “products of differences over products of sums”.
For , perform () and factor rows and columns to prove
where agrees with the Cauchy matrix on rows and has last row .
Perform () on , factor again, and conclude by induction Cauchy’s double alternant:
- Deduce the invertibility criterion (the pairwise distinct and the pairwise distinct). For the Hilbert matrix : compute and from the formula, and verify that has integer entries.
- Show that for pairwise distinct and any right-hand side, the system () has a unique solution, and relate this to the existence and uniqueness of partial fraction decompositions with simple poles (Theorem 9.5).
Part IV — The discriminant of a cubic. Let be the roots (in ) of , and .
- Using at each root and Vieta (), compute , , and .
With question 5 (over , keeping ), compute
- Deduce: has a repeated root if and only if ; check on .
- Suppose real. Prove that the cubic has three distinct real roots if and only if , and one real plus two nonreal conjugate roots if and only if . (If and , show is purely imaginary.)
Part V — Dividends, and the alternating method.
- For , show .
- Compute for , first by questions 2–3, then by direct expansion.
- Let be pairwise distinct and nonzero. Using an invertible Vandermonde matrix, prove again that the geometric sequences form a free family of the space of sequences.
- Compute from the double alternant.
- (Alternating polynomials) Call a polynomial in alternating when swapping any two variables changes its sign. Show that an alternating vanishes whenever (), and deduce — one variable at a time, by the factor theorem — that is divisible by .
- Use question 23 to reprove the Vandermonde formula with no induction: the determinant is an alternating polynomial of total degree , hence a constant multiple of ; identify the constant by comparing one monomial.
- Synthesis, in four sentences: what single property of the determinant (which axiom) generates all the factorizations of this problem; why the moment-matrix identity of question 5 turns a statement about complex distinctness into a computable real sign test; which two classical matrices were completely evaluated here and which linear problems they govern; and how the alternating method of questions 23–24 explains, in one stroke, why keeps appearing. Name the theorem of Part III.
Solution
Solution of Problem 22.1.
1. . Interpolation at distinct nodes asks for the coefficients of solving with , and : a Cramer system.
2. Work through the columns from left to right. is the constant column ( monic of degree ). Assume columns have already been reduced to the pure powers . Since , subtracting from the combination — an operation that does not change the determinant — leaves the pure power column . After the last column the matrix is the Vandermonde matrix: .
3. The polynomials are monic of degree , so question 2 gives
The left side is the determinant of a matrix with integer entries ( is integer-valued on : questions 16–17 of the weekend problem Problem 18.1), hence an integer; and it is positive since for . So the superfactorial divides the product of all pairwise differences.
4. Factor out of each row : .
5. : . Hence (Theorem 22.3 (2),(4)). For real : , and is invertible iff iff the are pairwise distinct — a sign-definite test computable from the power sums alone.
6. The interpolation conditions form the system ; gives existence and uniqueness at once. This is the third proof in the book: explicit formula in Theorem 8.23, kernel argument in Example 20.10, Cramer here.
7. Cramer: where is with its last column replaced by . Expanding along that column:
Now , and converting the second product costs :
whence — the divided-difference formula again.
8. gives the rows , , ; expanding along the first column and factoring :
Nonzero for : the linear system expressing , , on the coefficients of is Cramer — Hermite interpolation with a doubled node is well posed.
9. with , , : , so , unique. Consistency: here , and the determinant of question 8 is .
10. Direct computation:
and the numerator expands to : differences over sums.
11. For , the new entry of row is
Factor out of each row , then out of each column : what remains has entries in rows and constant in row — the matrix , with the announced prefactor.
12. On , for the operation turns row into and, in row ,
Factor from each column and from each row , then expand along the last row (sign ): the remaining determinant is . Collecting the factors of questions 11–12:
and the induction (base ) assembles exactly Cauchy’s double alternant: the factors for all pairs, over all sums .
13. The formula vanishes iff some or : the Cauchy matrix is invertible iff both families are pairwise distinct. Hilbert: , . For : numerator , denominator : . For : numerator , denominator : . Inverse for :
all integers (a phenomenon true for every ).
14. The matrix of the system is the Cauchy matrix, invertible by question 13 when the (and the ) are pairwise distinct: unique solution. Interpretation: a rational function with simple poles is determined by of its values , and conversely any such data sheet is realized exactly once — the sampling counterpart of the partial-fraction existence and uniqueness theorem (Theorem 9.5).
15. Vieta for : , , so and . Each root satisfies ; summing: . Multiplying by and summing: .
16. By question 5 (the identity and are valid over ),
expanding along the first row.
17. A repeated root means two equal , i.e. , i.e. . For : , matching the double root of .
18. The nonreal roots of a real cubic come in conjugate pairs, so exactly two cases occur when . Three distinct real roots: is real and nonzero, so . One real root and : then
so is a nonzero purely imaginary number and . The two signs characterize the two cases.
19. Take in the double alternant: the numerator is and the denominator (all entries positive): the determinant is positive. (In later language: the kernel is positive definite.)
20. By questions 2–3, the determinant equals . Directly, the matrix is
21. Suppose as a sequence. Reading off gives with invertible (, distinct ): . The geometric sequences are free.
22. : numerator ; denominator . Hence .
23. If , the swap of the two variables fixes the point but must change the sign of : , so there. Divisibility: view as a polynomial in the single variable with coefficients in the other variables; it vanishes at the “values” , so repeated factoring (Theorem 8.7) gives with polynomial. The prefactor is invariant under swaps of two indices , so is alternating in , and induction completes: divides .
24. is a polynomial in the ; swapping two variables swaps two rows, so is alternating, and by question 23, for some polynomial . Total degrees: has degree , the product has degree exactly : is a constant. The monomial has coefficient in (diagonal product) and in the product (choose the larger-index variable in every factor): , and Vandermonde’s formula falls out with no induction.
25. (i) Alternation — the axiom “two equal columns kill the determinant” — is the engine: it produced every factor , , in the problem. (ii) The identity replaces the individually complex, unreachable roots by their power sums, which are real polynomials in the coefficients, so distinctness becomes the sign of a computable real number. (iii) The Vandermonde determinant governs polynomial interpolation, the Cauchy determinant governs partial fractions and sampled rational functions (with the Hilbert matrix as its most famous special case). (iv) Any alternating polynomial is divisible by , and a degree count then pins such a polynomial down up to a constant — which is why this product keeps reappearing wherever a determinant vanishes on coincidences. The theorem of Part III is Cauchy’s double alternant.