Linear algebra begins here: the axioms of vector spaces isolate what R2, R3, polynomial spaces and function spaces have in common — one can add, and scale. Two chapters build the theory (Chapter 19 adds dimension); the language they set up — span, free family, basis, direct sum — is the daily bread of every chapter after them. Throughout, K denotes R or C (scalars).
18.1 Definition and examples
Definition 18.1(Vector space)
A K-vector space is a setE with an addition making (E,+) an abelian group (zero written 0E or 0), and a scalar multiplication K×E→E such that, for all λ,μ∈K and x,y∈E:
λ(x+y)=λx+λy,(λ+μ)x=λx+μx,λ(μx)=(λμ)x,1x=x.
Consequences: 0x=0E, λ0E=0E, (−1)x=−x, and λx=0E⟹λ=0 or x=0E (multiply by λ−1).
Proof of the consequences. For 0x=0E: from (0+0)x=0x+0x and (0+0)x=0x, cancel 0x in the group(E,+). For λ0E: same trick on λ(0E+0E). For (−1)x: add x,
x+(−1)x=1x+(−1)x=(1+(−1))x=0x=0E,
so (−1)x is the additive inverse of x. Finally if λx=0E with λ=0: multiply by λ−1 (the scalars form a field) and use the two axioms λ−1(λx)=(λ−1λ)x=1x=x together with λ−10E=0E: x=0E. Small as they are, these four rules are used silently on every page that follows — and the last one is exactly where fields are needed: over the scalars Z, the “space” Z/2Z would violate it with 2x=0. ∎
Example 18.2
Kn (coordinatewise operations); the polynomialsK[X]; the functions F(A,K) from any setA to K (pointwise operations) — containing continuous functions, sequences F(N,R), etc.; C as an R-vector space. In each case the axioms are inherited from those of K.
Definition 18.3(Subspace)
F⊆E is a subspace when 0E∈F and F is stable under addition and scalar multiplication — equivalently:
F=∅and∀x,y∈F,∀λ∈K,x+λy∈F.
A subspace is itself a vector space. Any intersection of subspaces is a subspace; a union almost never is (same proof as Exercise 7.6).
Example 18.4
In F(R,R): the continuous functions, the differentiable ones, the polynomials of degree ≤n (written Kn[X] inside K[X]), the solutions of a homogeneous linear differential equation (Theorem 5.10 said just that). Non-examples: {f:f(0)=1} (no zero), degree exactly n (not stable under addition).
Example 18.5(Subspace or not: four verdicts, argued)
In the space of real sequences:
{u:u bounded}is a subspace: 0 is bounded, and if ∣un∣≤M, ∣vn∣≤M′, then ∣un+λvn∣≤M+∣λ∣M′.
{u:un→1} is not: the zero sequence is missing (and the sum of two members tends to 2).
{u:u monotone} is not: un=n and vn=−n+(−1)n are monotone, their sum (−1)n is not; stability under addition is the axiom that fails, even though the set contains 0 and all scalar multiples of its members.
{u:un+1=un2} is not: it contains 0 but 2u escapes as soon as u is a nonzero member (2un+1=(2un)2 in general) — squaring is the nonlinearity.
The working order is always the same: test 0 first (cheapest), then stability — and to refute, one explicit counterexample pair beats any amount of doubt.
18.2 Span, sums, direct sums
Definition 18.6(Linear combinations, span)
A linear combination of the family (x1,…,xp) of vectors of E is any λ1x1+⋯+λpxp (λi∈K). The set of all of them is the spanVect(x1,…,xp): it is a subspace, the smallest one containing the family.
Proof of the two assertions. Stability: a sum of two linear combinations ∑λixi+∑μixi=∑(λi+μi)xi is again one, and so is a scalar multiple μ∑λixi=∑(μλi)xi; the zero combination shows 0 belongs: the span is a subspace. Minimality: let H be any subspace containing x1,…,xp. By stability under scalar multiplication each λixi∈H, and by stability under addition their sum lies in H: every linear combination belongs to H, i.e. Vect(x1,…,xp)⊆H. So the span is contained in every subspace containing the family: it is the smallest one. ∎
is a subspace (the smallest containing F∪G). The sum is direct, written F⊕G, when every element of F+G decomposes uniquely as u+v; equivalently (see below) when F∩G={0}. When E=F⊕G, the subspaces are supplementary in E.
Example 18.8(A sum of two lines)
In R3, let F=Vect((1,0,1)) and G=Vect((0,1,1)). Their sum is
the plane through the origin containing both lines. It is strictly bigger than the union F∪G (the mere cross of the two lines): the vector (1,1,2)=(1,0,1)+(0,1,1) lies in the sum but on neither line. And F∩G={0} (a common vector requires a(1,0,1)=b(0,1,1), whose first two coordinates force a=b=0): the sum is direct, and F⊕G is exactly that plane.
Proposition 18.9
F+G is direct if and only if F∩G={0}.
Proof. If some w=0 lies in F∩G: w=w+0=0+w are two decompositions of w. Conversely, if u+v=u′+v′ with u,u′∈F, v,v′∈G, then u−u′=v′−v belongs to F∩G={0}: decompositions are unique. ∎
Method 18.10(Proving E=F⊕G)
Two things to check, each with its standard opening move.
Trivial intersection. Take x∈F∩G, write out both membership conditions, and squeeze x=0. (Never argue by picture: cf. the pitfalls below.)
Sum is everything. Take an arbitrary x∈E and produce the decomposition x=f+g — either by guessing f from the target (f must satisfy the defining property of F, which usually dictates its formula) or by solving the linear system expressing x against generators of F and G.
When the decomposition formula is guessed, uniqueness is automatic from step 1; when only existence is unclear, step 2 is where the work lives. The two examples below run the method: for even/odd functions the formula for f is forced by evaluating the desired identity at x and −x; for polynomials vanishing at a point, by evaluating at a.
Example 18.11
In F(R,R), the even functions P and the odd functions I are supplementary: any f writes
f(x)=even2f(x)+f(−x)+odd2f(x)−f(−x),
and a function both even and odd is zero. (Applied to exp, this is the pair (cosh,sinh) of Chapter 4.)
Example 18.12(A supplementary pair in Kn[X])
Fix a∈K and set F={P∈Kn[X]:P(a)=0}, G=Vect(1) (the constants). Then Kn[X]=F⊕G. Indeed F∩G consists of the constants vanishing at a, i.e. {0}; and every P decomposes as
P=∈F(P−P(a))+∈GP(a).
The decomposition is worth memorizing: subtracting the value at a point is the standard way to project onto “functions vanishing at a”. Note that F is a large subspace and G a small one; a supplementary pair need not be balanced in any sense.
Example 18.13(A supplementary subspace is never unique)
In R2, let F=Vect((1,0)) (the x-axis). Both G=Vect((0,1)) and G′=Vect((1,1)) are supplementary to F: each meets F only at 0, and each pair sums to R2. The decompositions of a same vector differ:
In fact every line other than F itself is a supplementary of F in R2: supplementaries are plentiful, and speaking of “the” supplementary is meaningless until an extra structure (an inner product, Chapter 23) singles one out.
Two decompositions of the same point of R2 along F (the x-axis): with supplementaryG (vertical drop) and with supplementaryG′ (oblique drop). The F-components differ: a projection depends on the direction of descent.
18.3 Free families, generating families, bases
Definition 18.14
A family (x1,…,xp) of vectors of E is:
generating (of E) when Vect(x1,…,xp)=E;
free (its vectors linearly independent) when
λ1x1+⋯+λpxp=0⟹λ1=⋯=λp=0;
otherwise linked;
a basis when it is free and generating.
Proposition 18.15(Coordinates)
(e1,…,en) is a basis of E if and only if every x∈E is uniquely a combination x=λ1e1+⋯+λnen; the scalars λi are the coordinates of x in the basis.
Proof. Generating = existence of the decomposition. Uniqueness = freeness: two decompositions of the same x differ by a combination equal to 0; freeness forces all its coefficients — the differences of coordinates — to vanish. Conversely, a nontrivial null combination gives the two decompositions 0=∑λiei=∑0ei. ∎
Example 18.16
The canonical basis of Kn: ei=(0,…,1,…,0) (1 in slot i). The monomials (1,X,X2,…,Xn): a basis of Kn[X] (freeness: a null combination is the zero polynomial, so all coefficients vanish, Definition 8.1). In C over R: the basis(1,i).
Remark 18.17(Coordinates are a team effort)
The first coordinate of x in a basis(e1,…,en) depends on all the basis vectors, not just e1. In R2: the vector (3,1) has first coordinate 3 in the canonical basis, but first coordinate 2 in the basis((1,0),(1,1)) — solve (3,1)=a(1,0)+b(1,1): b=1, a=2. Changing one basis vector reshuffles every coordinate; Chapter 21 will package this reshuffling into the change-of-basis matrix.
Example 18.18(Testing a candidate basis, start to finish)
Is F=(1+X,1+X2,X+X2) a basis of R2[X]? Write u1,u2,u3 for the three polynomials. Freeness: a null combination au1+bu2+cu3=0 gives, coefficient by coefficient,
a+b=0,a+c=0,b+c=0;
subtracting the first two, b=c, then the third gives 2b=0: a=b=c=0, free. Generating: instead of solving three systems, notice the symmetric combination
The monomials lie in the span, so everything does: F is a basis. As a bonus, assembling the three displays gives the coordinates of any P=α+βX+γX2:
P=2α+β−γu1+2α−β+γu2+2−α+β+γu3.
(Sanity check with P=X: coordinates(21,−21,21), as found above.) Two lessons: symmetry in the family usually hides a shortcut combination; and once dimension is available (Chapter 19), the whole generating half of this work will come free of charge — three free vectors of a 3-dimensional space always form a basis.
Proposition 18.19(Useful freeness criteria)
A family of nonzero polynomials of pairwise distinct degrees is free.
Adding a vector to a free family keeps it free if and only if the vector is outside the span of the family.
Any subfamily of a free family is free; any family containing a generating family is generating.
Proof. (1) In a null combination, look at the highest degree present: its coefficient must vanish (nothing cancels that degree), and cascade down.
(2) If x∈Vect(x1,…,xp), the relation x−∑λixi=0 is nontrivial. Conversely, a nontrivial null combination of (x1,…,xp,x) must involve x with a nonzero coefficient (else it contradicts freeness of the small family), and solving for x puts it in the span.
(3) Subfamily: a null combination of the subfamily is one of the whole family with the missing coefficients set to 0; freeness of the big family kills all of them. Superfamily: every vector of E is already a combination of the generating part; give the extra vectors the coefficient 0. ∎
Example 18.20(The staircase principle)
Let P0,P1,…,Pn∈Kn[X] with degPk=k for each k (a “staircase” of degrees). Then (P0,…,Pn) is a basis of Kn[X]. Freeness is Proposition 18.19 (1). For the generating property, argue by finite descent on the degree: let Q∈Kn[X], Q=0, of degree d, with leading coefficient a, and let b=0 be the leading coefficient of Pd. Then Q−baPd has degree <d (the top terms cancel); replacing Q by this difference and iterating, after at most n+1 steps one reaches the zero polynomial, and unwinding the subtractions expresses Q as a combination of the Pk. Two staircases already met: the shifted powers ((X−a)k)0≤k≤n (Exercise 18.4), and the Newton products ((X−x0)(X−x1)⋯(X−xk−1))0≤k≤n, put to work in the weekend problem.
Example 18.21(Freeness in function spaces)
In F(R,R), the family (ea1x,…,eapx) with a1<⋯<ap is free: divide a null combination by eapx and let x→+∞; the last coefficient dies, and one cascades down (Exercise 18.8 details this and variants). Freeness of functions is proved by evaluating: at well-chosen points, at infinity, or after differentiating.
Example 18.22(A hidden relation shrinks a span)
In F(R,R), what is Vect(1,cos2,sin2)? The identity cos2+sin2=1 is a nontrivial null combination
1⋅1+(−1)cos2+(−1)sin2=0:
the family is linked, and the span is already generated by (1,cos2) alone (sin2=1−cos2). That smaller family is free: a+bcos2x=0 for all x gives, at x=0 and x=2π: a+b=0 and a=0. So the span is a plane inside the function space — and it also contains cos2x=2cos2x−1: linear-looking families of trigonometric functions routinely collapse under identities, which is why freeness must be proved, never assumed from the list’s length.
Remark 18.23(Common pitfalls)
Four classical traps. Pairwise is not enough: in R2, the vectors (1,0), (0,1), (1,1) are pairwise non-proportional, yet linked — freeness is a property of the whole family, tested by one global combination, never two by two. The zero vector poisons everything: any family containing 0 is linked (1⋅0=0 is a nontrivial relation), however innocent the other vectors. Union is not sum: F∪G is almost never a subspace (Definition 18.3); the smallest subspace containing both is F+G, usually much bigger than the union — in R2, two distinct lines have union a cross, sum the whole plane. Direct requires trivial intersection, not disjointness: two subspaces are never disjoint (both contain 0); the correct condition is F∩G={0}, and it must be proved, not read off a drawing — cf. Example 18.13, where many different G work. Freeness depends on the scalars: the pair (1,i) is free in C seen as an R-vector space, but linked in C seen as a C-vector space (i⋅1+(−1)⋅i=0). Always know which field is acting before declaring a family free — the weekend problem of Chapter 19 turns exactly this sensitivity into irrationality proofs.
Remark 18.24(Where this language goes)
Everything after this chapter speaks the language set up here. Chapter 19 counts basis vectors and turns “free” and “generating” into inequalities on a single integer, the dimension. Chapter 20 studies the maps compatible with the two operations; direct sums become projectors there. Chapter 21 encodes vectors by their coordinates in a basis — Proposition 18.15 is the licence for that encoding — and Chapter 23 adds lengths and angles on top of the linear structure. In the Year 2 volume the same axioms, verbatim, run over arbitrary fields and in infinite dimension; nothing in this chapter used finiteness anywhere.
Remark 18.25(Three threads to follow through Book 3)
Watch three specific ideas of this chapter grow. The staircase principle (Example 18.20) reappears as the Newton basis in this chapter’s weekend problem, as the binomial basis(Bk) there, and as the polynomial alternant trick in the weekend problem of Chapter 22: one lemma, three determinant-free dividends. Evaluation as a freeness test (Example 18.21) becomes the interpolation isomorphism of Chapter 20, then the Vandermonde criterion of Chapter 22, then the Gram test of Chapter 23: the same reflex, sharpened three times. Direct sums (Definition 18.7) become projectors in Chapter 20, orthogonal splittings E=F⊕F⊥ in Chapter 23, and the explained-plus-residual decomposition of least squares in the weekend problem of Chapter 25. Very little of this book is not, at bottom, one of these three ideas wearing new clothes.
Yes: contains 0, and the defining equation is linear (stable under x+λy).
No: does not contain (0,0,0).
No: (1,0) and (0,−1) belong (xy=0), their sum (1,−1) does not (xy=−1<0).
Yes: 0 vanishes at 1; (P+λQ)(1)=P(1)+λQ(1)=0.
Yes: the zero function is bounded; if ∣f∣≤M and ∣g∣≤M′, then ∣f+λg∣≤M+∣λ∣M′.
Exercise 18.2★
In R3, is (1,2,1) in Vect((1,0,1),(1,1,0))? And (2,1,1)? Describe Vect((1,0,1),(1,1,0)) by an equation.
Solution
Solution of Exercise 18.2.
(1,2,1)=a(1,0,1)+b(1,1,0) requires a+b=1, b=2, a=1: incompatible (a+b=3=1): not in the span. (2,1,1)=a(1,0,1)+b(1,1,0): b=1, a=1, a+b=2: consistent, so (2,1,1)=(1,0,1)+(1,1,0), in the span.
Equation: (x,y,z)=(a+b,b,a) means x=y+z: the span is the plane {x−y−z=0}.
Exercise 18.3★
Decide freeness in R3: ((1,1,0),(1,0,1),(0,1,1)); ((1,2,3),(2,4,6)); ((1,0,0),(1,1,0),(1,1,1),(0,1,1)).
Solution
Solution of Exercise 18.3.
First family: λ(1,1,0)+μ(1,0,1)+ν(0,1,1)=0 gives λ+μ=0, λ+ν=0, μ+ν=0: adding, 2(λ+μ+ν)=0, and subtracting each equation, λ=μ=ν=0: free.
Second: (2,4,6)=2(1,2,3): linked.
Third: four vectors in R3 — necessarily linked once dimension is available (Chapter 19); directly: (0,1,1)=−(1,0,0)+0⋅(1,1,0)+(1,1,1), indeed (−1,0,0)+(1,1,1)=(0,1,1): a nontrivial relation.
Exercise 18.4★
Prove that (1,X−1,(X−1)2,(X−1)3) is a basis of R3[X], and give the coordinates of X3 in it. (Taylor at 1!)
Solution
Solution of Exercise 18.4.
Polynomials1,(X−1),(X−1)2,(X−1)3 have distinct degrees 0,1,2,3: free (Proposition 18.19 (1)); four free vectors generating (every P∈R3[X] expands in powers of X−1, e.g. by Taylor for polynomials, cf. the proof of Proposition 8.11): a basis. For X3, Taylor at 1: P=X3, P(1)=1, P′(1)=3, P′′(1)=6, P′′′(1)=6:
X3=1+3(X−1)+3(X−1)2+(X−1)3,
coordinates(1,3,3,1) (Pascal’s row, as expected from X3=((X−1)+1)3).
Exercise 18.5★★
In R4, let F={(x,y,z,t):x=y=z} and G={(x,y,z,t):x=t=0}. Prove that F⊕G=R4, and decompose (1,2,3,4) accordingly.
Solution
Solution of Exercise 18.5.
F∩G: the conditions x=y=z and x=t=0 together give x=0, hence y=z=0, and t=0: the intersection is {0}. Sum: given (x,y,z,t), seek (a,a,a,b)∈F and (0,c,d,0)∈G summing to it: a=x, b=t, c=y−x, d=z−x: always possible. So R4=F⊕G, and
(1,2,3,4)=(1,1,1,4)+(0,1,2,0).
Exercise 18.6★★
In the space of sequences, let F be the set of convergent sequences and G=Vect(u) where un=(−1)n. Prove that F∩G={0}. Is F+G the whole space of sequences?
Solution
Solution of Exercise 18.6.
An element of G is λu; if it converges, then (as λun=λ(−1)n has the two subsequential limits ±λ) necessarily λ=0: F∩G={0}.
F+G is not everything: it consists of sequences of the form cn+λ(−1)n with (cn) convergent. The sequence vn=n is not of this form (vn−λ(−1)n is unbounded, never convergent). So F⊕G⊊ (space of all sequences).
and show by an example in R2 that the unrestricted distributivity F∩(G+H)=(F∩G)+(F∩H) fails.
Solution
Solution of Exercise 18.7.
(⊇) Both F∩G and F∩H lie in F, and their sum lies in G+(F∩H): inclusion follows since the left side is a subspace containing both pieces — concretely, an element g+h with g∈F∩G, h∈F∩H is in F (sum of two elements of F) and in G+(F∩H).
(⊆) Let x∈F with x=g+h, g∈G, h∈F∩H. Then g=x−h∈F (difference of elements of F), so g∈F∩G, and x=g+h∈(F∩G)+(F∩H).
Counterexample to full distributivity in R2: F=Vect(1,1), G=Vect(1,0), H=Vect(0,1). Then G+H=R2, so F∩(G+H)=F, while F∩G=F∩H={0}: the right side is {0}=F.
Exercise 18.8★★★
Prove that the following families of F(R,R) are free:
(ea1x,…,eapx) for a1<⋯<ap;
(cosx,sinx,cos2x,sin2x);
(x↦∣x−a1∣,…,x↦∣x−ap∣) for distinct ai(differentiability fails at exactly one point per function).
Solution
Solution of Exercise 18.8.
Suppose ∑iλieaix=0 for all x. Multiply by e−apx: λp+∑i<pλie(ai−ap)x→λp as x→+∞ (each exponent ai−ap<0). The left side is identically 0, so λp=0; iterate downward.
Let acosx+bsinx+ccos2x+dsin2x=0 for all x. Evaluate at x=0: a+c=0; at x=π: −a+c=0; hence a=c=0, and the relation reduces to bsinx+dsin2x=0. Evaluate at x=2π: b=0; then at x=4π: d=0.
Suppose ∑λi∣x−ai∣=0 for all x. The function ∑i=jλi∣x−ai∣ is differentiable at aj (each term is, away from its own corner), so −λj∣x−aj∣, their difference, must be differentiable at aj too — which forces λj=0 (∣⋅∣ has a corner). This holds for every j.
Exercise 18.9★★★
Let E be a K-vector space and F,G,Hsubspaces with F+G=F+H, F∩G=F∩H and G⊆H. Prove G=H. Give a counterexample without the hypothesis G⊆H.
Solution
Solution of Exercise 18.9.
Let h∈H. Since h∈H⊆F+H=F+G, write h=f+g with f∈F, g∈G. Then f=h−g∈H (both terms in H, using G⊆H), so f∈F∩H=F∩G⊆G, and h=f+g∈G. Hence H⊆G, and with the hypothesis G⊆H: equality.
Counterexample without G⊆H: in R2, take F=Vect(1,0), G=Vect(0,1), H=Vect(1,1): then F+G=F+H=R2 and F∩G=F∩H={0}, yet G=H.
Exercise 18.10★★
In R[X], let P be the set of evenpolynomials (P(−X)=P(X)) and I the set of odd ones (P(−X)=−P(X)). Prove that R[X]=P⊕I, and show that P=Vect(1,X2,X4,…), i.e. that the even polynomials are exactly the polynomials in X2.
Solution
Solution of Exercise 18.10.
Both sets are subspaces (the defining conditions are linear and hold for 0). Decomposition: for P∈R[X],
P(X)=∈P2P(X)+P(−X)+∈I2P(X)−P(−X),
and a polynomial both even and odd satisfies P=−P, so P=0: the sum is direct and equals R[X].
Now let P=∑kakXk be even. Then P(X)−P(−X)=2∑k oddakXk is the zero polynomial, so every odd-degree coefficient vanishes (Definition 8.1): P∈Vect(1,X2,X4,…), i.e. P=Q(X2) for a polynomialQ. Conversely every polynomial in X2 is even.
Exercise 18.11★★
Let (x1,x2,x3) be a free family of a real vector spaceE. Prove that (x1+x2,x2+x3,x3+x1) is free. Is the analogous family of four vectors (x1+x2,x2+x3,x3+x4,x4+x1)free when (x1,x2,x3,x4) is?
Solution
Solution of Exercise 18.11.
Suppose a(x1+x2)+b(x2+x3)+c(x3+x1)=0. Regrouping on the free family(x1,x2,x3):
(a+c)x1+(a+b)x2+(b+c)x3=0⟹a+c=a+b=b+c=0.
Subtracting the first two equations gives c=b; the third then gives 2b=0, so b=c=0, then a=0: the family is free.
For four vectors the analogous family is always linked:
(x1+x2)−(x2+x3)+(x3+x4)−(x4+x1)=0
is a nontrivial null combination (coefficients 1,−1,1,−1), whatever (x1,x2,x3,x4) is. The parity of the cycle length decides.
Exercise 18.12★★★
Let E be a vector space over R (or C) and F1,…,Fkpropersubspaces of E (each Fi=E).
Treat the case k=2 directly: if F1⊆F2 and F2⊆F1, pick x∈F1∖F2 and y∈F2∖F1 and locate x+y.
Prove in general that E=F1∪⋯∪Fk: a vector space over an infinite field is never a finite union of proper subspaces. (Take k minimal, pick x∈F1 outside the other Fi, pick y∈/F1, and follow the line t↦y+tx.)
Solution
Solution of Exercise 18.12.
If F1⊆F2 or F2⊆F1, the union is one of the two, hence proper. Otherwise pick x∈F1∖F2 and y∈F2∖F1, and consider x+y. If x+y∈F1, then y=(x+y)−x∈F1: contradiction. If x+y∈F2, then x∈F2: contradiction. So x+y∈/F1∪F2, and E=F1∪F2.
Suppose for contradiction that E=F1∪⋯∪Fk, with k chosen minimal among all such coverings. Minimality forbids F1⊆F2∪⋯∪Fk (else drop F1), so there is x∈F1 with x∈/Fi for all i≥2. Since F1 is proper, pick y∈/F1. For each scalar t, the vector y+tx lies in some Fi. It never lies in F1: otherwise y=(y+tx)−tx∈F1 (as x∈F1). The field is infinite, so choose k distinct scalars t1,…,tk: the k vectors y+tjx fall into the k−1subspacesF2,…,Fk, and two of them, say y+tx and y+t′x with t=t′, lie in the same Fi (i≥2). Then their difference (t−t′)x∈Fi, so x∈Fi: contradiction. Hence no finite covering by proper subspaces exists.
18.5 Problem: interpolation, three bases for one space
Problem 18.1
Fix n+1distinct points x0,x1,…,xn of R. This problem revisits Lagrange interpolation (Theorem 8.23) with the eyes of this chapter: the space Rn[X] carries three natural bases — Lagrange’s, Newton’s, and (for equally spaced points) the binomial basis — and each basis makes one question easy. The road ends at a genuine arithmetic theorem: Pólya’s characterization of the polynomials mapping Z into Z.
and conclude that (L0,…,Ln) is a basis of Rn[X]. (Consider the difference of the two sides and count its roots, Corollary 8.8.)
Deduce the interpolation theorem: for any values y0,…,yn∈R there is a uniqueP∈Rn[X] with P(xi)=yi for all i. In the Lagrange basis, what are the coordinates of a polynomialP?
Prove the identities
i=0∑nLi=1and, for 0≤k≤n,i=0∑nxikLi=Xk.
Part II — The Newton basis and divided differences. Set N0=1 and Nk=(X−x0)(X−x1)⋯(X−xk−1) for 1≤k≤n. For a function f defined at the nodes, define the divided differences by f[xi]=f(xi) and
Prove that each Bk is integer-valued. (Treat m≥k, 0≤m<k and m<0 separately; for m=−q<0, show Bk(−q)=(−1)k(kq+k−1).)
Prove Pólya’s characterization: P∈Rn[X] is integer-valued if and only if its coordinates in the basis(B0,…,Bn) are integers.
Deduce: if P∈Rn[X] takes integer values at n+1consecutive integers a,a+1,…,a+n, then P is integer-valued. (Shift: apply the study to Q(X)=P(X+a).)
Deduce from question 16 that a product of k consecutive integers is always divisible by k!.
Let P=6X(X+1)(2X+1). Compute its Newton table at 0,1,2,3, write P in the basis(Bk), and conclude that P is integer-valued although none of its monomial coefficients is an integer. Verify ΔP=(X+1)2 and deduce P(m)=12+22+⋯+m2 for m∈N.
Part V — Dividends.
Let P∈Rn[X] interpolate the values 2i at i=0,1,…,n. Show that P=B0+B1+⋯+Bn and that P(n+1)=2n+1−1: the “doubling pattern” always breaks at the very next point.
(Discrete antiderivative) Prove that for all integers m≥1 and k≥0,
j=0∑m−1Bk(j)=Bk+1(m),
i.e. the hockey-stick identity ∑j=km−1(kj)=(k+1m).
Expand X2 and X3 in the basis(Bk) and deduce closed formulas for ∑j=0m−1j2 and ∑j=0m−1j3; recover Nicomachus’ identity 13+⋯+m3=(1+⋯+m)2.
Take n=2 and nodes 0,1,2. Write the coordinates of X2 in the three bases of this problem: the monomial basis, the Lagrange basis, the Newton basis. Check the three answers against questions 4 and 9.
Synthesis. In four sentences: which vector-space concept makes question 4 automatic; why the Newton basis computes coordinatesrecursively while the Lagrange basis reads them off instantly; which freeness criterion both bases share; and in what precise sense Pólya’s theorem says that integrality of a polynomial is a property of its coordinatesin the right basis.
Solution
Solution of Problem 18.1.
1.Li is a product of n linear factors divided by a nonzero constant (the xi are distinct), so degLi=n. Evaluating at xj with j=i: the factor X−xj of the numerator vanishes, so Li(xj)=0. At xi, numerator and denominator coincide: Li(xi)=1.
2. Suppose ∑iλiLi=0. Evaluate at xj: all terms die except λjLj(xj)=λj, so λj=0 for every j: the family is free.
3. Let D=P−∑iP(xi)Li. Then degD≤n and, by question 1, D(xj)=P(xj)−P(xj)=0 for the n+1 distinct points x0,…,xn. A nonzero polynomial of degree ≤n has at most n roots (Corollary 8.8), so D=0. Thus every P∈Rn[X] is a combination of the Li: the family is generating, and with question 2, a basis.
4. Given y0,…,yn, the polynomialP=∑iyiLi has degree ≤n and interpolates. Uniqueness: an interpolating P has, by question 3, coordinates(P(x0),…,P(xn))=(y0,…,yn) in the basis(Li), and coordinates in a basis are unique (Proposition 18.15). The coordinates of P in the Lagrange basis are its values at the nodes — this is the whole point of the basis.
5. Apply question 3 to P=Xk (0≤k≤n):
Xk=i=0∑nxikLi,
and k=0 gives ∑iLi=1.
6.degNk=k exactly: the family (N0,…,Nn) is a staircase of degrees in Rn[X], hence a basis by Example 18.20 (freeness from Proposition 18.19 (1), generation by finite descent on the degree).
8.degS≤n since Q,R have degree ≤n−1. At x0: S(x0)=xn−x0−(x0−xn)R(x0)=R(x0)=f(x0). At xn: S(xn)=xn−x0(xn−x0)Q(xn)=Q(xn)=f(xn). At an interior node xi (1≤i≤n−1), both Q and R take the value f(xi), so
S(xi)=xn−x0(xi−x0)−(xi−xn)f(xi)=f(xi).
9. Induction on the number of nodes. One node: the interpolant is the constant f(x0)=f[x0]. Assume the claim for k nodes and let S interpolate at x0,…,xk; by uniqueness (question 4), S is given by Aitken’s lemma from R (nodes x0,…,xk−1) and Q (nodes x1,…,xk). The coefficient of Xk in S is
by the induction hypothesis and the defining recurrence.
10. Let Pk interpolate f at x0,…,xk. The difference Pk−Pk−1 has degree ≤k and vanishes at x0,…,xk−1, so by the factor theorem applied k times (Theorem 8.7) it equals cNk for a constant c; comparing coefficients of Xk and using question 9, c=f[x0,…,xk]. Telescoping from P0=f(x0)N0 gives Newton’s formula. For the closed form, write Pk=∑i≤kf(xi)Li (Lagrange, on the nodes x0,…,xk) and read the coefficient of Xk: each Li contributes ∏j=i(xi−xj)1, whence
f[x0,…,xk]=i=0∑k∏j=i,j≤k(xi−xj)f(xi).
The right side is invariant under any permutation of the nodes, so the divided difference does not depend on their ordering.
11. If P=aXm+(lower degrees), the binomial theorem gives
ΔP=a((X+1)m−Xm)+⋯=amXm−1+(lower degrees),
because (X+1)m−Xm=mXm−1+… and the lower-degree part of P contributes degree ≤m−2 after Δ (or degree ≤m−2 terms). So degΔP=m−1 with leading coefficient ma. A constant c gives Δc=c−c=0.
12.degBk=k: staircase, hence a basis of Rn[X] (Example 18.20). For ΔBk (k≥1), factor the common product:
13. Write P=∑k=0nckBk (basis, question 12). Apply Δj: by question 12, ΔjP=∑k≥jckBk−j. Evaluate at 0: B0(0)=1 and Bm(0)=0 for m≥1 (the factor X vanishes), so (ΔjP)(0)=cj. This is the forward-difference formula.
14. Induction on k. For k=0 the identity reads P(0)=P(0). Assume it for k and apply it to ΔP:
(Δk+1P)(0)=j=0∑k(−1)k−j(jk)(P(j+1)−P(j)).
Collect the coefficient of P(i): it is (−1)k−i+1(i−1k)⋅(−1)0 from the first sum (shifted) and −(−1)k−i(ik) from the second — together
(−1)k+1−i((i−1k)+(ik))=(−1)k+1−i(ik+1)
by Pascal’s rule, which is the identity at rank k+1.
15. Iterating question 11 from degree n, leading coefficient an: after one Δ, degree n−1 and leading coefficient nan; after two, n(n−1)an; after n steps, degree 0 and value n(n−1)⋯1an=n!an, a constant. One more Δ kills it: Δn+1P=0.
16. If m≥k: Bk(m)=(km)∈N. If 0≤m<k: one factor of m(m−1)⋯(m−k+1) is zero, so Bk(m)=0. If m=−q with q≥1:
17. (⇐) If P=∑kckBk with ck∈Z, then for m∈Z, P(m)=∑kckBk(m)∈Z by question 16. (⇒) If P is integer-valued, its coordinates are ck=(ΔkP)(0)=∑j=0k(−1)k−j(jk)P(j) (questions 13 and 14), an integer combination of the integers P(0),…,P(k). This is Pólya’s characterization of integer-valued polynomials.
18. Set Q(X)=P(X+a), a polynomial of degree ≤n with Q(0),Q(1),…,Q(n)∈Z. Its coordinates in (Bk)k≤n are ck=∑j≤k(−1)k−j(jk)Q(j)∈Z (question 14 uses only the values at 0,…,k≤n). By question 17 (⇐), Q is integer-valued on all of Z, hence so is P(X)=Q(X−a).
19. A product of k consecutive integers is m(m−1)⋯(m−k+1)=k!Bk(m) for some m∈Z, and Bk(m)∈Z by question 16: the product is divisible by k!.
20. Values of P=6X(X+1)(2X+1) at 0,1,2,3: 0,1,5,14. Difference table: Δ row 1,4,9; Δ2 row 3,5; Δ3 row 2. Hence, by question 13,
P=0⋅B0+1⋅B1+3B2+2B3,
with integer coordinates: P is integer-valued (question 17), while its monomial coefficients 31,21,61 are not integers. Direct computation:
Telescoping P(m)=∑j=0m−1ΔP(j)=∑j=1mj2 (with P(0)=0): the sum-of-squares formula.
21. The values 2i at i=0,…,n have difference table constantly 1 on the left edge: Δk of the sequence (2i) is (2i) again (since 2i+1−2i=2i), so (ΔkP)(0)=20=1 for all k≤n, and P=B0+B1+⋯+Bn by question 13. Then
P(n+1)=k=0∑n(kn+1)=2n+1−(n+1n+1)=2n+1−1=2n+1:
the pattern breaks at the first uncontrolled point.
Expanding the last expression: (2m)+6(3m)+6(4m)=2m(m−1)[1+2(m−2)+2(m−2)(m−3)]=4m2(m−1)2=(2m)2. Replacing m by m+1: 13+⋯+m3=(2m(m+1))2=(1+⋯+m)2, Nicomachus’ identity.
25. (i) Question 4 is automatic because (Li) is a basis: existence and uniqueness of interpolation are exactly existence and uniqueness of coordinates. (ii) The Newton basis is a staircase, so coordinates are computed by successive divisions — each new node adds one term without disturbing the previous ones — whereas the Lagrange coordinates of P are the values P(xi), available with no computation at all. (iii) Both bases are free by the same two criteria of Proposition 18.19: distinct degrees for Newton, evaluation at the nodes for Lagrange. (iv) Pólya’s theorem says that “P(Z)⊆Z”, a property of values, is equivalent to integrality of the coordinates in the basis(Bk) — the arithmetic of a polynomial becomes visible only in the basis adapted to the question.