Mathematics · Book 3 · Bachelor Year 1

University Mathematics — Year 1

University Mathematics — Year 1 · Bachelor Year 1

18Vector Spaces

Linear algebra begins here: the axioms of vector spaces isolate what R2\R^2, R3\R^3, polynomial spaces and function spaces have in common — one can add, and scale. Two chapters build the theory (Chapter 19 adds dimension); the language they set up — span, free family, basis, direct sum — is the daily bread of every chapter after them. Throughout, KK denotes R\R or C\C (scalars).

18.1 Definition and examples

Definition 18.1 (Vector space)

A KK-vector space is a set EE with an addition making (E,+)(E, +) an abelian group (zero written 0E0_E or 00), and a scalar multiplication K×EEK \times E \to E such that, for all λ,μK\lambda, \mu \in K and x,yEx, y \in E:

λ(x+y)=λx+λy,(λ+μ)x=λx+μx,λ(μx)=(λμ)x,1x=x.\lambda(x + y) = \lambda x + \lambda y,\quad (\lambda + \mu) x = \lambda x + \mu x,\quad \lambda(\mu x) = (\lambda\mu) x,\quad 1\,x = x .

Consequences: 0x=0E0\,x = 0_E, λ0E=0E\lambda\,0_E = 0_E, (1)x=x(-1)x = -x, and λx=0E    λ=0\lambda x = 0_E \implies \lambda = 0 or x=0Ex = 0_E (multiply by λ1\lambda^{-1}).

Proof of the consequences. For 0x=0E0\,x = 0_E: from (0+0)x=0x+0x(0 + 0)x = 0x + 0x and (0+0)x=0x(0+0)x = 0x, cancel 0x0x in the group (E,+)(E, +). For λ0E\lambda\,0_E: same trick on λ(0E+0E)\lambda(0_E + 0_E). For (1)x(-1)x: add xx,

x+(1)x=1x+(1)x=(1+(1))x=0x=0E,x + (-1)x = 1\,x + (-1)x = \bigl(1 + (-1)\bigr)x = 0\,x = 0_E ,

so (1)x(-1)x is the additive inverse of xx. Finally if λx=0E\lambda x = 0_E with λ0\lambda \neq 0: multiply by λ1\lambda^{-1} (the scalars form a field) and use the two axioms λ1(λx)=(λ1λ)x=1x=x\lambda^{-1}(\lambda x) = (\lambda^{-1}\lambda)x = 1x = x together with λ10E=0E\lambda^{-1}0_E = 0_E: x=0Ex = 0_E. Small as they are, these four rules are used silently on every page that follows — and the last one is exactly where fields are needed: over the scalars Z\Z, the “space” Z/2Z\Z/2\Z would violate it with 2x=02\,x = 0.

Example 18.2

KnK^n (coordinatewise operations); the polynomials K[X]K[X]; the functions F(A,K)\mathcal{F}(A, K) from any set AA to KK (pointwise operations) — containing continuous functions, sequences F(N,R)\mathcal{F}(\N, \R), etc.; C\C as an R\R-vector space. In each case the axioms are inherited from those of KK.

Definition 18.3 (Subspace)

FEF \subseteq E is a subspace when 0EF0_E \in F and FF is stable under addition and scalar multiplication — equivalently:

Fandx,yF, λK,x+λyF.F \neq \emptyset \qquad\text{and}\qquad \forall x, y \in F,\ \forall \lambda \in K,\quad x + \lambda y \in F .

A subspace is itself a vector space. Any intersection of subspaces is a subspace; a union almost never is (same proof as Exercise 7.6).

Example 18.4

In F(R,R)\mathcal{F}(\R, \R): the continuous functions, the differentiable ones, the polynomials of degree n\leq n (written Kn[X]K_n[X] inside K[X]K[X]), the solutions of a homogeneous linear differential equation (Theorem 5.10 said just that). Non-examples: {f:f(0)=1}\{f : f(0) = 1\} (no zero), degree exactly nn (not stable under addition).

Example 18.5 (Subspace or not: four verdicts, argued)

In the space of real sequences:

  • {u:u bounded}\{u : u \text{ bounded}\} is a subspace: 00 is bounded, and if unM\abs{u_n} \leq M, vnM\abs{v_n} \leq M', then un+λvnM+λM\abs{u_n + \lambda v_n} \leq M + \abs\lambda M'.
  • {u:un1}\{u : u_n \to 1\} is not: the zero sequence is missing (and the sum of two members tends to 22).
  • {u:u monotone}\{u : u \text{ monotone}\} is not: un=nu_n = n and vn=n+(1)nv_n = -n + (-1)^n are monotone, their sum (1)n(-1)^n is not; stability under addition is the axiom that fails, even though the set contains 00 and all scalar multiples of its members.
  • {u:un+1=un2}\{u : u_{n+1} = u_n^2\} is not: it contains 00 but 2u2u escapes as soon as uu is a nonzero member (2un+1(2un)22u_{n+1} \neq (2u_n)^2 in general) — squaring is the nonlinearity.

The working order is always the same: test 00 first (cheapest), then stability — and to refute, one explicit counterexample pair beats any amount of doubt.

18.2 Span, sums, direct sums

Definition 18.6 (Linear combinations, span)

A linear combination of the family (x1,,xp)(x_1, \dots, x_p) of vectors of EE is any λ1x1++λpxp\lambda_1 x_1 + \dots + \lambda_p x_p (λiK\lambda_i \in K). The set of all of them is the span Vect(x1,,xp)\operatorname{Vect}(x_1, \dots, x_p): it is a subspace, the smallest one containing the family.

Proof of the two assertions. Stability: a sum of two linear combinations λixi+μixi=(λi+μi)xi\sum\lambda_i x_i + \sum\mu_i x_i = \sum(\lambda_i + \mu_i)x_i is again one, and so is a scalar multiple μλixi=(μλi)xi\mu\sum\lambda_i x_i = \sum(\mu\lambda_i) x_i; the zero combination shows 00 belongs: the span is a subspace. Minimality: let HH be any subspace containing x1,,xpx_1, \dots, x_p. By stability under scalar multiplication each λixiH\lambda_i x_i \in H, and by stability under addition their sum lies in HH: every linear combination belongs to HH, i.e. Vect(x1,,xp)H\operatorname{Vect}(x_1, \dots, x_p) \subseteq H. So the span is contained in every subspace containing the family: it is the smallest one.

Definition 18.7 (Sum, direct sum)

For subspaces F,GF, G of EE:

F+G={u+v:uF, vG}F + G = \{\,u + v : u \in F,\ v \in G\,\}

is a subspace (the smallest containing FGF \cup G). The sum is direct, written FGF \oplus G, when every element of F+GF + G decomposes uniquely as u+vu + v; equivalently (see below) when FG={0}F \cap G = \{0\}. When E=FGE = F \oplus G, the subspaces are supplementary in EE.

Example 18.8 (A sum of two lines)

In R3\R^3, let F=Vect((1,0,1))F = \operatorname{Vect}\bigl((1,0,1)\bigr) and G=Vect((0,1,1))G = \operatorname{Vect}\bigl((0,1,1)\bigr). Their sum is

F+G={a(1,0,1)+b(0,1,1)}={(a, b, a+b)}={(x,y,z):z=x+y},F + G = \{\,a(1,0,1) + b(0,1,1)\,\} = \{(a,\ b,\ a + b)\} = \{(x, y, z) : z = x + y\},

the plane through the origin containing both lines. It is strictly bigger than the union FGF \cup G (the mere cross of the two lines): the vector (1,1,2)=(1,0,1)+(0,1,1)(1, 1, 2) = (1,0,1) + (0,1,1) lies in the sum but on neither line. And FG={0}F \cap G = \{0\} (a common vector requires a(1,0,1)=b(0,1,1)a(1,0,1) = b(0,1,1), whose first two coordinates force a=b=0a = b = 0): the sum is direct, and FGF \oplus G is exactly that plane.

Proposition 18.9

F+GF + G is direct if and only if FG={0}F \cap G = \{0\}.

Proof. If some w0w \neq 0 lies in FGF \cap G: w=w+0=0+ww = w + 0 = 0 + w are two decompositions of ww. Conversely, if u+v=u+vu + v = u' + v' with u,uFu, u' \in F, v,vGv, v' \in G, then uu=vvu - u' = v' - v belongs to FG={0}F \cap G = \{0\}: decompositions are unique.

Method 18.10 (Proving E=FGE = F \oplus G)

Two things to check, each with its standard opening move.

  1. Trivial intersection. Take xFGx \in F \cap G, write out both membership conditions, and squeeze x=0x = 0. (Never argue by picture: cf. the pitfalls below.)
  2. Sum is everything. Take an arbitrary xEx \in E and produce the decomposition x=f+gx = f + g — either by guessing ff from the target (ff must satisfy the defining property of FF, which usually dictates its formula) or by solving the linear system expressing xx against generators of FF and GG.

When the decomposition formula is guessed, uniqueness is automatic from step 1; when only existence is unclear, step 2 is where the work lives. The two examples below run the method: for even/odd functions the formula for ff is forced by evaluating the desired identity at xx and x-x; for polynomials vanishing at a point, by evaluating at aa.

Example 18.11

In F(R,R)\mathcal{F}(\R, \R), the even functions P\mathcal{P} and the odd functions I\mathcal{I} are supplementary: any ff writes

f(x)=f(x)+f(x)2even+f(x)f(x)2odd,f(x) = \underbrace{\frac{f(x) + f(-x)}{2}}_{\text{even}} + \underbrace{\frac{f(x) - f(-x)}{2}}_{\text{odd}},

and a function both even and odd is zero. (Applied to exp\exp, this is the pair (cosh,sinh)(\cosh, \sinh) of Chapter 4.)

Example 18.12 (A supplementary pair in Kn[X]K_n[X])

Fix aKa \in K and set F={PKn[X]:P(a)=0}F = \{P \in K_n[X] : P(a) = 0\}, G=Vect(1)G = \operatorname{Vect}(1) (the constants). Then Kn[X]=FGK_n[X] = F \oplus G. Indeed FGF \cap G consists of the constants vanishing at aa, i.e. {0}\{0\}; and every PP decomposes as

P=(PP(a))F+P(a)G.P = \underbrace{\bigl(P - P(a)\bigr)}_{\in F} + \underbrace{P(a)}_{\in G} .

The decomposition is worth memorizing: subtracting the value at a point is the standard way to project onto “functions vanishing at aa”. Note that FF is a large subspace and GG a small one; a supplementary pair need not be balanced in any sense.

Example 18.13 (A supplementary subspace is never unique)

In R2\R^2, let F=Vect((1,0))F = \operatorname{Vect}\bigl((1,0)\bigr) (the xx-axis). Both G=Vect((0,1))G = \operatorname{Vect}\bigl((0,1)\bigr) and G=Vect((1,1))G' = \operatorname{Vect}\bigl((1,1)\bigr) are supplementary to FF: each meets FF only at 00, and each pair sums to R2\R^2. The decompositions of a same vector differ:

(2, 1.5)=(2,0)F+(0,1.5)G=(0.5, 0)F+(1.5, 1.5)G.(2,\ 1.5) = \underbrace{(2, 0)}_{\in F} + \underbrace{(0, 1.5)}_{\in G} = \underbrace{(0.5,\ 0)}_{\in F} + \underbrace{(1.5,\ 1.5)}_{\in G'} .

In fact every line other than FF itself is a supplementary of FF in R2\R^2: supplementaries are plentiful, and speaking of “the” supplementary is meaningless until an extra structure (an inner product, Chapter 23) singles one out.

Two decompositions of the same point of ℝ2 along F (the x-axis): with supplementary G (vertical drop) and with supplementary G' (oblique drop). The F-components differ: a projection depends on the direction of descent.
Two decompositions of the same point of R2\R^2 along FF (the xx-axis): with supplementary GG (vertical drop) and with supplementary GG' (oblique drop). The FF-components differ: a projection depends on the direction of descent.

18.3 Free families, generating families, bases

Definition 18.14

A family (x1,,xp)(x_1, \dots, x_p) of vectors of EE is:

  • generating (of EE) when Vect(x1,,xp)=E\operatorname{Vect}(x_1,\dots,x_p) = E;
  • free (its vectors linearly independent) when

    λ1x1++λpxp=0    λ1==λp=0;\lambda_1 x_1 + \dots + \lambda_p x_p = 0 \implies \lambda_1 = \dots = \lambda_p = 0 ;

    otherwise linked;

  • a basis when it is free and generating.

Proposition 18.15 (Coordinates)

(e1,,en)(e_1, \dots, e_n) is a basis of EE if and only if every xEx \in E is uniquely a combination x=λ1e1++λnenx = \lambda_1 e_1 + \dots + \lambda_n e_n; the scalars λi\lambda_i are the coordinates of xx in the basis.

Proof. Generating == existence of the decomposition. Uniqueness == freeness: two decompositions of the same xx differ by a combination equal to 00; freeness forces all its coefficients — the differences of coordinates — to vanish. Conversely, a nontrivial null combination gives the two decompositions 0=λiei=0ei0 = \sum \lambda_i e_i = \sum 0\,e_i.

Example 18.16

The canonical basis of KnK^n: ei=(0,,1,,0)e_i = (0, \dots, 1, \dots, 0) (11 in slot ii). The monomials (1,X,X2,,Xn)(1, X, X^2, \dots, X^n): a basis of Kn[X]K_n[X] (freeness: a null combination is the zero polynomial, so all coefficients vanish, Definition 8.1). In C\C over R\R: the basis (1,i)(1, \iu).

Remark 18.17 (Coordinates are a team effort)

The first coordinate of xx in a basis (e1,,en)(e_1, \dots, e_n) depends on all the basis vectors, not just e1e_1. In R2\R^2: the vector (3,1)(3, 1) has first coordinate 33 in the canonical basis, but first coordinate 22 in the basis ((1,0),(1,1))\bigl((1,0), (1,1)\bigr) — solve (3,1)=a(1,0)+b(1,1)(3,1) = a(1,0) + b(1,1): b=1b = 1, a=2a = 2. Changing one basis vector reshuffles every coordinate; Chapter 21 will package this reshuffling into the change-of-basis matrix.

Example 18.18 (Testing a candidate basis, start to finish)

Is F=(1+X, 1+X2, X+X2)\mathcal{F} = (1 + X,\ 1 + X^2,\ X + X^2) a basis of R2[X]\R_2[X]? Write u1,u2,u3u_1, u_2, u_3 for the three polynomials. Freeness: a null combination au1+bu2+cu3=0a\,u_1 + b\,u_2 + c\,u_3 = 0 gives, coefficient by coefficient,

a+b=0,a+c=0,b+c=0;a + b = 0, \qquad a + c = 0, \qquad b + c = 0 ;

subtracting the first two, b=cb = c, then the third gives 2b=02b = 0: a=b=c=0a = b = c = 0, free. Generating: instead of solving three systems, notice the symmetric combination

u1+u2u3=(1+X)+(1+X2)(X+X2)=2,u_1 + u_2 - u_3 = (1 + X) + (1 + X^2) - (X + X^2) = 2 ,

so 1=12(u1+u2u3)1 = \frac12(u_1 + u_2 - u_3); then

X=u11=12(u1u2+u3),X2=u21=12(u1+u2+u3).X = u_1 - 1 = \tfrac12\bigl(u_1 - u_2 + u_3\bigr), \qquad X^2 = u_2 - 1 = \tfrac12\bigl(-u_1 + u_2 + u_3\bigr).

The monomials lie in the span, so everything does: F\mathcal{F} is a basis. As a bonus, assembling the three displays gives the coordinates of any P=α+βX+γX2P = \alpha + \beta X + \gamma X^2:

P=α+βγ2u1+αβ+γ2u2+α+β+γ2u3.P = \frac{\alpha + \beta - \gamma}{2}\,u_1 + \frac{\alpha - \beta + \gamma}{2}\,u_2 + \frac{-\alpha + \beta + \gamma}{2}\,u_3 .

(Sanity check with P=XP = X: coordinates (12,12,12)\bigl(\frac12, -\frac12, \frac12\bigr), as found above.) Two lessons: symmetry in the family usually hides a shortcut combination; and once dimension is available (Chapter 19), the whole generating half of this work will come free of charge — three free vectors of a 33-dimensional space always form a basis.

Proposition 18.19 (Useful freeness criteria)

  1. A family of nonzero polynomials of pairwise distinct degrees is free.
  2. Adding a vector to a free family keeps it free if and only if the vector is outside the span of the family.
  3. Any subfamily of a free family is free; any family containing a generating family is generating.

Proof. (1) In a null combination, look at the highest degree present: its coefficient must vanish (nothing cancels that degree), and cascade down.

(2) If xVect(x1,,xp)x \in \operatorname{Vect}(x_1, \dots, x_p), the relation xλixi=0x - \sum\lambda_i x_i = 0 is nontrivial. Conversely, a nontrivial null combination of (x1,,xp,x)(x_1, \dots, x_p, x) must involve xx with a nonzero coefficient (else it contradicts freeness of the small family), and solving for xx puts it in the span.

(3) Subfamily: a null combination of the subfamily is one of the whole family with the missing coefficients set to 00; freeness of the big family kills all of them. Superfamily: every vector of EE is already a combination of the generating part; give the extra vectors the coefficient 00.

Example 18.20 (The staircase principle)

Let P0,P1,,PnKn[X]P_0, P_1, \dots, P_n \in K_n[X] with degPk=k\deg P_k = k for each kk (a “staircase” of degrees). Then (P0,,Pn)(P_0, \dots, P_n) is a basis of Kn[X]K_n[X]. Freeness is Proposition 18.19 (1). For the generating property, argue by finite descent on the degree: let QKn[X]Q \in K_n[X], Q0Q \neq 0, of degree dd, with leading coefficient aa, and let b0b \neq 0 be the leading coefficient of PdP_d. Then QabPdQ - \frac ab P_d has degree <d< d (the top terms cancel); replacing QQ by this difference and iterating, after at most n+1n + 1 steps one reaches the zero polynomial, and unwinding the subtractions expresses QQ as a combination of the PkP_k. Two staircases already met: the shifted powers ((Xa)k)0kn\bigl((X-a)^k\bigr)_{0 \leq k \leq n} (Exercise 18.4), and the Newton products ((Xx0)(Xx1)(Xxk1))0kn\bigl((X - x_0)(X - x_1)\cdots(X - x_{k-1})\bigr)_{0 \leq k \leq n}, put to work in the weekend problem.

Example 18.21 (Freeness in function spaces)

In F(R,R)\mathcal{F}(\R,\R), the family (ea1x,,eapx)(\eu^{a_1 x}, \dots, \eu^{a_p x}) with a1<<apa_1 < \dots < a_p is free: divide a null combination by eapx\eu^{a_p x} and let x+x \to +\infty; the last coefficient dies, and one cascades down (Exercise 18.8 details this and variants). Freeness of functions is proved by evaluating: at well-chosen points, at infinity, or after differentiating.

Example 18.22 (A hidden relation shrinks a span)

In F(R,R)\mathcal{F}(\R, \R), what is Vect(1, cos2, sin2)\operatorname{Vect}(1,\ \cos^2,\ \sin^2)? The identity cos2+sin2=1\cos^2 + \sin^2 = 1 is a nontrivial null combination

11+(1)cos2+(1)sin2=0:1\cdot\mathbf{1} + (-1)\cos^2 + (-1)\sin^2 = 0 :

the family is linked, and the span is already generated by (1,cos2)(1, \cos^2) alone (sin2=1cos2\sin^2 = 1 - \cos^2). That smaller family is free: a+bcos2x=0a + b\cos^2 x = 0 for all xx gives, at x=0x = 0 and x=π2x = \frac\pi2: a+b=0a + b = 0 and a=0a = 0. So the span is a plane inside the function space — and it also contains cos2x=2cos2x1\cos 2x = 2\cos^2 x - 1: linear-looking families of trigonometric functions routinely collapse under identities, which is why freeness must be proved, never assumed from the list’s length.

Remark 18.23 (Common pitfalls)

Four classical traps. Pairwise is not enough: in R2\R^2, the vectors (1,0)(1,0), (0,1)(0,1), (1,1)(1,1) are pairwise non-proportional, yet linked — freeness is a property of the whole family, tested by one global combination, never two by two. The zero vector poisons everything: any family containing 00 is linked (10=01\cdot 0 = 0 is a nontrivial relation), however innocent the other vectors. Union is not sum: FGF \cup G is almost never a subspace (Definition 18.3); the smallest subspace containing both is F+GF + G, usually much bigger than the union — in R2\R^2, two distinct lines have union a cross, sum the whole plane. Direct requires trivial intersection, not disjointness: two subspaces are never disjoint (both contain 00); the correct condition is FG={0}F \cap G = \{0\}, and it must be proved, not read off a drawing — cf. Example 18.13, where many different GG work. Freeness depends on the scalars: the pair (1,i)(1, \iu) is free in C\C seen as an R\R-vector space, but linked in C\C seen as a C\C-vector space (i1+(1)i=0\iu\cdot 1 + (-1)\cdot\iu = 0). Always know which field is acting before declaring a family free — the weekend problem of Chapter 19 turns exactly this sensitivity into irrationality proofs.

Remark 18.24 (Where this language goes)

Everything after this chapter speaks the language set up here. Chapter 19 counts basis vectors and turns “free” and “generating” into inequalities on a single integer, the dimension. Chapter 20 studies the maps compatible with the two operations; direct sums become projectors there. Chapter 21 encodes vectors by their coordinates in a basisProposition 18.15 is the licence for that encoding — and Chapter 23 adds lengths and angles on top of the linear structure. In the Year 2 volume the same axioms, verbatim, run over arbitrary fields and in infinite dimension; nothing in this chapter used finiteness anywhere.

Remark 18.25 (Three threads to follow through Book 3)

Watch three specific ideas of this chapter grow. The staircase principle (Example 18.20) reappears as the Newton basis in this chapter’s weekend problem, as the binomial basis (Bk)(B_k) there, and as the polynomial alternant trick in the weekend problem of Chapter 22: one lemma, three determinant-free dividends. Evaluation as a freeness test (Example 18.21) becomes the interpolation isomorphism of Chapter 20, then the Vandermonde criterion of Chapter 22, then the Gram test of Chapter 23: the same reflex, sharpened three times. Direct sums (Definition 18.7) become projectors in Chapter 20, orthogonal splittings E=FFE = F \oplus F^\perp in Chapter 23, and the explained-plus-residual decomposition of least squares in the weekend problem of Chapter 25. Very little of this book is not, at bottom, one of these three ideas wearing new clothes.

18.4 Exercises

Exercise 18.1

Which of the following are subspaces?

  1. {(x,y,z)R3:x+2yz=0}\{(x, y, z) \in \R^3 : x + 2y - z = 0\};
  2. {(x,y,z)R3:x+2yz=1}\{(x, y, z) \in \R^3 : x + 2y - z = 1\};
  3. {(x,y)R2:xy0}\{(x, y) \in \R^2 : xy \geq 0\};
  4. {PR[X]:P(1)=0}\{P \in \R[X] : P(1) = 0\};
  5. {fF(R,R):f bounded}\{f \in \mathcal{F}(\R,\R) : f \text{ bounded}\}.
Solution

Solution of Exercise 18.1.

  1. Yes: contains 00, and the defining equation is linear (stable under x+λyx + \lambda y).
  2. No: does not contain (0,0,0)(0,0,0).
  3. No: (1,0)(1, 0) and (0,1)(0, -1) belong (xy=0xy = 0), their sum (1,1)(1, -1) does not (xy=1<0xy = -1 < 0).
  4. Yes: 00 vanishes at 11; (P+λQ)(1)=P(1)+λQ(1)=0(P + \lambda Q)(1) = P(1) + \lambda Q(1) = 0.
  5. Yes: the zero function is bounded; if fM\abs f \leq M and gM\abs g \leq M', then f+λgM+λM\abs{f + \lambda g} \leq M + \abs\lambda M'.

Exercise 18.2

In R3\R^3, is (1,2,1)(1, 2, 1) in Vect((1,0,1),(1,1,0))\operatorname{Vect}\bigl((1,0,1),\, (1,1,0)\bigr)? And (2,1,1)(2, 1, 1)? Describe Vect((1,0,1),(1,1,0))\operatorname{Vect}\bigl((1,0,1),(1,1,0)\bigr) by an equation.

Solution

Solution of Exercise 18.2.

(1,2,1)=a(1,0,1)+b(1,1,0)(1,2,1) = a(1,0,1) + b(1,1,0) requires a+b=1a + b = 1, b=2b = 2, a=1a = 1: incompatible (a+b=31a + b = 3 \neq 1): not in the span. (2,1,1)=a(1,0,1)+b(1,1,0)(2,1,1) = a(1,0,1) + b(1,1,0): b=1b = 1, a=1a = 1, a+b=2a + b = 2: consistent, so (2,1,1)=(1,0,1)+(1,1,0)(2,1,1) = (1,0,1) + (1,1,0), in the span.

Equation: (x,y,z)=(a+b,b,a)(x, y, z) = (a + b, b, a) means x=y+zx = y + z: the span is the plane {xyz=0}\{x - y - z = 0\}.

Exercise 18.3

Decide freeness in R3\R^3:   ((1,1,0),(1,0,1),(0,1,1))\;\bigl((1,1,0), (1,0,1), (0,1,1)\bigr);   ((1,2,3),(2,4,6))\;\bigl((1,2,3), (2,4,6)\bigr);   ((1,0,0),(1,1,0),(1,1,1),(0,1,1))\;\bigl((1,0,0), (1,1,0), (1,1,1), (0,1,1)\bigr).

Solution

Solution of Exercise 18.3.

First family: λ(1,1,0)+μ(1,0,1)+ν(0,1,1)=0\lambda(1,1,0) + \mu(1,0,1) + \nu(0,1,1) = 0 gives λ+μ=0\lambda + \mu = 0, λ+ν=0\lambda + \nu = 0, μ+ν=0\mu + \nu = 0: adding, 2(λ+μ+ν)=02(\lambda + \mu + \nu) = 0, and subtracting each equation, λ=μ=ν=0\lambda = \mu = \nu = 0: free.

Second: (2,4,6)=2(1,2,3)(2,4,6) = 2(1,2,3): linked.

Third: four vectors in R3\R^3 — necessarily linked once dimension is available (Chapter 19); directly: (0,1,1)=(1,0,0)+0(1,1,0)+(1,1,1)(0,1,1) = -(1,0,0) + 0\cdot(1,1,0) + (1,1,1), indeed (1,0,0)+(1,1,1)=(0,1,1)(-1,0,0) + (1,1,1) = (0,1,1): a nontrivial relation.

Exercise 18.4

Prove that (1,X1,(X1)2,(X1)3)(1, X - 1, (X-1)^2, (X-1)^3) is a basis of R3[X]\R_3[X], and give the coordinates of X3X^3 in it. (Taylor at 11!)

Solution

Solution of Exercise 18.4.

Polynomials 1,(X1),(X1)2,(X1)31, (X-1), (X-1)^2, (X-1)^3 have distinct degrees 0,1,2,30, 1, 2, 3: free (Proposition 18.19 (1)); four free vectors generating (every PR3[X]P \in \R_3[X] expands in powers of X1X - 1, e.g. by Taylor for polynomials, cf. the proof of Proposition 8.11): a basis. For X3X^3, Taylor at 11: P=X3P = X^3, P(1)=1P(1) = 1, P(1)=3P'(1) = 3, P(1)=6P''(1) = 6, P(1)=6P'''(1) = 6:

X3=1+3(X1)+3(X1)2+(X1)3,X^3 = 1 + 3(X - 1) + 3(X-1)^2 + (X-1)^3 ,

coordinates (1,3,3,1)(1, 3, 3, 1) (Pascal’s row, as expected from X3=((X1)+1)3X^3 = ((X-1)+1)^3).

Exercise 18.5 ★★

In R4\R^4, let F={(x,y,z,t):x=y=z}F = \{(x,y,z,t) : x = y = z\} and G={(x,y,z,t):x=t=0}G = \{(x,y,z,t) : x = t = 0\}. Prove that FG=R4F \oplus G = \R^4, and decompose (1,2,3,4)(1,2,3,4) accordingly.

Solution

Solution of Exercise 18.5.

FGF \cap G: the conditions x=y=zx = y = z and x=t=0x = t = 0 together give x=0x = 0, hence y=z=0y = z = 0, and t=0t = 0: the intersection is {0}\{0\}. Sum: given (x,y,z,t)(x,y,z,t), seek (a,a,a,b)F(a,a,a,b) \in F and (0,c,d,0)G(0,c,d,0) \in G summing to it: a=xa = x, b=tb = t, c=yxc = y - x, d=zxd = z - x: always possible. So R4=FG\R^4 = F \oplus G, and

(1,2,3,4)=(1,1,1,4)+(0,1,2,0).(1,2,3,4) = (1,1,1,4) + (0,1,2,0) .

Exercise 18.6 ★★

In the space of sequences, let FF be the set of convergent sequences and G=Vect(u)G = \operatorname{Vect}(u) where un=(1)nu_n = (-1)^n. Prove that FG={0}F \cap G = \{0\}. Is F+GF + G the whole space of sequences?

Solution

Solution of Exercise 18.6.

An element of GG is λu\lambda u; if it converges, then (as λun=λ(1)n\lambda u_n = \lambda(-1)^n has the two subsequential limits ±λ\pm \lambda) necessarily λ=0\lambda = 0: FG={0}F \cap G = \{0\}.

F+GF + G is not everything: it consists of sequences of the form cn+λ(1)nc_n + \lambda(-1)^n with (cn)(c_n) convergent. The sequence vn=nv_n = n is not of this form (vnλ(1)nv_n - \lambda(-1)^n is unbounded, never convergent). So FGF \oplus G \subsetneq (space of all sequences).

Exercise 18.7 ★★

Let F,G,HF, G, H be subspaces of EE. Prove that

F(G+(FH))=(FG)+(FH),F \cap (G + (F \cap H)) = (F \cap G) + (F \cap H),

and show by an example in R2\R^2 that the unrestricted distributivity F(G+H)=(FG)+(FH)F \cap (G + H) = (F\cap G) + (F \cap H) fails.

Solution

Solution of Exercise 18.7.

(\supseteq) Both FGF \cap G and FHF \cap H lie in FF, and their sum lies in G+(FH)G + (F \cap H): inclusion follows since the left side is a subspace containing both pieces — concretely, an element g+hg + h with gFGg \in F\cap G, hFHh \in F \cap H is in FF (sum of two elements of FF) and in G+(FH)G + (F \cap H).

(\subseteq) Let xFx \in F with x=g+hx = g + h, gGg \in G, hFHh \in F \cap H. Then g=xhFg = x - h \in F (difference of elements of FF), so gFGg \in F \cap G, and x=g+h(FG)+(FH)x = g + h \in (F \cap G) + (F \cap H).

Counterexample to full distributivity in R2\R^2: F=Vect(1,1)F = \operatorname{Vect}(1,1), G=Vect(1,0)G = \operatorname{Vect}(1,0), H=Vect(0,1)H = \operatorname{Vect}(0,1). Then G+H=R2G + H = \R^2, so F(G+H)=FF \cap (G+H) = F, while FG=FH={0}F \cap G = F \cap H = \{0\}: the right side is {0}F\{0\} \neq F.

Exercise 18.8 ★★★

Prove that the following families of F(R,R)\mathcal{F}(\R, \R) are free:

  1. (ea1x,,eapx)(\eu^{a_1 x}, \dots, \eu^{a_p x}) for a1<<apa_1 < \dots < a_p;
  2. (cosx,sinx,cos2x,sin2x)(\cos x, \sin x, \cos 2x, \sin 2x);
  3. (xxa1,,xxap)(x \mapsto \abs{x - a_1}, \dots, x \mapsto \abs{x - a_p}) for distinct aia_i (differentiability fails at exactly one point per function).
Solution

Solution of Exercise 18.8.

  1. Suppose iλieaix=0\sum_{i} \lambda_i \eu^{a_i x} = 0 for all xx. Multiply by eapx\eu^{-a_p x}: λp+i<pλie(aiap)xλp\lambda_p + \sum_{i < p} \lambda_i \eu^{(a_i - a_p)x} \to \lambda_p as x+x \to +\infty (each exponent aiap<0a_i - a_p < 0). The left side is identically 00, so λp=0\lambda_p = 0; iterate downward.
  2. Let acosx+bsinx+ccos2x+dsin2x=0a\cos x + b \sin x + c \cos 2x + d\sin 2x = 0 for all xx. Evaluate at x=0x = 0: a+c=0a + c = 0; at x=πx = \pi: a+c=0-a + c = 0; hence a=c=0a = c = 0, and the relation reduces to bsinx+dsin2x=0b\sin x + d \sin 2x = 0. Evaluate at x=π2x = \frac\pi2: b=0b = 0; then at x=π4x = \frac\pi4: d=0d = 0.
  3. Suppose λixai=0\sum \lambda_i \abs{x - a_i} = 0 for all xx. The function ijλixai\sum_{i \neq j} \lambda_i\abs{x - a_i} is differentiable at aja_j (each term is, away from its own corner), so λjxaj-\lambda_j \abs{x - a_j}, their difference, must be differentiable at aja_j too — which forces λj=0\lambda_j = 0 (\abs{\,\cdot\,} has a corner). This holds for every jj.

Exercise 18.9 ★★★

Let EE be a KK-vector space and F,G,HF, G, H subspaces with F+G=F+HF + G = F + H, FG=FHF \cap G = F \cap H and GHG \subseteq H. Prove G=HG = H. Give a counterexample without the hypothesis GHG \subseteq H.

Solution

Solution of Exercise 18.9.

Let hHh \in H. Since hHF+H=F+Gh \in H \subseteq F + H = F + G, write h=f+gh = f + g with fFf \in F, gGg \in G. Then f=hgHf = h - g \in H (both terms in HH, using GHG \subseteq H), so fFH=FGGf \in F \cap H = F \cap G \subseteq G, and h=f+gGh = f + g \in G. Hence HGH \subseteq G, and with the hypothesis GHG \subseteq H: equality.

Counterexample without GHG \subseteq H: in R2\R^2, take F=Vect(1,0)F = \operatorname{Vect}(1,0), G=Vect(0,1)G = \operatorname{Vect}(0,1), H=Vect(1,1)H = \operatorname{Vect}(1,1): then F+G=F+H=R2F + G = F + H = \R^2 and FG=FH={0}F \cap G = F \cap H = \{0\}, yet GHG \neq H.

Exercise 18.10 ★★

In R[X]\R[X], let P\mathcal P be the set of even polynomials (P(X)=P(X)P(-X) = P(X)) and I\mathcal I the set of odd ones (P(X)=P(X)P(-X) = -P(X)). Prove that R[X]=PI\R[X] = \mathcal P \oplus \mathcal I, and show that P=Vect(1,X2,X4,)\mathcal P = \operatorname{Vect}(1, X^2, X^4, \dots), i.e. that the even polynomials are exactly the polynomials in X2X^2.

Solution

Solution of Exercise 18.10.

Both sets are subspaces (the defining conditions are linear and hold for 00). Decomposition: for PR[X]P \in \R[X],

P(X)=P(X)+P(X)2P+P(X)P(X)2I,P(X) = \underbrace{\frac{P(X) + P(-X)}{2}}_{\in\,\mathcal P} + \underbrace{\frac{P(X) - P(-X)}{2}}_{\in\,\mathcal I},

and a polynomial both even and odd satisfies P=PP = -P, so P=0P = 0: the sum is direct and equals R[X]\R[X].

Now let P=kakXkP = \sum_k a_k X^k be even. Then P(X)P(X)=2k oddakXkP(X) - P(-X) = 2 \sum_{k \text{ odd}} a_k X^k is the zero polynomial, so every odd-degree coefficient vanishes (Definition 8.1): PVect(1,X2,X4,)P \in \operatorname{Vect}(1, X^2, X^4, \dots), i.e. P=Q(X2)P = Q(X^2) for a polynomial QQ. Conversely every polynomial in X2X^2 is even.

Exercise 18.11 ★★

Let (x1,x2,x3)(x_1, x_2, x_3) be a free family of a real vector space EE. Prove that (x1+x2, x2+x3, x3+x1)(x_1 + x_2,\ x_2 + x_3,\ x_3 + x_1) is free. Is the analogous family of four vectors (x1+x2, x2+x3, x3+x4, x4+x1)(x_1 + x_2,\ x_2 + x_3,\ x_3 + x_4,\ x_4 + x_1) free when (x1,x2,x3,x4)(x_1, x_2, x_3, x_4) is?

Solution

Solution of Exercise 18.11.

Suppose a(x1+x2)+b(x2+x3)+c(x3+x1)=0a(x_1 + x_2) + b(x_2 + x_3) + c(x_3 + x_1) = 0. Regrouping on the free family (x1,x2,x3)(x_1, x_2, x_3):

(a+c)x1+(a+b)x2+(b+c)x3=0    a+c=a+b=b+c=0.(a + c)\,x_1 + (a + b)\,x_2 + (b + c)\,x_3 = 0 \implies a + c = a + b = b + c = 0 .

Subtracting the first two equations gives c=bc = b; the third then gives 2b=02b = 0, so b=c=0b = c = 0, then a=0a = 0: the family is free.

For four vectors the analogous family is always linked:

(x1+x2)(x2+x3)+(x3+x4)(x4+x1)=0(x_1 + x_2) - (x_2 + x_3) + (x_3 + x_4) - (x_4 + x_1) = 0

is a nontrivial null combination (coefficients 1,1,1,11, -1, 1, -1), whatever (x1,x2,x3,x4)(x_1, x_2, x_3, x_4) is. The parity of the cycle length decides.

Exercise 18.12 ★★★

Let EE be a vector space over R\R (or C\C) and F1,,FkF_1, \dots, F_k proper subspaces of EE (each FiEF_i \neq E).

  1. Treat the case k=2k = 2 directly: if F1⊈F2F_1 \not\subseteq F_2 and F2⊈F1F_2 \not\subseteq F_1, pick xF1F2x \in F_1 \setminus F_2 and yF2F1y \in F_2 \setminus F_1 and locate x+yx + y.
  2. Prove in general that EF1FkE \neq F_1 \cup \dots \cup F_k: a vector space over an infinite field is never a finite union of proper subspaces. (Take kk minimal, pick xF1x \in F_1 outside the other FiF_i, pick yF1y \notin F_1, and follow the line ty+txt \mapsto y + tx.)
Solution

Solution of Exercise 18.12.

  1. If F1F2F_1 \subseteq F_2 or F2F1F_2 \subseteq F_1, the union is one of the two, hence proper. Otherwise pick xF1F2x \in F_1 \setminus F_2 and yF2F1y \in F_2 \setminus F_1, and consider x+yx + y. If x+yF1x + y \in F_1, then y=(x+y)xF1y = (x + y) - x \in F_1: contradiction. If x+yF2x + y \in F_2, then xF2x \in F_2: contradiction. So x+yF1F2x + y \notin F_1 \cup F_2, and EF1F2E \neq F_1 \cup F_2.
  2. Suppose for contradiction that E=F1FkE = F_1 \cup \dots \cup F_k, with kk chosen minimal among all such coverings. Minimality forbids F1F2FkF_1 \subseteq F_2 \cup \dots \cup F_k (else drop F1F_1), so there is xF1x \in F_1 with xFix \notin F_i for all i2i \geq 2. Since F1F_1 is proper, pick yF1y \notin F_1. For each scalar tt, the vector y+txy + t x lies in some FiF_i. It never lies in F1F_1: otherwise y=(y+tx)txF1y = (y + tx) - tx \in F_1 (as xF1x \in F_1). The field is infinite, so choose kk distinct scalars t1,,tkt_1, \dots, t_k: the kk vectors y+tjxy + t_j x fall into the k1k - 1 subspaces F2,,FkF_2, \dots, F_k, and two of them, say y+txy + t x and y+txy + t' x with ttt \neq t', lie in the same FiF_i (i2i \geq 2). Then their difference (tt)xFi(t - t')x \in F_i, so xFix \in F_i: contradiction. Hence no finite covering by proper subspaces exists.

18.5 Problem: interpolation, three bases for one space

Problem 18.1

Fix n+1n + 1 distinct points x0,x1,,xnx_0, x_1, \dots, x_n of R\R. This problem revisits Lagrange interpolation (Theorem 8.23) with the eyes of this chapter: the space Rn[X]\R_n[X] carries three natural bases — Lagrange’s, Newton’s, and (for equally spaced points) the binomial basis — and each basis makes one question easy. The road ends at a genuine arithmetic theorem: Pólya’s characterization of the polynomials mapping Z\Z into Z\Z.

Part I — The Lagrange basis. For 0in0 \leq i \leq n set

Li  =  jiXxjxixj    Rn[X].L_i \;=\; \prod_{j \neq i} \frac{X - x_j}{x_i - x_j} \;\in\; \R_n[X].
  1. Check that degLi=n\deg L_i = n and that Li(xj)=1L_i(x_j) = 1 if j=ij = i, and 00 if jij \neq i.
  2. Prove that the family (L0,,Ln)(L_0, \dots, L_n) is free.
  3. Prove that for every PRn[X]P \in \R_n[X],

    P  =  i=0nP(xi)Li,P \;=\; \sum_{i=0}^{n} P(x_i)\, L_i ,

    and conclude that (L0,,Ln)(L_0, \dots, L_n) is a basis of Rn[X]\R_n[X]. (Consider the difference of the two sides and count its roots, Corollary 8.8.)

  4. Deduce the interpolation theorem: for any values y0,,ynRy_0, \dots, y_n \in \R there is a unique PRn[X]P \in \R_n[X] with P(xi)=yiP(x_i) = y_i for all ii. In the Lagrange basis, what are the coordinates of a polynomial PP?
  5. Prove the identities

    i=0nLi=1and, for 0kn,i=0nxikLi=Xk.\sum_{i=0}^{n} L_i = 1 \qquad\text{and, for } 0 \leq k \leq n,\qquad \sum_{i=0}^{n} x_i^{k}\, L_i = X^{k} .

Part II — The Newton basis and divided differences. Set N0=1N_0 = 1 and Nk=(Xx0)(Xx1)(Xxk1)N_k = (X - x_0)(X - x_1) \cdots (X - x_{k-1}) for 1kn1 \leq k \leq n. For a function ff defined at the nodes, define the divided differences by f[xi]=f(xi)f[x_i] = f(x_i) and

f[xi,,xi+k]  =  f[xi+1,,xi+k]f[xi,,xi+k1]xi+kxi.f[x_i, \dots, x_{i+k}] \;=\; \frac{f[x_{i+1}, \dots, x_{i+k}] - f[x_i, \dots, x_{i+k-1}]} {x_{i+k} - x_i} .
  1. Prove that (N0,N1,,Nn)(N_0, N_1, \dots, N_n) is a basis of Rn[X]\R_n[X].
  2. Compute f[x0,x1]f[x_0, x_1] and f[x0,x1,x2]f[x_0, x_1, x_2] in terms of the values of ff, then compute all divided differences of f(x)=x2f(x) = x^2 at three arbitrary nodes.
  3. (Aitken’s lemma) Let RR interpolate ff at x0,,xn1x_0, \dots, x_{n-1} and QQ interpolate ff at x1,,xnx_1, \dots, x_n, both of degree n1\leq n - 1. Prove that

    S  =  (Xx0)Q(Xxn)Rxnx0S \;=\; \frac{(X - x_0)\,Q - (X - x_n)\,R}{x_n - x_0}

    interpolates ff at x0,x1,,xnx_0, x_1, \dots, x_n.

  4. Deduce, by induction on the number of nodes, that the coefficient of XkX^{k} in the interpolant of ff at x0,,xkx_0, \dots, x_k is exactly f[x0,,xk]f[x_0, \dots, x_k].
  5. Prove Newton’s interpolation formula: the interpolant of ff at x0,,xnx_0, \dots, x_n is

    P  =  k=0nf[x0,,xk]Nk,P \;=\; \sum_{k=0}^{n} f[x_0, \dots, x_k]\, N_k ,

    and derive the closed formula

    f[x0,,xk]  =  i=0kf(xi)ji,jk(xixj),f[x_0, \dots, x_k] \;=\; \sum_{i=0}^{k} \frac{f(x_i)}{\prod_{j \neq i,\, j \leq k} (x_i - x_j)} ,

    which shows that f[x0,,xk]f[x_0, \dots, x_k] does not depend on the ordering of the nodes.

Part III — Equally spaced nodes: the difference operator. From now on the nodes are 0,1,2,0, 1, 2, \dots and, for a polynomial PP, we set

ΔP(X)=P(X+1)P(X),Bk=X(X1)(Xk+1)k!(B0=1).\Delta P(X) = P(X + 1) - P(X), \qquad B_k = \frac{X(X-1)\cdots(X-k+1)}{k!} \quad (B_0 = 1).
  1. Show that if degP=m1\deg P = m \geq 1 with leading coefficient aa, then degΔP=m1\deg \Delta P = m - 1 with leading coefficient mam\,a, and that Δ\Delta kills constants.
  2. Show that (B0,B1,,Bn)(B_0, B_1, \dots, B_n) is a basis of Rn[X]\R_n[X] and that ΔBk=Bk1\Delta B_k = B_{k-1} for k1k \geq 1.
  3. (Newton’s forward-difference formula) Prove that every PRn[X]P \in \R_n[X] satisfies

    P  =  k=0n(ΔkP)(0)Bk.P \;=\; \sum_{k=0}^{n} \bigl(\Delta^{k} P\bigr)(0)\, B_k .
  4. Prove that for every k0k \geq 0,

    (ΔkP)(0)  =  j=0k(1)kj(kj)P(j).\bigl(\Delta^{k} P\bigr)(0) \;=\; \sum_{j=0}^{k} (-1)^{k-j} \binom{k}{j} P(j) .
  5. Show that if degP=n\deg P = n with leading coefficient ana_n, then ΔnP\Delta^{n} P is the constant n!ann!\,a_n and Δn+1P=0\Delta^{n+1} P = 0.

Part IV — Integer-valued polynomials. A polynomial PR[X]P \in \R[X] is integer-valued when P(m)ZP(m) \in \Z for every mZm \in \Z.

  1. Prove that each BkB_k is integer-valued. (Treat mkm \geq k, 0m<k0 \leq m < k and m<0m < 0 separately; for m=q<0m = -q < 0, show Bk(q)=(1)k(q+k1k)B_k(-q) = (-1)^k \binom{q + k - 1}{k}.)
  2. Prove Pólya’s characterization: PRn[X]P \in \R_n[X] is integer-valued if and only if its coordinates in the basis (B0,,Bn)(B_0, \dots, B_n) are integers.
  3. Deduce: if PRn[X]P \in \R_n[X] takes integer values at n+1n + 1 consecutive integers a,a+1,,a+na, a+1, \dots, a+n, then PP is integer-valued. (Shift: apply the study to Q(X)=P(X+a)Q(X) = P(X + a).)
  4. Deduce from question 16 that a product of kk consecutive integers is always divisible by k!k!.
  5. Let P=X(X+1)(2X+1)6P = \dfrac{X(X+1)(2X+1)}{6}. Compute its Newton table at 0,1,2,30, 1, 2, 3, write PP in the basis (Bk)(B_k), and conclude that PP is integer-valued although none of its monomial coefficients is an integer. Verify ΔP=(X+1)2\Delta P = (X+1)^2 and deduce P(m)=12+22++m2P(m) = 1^2 + 2^2 + \dots + m^2 for mNm \in \N.

Part V — Dividends.

  1. Let PRn[X]P \in \R_n[X] interpolate the values 2i2^i at i=0,1,,ni = 0, 1, \dots, n. Show that P=B0+B1++BnP = B_0 + B_1 + \dots + B_n and that P(n+1)=2n+11P(n + 1) = 2^{n+1} - 1: the “doubling pattern” always breaks at the very next point.
  2. (Discrete antiderivative) Prove that for all integers m1m \geq 1 and k0k \geq 0,

    j=0m1Bk(j)  =  Bk+1(m),\sum_{j=0}^{m-1} B_k(j) \;=\; B_{k+1}(m),

    i.e. the hockey-stick identity j=km1(jk)=(mk+1)\sum_{j=k}^{m-1} \binom{j}{k} = \binom{m}{k+1}.

  3. Expand X2X^2 and X3X^3 in the basis (Bk)(B_k) and deduce closed formulas for j=0m1j2\sum_{j=0}^{m-1} j^2 and j=0m1j3\sum_{j=0}^{m-1} j^3; recover Nicomachus’ identity 13++m3=(1++m)21^3 + \dots + m^3 = (1 + \dots + m)^2.
  4. Take n=2n = 2 and nodes 0,1,20, 1, 2. Write the coordinates of X2X^2 in the three bases of this problem: the monomial basis, the Lagrange basis, the Newton basis. Check the three answers against questions 4 and 9.
  5. Synthesis. In four sentences: which vector-space concept makes question 4 automatic; why the Newton basis computes coordinates recursively while the Lagrange basis reads them off instantly; which freeness criterion both bases share; and in what precise sense Pólya’s theorem says that integrality of a polynomial is a property of its coordinates in the right basis.
Solution

Solution of Problem 18.1.

1. LiL_i is a product of nn linear factors divided by a nonzero constant (the xix_i are distinct), so degLi=n\deg L_i = n. Evaluating at xjx_j with jij \neq i: the factor XxjX - x_j of the numerator vanishes, so Li(xj)=0L_i(x_j) = 0. At xix_i, numerator and denominator coincide: Li(xi)=1L_i(x_i) = 1.

2. Suppose iλiLi=0\sum_i \lambda_i L_i = 0. Evaluate at xjx_j: all terms die except λjLj(xj)=λj\lambda_j L_j(x_j) = \lambda_j, so λj=0\lambda_j = 0 for every jj: the family is free.

3. Let D=PiP(xi)LiD = P - \sum_i P(x_i) L_i. Then degDn\deg D \leq n and, by question 1, D(xj)=P(xj)P(xj)=0D(x_j) = P(x_j) - P(x_j) = 0 for the n+1n + 1 distinct points x0,,xnx_0, \dots, x_n. A nonzero polynomial of degree n\leq n has at most nn roots (Corollary 8.8), so D=0D = 0. Thus every PRn[X]P \in \R_n[X] is a combination of the LiL_i: the family is generating, and with question 2, a basis.

4. Given y0,,yny_0, \dots, y_n, the polynomial P=iyiLiP = \sum_i y_i L_i has degree n\leq n and interpolates. Uniqueness: an interpolating PP has, by question 3, coordinates (P(x0),,P(xn))=(y0,,yn)(P(x_0), \dots, P(x_n)) = (y_0, \dots, y_n) in the basis (Li)(L_i), and coordinates in a basis are unique (Proposition 18.15). The coordinates of PP in the Lagrange basis are its values at the nodes — this is the whole point of the basis.

5. Apply question 3 to P=XkP = X^k (0kn0 \leq k \leq n):

Xk=i=0nxikLi,X^k = \sum_{i=0}^{n} x_i^{k} L_i ,

and k=0k = 0 gives iLi=1\sum_i L_i = 1.

6. degNk=k\deg N_k = k exactly: the family (N0,,Nn)(N_0, \dots, N_n) is a staircase of degrees in Rn[X]\R_n[X], hence a basis by Example 18.20 (freeness from Proposition 18.19 (1), generation by finite descent on the degree).

7. From the recurrence,

f[x0,x1]=f(x1)f(x0)x1x0,f[x0,x1,x2]=f[x1,x2]f[x0,x1]x2x0.f[x_0, x_1] = \frac{f(x_1) - f(x_0)}{x_1 - x_0}, \qquad f[x_0, x_1, x_2] = \frac{f[x_1, x_2] - f[x_0, x_1]}{x_2 - x_0}.

For f(x)=x2f(x) = x^2:

f[x0,x1]=x12x02x1x0=x0+x1,f[x_0, x_1] = \frac{x_1^2 - x_0^2}{x_1 - x_0} = x_0 + x_1,

and then

f[x0,x1,x2]=(x1+x2)(x0+x1)x2x0=x2x0x2x0=1.f[x_0, x_1, x_2] = \frac{(x_1 + x_2) - (x_0 + x_1)}{x_2 - x_0} = \frac{x_2 - x_0}{x_2 - x_0} = 1 .

8. degSn\deg S \leq n since Q,RQ, R have degree n1\leq n - 1. At x0x_0: S(x0)=(x0xn)R(x0)xnx0=R(x0)=f(x0)S(x_0) = \frac{-(x_0 - x_n) R(x_0)}{x_n - x_0} = R(x_0) = f(x_0). At xnx_n: S(xn)=(xnx0)Q(xn)xnx0=Q(xn)=f(xn)S(x_n) = \frac{(x_n - x_0) Q(x_n)}{x_n - x_0} = Q(x_n) = f(x_n). At an interior node xix_i (1in11 \leq i \leq n-1), both QQ and RR take the value f(xi)f(x_i), so

S(xi)=(xix0)(xixn)xnx0f(xi)=f(xi).S(x_i) = \frac{(x_i - x_0) - (x_i - x_n)}{x_n - x_0}\, f(x_i) = f(x_i) .

9. Induction on the number of nodes. One node: the interpolant is the constant f(x0)=f[x0]f(x_0) = f[x_0]. Assume the claim for kk nodes and let SS interpolate at x0,,xkx_0, \dots, x_k; by uniqueness (question 4), SS is given by Aitken’s lemma from RR (nodes x0,,xk1x_0, \dots, x_{k-1}) and QQ (nodes x1,,xkx_1, \dots, x_k). The coefficient of XkX^{k} in SS is

[Xk1]Q[Xk1]Rxkx0=f[x1,,xk]f[x0,,xk1]xkx0=f[x0,,xk]\frac{[X^{k-1}]\,Q - [X^{k-1}]\,R}{x_k - x_0} = \frac{f[x_1, \dots, x_k] - f[x_0, \dots, x_{k-1}]}{x_k - x_0} = f[x_0, \dots, x_k]

by the induction hypothesis and the defining recurrence.

10. Let PkP_k interpolate ff at x0,,xkx_0, \dots, x_k. The difference PkPk1P_k - P_{k-1} has degree k\leq k and vanishes at x0,,xk1x_0, \dots, x_{k-1}, so by the factor theorem applied kk times (Theorem 8.7) it equals cNkc\,N_k for a constant cc; comparing coefficients of XkX^{k} and using question 9, c=f[x0,,xk]c = f[x_0, \dots, x_k]. Telescoping from P0=f(x0)N0P_0 = f(x_0) N_0 gives Newton’s formula. For the closed form, write Pk=ikf(xi)LiP_k = \sum_{i \leq k} f(x_i) L_i (Lagrange, on the nodes x0,,xkx_0, \dots, x_k) and read the coefficient of XkX^{k}: each LiL_i contributes 1ji(xixj)\frac{1}{\prod_{j \neq i}(x_i - x_j)}, whence

f[x0,,xk]=i=0kf(xi)ji,jk(xixj).f[x_0, \dots, x_k] = \sum_{i=0}^{k} \frac{f(x_i)}{\prod_{j \neq i,\, j \leq k}(x_i - x_j)} .

The right side is invariant under any permutation of the nodes, so the divided difference does not depend on their ordering.

11. If P=aXm+(lower degrees)P = a X^m + (\text{lower degrees}), the binomial theorem gives

ΔP=a((X+1)mXm)+=amXm1+(lower degrees),\Delta P = a\bigl((X+1)^m - X^m\bigr) + \dots = a\,m\,X^{m-1} + (\text{lower degrees}),

because (X+1)mXm=mXm1+(X+1)^m - X^m = m X^{m-1} + \dots and the lower-degree part of PP contributes degree m2\leq m - 2 after Δ\Delta (or degree m2\leq m-2 terms). So degΔP=m1\deg \Delta P = m - 1 with leading coefficient mam a. A constant cc gives Δc=cc=0\Delta c = c - c = 0.

12. degBk=k\deg B_k = k: staircase, hence a basis of Rn[X]\R_n[X] (Example 18.20). For ΔBk\Delta B_k (k1k \geq 1), factor the common product:

k!ΔBk=(X+1)X(Xk+2)X(X1)(Xk+1)=X(X1)(Xk+2)[(X+1)(Xk+1)]=kX(X1)(Xk+2),\begin{align*} k!\,\Delta B_k &= (X+1)X\cdots(X-k+2) - X(X-1)\cdots(X-k+1) \\ &= X(X-1)\cdots(X-k+2)\,\bigl[(X+1) - (X-k+1)\bigr] \\ &= k\,X(X-1)\cdots(X-k+2), \end{align*}

so ΔBk=X(X1)(Xk+2)(k1)!=Bk1\Delta B_k = \frac{X(X-1)\cdots(X-k+2)}{(k-1)!} = B_{k-1}.

13. Write P=k=0nckBkP = \sum_{k=0}^{n} c_k B_k (basis, question 12). Apply Δj\Delta^{j}: by question 12, ΔjP=kjckBkj\Delta^{j} P = \sum_{k \geq j} c_k B_{k-j}. Evaluate at 00: B0(0)=1B_0(0) = 1 and Bm(0)=0B_m(0) = 0 for m1m \geq 1 (the factor XX vanishes), so (ΔjP)(0)=cj\bigl(\Delta^{j}P\bigr)(0) = c_j. This is the forward-difference formula.

14. Induction on kk. For k=0k = 0 the identity reads P(0)=P(0)P(0) = P(0). Assume it for kk and apply it to ΔP\Delta P:

(Δk+1P)(0)=j=0k(1)kj(kj)(P(j+1)P(j)).\bigl(\Delta^{k+1} P\bigr)(0) = \sum_{j=0}^{k} (-1)^{k-j}\binom kj \bigl(P(j+1) - P(j)\bigr).

Collect the coefficient of P(i)P(i): it is (1)ki+1(ki1)(1)0(-1)^{k-i+1}\binom k{i-1}\cdot(-1)^{0} from the first sum (shifted) and (1)ki(ki)-(-1)^{k-i}\binom ki from the second — together

(1)k+1i((ki1)+(ki))=(1)k+1i(k+1i)(-1)^{k+1-i}\Bigl(\binom k{i-1} + \binom ki\Bigr) = (-1)^{k+1-i}\binom{k+1}i

by Pascal’s rule, which is the identity at rank k+1k + 1.

15. Iterating question 11 from degree nn, leading coefficient ana_n: after one Δ\Delta, degree n1n-1 and leading coefficient nann a_n; after two, n(n1)ann(n-1)a_n; after nn steps, degree 00 and value n(n1)1an=n!ann(n-1)\cdots 1\, a_n = n!\,a_n, a constant. One more Δ\Delta kills it: Δn+1P=0\Delta^{n+1}P = 0.

16. If mkm \geq k: Bk(m)=(mk)NB_k(m) = \binom mk \in \N. If 0m<k0 \leq m < k: one factor of m(m1)(mk+1)m(m-1)\cdots(m-k+1) is zero, so Bk(m)=0B_k(m) = 0. If m=qm = -q with q1q \geq 1:

Bk(q)=(q)(q1)(qk+1)k!=(1)kq(q+1)(q+k1)k!=(1)k(q+k1k),B_k(-q) = \frac{(-q)(-q-1)\cdots(-q-k+1)}{k!} = (-1)^k\,\frac{q(q+1)\cdots(q+k-1)}{k!} = (-1)^k \binom{q+k-1}{k},

an integer. So every BkB_k maps Z\Z into Z\Z.

17. (\Leftarrow) If P=kckBkP = \sum_k c_k B_k with ckZc_k \in \Z, then for mZm \in \Z, P(m)=kckBk(m)ZP(m) = \sum_k c_k B_k(m) \in \Z by question 16. (\Rightarrow) If PP is integer-valued, its coordinates are ck=(ΔkP)(0)=j=0k(1)kj(kj)P(j)c_k = \bigl(\Delta^k P\bigr)(0) = \sum_{j=0}^k (-1)^{k-j}\binom kj P(j) (questions 13 and 14), an integer combination of the integers P(0),,P(k)P(0), \dots, P(k). This is Pólya’s characterization of integer-valued polynomials.

18. Set Q(X)=P(X+a)Q(X) = P(X + a), a polynomial of degree n\leq n with Q(0),Q(1),,Q(n)ZQ(0), Q(1), \dots, Q(n) \in \Z. Its coordinates in (Bk)kn(B_k)_{k \leq n} are ck=jk(1)kj(kj)Q(j)Zc_k = \sum_{j \leq k}(-1)^{k-j}\binom kj Q(j) \in \Z (question 14 uses only the values at 0,,kn0, \dots, k \leq n). By question 17 (\Leftarrow), QQ is integer-valued on all of Z\Z, hence so is P(X)=Q(Xa)P(X) = Q(X - a).

19. A product of kk consecutive integers is m(m1)(mk+1)=k!Bk(m)m(m-1) \cdots(m-k+1) = k!\,B_k(m) for some mZm \in \Z, and Bk(m)ZB_k(m) \in \Z by question 16: the product is divisible by k!k!.

20. Values of P=X(X+1)(2X+1)6P = \frac{X(X+1)(2X+1)}{6} at 0,1,2,30,1,2,3: 0,1,5,140, 1, 5, 14. Difference table: Δ\Delta row 1,4,91, 4, 9; Δ2\Delta^2 row 3,53, 5; Δ3\Delta^3 row 22. Hence, by question 13,

P=0B0+1B1+3B2+2B3,P = 0\cdot B_0 + 1\cdot B_1 + 3\,B_2 + 2\,B_3 ,

with integer coordinates: PP is integer-valued (question 17), while its monomial coefficients 13,12,16\frac13, \frac12, \frac16 are not integers. Direct computation:

ΔP=(X+1)(X+2)(2X+3)X(X+1)(2X+1)6=(X+1)[(X+2)(2X+3)X(2X+1)]6=(X+1)(6X+6)6=(X+1)2.\begin{align*} \Delta P &= \frac{(X+1)(X+2)(2X+3) - X(X+1)(2X+1)}{6} \\ &= \frac{(X+1)\bigl[(X+2)(2X+3) - X(2X+1)\bigr]}{6} = \frac{(X+1)(6X+6)}{6} = (X+1)^2 . \end{align*}

Telescoping P(m)=j=0m1ΔP(j)=j=1mj2P(m) = \sum_{j=0}^{m-1}\Delta P(j) = \sum_{j=1}^{m} j^2 (with P(0)=0P(0) = 0): the sum-of-squares formula.

21. The values 2i2^i at i=0,,ni = 0, \dots, n have difference table constantly 11 on the left edge: Δk\Delta^k of the sequence (2i)(2^i) is (2i)(2^i) again (since 2i+12i=2i2^{i+1} - 2^i = 2^i), so (ΔkP)(0)=20=1\bigl(\Delta^k P\bigr)(0) = 2^0 = 1 for all knk \leq n, and P=B0+B1++BnP = B_0 + B_1 + \dots + B_n by question 13. Then

P(n+1)=k=0n(n+1k)=2n+1(n+1n+1)=2n+112n+1:P(n+1) = \sum_{k=0}^{n}\binom{n+1}{k} = 2^{n+1} - \binom{n+1}{n+1} = 2^{n+1} - 1 \neq 2^{n+1}:

the pattern breaks at the first uncontrolled point.

22. By question 12, Bk=ΔBk+1B_k = \Delta B_{k+1}, so

j=0m1Bk(j)=j=0m1(Bk+1(j+1)Bk+1(j))=Bk+1(m)Bk+1(0)=Bk+1(m).\sum_{j=0}^{m-1} B_k(j) = \sum_{j=0}^{m-1}\bigl(B_{k+1}(j+1) - B_{k+1}(j)\bigr) = B_{k+1}(m) - B_{k+1}(0) = B_{k+1}(m).

For j<kj < k the terms Bk(j)B_k(j) vanish, so the sum really starts at j=kj = k: j=km1(jk)=(mk+1)\sum_{j=k}^{m-1}\binom jk = \binom m{k+1}, the hockey-stick identity.

23. Difference tables (or direct expansion) give

X2=B1+2B2,X3=B1+6B2+6B3X^2 = B_1 + 2 B_2, \qquad X^3 = B_1 + 6 B_2 + 6 B_3

(check: B1+2B2=X+X(X1)=X2B_1 + 2B_2 = X + X(X-1) = X^2; at X=1,2,3X = 1, 2, 3 the second gives 1,8,271, 8, 27). Question 22 then yields

j=0m1j2=B2(m)+2B3(m)=(m2)+2(m3)=m(m1)(2m1)6,\sum_{j=0}^{m-1} j^2 = B_2(m) + 2B_3(m) = \binom m2 + 2\binom m3 = \frac{m(m-1)(2m-1)}{6},
j=0m1j3=B2(m)+6B3(m)+6B4(m)=(m2)+6(m3)+6(m4).\sum_{j=0}^{m-1} j^3 = B_2(m) + 6B_3(m) + 6B_4(m) = \binom m2 + 6\binom m3 + 6\binom m4 .

Expanding the last expression: (m2)+6(m3)+6(m4)=m(m1)2[1+2(m2)+(m2)(m3)2]=m2(m1)24=(m2)2\binom m2 + 6\binom m3 + 6\binom m4 = \frac{m(m-1)}{2}\bigl[1 + 2(m-2) + \frac{(m-2)(m-3)}{2}\bigr] = \frac{m^2(m-1)^2}{4} = \binom m2^2. Replacing mm by m+1m + 1: 13++m3=(m(m+1)2)2=(1++m)21^3 + \dots + m^3 = \bigl(\frac{m(m+1)}2\bigr)^2 = (1 + \dots + m)^2, Nicomachus’ identity.

24. Nodes 0,1,20, 1, 2, polynomial X2X^2. Monomial basis (1,X,X2)(1, X, X^2): coordinates (0,0,1)(0, 0, 1). Lagrange basis: coordinates are the values (0,1,4)(0, 1, 4) (question 4). Newton basis (1,X,X(X1))(1, X, X(X-1)): divided differences f[0]=0f[0] = 0, f[0,1]=1f[0,1] = 1, f[0,1,2]=312=1f[0,1,2] = \frac{3 - 1}{2} = 1 (question 9), so coordinates (0,1,1)(0, 1, 1) — indeed X+X(X1)=X2X + X(X-1) = X^2. Three bases, three coordinate vectors, one polynomial.

25. (i) Question 4 is automatic because (Li)(L_i) is a basis: existence and uniqueness of interpolation are exactly existence and uniqueness of coordinates. (ii) The Newton basis is a staircase, so coordinates are computed by successive divisions — each new node adds one term without disturbing the previous ones — whereas the Lagrange coordinates of PP are the values P(xi)P(x_i), available with no computation at all. (iii) Both bases are free by the same two criteria of Proposition 18.19: distinct degrees for Newton, evaluation at the nodes for Lagrange. (iv) Pólya’s theorem says that “P(Z)ZP(\Z) \subseteq \Z”, a property of values, is equivalent to integrality of the coordinates in the basis (Bk)(B_k) — the arithmetic of a polynomial becomes visible only in the basis adapted to the question.