Mathematics · Book 3 · Bachelor Year 1

University Mathematics — Year 1

University Mathematics — Year 1 · Bachelor Year 1

14Differentiation

Derivatives were computed throughout the High School volume; what was missing is the chain of theorems that turns computation into information about functions: Rolle’s theorem, the mean value theorem, and their consequences — monotonicity criteria, Lipschitz bounds, convexity. Everything in this chapter concerns functions defined on an interval II.

14.1 The derivative

Definition 14.1

f ⁣:IRf \colon I \to \R is differentiable at x0Ix_0 \in I when the difference quotient f(x)f(x0)xx0\frac{f(x) - f(x_0)}{x - x_0} has a (finite) limit as xx0x \to x_0; the limit is written f(x0)f'(x_0). Equivalently:

f(x0+h)=f(x0)+f(x0)h+hε(h),ε(h)h00,f(x_0 + h) = f(x_0) + f'(x_0)\,h + h\,\varepsilon(h), \qquad \varepsilon(h) \xrightarrow[h \to 0]{} 0 ,

the graph then admitting the tangent line y=f(x0)+f(x0)(xx0)y = f(x_0) + f'(x_0)(x - x_0). Differentiability at x0x_0 implies continuity at x0x_0 (read the display). ff is differentiable on II when it is at every point; ff is of class C1C^1 when moreover ff' is continuous, and of class CkC^k when ff can be differentiated kk times with f(k)f^{(k)} continuous.

Example 14.2

The converse of “differentiable \Rightarrow continuous” fails: \abs{\,\cdot\,} at 00. More surprisingly, differentiable does not imply C1C^1: the function f(x)=x2sin1xf(x) = x^2 \sin\frac 1x (f(0)=0f(0) = 0) is differentiable everywhere, with f(0)=0f'(0) = 0, but f(x)=2xsin1xcos1xf'(x) = 2x \sin\frac1x - \cos\frac 1x has no limit at 00 (Exercise 14.2).

Example 14.3 (Differentiable at exactly one point)

Let f(x)=x2f(x) = x^2 for xQx \in \Q and f(x)=0f(x) = 0 for xQx \notin \Q. At 00: f(h)0hh0\bigl|\frac{f(h) - 0}{h}\bigr| \leq \abs h \to 0, so ff is differentiable at 00 with f(0)=0f'(0) = 0. At any x00x_0 \neq 0, ff is not even continuous: rational and irrational sequences converging to x0x_0 send ff to x020x_0^2 \neq 0 and to 00 respectively (density, Theorem 10.14). So differentiability is a genuinely pointwise notion: it can hold at one point of R\R and nowhere else. The moral for practice: statements like the monotonicity criterion or Rolle require the derivative on an interval — possessing f(x0)f'(x_0) at isolated points, however many, supports no global conclusion whatsoever.

Theorem 14.4 (Operations)

If f,gf, g are differentiable at x0x_0 (and where the formulas make sense):

(f+g)=f+g,(fg)=fg+fg,(fg)=fgfgg2,(f + g)' = f' + g', \qquad (fg)' = f'g + fg', \qquad \Bigl(\frac fg\Bigr)' = \frac{f'g - fg'}{g^2},

and if gg is differentiable at f(x0)f(x_0):   (gf)(x0)=g(f(x0))f(x0)\;(g \circ f)'(x_0) = g'\bigl(f(x_0)\bigr)\, f'(x_0) (chain rule).

Proof. Sum: immediate. Product: write

f(x)g(x)f(x0)g(x0)=(f(x)f(x0))g(x)+f(x0)(g(x)g(x0)),f(x)g(x) - f(x_0)g(x_0) = \bigl(f(x) - f(x_0)\bigr) g(x) + f(x_0)\bigl(g(x) - g(x_0)\bigr),

divide by xx0x - x_0 and let xx0x \to x_0 (gg is continuous at x0x_0). Quotient: treat 1g\frac 1g via 1/g(x)1/g(x0)xx0=1g(x)g(x0)g(x)g(x0)xx0\frac{1/g(x) - 1/g(x_0)}{x - x_0} = \frac{-1}{g(x)g(x_0)}\cdot\frac{g(x) - g(x_0)}{x - x_0}, then apply the product rule. Chain rule: with y0=f(x0)y_0 = f(x_0), define θ(y)=g(y)g(y0)yy0\theta(y) = \frac{g(y) - g(y_0)}{y - y_0} for yy0y \neq y_0 and θ(y0)=g(y0)\theta(y_0) = g'(y_0): θ\theta is continuous at y0y_0, and for xx0x \neq x_0,

g(f(x))g(f(x0))xx0=θ(f(x))f(x)f(x0)xx0g(y0)f(x0),\frac{g(f(x)) - g(f(x_0))}{x - x_0} = \theta\bigl(f(x)\bigr)\cdot \frac{f(x) - f(x_0)}{x - x_0} \longrightarrow g'(y_0)\, f'(x_0),

the first factor by composition of limits (this device handles the case f(x)=f(x0)f(x) = f(x_0) cleanly, where the naive “multiply and divide by f(x)f(x0)f(x) - f(x_0)” breaks).

Theorem 14.5 (Derivative of an inverse function)

Let ff be continuous and strictly monotonic on II, differentiable at x0x_0 with f(x0)0f'(x_0) \neq 0. Then f1f^{-1} (Theorem 13.16) is differentiable at y0=f(x0)y_0 = f(x_0), with

(f1)(y0)=1f(x0)=1f(f1(y0)).(f^{-1})'(y_0) = \frac{1}{f'(x_0)} = \frac{1}{f'\bigl(f^{-1}(y_0)\bigr)} .

If f(x0)=0f'(x_0) = 0, the inverse has a vertical tangent at y0y_0.

Proof. For yy0y \to y_0, set x=f1(y)x = f^{-1}(y): continuity of f1f^{-1} gives xx0x \to x_0, and

f1(y)f1(y0)yy0=xx0f(x)f(x0)=1f(x)f(x0)xx01f(x0).\frac{f^{-1}(y) - f^{-1}(y_0)}{y - y_0} = \frac{x - x_0}{f(x) - f(x_0)} = \frac{1}{\dfrac{f(x) - f(x_0)}{x - x_0}} \longrightarrow \frac{1}{f'(x_0)} .

Vertical-tangent claim: if f(x0)=0f'(x_0) = 0, the displayed quotient is the reciprocal of a quantity that tends to 00 while keeping one constant sign (for ff strictly increasing, f(x)f(x0)xx0>0\frac{f(x) - f(x_0)}{x - x_0} > 0 for all xx0x \neq x_0): the difference quotient of f1f^{-1} therefore tends to ++\infty (to -\infty for ff decreasing). The inverse remains continuous but is not differentiable at y0y_0 — its graph, the reflection of ff’s across the diagonal, stands vertical exactly where ff’s ran horizontal, as x1/3x^{1/3} at 00 illustrates against x3x^3.

Example 14.6 (Inverse derivatives, twice)

The theorem recomputes the classical derivatives with no limit work. For ln=exp1\ln = \exp^{-1}: at y=exy = \eu^x,

(ln)(y)=1exp(x)=1ex=1y,(\ln)'(y) = \frac{1}{\exp'(x)} = \frac{1}{\eu^{x}} = \frac1y ,

valid for every y>0y > 0 since exp=exp\exp' = \exp never vanishes. For arctan=tan1\arctan = \tan^{-1}: at y=tanxy = \tan x,

(arctan)(y)=11+tan2x=11+y2,(\arctan)'(y) = \frac{1}{1 + \tan^2 x} = \frac{1}{1 + y^2} ,

using tan=1+tan2>0\tan' = 1 + \tan^2 > 0. The closing insight: the formula converts knowledge about a function into knowledge about its inverse at the price of one substitution — and the substitution (x=lnyx = \ln y, x=arctanyx = \arctan y) is exactly the statement that the two variables live on opposite sides of the bijection.

14.2 Rolle and the mean value theorem

Proposition 14.7 (Interior extremum)

If ff is differentiable at an interior point x0x_0 of II and has a local extremum there, then f(x0)=0f'(x_0) = 0.

Proof. Say a local maximum: there is r>0r > 0 with f(x)f(x0)f(x) \leq f(x_0) for xx0r\abs{x - x_0} \leq r, and interiority guarantees both sides of x0x_0 are available within II. For 0<hr0 < h \leq r the quotient f(x0+h)f(x0)h\frac{f(x_0 + h) - f(x_0)}{h} has numerator 0\leq 0 and denominator >0> 0: it is 0\leq 0, and its limit f(x0)f'(x_0) inherits 0\leq 0 (wide inequalities pass to limits, Theorem 11.7); for rh<0-r \leq h < 0 the quotient is 0\geq 0, giving f(x0)0f'(x_0) \geq 0. Hence f(x0)=0f'(x_0) = 0. (At an endpoint, only one sign is available: the conclusion fails there — think of xx on [0,1]\intcc{0}{1}, maximal at 11 with derivative 11.)

Theorem 14.8 (Rolle)

Let ff be continuous on [a,b]\intcc{a}{b}, differentiable on (a,b)\intoo{a}{b}, with f(a)=f(b)f(a) = f(b). Then f(c)=0f'(c) = 0 for some c(a,b)c \in \intoo{a}{b}.

Proof. By the extreme value theorem (Theorem 13.13), ff attains its maximum and minimum on [a,b]\intcc{a}{b}. If both are attained at endpoints, then (since f(a)=f(b)f(a) = f(b)) max == min and ff is constant: any interior cc works. Otherwise an extremum is attained at an interior point cc, and Proposition 14.7 gives f(c)=0f'(c) = 0.

Theorem 14.9 (Mean value theorem)

Let ff be continuous on [a,b]\intcc{a}{b}, differentiable on (a,b)\intoo{a}{b}. There exists c(a,b)c \in \intoo{a}{b} with

f(b)f(a)=f(c)(ba).f(b) - f(a) = f'(c)\,(b - a) .

Mean value inequality: if moreover mfMm \leq f' \leq M on (a,b)\intoo{a}{b}, then m(ba)f(b)f(a)M(ba)m(b-a) \leq f(b) - f(a) \leq M(b-a); in particular fK\abs{f'} \leq K implies that ff is KK-Lipschitz.

Proof. Apply Rolle to g(x)=f(x)f(b)f(a)ba(xa)g(x) = f(x) - \frac{f(b) - f(a)}{b - a}(x - a): gg is continuous on [a,b]\intcc{a}{b}, differentiable inside, and g(a)=f(a)=g(b)g(a) = f(a) = g(b). At the point cc where g(c)=0g'(c) = 0: f(c)=f(b)f(a)baf'(c) = \frac{f(b)-f(a)}{b-a}. The inequality follows by bounding f(c)f'(c); the Lipschitz statement applies it to every pair of points.

The mean value theorem: some tangent (dashed) is parallel to the chord (gray). Its abscissa c is where Rolle’s theorem, applied to the function minus its chord, finds a critical point.
The mean value theorem: some tangent (dashed) is parallel to the chord (gray). Its abscissa cc is where Rolle’s theorem, applied to the function minus its chord, finds a critical point.

Example 14.10 (Newton’s method is Heron’s)

Newton’s method for solving f(x)=0f(x) = 0 replaces the curve by its tangent at the current guess xnx_n and takes the tangent’s root as the next guess:

0=f(xn)+f(xn)(xn+1xn)xn+1=xnf(xn)f(xn).0 = f(x_n) + f'(x_n)(x_{n+1} - x_n) \quad\Longrightarrow\quad x_{n+1} = x_n - \frac{f(x_n)}{f'(x_n)} .

Run it on f(x)=x22f(x) = x^2 - 2:

xn+1=xnxn222xn=xn2+1xn=12(xn+2xn):x_{n+1} = x_n - \frac{x_n^2 - 2}{2x_n} = \frac{x_n}{2} + \frac{1}{x_n} = \frac12\Bigl(x_n + \frac{2}{x_n}\Bigr) :

exactly Heron’s iteration (Example 11.24), two millennia early. The quadratic speed observed there is now explained by the tangent picture: near a simple root, curve and tangent differ by a second-order error, so each step roughly squares the error — the general statement follows from the Taylor bounds of Chapter 16. The closing insight: where dichotomy (Example 13.12) uses only continuity and gains one bit per step, Newton spends a derivative to double the number of correct digits per step.

Example 14.11 (The mean value theorem as an estimator)

How large is 101\sqrt{101}? Apply the theorem to f(t)=tf(t) = \sqrt t on [100,101]\intcc{100}{101}: for some c(100,101)c \in \intoo{100}{101},

10110=12c,so12101<10110<120=0.05,\sqrt{101} - 10 = \frac{1}{2\sqrt c}, \qquad\text{so}\qquad \frac{1}{2\sqrt{101}} < \sqrt{101} - 10 < \frac{1}{20} = 0.05 ,

and since 101<10.05\sqrt{101} < 10.05, the left bound exceeds 120.1>0.0497\frac{1}{20.1} > 0.0497: thus 10.0497<101<10.0510.0497 < \sqrt{101} < 10.05 (true value 10.04987510.049875\dots) — three correct decimals from one derivative evaluation. Likewise sinasinbab\abs{\sin a - \sin b} \leq \abs{a - b} (bound cos1\abs{\cos}\leq 1): the Lipschitz estimates used since Chapter 11 are all this theorem. The closing insight: the mean value theorem is a zeroth-order Taylor formula — it trades one unknown point cc for a hard inequality, and Chapter 16 will iterate exactly this trade.

Corollary 14.12 (Monotonicity criterion)

Let ff be continuous on II, differentiable on the interior.

  1. f0f' \geq 0 on the interior     \iff ff is increasing; f=0f' = 0     \iff ff constant.
  2. If f>0f' > 0 except at finitely many points where it vanishes, ff is strictly increasing.

Proof. If f0f' \geq 0: for x<yx < y in II, the mean value theorem on [x,y]\intcc{x}{y} gives f(y)f(x)=f(c)(yx)0f(y) - f(x) = f'(c)(y - x) \geq 0. Conversely, difference quotients of an increasing function are 0\geq 0, so their limits are too. The constant case: apply the previous to ff' and f0-f' \geq 0. Strict version: ff is increasing; equality f(x)=f(y)f(x) = f(y) for x<yx < y would freeze ff on [x,y]\intcc{x}{y}, forcing f=0f' = 0 there — infinitely many points.

Example 14.13 (Equal derivatives, unequal functions)

On R=(,0)(0,+)\R^* = \intoo{-\infty}{0} \cup \intoo{0}{+\infty}, both f(x)=lnxf(x) = \ln\abs x and g(x)=lnx+1x>0g(x) = \ln\abs x + \mathbf{1}_{x>0} (add 11 on the right half-line only) satisfy f=g=1xf' = g' = \frac1x. They do not differ by a constant: the criterion “f=0    ff' = 0 \implies f constant” is an interval statement — its proof runs the mean value theorem between two points, which requires the whole segment joining them to lie in the domain. On each half-line separately, the primitives of 1x\frac1x are lnx+c\ln\abs x + c with one constant per half-line, two independent constants in total. Chapter 15 inherits this fine print: “the” primitive of a function is well defined up to a constant on each interval of its domain, and antiderivative tables silently assume connectivity.

Example 14.14 (Strictness for free)

xx3x \mapsto x^3 is strictly increasing on R\R even though its derivative vanishes at 00: the criterion’s clause “f>0f' > 0 except at finitely many points” is exactly designed for such flat points. By contrast, f0f' \geq 0 alone only gives increase in the wide sense (a constant function qualifies), and a derivative vanishing on a whole subinterval does freeze the function there. The practical rule: to claim strict monotonicity, list the zeros of ff'; finitely many (or more generally, none on any subinterval) is harmless, an interval of them is fatal.

Example 14.15 (A complete variation study)

Study f(x)=x33x+1f(x) = x^3 - 3x + 1 on R\R. Derivative: f(x)=3(x21)f'(x) = 3(x^2 - 1), positive on (,1)\intoo{-\infty}{-1}, negative on (1,1)\intoo{-1}{1}, positive on (1,+)\intoo{1}{+\infty}: by the monotonicity criterion, ff increases, then decreases, then increases, with a local maximum f(1)=3f(-1) = 3 and a local minimum f(1)=1f(1) = -1. Limits: \mp\infty at \mp\infty. Consequences, read off the variation table with the intermediate value theorem on each monotone branch: ff vanishes exactly once in each of

(,1),(1,1),(1,+)\intoo{-\infty}{-1}, \qquad \intoo{-1}{1}, \qquad \intoo{1}{+\infty}

(the values at the junctions have opposite signs: 3>0>13 > 0 > -1), so the equation x33x+1=0x^3 - 3x + 1 = 0 has exactly three real roots; numerically they sit near 1.88-1.88, 0.350.35, 1.531.53. The closing insight: a variation table is a proof device, not a sketch — monotone branch plus sign change equals exactly one root, and the table enumerates the branches exhaustively.

Theorem 14.16 (Leibniz formula)

If f,gf, g are nn times differentiable, so is fgfg, and

(fg)(n)=k=0n(nk)f(k)g(nk).(fg)^{(n)} = \sum_{k=0}^{n} \binom nk f^{(k)}\, g^{(n-k)} .

Proof. Induction on nn, exactly parallel to the binomial theorem. The case n=1n = 1 is the product rule. Assuming the formula at rank nn, differentiate once more:

(fg)(n+1)=k=0n(nk)(f(k+1)g(nk)+f(k)g(nk+1)),(fg)^{(n+1)} = \sum_{k=0}^{n} \binom nk \Bigl( f^{(k+1)} g^{(n-k)} + f^{(k)} g^{(n-k+1)} \Bigr),

then reindex the first sum with j=k+1j = k + 1 and collect the coefficient of f(j)g(n+1j)f^{(j)} g^{(n+1-j)}: it is (nj1)+(nj)=(n+1j)\binom{n}{j-1} + \binom nj = \binom{n+1}{j} by Pascal’s rule (Proposition 2.15), the boundary terms j=0j = 0 and j=n+1j = n + 1 carrying (n+10)=(n+1n+1)=1\binom{n+1}{0} = \binom{n+1}{n+1} = 1 as they should.

Example 14.17 (Leibniz in action)

Compute (x2ex)(n)\bigl(x^2 \eu^x\bigr)^{(n)} for n2n \geq 2. Take f=x2f = x^2, whose derivatives die quickly (f=2xf' = 2x, f=2f'' = 2, f(k)=0f^{(k)} = 0 for k3k \geq 3), and g=exg = \eu^x: only three terms of the Leibniz sum survive,

(x2ex)(n)=(n0)x2ex+(n1)(2x)ex+(n2)2ex=ex(x2+2nx+n(n1)).\bigl(x^2\eu^x\bigr)^{(n)} = \binom n0 x^2 \eu^x + \binom n1 (2x)\,\eu^x + \binom n2\, 2\,\eu^x = \eu^x\bigl(x^2 + 2nx + n(n-1)\bigr).

Sanity check at n=1n = 1: ex(x2+2x)\eu^x(x^2 + 2x), which is indeed (x2ex)(x^2\eu^x)'. The closing insight: use Leibniz when one factor is a polynomial — the sum then has only deg+1\deg + 1 terms, and the formula is a closed form, not an abstract identity. (For two infinitely-lively factors like exsinx\eu^x\sin x, complex exponentials from Chapter 3 are the better tool.)

14.3 Convexity

Definition 14.18

f ⁣:IRf \colon I \to \R is convex when every chord lies above the graph:

x,yI, t[0,1],f(tx+(1t)y)tf(x)+(1t)f(y).\forall x, y \in I,\ \forall t \in \intcc{0}{1}, \quad f\bigl(tx + (1-t)y\bigr) \leq t f(x) + (1-t) f(y).

(ff is concave when f-f is convex.)

Theorem 14.19 (Differential characterizations)

Let ff be differentiable on II. The following are equivalent:

  1. ff is convex;
  2. ff' is increasing on II;
  3. the graph lies above every tangent: f(y)f(x)+f(x)(yx)f(y) \geq f(x) + f'(x)(y - x) for all x,yIx, y \in I.

If ff is twice differentiable: ff convex     f0\iff f'' \geq 0.

Proof. (1 \Rightarrow 3) Convexity written as f(x+t(yx))f(x)tf(y)f(x)\frac{f(x + t(y-x)) - f(x)}{t} \leq f(y) - f(x) for t(0,1]t \in \intoc{0}{1}; let t0+t \to 0^+: f(x)(yx)f(y)f(x)f'(x)(y - x) \leq f(y) - f(x).

(3 \Rightarrow 2) For x<yx < y, the two tangent inequalities at xx and at yy give f(x)(yx)f(y)f(x)f(y)(yx)f'(x)(y-x) \leq f(y) - f(x) \leq f'(y)(y - x), hence f(x)f(y)f'(x) \leq f'(y).

(2 \Rightarrow 1) Fix x<yx < y and t(0,1)t \in \intoo{0}{1}, and let z=tx+(1t)y(x,y)z = tx + (1-t)y \in \intoo{x}{y}. By the mean value theorem on [x,z]\intcc{x}{z} and [z,y]\intcc{z}{y}: there are c1<z<c2c_1 < z < c_2 with

f(z)f(x)zx=f(c1)f(c2)=f(y)f(z)yz,\frac{f(z) - f(x)}{z - x} = f'(c_1) \leq f'(c_2) = \frac{f(y) - f(z)}{y - z} ,

and clearing denominators (zx=(1t)(yx)z - x = (1-t)(y-x), yz=t(yx)y - z = t(y-x)) rearranges exactly into the convexity inequality.

Twice differentiable case: f0    ff'' \geq 0 \iff f' increasing (Corollary 14.12).

Convexity, twice: every chord (gray) lies above the graph, and the graph lies above every tangent (dashed).
Convexity, twice: every chord (gray) lies above the graph, and the graph lies above every tangent (dashed).

Example 14.20 (Classical convexity inequalities)

exp\exp is convex (exp=exp>0\exp'' = \exp > 0): its tangent at 00 gives ex1+x\eu^x \geq 1 + x for all xx. ln\ln is concave: its tangent at 11 gives lnxx1\ln x \leq x - 1; its chords give, for 0<ab0 < a \leq b, the inequality between geometric and arithmetic means: taking t=12t = \frac12 in concavity,

lna+b2lna+lnb2=lnab,soaba+b2.\ln\frac{a + b}{2} \geq \frac{\ln a + \ln b}{2} = \ln\sqrt{ab}, \qquad\text{so}\qquad \sqrt{ab} \leq \frac{a+b}{2} .

The general arithmetic–geometric inequality is Exercise 14.9.

Example 14.21 (A convexity inequality from scratch)

The function f(t)=tlntf(t) = t\ln t is convex on (0,+)\intoo{0}{+\infty}: f(t)=1t>0f''(t) = \frac1t > 0. Its midpoint inequality, multiplied by 22, reads: for all a,b>0a, b > 0,

alna+blnb    (a+b)lna+b2,a\ln a + b\ln b \;\geq\; (a + b)\,\ln\frac{a + b}{2} ,

with equality iff a=ba = b (strict convexity). Test drive: a=1a = 1, b=3b = 3 gives 3ln3=3.2963\ln 3 = 3.296 against 4ln2=2.7734\ln 2 = 2.773. This innocuous inequality is the two-point case of the entropy comparison that reappears with Jensen’s inequality (Exercise 14.9) and in the information-theoretic asymptotics of the Year 3 volume. The closing insight: to manufacture an inequality, find a function whose second derivative has a sign and write down what convexity says — the differential characterization turns one sign check into infinitely many inequalities.

Remark 14.22 (Common pitfalls with derivatives)

(i) A positive derivative at one point does not give monotonicity near it: f(x)=x2+x2sin1xf(x) = \frac x2 + x^2\sin\frac1x (with f(0)=0f(0) = 0) has f(0)=12>0f'(0) = \frac12 > 0, yet

f(x)=12+2xsin1xcos1xf'(x) = \frac12 + 2x\sin\frac1x - \cos\frac1x

equals 12-\frac12 at each xn=12πnx_n = \frac{1}{2\pi n}: every neighborhood of 00 contains descents. Monotonicity needs f0f' \geq 0 on an interval (Corollary 14.12); the pointwise sign only controls the crossing of the tangent line. (ii) Rolle’s three hypotheses are all active: x\abs x on [1,1]\intcc{-1}{1} (no interior differentiability), xx on [0,1]\intcc{0}{1} (ends not equal), and xxx - \lfloor x\rfloor on [0,1]\intcc{0}{1} (continuity fails at 11) each break exactly one hypothesis and the conclusion. (iii) Derivatives may be discontinuous, but not arbitrarily: ff' can oscillate (Example 14.2) yet always satisfies the intermediate value property (Darboux, Exercise 14.10): a derivative never jumps — if you compute a one-sided “derivative limit” with a jump, you have differentiated a non-differentiable function. (iv) The inverse formula needs f0f' \neq 0: xx3x \mapsto x^3 is a smooth strictly increasing bijection whose inverse x1/3x^{1/3} has a vertical tangent at 00 — differentiability of the inverse is lost exactly where ff' vanishes (Theorem 14.5).

Remark 14.23 (Where the mean value theorem works next)

Nearly every quantitative statement of the next chapters is this chapter’s mean value theorem in costume: the fundamental theorem of calculus (Chapter 15) differentiates the area function and concludes with the monotonicity criterion; the Taylor–Lagrange formula (Chapter 16) is the mean value theorem iterated nn times; the error analysis of Newton’s method and of fixed-point iterations (Exercise 14.11) is the Lipschitz form; and this chapter’s weekend problem (Problem 14.1) turns the same Lipschitz bound into number theory — a repulsion inequality between algebraic numbers and rationals, yielding the first transcendental number in history. In the Year 2 volume, the mean value inequality survives in several variables when the equality does not.

Example 14.24 (Young’s inequality from concavity)

Let p,q>1p, q > 1 with 1p+1q=1\frac1p + \frac1q = 1. For all a,b>0a, b > 0:

ab    app+bqq.ab \;\leq\; \frac{a^p}{p} + \frac{b^q}{q} .

Proof by one application of the concavity of ln\ln with weights 1p,1q\frac1p, \frac1q (the two-point Jensen inequality, as in Exercise 14.9):

ln(app+bqq)    1pln(ap)+1qln(bq)=lna+lnb=ln(ab),\ln\Bigl(\frac{a^p}{p} + \frac{b^q}{q}\Bigr) \;\geq\; \frac1p \ln(a^p) + \frac1q \ln(b^q) = \ln a + \ln b = \ln(ab),

and ln\ln increasing converts the inequality of logarithms into the claim; equality iff ap=bqa^p = b^q (strict concavity). The case p=q=2p = q = 2 is the arithmetic-geometric inequality aba2+b22ab \leq \frac{a^2 + b^2}{2} in disguise. The closing insight: Young’s inequality is the algebraic seed of the Hölder and Minkowski inequalities of the Year 2 volume — one concavity statement about ln\ln, harvested for norms.

Remark 14.25 (Perspectives inside this volume)

The derivative acquires three new lives before the volume ends. In Chapter 16 it iterates: nn derivatives at a point compress into one polynomial plus a controlled error, and the mean value theorem becomes the Lagrange remainder. In Chapter 24, differentiation turns geometric: for a parametrized curve t(x(t),y(t))t \mapsto (x(t), y(t)), the pair (x(t),y(t))(x'(t), y'(t)) is a velocity vector, tangency becomes collinearity, and critical points become cusps to classify. In Chapter 25, one variable is frozen at a time: partial derivatives repeat this chapter twice over, and the tangent line grows into a tangent plane. All three chapters inherit the same grammar — local linear approximation plus an error term — first spoken here.

14.4 Exercises

Exercise 14.1

Differentiate (specifying the domains): xxx^x;   ln(x+x2+1)\;\ln\bigl(x + \sqrt{x^2+1}\bigr);   arctan1x\;\arctan\frac{1}{x};   1+e2x\;\sqrt{1 + \eu^{2x}}.

Solution

Solution of Exercise 14.1.

xx=exlnxx^x = \eu^{x\ln x} on (0,+)\intoo{0}{+\infty}: derivative (lnx+1)xx(\ln x + 1)\,x^x.

ln(x+x2+1)\ln(x + \sqrt{x^2+1}) on R\R (the argument is always >0> 0): derivative 1x2+1\frac{1}{\sqrt{x^2+1}} (computed in Proposition 4.21 — it is arsinh\operatorname{arsinh}).

arctan1x\arctan\frac1x on R\R^*: derivative 1/x21+1/x2=11+x2\frac{-1/x^2}{1 + 1/x^2} = \frac{-1}{1 + x^2} (consistent with Proposition 4.12 (2): the function is ±π2arctanx\pm\frac\pi2 - \arctan x on each half-line).

1+e2x\sqrt{1 + \eu^{2x}} on R\R: derivative e2x1+e2x\frac{\eu^{2x}}{\sqrt{1 + \eu^{2x}}}.

Exercise 14.2

Complete Example 14.2: prove that f(x)=x2sin1xf(x) = x^2 \sin\frac1x, f(0)=0f(0) = 0, is differentiable at 00 with f(0)=0f'(0) = 0, and that ff' has no limit at 00.

Solution

Solution of Exercise 14.2.

At 00: f(h)0h=hsin1hh0\bigl|\frac{f(h) - 0}{h}\bigr| = \abs{h \sin\frac1h} \leq \abs h \to 0, so f(0)=0f'(0) = 0. For x0x \neq 0, the usual rules give f(x)=2xsin1xcos1xf'(x) = 2x\sin\frac1x - \cos\frac1x. Along xn=12πnx_n = \frac{1}{2\pi n}: f(xn)=011f'(x_n) = 0 - 1 \to -1; along yn=1(2n+1)πy_n = \frac{1}{(2n+1)\pi}: f(yn)=0+11f'(y_n) = 0 + 1 \to 1. Two sequences tending to 00 with different limits of ff': no limit (Theorem 13.3), so ff' is not continuous at 00 and ff is differentiable without being C1C^1.

Exercise 14.3

Using the mean value theorem or the tangent inequalities, prove that for all x>0x > 0:

x1+x<ln(1+x)<x.\frac{x}{1 + x} < \ln(1 + x) < x .

Deduce limn(1+xn)n=ex\lim_{n\to\infty} \bigl(1 + \frac xn\bigr)^n = \eu^x for every x>0x > 0.

Solution

Solution of Exercise 14.3.

ln(1+x)<x\ln(1+x) < x for x>0x > 0: concavity tangent inequality at 00 (strict away from the contact point since ln\ln is strictly concave; or apply the mean value theorem: ln(1+x)=x1+c\ln(1+x) = \frac{x}{1+c} for some c(0,x)c \in \intoo{0}{x}, and x1+c<x\frac{x}{1+c} < x). The same mean value identity gives the lower bound: x1+c>x1+x\frac{x}{1+c} > \frac{x}{1+x}.

Consequence: with x/nx/n in place of xx,

x/n1+x/n<ln(1+xn)<xn    x1+x/n<nln(1+xn)<x.\frac{x/n}{1 + x/n} < \ln\Bigl(1 + \frac xn\Bigr) < \frac xn \quad\implies\quad \frac{x}{1 + x/n} < n \ln\Bigl(1 + \frac xn\Bigr) < x .

The left member tends to xx: by the squeeze, nln(1+xn)xn\ln(1 + \frac xn) \to x, and by continuity of exp\exp, (1+xn)n=enln(1+x/n)ex\bigl(1 + \frac xn\bigr)^n = \eu^{n\ln(1 + x/n)} \to \eu^x.

Exercise 14.4

Let PP be a real polynomial with kk distinct real roots. Prove that PP' has at least k1k - 1 distinct real roots, interlaced with those of PP. Deduce that if PP has all its roots real, so does PP'.

Solution

Solution of Exercise 14.4.

Let x1<x2<<xkx_1 < x_2 < \dots < x_k be distinct roots of PP. On each [xi,xi+1]\intcc{x_i}{x_{i+1}}, Rolle (Theorem 14.8) produces ci(xi,xi+1)c_i \in \intoo{x_i}{x_{i+1}} with P(ci)=0P'(c_i) = 0: that is k1k - 1 roots of PP', distinct because the open intervals are disjoint — and interlaced by construction.

If PP (degree nn) has all roots real, write them with multiplicities m1++mk=nm_1 + \dots + m_k = n. Each root of multiplicity mi2m_i \geq 2 is a root of PP' of multiplicity mi1m_i - 1 (Proposition 8.11), contributing (mi1)=nk\sum (m_i - 1) = n - k; Rolle contributes k1k - 1 more, all distinct from these. Total n1=degP\geq n - 1 = \deg P': all roots of PP' are real.

Exercise 14.5 ★★

Let ff be differentiable on R\R with f(x)f' (x)\to \ell as x+x \to +\infty. Prove that f(x)x\frac{f(x)}{x} \to \ell (mean value theorem on [A,x]\intcc{A}{x}). Does f(x+1)f(x)f(x+1) - f(x) \to \ell hold too?

Solution

Solution of Exercise 14.5.

Fix ε>0\varepsilon > 0 and AA with f(t)ε\abs{f'(t) - \ell} \leq \varepsilon for tAt \geq A. For x>Ax > A, the mean value theorem on [A,x]\intcc{A}{x} gives c(A,x)c \in \intoo{A}{x} with

f(x)=f(A)+f(c)(xA),sof(x)xf(A)+Ax+f(c)xAxCAx+ε.f(x) = f(A) + f'(c)(x - A), \qquad\text{so}\qquad \Bigl|\frac{f(x)}{x} - \ell\Bigr| \leq \frac{\abs{f(A)} + \abs\ell A}{x} + \abs{f'(c) - \ell} \cdot\frac{x - A}{x} \leq \frac{C_A}{x} + \varepsilon .

For xx large, CAxε\frac{C_A}{x} \leq \varepsilon: hence f(x)x\frac{f(x)}{x} \to \ell.

Yes: f(x+1)f(x)=f(cx)f(x+1) - f(x) = f'(c_x) with cx(x,x+1)c_x \in \intoo{x}{x+1} (mean value theorem on [x,x+1]\intcc{x}{x+1}), and cx+c_x \to +\infty, so f(x+1)f(x)f(x+1) - f(x) \to \ell.

Exercise 14.6 ★★

(A discrete Rolle) Let ff be nn times differentiable on II and vanish at n+1n + 1 distinct points. Prove that f(n)f^{(n)} vanishes at least once. Application: a polynomial of degree n\leq n vanishing at n+1n+1 points is zero (again).

Solution

Solution of Exercise 14.6.

Induction on nn. For n=1n = 1: Rolle. If the claim holds for n1n - 1: ff vanishes at n+1n+1 points, so by Rolle applied on the nn gaps, ff' vanishes at nn distinct points; the induction hypothesis applied to ff' (n1n-1 times differentiable, nn zeros) makes (f)(n1)=f(n)(f')^{(n-1)} = f^{(n)} vanish somewhere.

Application: if PP of degree n\leq n vanishes at n+1n+1 points, then P(n)P^{(n)}, a constant equal to n!n! times the leading coefficient, vanishes: the leading coefficient is 00, and one concludes by downward induction (or directly: all coefficients vanish).

Exercise 14.7 ★★

Let ff be twice differentiable on [a,b]\intcc{a}{b} with f(a)=f(b)=0f(a) = f(b) = 0 and f(x0)>0f(x_0) > 0 for some interior x0x_0. Prove that f(c)<0f''(c) < 0 for some c(a,b)c \in \intoo{a}{b}. (Two mean value theorems and a comparison of slopes.)

Solution

Solution of Exercise 14.7.

By the mean value theorem on [a,x0]\intcc{a}{x_0} and on [x0,b]\intcc{x_0}{b}:

f(c1)=f(x0)f(a)x0a=f(x0)x0a>0,f(c2)=f(b)f(x0)bx0=f(x0)bx0<0,f'(c_1) = \frac{f(x_0) - f(a)}{x_0 - a} = \frac{f(x_0)}{x_0 - a} > 0, \qquad f'(c_2) = \frac{f(b) - f(x_0)}{b - x_0} = \frac{-f(x_0)}{b - x_0} < 0,

with c1<x0<c2c_1 < x_0 < c_2. Then the mean value theorem applied to ff' on [c1,c2]\intcc{c_1}{c_2} gives cc with

f(c)=f(c2)f(c1)c2c1<0.f''(c) = \frac{f'(c_2) - f'(c_1)}{c_2 - c_1} < 0 . \qedhere

Exercise 14.8 ★★

Study the function f(x)=lnxxf(x) = \dfrac{\ln x}{x} on (0,+)\intoo{0}{+\infty}: variations, limits, maximum. Deduce that ab>baa^b > b^a for all reals ea<b\eu \leq a < b, and settle the famous special case: which of eπ\eu^\pi, πe\pi^\eu is larger? Check against the small integer pairs (2,3)(2,3) and (2,4)(2,4): why do they behave differently?

Solution

Solution of Exercise 14.8.

f(x)=1lnxx2f'(x) = \frac{1 - \ln x}{x^2}: ff increases on (0,e]\intoc{0}{\eu}, decreases on [e,+)\intco{\eu}{+\infty}, with maximum f(e)=1ef(\eu) = \frac1\eu; limits -\infty at 0+0^+ and 00 at ++\infty (growth comparison).

For ea<b\eu \leq a < b: ff strictly decreasing there gives lnaa>lnbb\frac{\ln a}{a} > \frac{\ln b}{b}, i.e. blna>alnbb \ln a > a \ln b, i.e. ab>baa^b > b^a.

With a=e<b=πa = \eu < b = \pi: eπ>πe\eu^\pi > \pi^\eu.

Small pairs: (2,3)(2, 3): 23=8<9=322^3 = 8 < 9 = 3^2 — reversed! The reason: 2<e2 < \eu, and on (0,e)\intoo{0}{\eu} the function ff is increasing, so the comparison flips when both numbers sit below e\eu, and is unpredictable across e\eu (f(2)=f(4)f(2) = f(4) explains the tie 24=42=162^4 = 4^2 = 16).

Exercise 14.9 ★★

(Arithmetic–geometric inequality) Using the concavity of ln\ln with general weights (Jensen’s inequality for nn points, to be proved by induction on nn), show that for positive reals a1,,ana_1, \dots, a_n:

a1a2anna1++ann,\sqrt[n]{a_1 a_2 \cdots a_n} \leq \frac{a_1 + \dots + a_n}{n},

with equality iff all aia_i are equal.

Solution

Solution of Exercise 14.9.

Jensen for ln\ln, by induction on nn. Claim: for positive xix_i and weights λi>0\lambda_i > 0 with λi=1\sum \lambda_i = 1: ln(λixi)λilnxi\ln\bigl(\sum \lambda_i x_i\bigr) \geq \sum \lambda_i \ln x_i. For n=2n = 2 this is concavity. Step: with Λ=λ1++λn1=1λn\Lambda = \lambda_1 + \dots + \lambda_{n-1} = 1 - \lambda_n and y=i<nλiΛxiy = \sum_{i<n} \frac{\lambda_i}{\Lambda} x_i,

ln(inλixi)=ln(Λy+λnxn)Λlny+λnlnxnΛi<nλiΛlnxi+λnlnxn,\ln\Bigl(\sum_{i \leq n} \lambda_i x_i\Bigr) = \ln\bigl(\Lambda y + \lambda_n x_n\bigr) \geq \Lambda \ln y + \lambda_n \ln x_n \geq \Lambda \sum_{i<n} \frac{\lambda_i}{\Lambda}\ln x_i + \lambda_n \ln x_n,

using concavity (n=2n = 2) then the induction hypothesis.

With λi=1n\lambda_i = \frac 1n and xi=aix_i = a_i: lnain1nlnai=lna1ann\ln\frac{\sum a_i}{n} \geq \frac 1n \sum \ln a_i = \ln\sqrt[n]{a_1\cdots a_n}; exponentiate. Equality: ln\ln is strictly concave (ln<0\ln'' < 0), so equality at each step forces the averaged points to coincide — i.e. all aia_i equal; and if all are equal, equality is clear.

Exercise 14.10 ★★★

(Darboux: derivatives take intermediate values) Let ff be differentiable on II and a<ba < b in II with f(a)<v<f(b)f'(a) < v < f'(b). By considering g(x)=f(x)vxg(x) = f(x) - vx and the point where gg attains its minimum on [a,b]\intcc{a}{b}, prove that f(c)=vf'(c) = v for some c(a,b)c \in \intoo{a}{b} — even though ff' need not be continuous (Exercise 14.2).

Solution

Solution of Exercise 14.10.

Let g(x)=f(x)vxg(x) = f(x) - vx: differentiable, with g(a)=f(a)v<0g'(a) = f'(a) - v < 0 and g(b)=f(b)v>0g'(b) = f'(b) - v > 0. By the extreme value theorem, gg attains its minimum on [a,b]\intcc{a}{b} at some cc. It is not at aa: since g(a)<0g'(a) < 0, points just right of aa have g<g(a)g < g(a). It is not at bb: since g(b)>0g'(b) > 0, points just left of bb have g<g(b)g < g(b). So cc is interior, and Proposition 14.7 gives g(c)=0g'(c) = 0, i.e. f(c)=vf'(c) = v.

Exercise 14.11 ★★★

Let f ⁣:RRf \colon \R \to \R be differentiable with f(x)k<1\abs{f'(x)} \leq k < 1 for all xx (a contraction). Prove that ff has exactly one fixed point \ell, and that every sequence un+1=f(un)u_{n+1} = f(u_n) converges to \ell with unknu0\abs{u_n - \ell} \leq k^n\abs{u_0 - \ell}. (Existence: apply the intermediate value theorem to f(x)xf(x) - x on a large segment, using the Lipschitz bound; or use completeness with the Cauchy criterion.)

Solution

Solution of Exercise 14.11.

Uniqueness: two fixed points \ell \neq \ell' would give =f()f()k<\abs{\ell - \ell'} = \abs{f(\ell) - f(\ell')} \leq k\abs{\ell - \ell'} < \abs{\ell - \ell'}, absurd.

Existence: g(x)=f(x)xg(x) = f(x) - x satisfies, by the mean value inequality, f(x)f(0)+kxf(x) \leq f(0) + k\abs x; so for xf(0)1kx \geq \frac{\abs{f(0)}}{1 - k}, g(x)f(0)+kxx0g(x) \leq f(0) + kx - x \leq 0, and symmetrically g(x)0g(-x) \geq 0 for xx large. The intermediate value theorem gives a zero \ell of gg: a fixed point.

Convergence: the mean value inequality again:

un+1=f(un)f()kun,\abs{u_{n+1} - \ell} = \abs{f(u_n) - f(\ell)} \leq k\abs{u_n - \ell},

so by induction unknu00\abs{u_n - \ell} \leq k^n \abs{u_0 - \ell} \to 0.

Exercise 14.12 ★★★

(Cauchy’s mean value theorem and l’Hospital’s rule)

  1. Let f,gf, g be continuous on [a,b]\intcc{a}{b}, differentiable on (a,b)\intoo{a}{b}, with gg' never zero there. Prove that g(b)g(a)g(b) \neq g(a) and that some c(a,b)c \in \intoo{a}{b} satisfies

    f(b)f(a)g(b)g(a)=f(c)g(c)\frac{f(b) - f(a)}{g(b) - g(a)} = \frac{f'(c)}{g'(c)}

    (apply Rolle to h=fλgh = f - \lambda g for the right constant λ\lambda).

  2. Deduce l’Hospital’s rule in the 00\frac00 form at a point: if f(a)=g(a)=0f(a) = g(a) = 0 and f(x)g(x)\frac{f'(x)}{g'(x)} \to \ell as xa+x \to a^+, then f(x)g(x)\frac{f(x)}{g(x)} \to \ell.
  3. Show the converse fails: for f(x)=x2sin1xf(x) = x^2\sin\frac1x (f(0)=0f(0) = 0) and g(x)=xg(x) = x, the quotient fg\frac{f}{g} has a limit at 00 but fg\frac{f'}{g'} has none.
Solution

Solution of Exercise 14.12.

  1. If g(b)=g(a)g(b) = g(a), Rolle would give an interior zero of gg': excluded. Set λ=f(b)f(a)g(b)g(a)\lambda = \frac{f(b) - f(a)}{g(b) - g(a)} and h=fλgh = f - \lambda g: hh is continuous on [a,b]\intcc{a}{b}, differentiable inside, and h(b)h(a)=f(b)f(a)λ(g(b)g(a))=0h(b) - h(a) = f(b) - f(a) - \lambda(g(b) - g(a)) = 0. Rolle provides cc with h(c)=0h'(c) = 0, i.e. f(c)=λg(c)f'(c) = \lambda\,g'(c); divide by g(c)0g'(c) \neq 0.
  2. For x>ax > a close to aa, part (1) on [a,x]\intcc{a}{x} (where g0g' \neq 0) gives g(x)0g(x) \neq 0 and cx(a,x)c_x \in \intoo{a}{x} with

    f(x)g(x)=f(x)f(a)g(x)g(a)=f(cx)g(cx).\frac{f(x)}{g(x)} = \frac{f(x) - f(a)}{g(x) - g(a)} = \frac{f'(c_x)}{g'(c_x)} .

    As xa+x \to a^+, cxa+c_x \to a^+ (squeeze), so the right side tends to \ell: fg\frac{f}{g} \to \ell.

  3. f(x)g(x)=xsin1x0\frac{f(x)}{g(x)} = x\sin\frac1x \to 0, while f(x)g(x)=2xsin1xcos1x\frac{f'(x)}{g'(x)} = 2x\sin\frac1x - \cos\frac1x has no limit at 00 (Exercise 14.2): l’Hospital’s rule transfers information only from fg\frac{f'}{g'} to fg\frac fg, never back.

14.5 Problem: Liouville’s inequality and the first transcendental number

Problem 14.1

Weekend problem — algebraic numbers repel rationals: xp/qC/qd\abs{x - p/q} \geq C/q^d, and the transcendence of 10n!\sum 10^{-n!}

A real number is algebraic when it is a root of a nonzero polynomial with integer coefficients, and transcendental otherwise. In 1844 Liouville produced the first number ever proved transcendental, and the engine of his proof is this chapter’s mean value theorem: an algebraic number of degree dd cannot be approximated by rationals better than C/qdC/q^d — so a number approximable faster than every power cannot be algebraic. This problem builds the inequality, constructs Liouville’s number L=0.110001000L = 0.110001000\dots (ones at the factorial positions, via the digit machinery of Problem 10.1), proves its transcendence, and ends with Cantor’s rival proof and effective bounds for 2\sqrt2 and 21/32^{1/3}.

Part I — How well can rationals be approximated?

  1. Show that two distinct rationals abpq\frac ab \neq \frac pq (written with b,q1b, q \geq 1) satisfy abpq1bq\bigl|\frac ab - \frac pq\bigr| \geq \frac{1}{bq}. Deduce: if x=abx = \frac ab and 0<xpq<1bq0 < \bigl|x - \frac pq\bigr| < \frac{1}{bq}, no such pq\frac pq exists — a rational repels all other rationals at scale 1q\frac 1q.
  2. Prove that for every rational pq\frac pq (q1q \geq 1): 2pq14q2\bigl|\sqrt2 - \frac pq\bigr| \geq \frac{1}{4q^2} (if the distance exceeds 11 this is clear; otherwise bound 2+p/q<4\abs{\sqrt2 + p/q} < 4 and use the nonzero integer p22q21\abs{p^2 - 2q^2} \geq 1).
  3. In the other direction: check that (p,q)(p+2q,p+q)(p, q) \mapsto (p + 2q, p + q) preserves p22q2=1\abs{p^2 - 2q^2} = 1, generate from (1,1)(1,1) the pairs (3,2)(3,2), (7,5)(7,5), (17,12)(17,12), (41,29)(41,29), (99,70)(99,70), and show each satisfies

    2pq=1q2(2+p/q)<12q2:\Bigl|\sqrt2 - \frac pq\Bigr| = \frac{1}{q^2\,(\sqrt2 + p/q)} < \frac{1}{2q^2} :

    infinitely many approximations of order 22. With question 2: the approximation exponent of 2\sqrt 2 is exactly 22.

  4. (Dirichlet) Let xx be irrational and NNN \in \N^*. Consider the N+1N + 1 fractional parts of 0,x,2x,,Nx0, x, 2x, \dots, Nx in the NN boxes [kN,k+1N)\intco{\frac kN}{\frac{k + 1}{N}}: by the pigeonhole principle (Corollary 2.3), two fall in one box. Deduce qNq \leq N and pp with qxp<1N\abs{qx - p} < \frac 1N, hence infinitely many rationals with xpq<1q2\bigl|x - \frac pq\bigr| < \frac{1}{q^2}: every irrational is approximable to order 22.

Part II — Liouville’s inequality. Let xx be irrational and algebraic.

  1. Show that among the nonzero integer polynomials vanishing at xx there is one, say PP of degree dd, with no rational root; and check d2d \geq 2 (divide out a factor XabX - \frac ab over Q\Q and clear denominators; degree 11 would make xx rational).
  2. Show that for every rational pq\frac pq (q1q \geq 1): P(pq)1qd\bigl|P\bigl(\frac pq\bigr)\bigr| \geq \frac{1}{q^d} (qdP(p/q)q^d P(p/q) is a nonzero integer).
  3. Let M=max[x1,x+1]PM = \max_{\intcc{x-1}{x+1}} \abs{P'} (Theorem 13.13). Using the mean value theorem between xx and pq\frac pq, prove Liouville’s inequality: with C=min(1,1M)>0C = \min\bigl(1, \frac 1M\bigr) > 0,

    xpqCqdfor every rational pq, q1.\Bigl| x - \frac pq \Bigr| \geq \frac{C}{q^{\,d}} \qquad\text{for every rational } \frac pq,\ q \geq 1 .
  4. Call xx a Liouville number when for every nNn \in \N there is a rational pq\frac pq with q2q \geq 2 and 0<xpq<qn0 < \bigl|x - \frac pq\bigr| < q^{-n}. Prove that a Liouville number is irrational (question 1: choose nn with 2n1>b2^{\,n-1} > b).
  5. Prove Liouville’s theorem: a Liouville number is transcendental (combine questions 7 and 8: the inequality C<qdnC < q^{\,d-n} fails for large nn).

Part III — The number LL.

  1. Let LL be the value (in the sense of Problem 10.1) of the decimal digit string with digit 11 at the positions n!n! (n=1,2,3,n = 1, 2, 3, \dots) and 00 elsewhere, i.e. L=supktkL = \sup_k t_k with tk=n=1k10n!t_k = \sum_{n=1}^{k} 10^{-n!}. Write out the first 2525 digits of LL.
  2. Prove the tail bracketing, for every k1k \geq 1:

    10(k+1)!    Ltk    10910(k+1)!  <  210(k+1)!10^{-(k+1)!} \;\leq\; L - t_k \;\leq\; \frac{10}{9}\,10^{-(k+1)!} \;<\; 2\cdot 10^{-(k+1)!}

    (bound every partial sum beyond tkt_k by a finite geometric sum).

  3. Write tk=pkqkt_k = \frac{p_k}{q_k} with qk=10k!q_k = 10^{k!}. Show 0<Lpkqk<2qkk+10 < L - \frac{p_k}{q_k} < \frac{2}{q_k^{\,k+1}}, and conclude that LL is a Liouville number in the sense of question 8.
  4. Conclude: LL is transcendental — the first explicit example in history (Liouville, 1844). Cross-check its irrationality directly: its digits are not eventually periodic (growing gaps, as in Problem 10.1, question 20).
  5. Generalize: replace each digit 11 by an arbitrary nonzero digit dn[ ⁣[1,9] ⁣]d_n \in \intint{1}{9}. Show the value is still a Liouville number, and deduce — by the diagonal argument of Problem 10.1 (question 22) applied to these digit choices — that there are uncountably many transcendental numbers of this shape.

Part IV — The hierarchy of approximation orders. Say xx is approximable to order μ\mu when for some constant c>0c > 0 infinitely many rationals satisfy xpq<cqμ\bigl|x - \frac pq\bigr| < \frac{c}{q^{\mu}}.

  1. Assemble the hierarchy from Parts I–III: rationals are approximable to order 11 and no better; 2\sqrt 2 to order 22 and no better; every irrational to order at least 22; an algebraic number of degree dd to no order beyond dd; Liouville numbers to every order. Justify each claim by citing the relevant question.
  2. Show that L+rL + r is a Liouville number for every rational r=abr = \frac ab (translate the approximants: the new denominators are bqkb\,q_k). Conclude that Liouville — hence transcendental — numbers are dense in R\R.
  3. (Cantor, 1874) Prove that the set of algebraic numbers is countable: there are finitely many integer polynomials with degree plus sum of coefficients\abs{\text{coefficients}} bounded by hh, each with at most deg\deg roots; a countable union of finite sets is countable. Since no sequence exhausts R\R (Problem 10.1, question 22), transcendental numbers exist — in fact form an uncountable set. Compare the two proofs: what does Liouville’s give that Cantor’s cannot?
  4. Prove directly from question 2 that 2\sqrt 2 is not a Liouville number (for n3n \geq 3, the inequality qn>14q2q^{-n} > \frac{1}{4q^2} bounds qq; then only finitely many candidate rationals remain, all at positive distance from 2\sqrt2). Generalize: no algebraic number is Liouville.

Part V — Effective constants.

  1. For the Pell pair (99,70)(99, 70): verify 9922702=199^2 - 2\cdot70^2 = 1 and evaluate the exact error

    29970=1702(2+9970),299707.2105:\sqrt2 - \frac{99}{70} = \frac{-1}{70^2\,\bigl(\sqrt2 + \frac{99}{70}\bigr)}, \qquad \Bigl|\sqrt 2 - \frac{99}{70}\Bigr| \approx 7.2\cdot 10^{-5} :

    five correct digits from a three-digit fraction.

  2. Run Part II on x=21/3x = 2^{1/3}, P=X32P = X^3 - 2: check PP has no rational root, bound M=max[x1,x+1]3t23(1+21/3)2<16M = \max_{\intcc{x-1}{x+1}} 3t^2 \leq 3\,(1 + 2^{1/3})^2 < 16, and conclude the effective inequality

    21/3pq116q3for all pq.\Bigl| 2^{1/3} - \frac pq \Bigr| \geq \frac{1}{16\,q^3} \qquad \text{for all } \frac pq .
  3. Payoff: show that any rational approximating 21/32^{1/3} within 10610^{-6} must have denominator q40q \geq 40.
  4. Show that the base 1010 is irrelevant: the binary analogue n12n!\sum_{n\geq1} 2^{-n!} (value of the binary string with ones at factorial positions) is also a Liouville number, hence transcendental.

Part VI — Frontiers and synthesis.

  1. Let xx^\dagger be the value of the decimal string with ones exactly at the positions 3k3^k (k0k \geq 0). Show xx^\dagger is approximable to order 33, and deduce from Liouville’s inequality that xx^\dagger is neither rational nor a quadratic irrational. Explain why the method stalls there: order 33 is compatible with algebraicity of degree 3\geq 3, and closing that gap (any exponent >2> 2 suffices, for every algebraic number) is Roth’s theorem, far beyond this volume.
  2. Quantify Cantor: show that the algebraic numbers of degree d\leq d given by polynomials with coefficients in [ ⁣[H,H] ⁣]\intint{-H}{H} number at most d(2H+1)d+1d\,(2H + 1)^{d+1}. (This finiteness is what made question 17 work.)
  3. Synthesis, one sentence each: (i) locate the single analytic ingredient of Liouville’s proof (which theorem of this chapter, used where); (ii) state the tension that powers it (integrality forces P(p/q)qd\abs{P(p/q)} \geq q^{-d}, smoothness forbids P(p/q)>Mxp/q\abs{P(p/q)} > M\abs{x - p/q}); (iii) contrast Liouville’s and Cantor’s proofs of the existence of transcendental numbers; (iv) name where this volume meets the theme again — the weekend problem of Chapter 15 proves π\pi irrational by the same integrality-versus-smallness squeeze, with integrals in place of derivatives.
Solution

Solution of Problem 14.1.

1. abpq=aqbpbq\bigl|\frac ab - \frac pq\bigr| = \frac{\abs{aq - bp}}{bq}, and aqbpaq - bp is a nonzero integer when the fractions differ: the distance is 1bq\geq \frac{1}{bq}. So no rational other than xx itself enters the punctured interval of radius 1bq\frac{1}{bq} around x=abx = \frac ab.

2. If 2pq114q2\bigl|\sqrt2 - \frac pq\bigr| \geq 1 \geq \frac{1}{4q^2}, done. Otherwise pq(21,2+1)\frac pq \in \intoo{\sqrt2 - 1}{\sqrt2 + 1}, so 0<2+pq<22+1<40 < \sqrt2 + \frac pq < 2\sqrt2 + 1 < 4. Since 2Q\sqrt 2 \notin \Q, p22q2p^2 - 2q^2 is a nonzero integer, and

2pq=2q2p2q2(2+pq)14q2.\Bigl|\sqrt2 - \frac pq\Bigr| = \frac{\abs{2q^2 - p^2}}{q^2\,\bigl(\sqrt2 + \frac pq\bigr)} \geq \frac{1}{4q^2} .

3. (p+2q)22(p+q)2=(p22q2)(p + 2q)^2 - 2(p + q)^2 = -(p^2 - 2q^2): the value ±1\pm1 propagates. From (1,1)(1,1):

(3,2), (7,5), (17,12), (41,29), (99,70),(3,2),\ (7,5),\ (17,12),\ (41,29),\ (99,70),

with p22q2p^2 - 2q^2 alternating 1,+1,-1, +1, \dots For these, pq1\frac pq \geq 1, so 2+pq>2\sqrt2 + \frac pq > 2 and

2pq=1q2(2+p/q)<12q2,\Bigl|\sqrt2 - \frac pq\Bigr| = \frac{1}{q^2(\sqrt2 + p/q)} < \frac{1}{2q^2} ,

with qq \to \infty: infinitely many order-22 approximations. With question 2, the exponent 22 is exact for 2\sqrt 2.

4. The N+1N + 1 numbers kxkxkx - \lfloor kx\rfloor (0kN0 \leq k \leq N) lie in the NN boxes [jN,j+1N)\intco{\frac jN}{\frac{j+1}{N}}: two share a box (Corollary 2.3), say for i<ji < j. With q=jiNq = j - i \leq N and p=jxixp = \lfloor jx\rfloor - \lfloor ix\rfloor: qxp<1N\abs{qx - p} < \frac1N, so xpq<1Nq1q2\bigl|x - \frac pq\bigr| < \frac{1}{Nq} \leq \frac{1}{q^2}. Letting NN \to \infty: since xx is irrational, each fixed fraction has positive distance to xx, while 1Nq1N0\frac{1}{Nq} \leq \frac 1N \to 0 forces new fractions to appear: infinitely many distinct pq\frac pq with xpq<1q2\bigl|x - \frac pq\bigr| < \frac{1}{q^2}.

5. Start from any nonzero integer P0P_0 with P0(x)=0P_0(x) = 0. If P0P_0 has a rational root ab\frac ab, the factor theorem (Theorem 8.7) writes P0=(Xab)QP_0 = \bigl(X - \frac ab\bigr)Q with QQ[X]Q \in \Q[X]; since xabx \neq \frac ab (xx irrational), Q(x)=0Q(x) = 0, and clearing denominators gives a nonzero integer polynomial of smaller degree vanishing at xx. The degree drops at each step, so the process stops: we reach PZ[X]P \in \Z[X], P(x)=0P(x) = 0, with no rational root, of some degree dd. If d1d \leq 1, P=uX+vP = uX + v would make x=vux = -\frac vu rational: so d2d \geq 2.

6. qdP(pq)=adpd+ad1pd1q++a0qdq^d\,P\bigl(\frac pq\bigr) = a_d p^d + a_{d-1} p^{d-1} q + \dots + a_0 q^d is an integer, and it is nonzero because PP has no rational root: P(pq)qd\bigl|P\bigl(\frac pq\bigr)\bigr| \geq q^{-d}.

7. Note M>0M > 0: PP' is a nonzero polynomial (d2d \geq 2), so it cannot vanish identically on [x1,x+1]\intcc{x-1}{x+1}. If xpq>1\bigl|x - \frac pq\bigr| > 1, then it exceeds Cqd\frac{C}{q^d} trivially. Otherwise pq[x1,x+1]\frac pq \in \intcc{x-1}{x+1} and the mean value theorem (Theorem 14.9) gives cc between xx and pq\frac pq with

P(pq)=P(pq)P(x)=P(c)xpqMxpq,\Bigl|P\Bigl(\frac pq\Bigr)\Bigr| = \Bigl|P\Bigl(\frac pq\Bigr) - P(x)\Bigr| = \abs{P'(c)}\,\Bigl|x - \frac pq\Bigr| \leq M\,\Bigl|x - \frac pq\Bigr| ,

so with question 6: xpq1MqdCqd\bigl|x - \frac pq\bigr| \geq \frac{1}{Mq^d} \geq \frac{C}{q^d}.

8. Suppose x=abx = \frac ab is Liouville. Pick nn with 2n1>b2^{n-1} > b and the corresponding pq\frac pq, q2q \geq 2:

0<xpq<1qn=1qn1q12n1q<1bq,0 < \Bigl|x - \frac pq\Bigr| < \frac{1}{q^n} = \frac{1}{q^{n-1}\,q} \leq \frac{1}{2^{n-1} q} < \frac{1}{bq} ,

contradicting question 1. So Liouville numbers are irrational.

9. If a Liouville xx were algebraic: it is irrational (question 8), so questions 5–7 provide d2d \geq 2 and C>0C > 0 with xpqCqd\bigl|x - \frac pq\bigr| \geq \frac{C}{q^d} always. For each nn, the Liouville approximant gives Cqd<qn\frac{C}{q^d} < q^{-n}, i.e. C<qdn2dnC < q^{d-n} \leq 2^{d-n} (as q2q \geq 2). For nn large, 2dn<C2^{d-n} < C: contradiction. Liouville numbers are transcendental.

10. Ones at positions 1,2,6,241, 2, 6, 24; all other digits among the first 2525 vanish:

L=0.1100010000000000000000010L = 0.1100010000\,0000000000\,00010\dots

11. For m>km > k, the positions n!n! with n>kn > k are distinct integers (k+1)!\geq (k+1)!, so the finite geometric sum gives

tmtk=n=k+1m10n!j=(k+1)!m!10j<10(k+1)!11110=10910(k+1)!;t_m - t_k = \sum_{n=k+1}^{m} 10^{-n!} \leq \sum_{j = (k+1)!}^{m!} 10^{-j} < 10^{-(k+1)!}\,\frac{1}{1 - \frac1{10}} = \frac{10}{9}\,10^{-(k+1)!} ;

taking the supremum over mm: Ltk10910(k+1)!<210(k+1)!L - t_k \leq \frac{10}{9}10^{-(k+1)!} < 2\cdot10^{-(k+1)!}. Lower bound: Ltk+1=tk+10(k+1)!L \geq t_{k+1} = t_k + 10^{-(k+1)!}.

12. pk=10k!tkNp_k = 10^{k!}\,t_k \in \N, qk=10k!q_k = 10^{k!}, and (k+1)!=(k+1)k!(k+1)! = (k+1)\,k! gives 10(k+1)!=qk(k+1)10^{-(k+1)!} = q_k^{-(k+1)}: question 11 reads

0<Lpkqk<2qkk+1.0 < L - \frac{p_k}{q_k} < \frac{2}{q_k^{\,k+1}} .

Given nn: for knk \geq n, 2qk(k+1)qkn2\,q_k^{-(k+1)} \leq q_k^{-n} (indeed qkk+1nqk10>2q_k^{\,k+1-n} \geq q_k \geq 10 > 2), and qk2q_k \geq 2: the definition of question 8 is met. LL is a Liouville number.

13. By question 9, LL is transcendental — the first number in history proved transcendental (Liouville, 1844). Digit cross-check: the string has infinitely many ones with consecutive gaps (k+1)!k!=kk!(k+1)! - k! = k\cdot k! \to \infty, so it is not eventually periodic, and LQL \notin \Q by the periodicity criterion of Problem 10.1 (question 18) — consistent.

14. With digits dn[ ⁣[1,9] ⁣]d_n \in \intint{1}{9} at the factorial positions: the tail bound of question 11 scales by at most 99: 0<Ltk910910(k+1)!=10qk(k+1)0 < L' - t'_k \leq 9\cdot\frac{10}{9}\,10^{-(k+1)!} = 10\,q_k^{-(k+1)} (positivity because the digit at position (k+1)!(k+1)! is nonzero). For knk \geq n: 10qk(k+1)qkn10\,q_k^{-(k+1)} \leq q_k^{-n} since qkk+1n10q_k^{\,k+1-n} \geq 10: again a Liouville number, hence transcendental. These values are pairwise distinct for distinct digit choices (the strings are proper — zeros abound — and proper strings determine their value, Problem 10.1, question 10). Given any list kxkk \mapsto x_k of them, choose the kk-th factorial digit in [ ⁣[1,9] ⁣]\intint{1}{9} different from that of xkx_k: a number of the same shape missing from the list. Uncountably many explicit transcendentals.

15. First a lemma: if xpqCqs\bigl|x - \frac pq\bigr| \geq \frac{C}{q^s} for all pqx\frac pq \neq x, then xx is not approximable to any order μ>s\mu > s. Indeed infinitely many pqx\frac pq \neq x with xpq<cqμ\bigl|x - \frac pq\bigr| < \frac{c}{q^\mu} would force Cqs<cqμ\frac{C}{q^s} < \frac{c}{q^\mu}, i.e. qμs<cCq^{\mu - s} < \frac cC: the qq are bounded, and boundedly many fractions lie within distance 11 of xx — finitely many candidates, not infinitely many. Now the hierarchy: rationals are approximable to order 11 (pq\frac pq with p=qx+1p = \lfloor qx\rfloor + 1 gives error 1q<2q\leq \frac1q < \frac2q) and to no order μ>1\mu > 1 (question 1 gives the hypothesis of the lemma with s=1s = 1, C=1bC = \frac1b); 2\sqrt2: order 22 (question 3) and no more (question 2 and the lemma); every irrational: at least 22 (question 4); algebraic of degree dd: at most dd (question 7 and the lemma); Liouville numbers: every order (question 12’s display, with c=2c = 2).

16. With r=abr = \frac ab: pkqk+ab=bpk+aqkbqk=:PkQk\frac{p_k}{q_k} + \frac ab = \frac{b p_k + a q_k}{b q_k} =: \frac{P_k}{Q_k}, Qk=bqk2Q_k = b q_k \geq 2, and

(L+r)PkQk=Lpkqk<2qk(k+1)=2bk+1Qk(k+1).\Bigl|(L + r) - \frac{P_k}{Q_k}\Bigr| = L - \frac{p_k}{q_k} < 2\,q_k^{-(k+1)} = 2\,b^{\,k+1} Q_k^{-(k+1)} .

Given nn: for large kk, Qkk+1nQk=b10k!2bk+1Q_k^{\,k+1-n} \geq Q_k = b\,10^{k!} \geq 2\,b^{\,k+1} (the factorial crushes the power), so the error is <Qkn< Q_k^{-n}: L+rL + r is Liouville. Since Q\Q is dense and each L+rL + r is transcendental, transcendental numbers are dense in R\R.

17. For h1h \geq 1 there are finitely many PZ[X]P \in \Z[X] with degP+iaih\deg P + \sum_i \abs{a_i} \leq h (degree h\leq h and each coefficient in [ ⁣[h,h] ⁣]\intint{-h}{h}: at most (2h+1)h+1(2h+1)^{h+1}). Every nonzero integer polynomial has such a height, and has at most degP\deg P real roots: the algebraic numbers form a countable union (over hh) of finite sets, hence can be listed as a single sequence. If the transcendentals could also be listed, interleaving the two lists would list R\R, contradicting Problem 10.1 (question 22). So transcendental numbers form an uncountable set. Comparison: Cantor proves most reals are transcendental yet exhibits none; Liouville exhibits one, with effective constants (Part V) — existence by abundance versus existence by construction.

18. From question 2, the lemma hypothesis holds with s=2s = 2, C=14C = \frac14. If 2\sqrt2 were Liouville, then for n=3n = 3: 14q2<q3\frac{1}{4q^2} < q^{-3} forces q<4q < 4, so q{2,3}q \in \{2, 3\}; only finitely many pq\frac pq with these qq lie within 11 of 2\sqrt2, each at some positive distance ε0\geq \varepsilon_0 (2\sqrt2 irrational); choosing nn with 2n<ε02^{-n} < \varepsilon_0 leaves no admissible pq\frac pq at all: contradiction. The same argument with Cqd\frac{C}{q^d} shows no algebraic number is Liouville — question 9 in effective clothing.

19. 9922702=98019800=199^2 - 2\cdot70^2 = 9801 - 9800 = 1. Hence

29970=2(99/70)22+99/70=14900(2+9970),29970=14900×2.82847.2105:\sqrt2 - \frac{99}{70} = \frac{2 - (99/70)^2}{\sqrt2 + 99/70} = \frac{-1}{4900\,\bigl(\sqrt2 + \tfrac{99}{70}\bigr)} , \qquad \Bigl|\sqrt2 - \frac{99}{70}\Bigr| = \frac{1}{4900 \times 2.8284\dots} \approx 7.2\cdot10^{-5} :

9970=1.414285\frac{99}{70} = 1.414285\dots against 2=1.414213\sqrt2 = 1.414213\dots — five correct digits.

20. Rational-root test for P=X32P = X^3 - 2: candidates ±1,±2,±12\pm1, \pm2, \pm\frac12, none a root. So d=3d = 3 and Part II applies to x=21/3=1.2599x = 2^{1/3} = 1.2599\dots On [x1,x+1][0.25,2.26]\intcc{x - 1}{x + 1} \subseteq \intcc{0.25}{2.26}: P(t)=3t23(1+21/3)2<3×(2.26)2=15.32<16\abs{P'(t)} = 3t^2 \leq 3\,(1 + 2^{1/3})^2 < 3\times(2.26)^2 = 15.32 < 16, so M<16M < 16 and C116C \geq \frac{1}{16}:

21/3pq116q3for all rationals.\Bigl|2^{1/3} - \frac pq\Bigr| \geq \frac{1}{16\,q^3} \qquad\text{for all rationals.}

21. If 21/3pq<106\bigl|2^{1/3} - \frac pq\bigr| < 10^{-6}, then 116q3<106\frac{1}{16 q^3} < 10^{-6}, i.e. q3>10616=62500q^3 > \frac{10^6}{16} = 62\,500; since 393=59319<6250064000=40339^3 = 59\,319 < 62\,500 \leq 64\,000 = 40^3: q40q \geq 40.

22. Run Part III in base 22: B=supknk2n!B = \sup_k \sum_{n\leq k} 2^{-n!}, qk=2k!q_k = 2^{k!}, and the geometric tail (ratio 12\frac12) gives 0<Bpkqk22(k+1)!=2qk(k+1)qkn0 < B - \frac{p_k}{q_k} \leq 2\cdot2^{-(k+1)!} = 2\,q_k^{-(k+1)} \leq q_k^{-n} for knk \geq n. So BB is Liouville, hence transcendental: nothing in the argument is decimal.

23. With ones at positions 3k3^k: qk=103kq_k = 10^{3^k} and the tail bound gives 0<xpkqk<2103k+1=2qk30 < x^\dagger - \frac{p_k}{q_k} < 2\cdot10^{-3^{k+1}} = 2\,q_k^{-3} (as 3k+1=33k3^{k+1} = 3\cdot3^k): infinitely many approximations of order 33. By the lemma of question 15: order 3>13 > 1 rules out rationality, and order 3>23 > 2 rules out being a quadratic irrational (whose Liouville inequality has s=d=2s = d = 2). But an algebraic number of degree 3\geq 3 is only repelled at order d3d \geq 3: Liouville’s method cannot separate xx^\dagger from the cubics. The gap is closed by Roth’s theorem — every algebraic irrational has approximation order exactly 22 — a twentieth-century result far beyond this volume; granted it, xx^\dagger too is transcendental.

24. There are at most (2H+1)d+1(2H+1)^{d+1} tuples (a0,,ad)(a_0, \dots, a_d) with entries in [ ⁣[H,H] ⁣]\intint{-H}{H}, and each nonzero polynomial among them has at most dd real roots: at most d(2H+1)d+1d\,(2H+1)^{d+1} algebraic numbers arise — the finiteness that let question 17 enumerate them all.

25. (i) The single analytic ingredient is the mean value theorem, in question 7, converting the vanishing P(x)=0P(x) = 0 into the Lipschitz repulsion P(p/q)Mxp/q\abs{P(p/q)} \leq M\abs{x - p/q}. (ii) The tension: integrality pushes P(p/q)\abs{P(p/q)} up to qdq^{-d}, smoothness pulls it down to Mxp/qM\abs{x - p/q} — a rational too close to xx would be crushed between the two. (iii) Liouville constructs one transcendental with effective constants; Cantor shows almost all reals are transcendental without naming one: construction versus cardinality. (iv) The weekend problem of Chapter 15 proves the irrationality of π\pi by the same squeeze — an integral that would be a positive integer yet is trapped in (0,1)\intoo{0}{1} — with integration replacing differentiation as the analytic half.