Mathematics · Book 3 · Bachelor Year 1

University Mathematics — Year 1

University Mathematics — Year 1 · Bachelor Year 1

17Numerical Series

Summing infinitely many numbers means taking the limit of the partial sums — nothing more, nothing less. This chapter sets up the definitions and the convergence tests usable in first year: comparison and equivalents for positive terms, the ratio test, the integral comparison giving the Riemann series, absolute convergence, and the alternating series theorem. The finer theory (products of series, summation by packets, series of functions) belongs to the second year.

17.1 Generalities

Definition 17.1

Given a sequence (un)(u_n), the series un\sum u_n is the sequence of partial sums SN=n=0NunS_N = \sum_{n=0}^{N} u_n. The series converges when (SN)(S_N) converges; the limit is the sum n=0un\sum_{n=0}^{\infty} u_n, and RN=n>Nun=SSNR_N = \sum_{n > N} u_n = S - S_N is the remainder, which tends to 00.

Example 17.2 (Geometric series)

For qCq \in \C:   SN=n=0Nqn=1qN+11q\;S_N = \sum_{n=0}^{N} q^n = \frac{1 - q^{N+1}}{1-q} (q1q \neq 1). The series converges iff q<1\abs q < 1 (Exercise 11.3), with

n=0qn=11q.\sum_{n=0}^{\infty} q^n = \frac{1}{1 - q} .

Example 17.3 (Periodic decimals are geometric series)

What number is 0.3636360.363636\dots? Its very writing is a series:

0.36=k=136100k=361/10011/100=3699=411,0.\overline{36} = \sum_{k=1}^{\infty} \frac{36}{100^k} = 36\cdot\frac{1/100}{1 - 1/100} = \frac{36}{99} = \frac{4}{11} ,

by the geometric sum with q=1100q = \frac{1}{100}. In general a block BB of pp digits repeating forever is worth B10p1\frac{B}{10^p - 1} — the mechanism behind the periodicity criterion of Problem 10.1, which this chapter’s language finally states in one line: a decimal expansion is a convergent series, eventually periodic exactly when its sum is rational. The digit machinery of Chapter 10, built there with bare suprema, was series theory traveling incognito.

Proposition 17.4 (First facts)

  1. If un\sum u_n converges, then un0u_n \to 0. (The converse is false: the harmonic series.)
  2. Linearity: convergent series add and scale, with the expected sums.
  3. (Telescoping) (vn+1vn)\sum (v_{n+1} - v_n) converges iff (vn)(v_n) converges, with sum limvnv0\lim v_n - v_0.
  4. Changing finitely many terms does not affect convergence (only the sum).

Proof. (1) uN=SNSN1SS=0u_N = S_N - S_{N-1} \to S - S = 0. The harmonic series has un=1n0u_n = \frac1n \to 0 yet diverges (Exercise 11.5). (2) Operations on limits. (3) SN=vN+1v0S_N = v_{N+1} - v_0. (4) The partial sums change by an eventually constant amount.

Example 17.5 (Planning digits with the geometric remainder)

For q<1\abs q < 1 the remainder of the geometric series is explicit:

RN=n=N+1qn=qN+11q.R_N = \sum_{n = N+1}^{\infty} q^n = \frac{q^{N+1}}{1 - q} .

This converts accuracy goals into term counts before any computation. To evaluate n0(13)n=32\sum_{n\geq0} \bigl(\frac13\bigr)^n = \frac32 within 101010^{-10}: need (1/3)N+12/31010\frac{(1/3)^{N+1}}{2/3} \leq 10^{-10}, i.e. 3N3210103^{N} \geq \frac{3}{2}\cdot 10^{10}, i.e. N22N \geq 22 (as 3223.110103^{22} \approx 3.1\cdot10^{10}): twenty-three terms, known in advance. Every geometric-rate estimate of the weekend problems (the 13\frac13-series for ln2\ln 2, Machin’s arctangents in Problem 16.1) is this two-line budget in professional dress.

Example 17.6 (A longer telescope)

Compute n11n(n+1)(n+2)\sum_{n\geq1} \frac{1}{n(n+1)(n+2)}. Partial fractions (Chapter 9):

1n(n+1)(n+2)=1/2n1n+1+1/2n+2=12(1n(n+1)1(n+1)(n+2)),\frac{1}{n(n+1)(n+2)} = \frac{1/2}{n} - \frac{1}{n+1} + \frac{1/2}{n+2} = \frac12\Bigl(\frac{1}{n(n+1)} - \frac{1}{(n+1)(n+2)}\Bigr),

where the second form — a difference of consecutive values of wn=1n(n+1)w_n = \frac{1}{n(n+1)} — is the telescoping one. Hence

n=1N1n(n+1)(n+2)=12(w1wN+1)=12(121(N+1)(N+2))14.\sum_{n=1}^{N} \frac{1}{n(n+1)(n+2)} = \frac12\Bigl(w_1 - w_{N+1}\Bigr) = \frac12\Bigl(\frac12 - \frac{1}{(N+1)(N+2)}\Bigr) \longrightarrow \frac14 .

The closing insight: three-term partial fractions rarely telescope as written; regroup them into a difference wnwn+1w_n - w_{n+1} first — the reward is not just convergence but the exact sum, which no comparison test ever delivers.

17.2 Series with nonnegative terms

Theorem 17.7 (Bounded partial sums)

If un0u_n \geq 0 for all nn, the partial sums increase, so: un\sum u_n converges     \iff its partial sums are bounded above. Hence the comparison test: if 0unvn0 \leq u_n \leq v_n for all (large) nn,

vn converges    un converges,un diverges    vn diverges.\sum v_n \text{ converges} \implies \sum u_n \text{ converges}, \qquad \sum u_n \text{ diverges} \implies \sum v_n \text{ diverges}.

And the equivalents test: if unvnu_n \sim v_n with vn0v_n \geq 0, the two series have the same nature.

Proof. Monotone limit theorem (Theorem 11.9) for the first point; comparison of partial sums for the second. Equivalents: for large nn, 12vnun2vn\frac12 v_n \leq u_n \leq 2 v_n (definition of \sim with ε=12\varepsilon = \frac12), and comparison applies both ways.

Example 17.8 (An equivalent that proves divergence)

Nature of n1nsin1n2\sum_{n\geq1} n\sin\dfrac{1}{n^2}? Since 1n20\frac{1}{n^2} \to 0 and sinhh\sin h \sim h at 00:

nsin1n2    n1n2=1n,n\sin\frac{1}{n^2} \;\sim\; n\cdot\frac{1}{n^2} = \frac1n ,

and the equivalents test transfers the divergence of the harmonic series: divergent — even though the terms tend to 00. One expansion, one scale, one verdict; the same two-step pattern (equivalent, then Riemann or geometric lookup) decides all four series of Exercise 17.3.

Example 17.9 (The equivalents test in one line)

Nature of n1n+1nn\sum_{n \geq 1} \frac{\sqrt{n+1} - \sqrt n}{n}? Conjugate the numerator:

n+1nn=1n(n+1+n)12n3/2,\frac{\sqrt{n+1} - \sqrt n}{n} = \frac{1}{n\,(\sqrt{n+1} + \sqrt n)} \sim \frac{1}{2\,n^{3/2}} ,

a convergent Riemann scale (α=32>1\alpha = \frac32 > 1): the series converges. The whole decision took one equivalent and one lookup — provided the terms are nonnegative, which they are. The closing insight: for positive series, the entire convergence theory is a dictionary of scales (nαn^{-\alpha}, qnq^n, 1n(lnn)α\frac{1}{n(\ln n)^\alpha}) plus the license to replace a term by an equivalent; the analytic work is in the asymptotics (Chapter 16), never in the summation.

Theorem 17.10 (Integral comparison; Riemann series)

Let ff be continuous, nonnegative and decreasing on [1,+)\intco{1}{+\infty}. Then

1N+1f(t) ⁣dt    n=1Nf(n)    f(1)+1Nf(t) ⁣dt,\int_1^{N+1} f(t)\,\dd t \;\leq\; \sum_{n=1}^{N} f(n) \;\leq\; f(1) + \int_1^{N} f(t)\,\dd t ,

so f(n)\sum f(n) converges iff (1xf)\bigl(\int_1^x f\bigr) is bounded. In particular, for αR\alpha \in \R:

n11nα converges    α>1,\sum_{n \geq 1} \frac{1}{n^\alpha} \text{ converges} \iff \alpha > 1,

and n=1N1n=lnN+O(1)\sum_{n=1}^{N} \frac1n = \ln N + O(1).

Proof. For ntn+1n \leq t \leq n+1, monotonicity gives f(n+1)f(t)f(n)f(n+1) \leq f(t) \leq f(n); integrating over [n,n+1]\intcc{n}{n+1} (a segment of length 11):

f(n+1)    nn+1f(t) ⁣dt    f(n).f(n+1) \;\leq\; \int_n^{n+1} f(t)\,\dd t \;\leq\; f(n) .

Summing the right inequalities for n=1,,N1n = 1, \dots, N-1 gives 1Nfn=1N1f(n)\int_1^{N} f \leq \sum_{n=1}^{N-1} f(n), hence the upper framing after adding f(N)f(1)f(N) \leq f(1); summing the left ones for n=1,,Nn = 1, \dots, N gives n=2N+1f(n)1N+1f\sum_{n=2}^{N+1} f(n) \leq \int_1^{N+1} f, which after reindexing is the lower framing. Convergence: the partial sums and the integrals 1xf\int_1^x f bound each other within the constant f(1)f(1), and both are nondecreasing, so one is bounded iff the other is (Theorem 17.7). For f(t)=tαf(t) = t^{-\alpha} (α1\alpha \neq 1): 1xtα ⁣dt=x1α11α\int_1^x t^{-\alpha}\dd t = \frac{x^{1-\alpha} - 1}{1 - \alpha}, bounded iff α>1\alpha > 1; for α=1\alpha = 1 the integral is lnx\ln x \to \infty, and the framing gives ln(N+1)HN1+lnN\ln(N+1) \leq H_N \leq 1 + \ln N. For α0\alpha \leq 0 the terms do not tend to 00.

Example 17.11 (The harmonic stack)

How many terms must the harmonic series accumulate to pass 2020? The framing ln(N+1)HN1+lnN\ln(N+1) \leq H_N \leq 1 + \ln N answers with no summation at all: HN20H_N \geq 20 requires 1+lnN201 + \ln N \geq 20, i.e. Ne191.8108N \geq \eu^{19} \approx 1.8\cdot10^{8}, and is guaranteed once ln(N+1)20\ln(N + 1) \geq 20, i.e. Ne204.9108N \approx \eu^{20} \approx 4.9\cdot10^{8}. (The weekend problem sharpens this to Ne20γ2.7108N \approx \eu^{20 - \gamma} \approx 2.7\cdot10^{8} via Euler’s constant.) The closing insight: the integral comparison does not merely decide convergence — it locates partial sums with logarithmic precision, turning a hopeless computation (hundreds of millions of terms) into a two-line estimate.

Theorem 17.12 (Ratio test (d’Alembert))

Let un>0u_n > 0 with un+1un\frac{u_{n+1}}{u_n} \to \ell.

  • If <1\ell < 1: un\sum u_n converges;
  • if >1\ell > 1: un+u_n \to +\infty, divergence;
  • if =1\ell = 1: no conclusion (1n\sum \frac1n diverges, 1n2\sum \frac{1}{n^2} converges).

Proof. If <1\ell < 1, fix q(,1)q \in \intoo{\ell}{1}: beyond some NN, un+1qunu_{n+1} \leq q\,u_n, so unuNqnNu_n \leq u_N q^{\,n-N} by induction: comparison with a geometric series. If >1\ell > 1: beyond some NN the sequence (un)(u_n) is increasing, so it cannot tend to 00 (its limit, if any, is uN>0\geq u_N > 0); by Proposition 17.4 (1), divergence — and in fact unuNqnNu_n \geq u_N q^{n-N} with q>1q > 1 gives unu_n \to \infty.

Example 17.13

xnn!\sum \frac{x^n}{n!} converges for every x>0x > 0: ratio xn+10\frac{x}{n+1} \to 0. Its sum is ex\eu^x: by Taylor–Lagrange (Theorem 16.7) on [0,x]\intcc{0}{x},

exk=0nxkk!exxn+1(n+1)!n0,\Bigl| \eu^x - \sum_{k=0}^{n} \frac{x^k}{k!} \Bigr| \leq \eu^{x}\, \frac{x^{n+1}}{(n+1)!} \xrightarrow[n\to\infty]{} 0 ,

the bound tending to 00 because the factorial dominates (Exercise 15.9 (1) used the same fact). The same argument sums the sin\sin, cos\cos, sinh\sinh, cosh\cosh series on all of R\R.

Example 17.14 (The ratio test is sufficient, not necessary)

Let un=2nu_n = 2^{-n} for even nn and un=2n2u_n = 2^{-n-2} for odd nn. The consecutive ratios oscillate between 18\frac{1}{8} and 124=2\frac12\cdot4 = 2, so un+1un\frac{u_{n+1}}{u_n} has no limit and d’Alembert is mute — yet un2nu_n \leq 2^{-n} and the comparison test settles convergence instantly. The test’s hypothesis (the ratio converges) is a real restriction: it suits terms with one dominant multiplicative structure (factorials, powers), and fails on anything that breathes. When ratios misbehave, step back to comparison against a geometric envelope — which is all the ratio test ever was, as its proof shows.

Example 17.15 (Ratio test on factorial battles)

Nature of n0(n!)2(2n)!\sum_{n\geq0} \dfrac{(n!)^2}{(2n)!} (reciprocals of the central binomial coefficients, up to the factor n+1n + 1)? The ratio collapses the factorials:

un+1un=((n+1)!)2(n!)2(2n)!(2n+2)!=(n+1)2(2n+1)(2n+2)14<1:\frac{u_{n+1}}{u_n} = \frac{((n+1)!)^2}{(n!)^2}\cdot\frac{(2n)!}{(2n+2)!} = \frac{(n+1)^2}{(2n+1)(2n+2)} \longrightarrow \frac14 < 1 :

convergent, with room to spare — the terms decay essentially like 4n4^{-n}, consistent with (2nn)4n2n+1\binom{2n}{n} \geq \frac{4^n}{2n+1} from Problem 15.1. The closing insight: quotients of factorials are exactly what the ratio test digests — every factorial cancels into a rational function of nn, whose limit is read off the leading terms.

17.3 Absolute convergence; alternating series

Theorem 17.16 (Absolute convergence)

If un\sum \abs{u_n} converges (absolute convergence), then un\sum u_n converges, and unun\bigl|\sum u_n\bigr| \leq \sum \abs{u_n}. This holds for real or complex terms.

Proof. The partial sums satisfy, for M>NM > N (Cauchy criterion, Theorem 11.20):

SMSN=n=N+1Munn=N+1Mun,\abs{S_M - S_N} = \Bigl| \sum_{n=N+1}^{M} u_n \Bigr| \leq \sum_{n=N+1}^{M} \abs{u_n},

which is small for large NN since the partial sums of un\sum\abs{u_n} form a Cauchy sequence. So (SN)(S_N) is Cauchy, hence convergent. The inequality passes to the limit from the finite triangle inequality.

Example 17.17 (Absolute convergence, real and complex)

n1sinnn2\sum_{n\geq1} \frac{\sin n}{n^2}: the terms change sign erratically (indeed (sinn)(\sin n) is dense in [1,1]\intcc{-1}{1}, Exercise 11.12), and no alternating structure is in sight. Absolute convergence rescues everything at once: sinnn21n2\bigl|\frac{\sin n}{n^2}\bigr| \leq \frac{1}{n^2}, a convergent scale, so the series converges. The same shield works over C\C: n1einn2\sum_{n\geq1}\frac{\eu^{\iu n}}{n^2} converges because einn2=1n2\bigl|\frac{\eu^{\iu n}}{n^2}\bigr| = \frac{1}{n^2} — sign patterns, even two-dimensional ones, are irrelevant once the moduli are summable. The closing insight: absolute convergence is the only tool of this chapter that never asks how the signs are organized; try it first (Method 17.21), and reserve the delicate tests for the series that fail it.

Theorem 17.18 (Alternating series test)

Let (an)(a_n) be decreasing with an0a_n \to 0. Then the alternating series (1)nan\sum (-1)^n a_n converges; its sum lies between any two consecutive partial sums, and

RN=n>N(1)nanaN+1.\abs{R_N} = \Bigl| \sum_{n > N} (-1)^n a_n \Bigr| \leq a_{N+1} .

Proof. The even and odd partial sums are adjacent: S2p+2S2p=a2p+2a2p+10S_{2p+2} - S_{2p} = a_{2p+2} - a_{2p+1} \leq 0 (decreasing), S2p+1S2p1=a2pa2p+10S_{2p+1} - S_{2p-1} = a_{2p} - a_{2p+1} \geq 0 (increasing), and S2pS2p+1=a2p+10S_{2p} - S_{2p+1} = a_{2p+1} \to 0. By Theorem 11.11 they share a limit SS, which the two subsequences criterion (Proposition 11.14) makes the limit of (SN)(S_N); moreover SS is trapped between consecutive partial sums, and SSN\abs{S - S_N} is at most the gap to the next one, aN+1a_{N+1}.

Example 17.19 (Alternating harmonic series)

n1(1)n1n\sum_{n \geq 1} \frac{(-1)^{n-1}}{n} converges (alternating test) but not absolutely (harmonic series). Its sum is ln2\ln 2: from the finite geometric identity 11+t=k=0n1(t)k+(t)n1+t\frac{1}{1+t} = \sum_{k=0}^{n-1} (-t)^k + \frac{(-t)^n}{1+t}, integrate over [0,1]\intcc{0}{1}:

ln2=k=1n(1)k1k+(1)n01tn1+t ⁣dt,001tn1+t ⁣dt1n+10.\ln 2 = \sum_{k=1}^{n} \frac{(-1)^{k-1}}{k} + (-1)^n \int_0^1 \frac{t^n}{1+t}\,\dd t , \qquad 0 \leq \int_0^1 \frac{t^n}{1+t}\,\dd t \leq \frac{1}{n+1} \to 0 .

The convergence is painfully slow (RN1NR_N \approx \frac{1}{N}) — alternating series converge by cancellation, not by smallness.

The partial sums S_N of the alternating harmonic series 1 - 1/2 + 1/3 - hop over their limit 2 at every step: odd sums from above, even sums from below, each hop of size 1/N+1. The bracketing is the proof of  made visible — and the slow closing of the pincers (|S_N - 2| 1/2N, weekend problem ) is why nobody computes 2 this way.
The partial sums SNS_N of the alternating harmonic series 112+131 - \frac12 + \frac13 - \cdots hop over their limit ln2\ln 2 at every step: odd sums from above, even sums from below, each hop of size 1N+1\frac{1}{N+1}. The bracketing is the proof of Theorem 17.18 made visible — and the slow closing of the pincers (SNln212N\abs{S_N - \ln 2} \approx \frac{1}{2N}, weekend problem Problem 17.1) is why nobody computes ln2\ln 2 this way.

Remark 17.20 (Common pitfalls with series)

(i) The equivalents test needs a sign: let vn=(1)nnv_n = \frac{(-1)^n}{\sqrt n} and un=vn+1nu_n = v_n + \frac1n. Then unvn=1+(1)nn1\frac{u_n}{v_n} = 1 + \frac{(-1)^n}{\sqrt n} \to 1, so unvnu_n \sim v_n; yet vn\sum v_n converges (alternating test) while un=vn+1n\sum u_n = \sum v_n + \sum \frac1n diverges. Equivalence controls the size of terms, and for signed series size is not destiny — the test is stated, and true, for (eventually) nonnegative terms only. (ii) un0u_n \to 0 proves nothing: the harmonic series is the eternal counterexample; the converse direction (Proposition 17.4 (1)) is only a quick divergence test. (iii) Ratio limit 11 is silence, not convergence: both 1n\sum\frac1n and 1n2\sum\frac{1}{n^2} have ratio 1\to 1; switch to Riemann scales or integral comparison. (iv) Alternating needs decreasing: (1)nn+(1)n\sum \frac{(-1)^n}{n + (-1)^n} looks alternating and is handled only by expansion (Exercise 17.5); the weekend problem of Chapter 16 (question 23 there) shows the test can fail outright without monotonicity. (v) Grouping and reordering are not free: inserting parentheses is harmless for convergent series but can create convergence from divergence (11+11 - 1 + 1 - \cdots grouped in pairs), and reordering can change the sum itself — the drama staged in this chapter’s weekend problem (Problem 17.1).

Method 17.21 (Deciding the nature of a series)

  1. Does un0u_n \to 0? If not, divergence, stop.
  2. Nonnegative terms: seek an equivalent of unu_n (expansions, Chapter 16!), compare with Riemann or geometric scales; factorials and powers call for the ratio test; decreasing f(n)f(n) calls for integral comparison.
  3. Signs vary: try absolute convergence first; if it fails, the alternating test (check decreasing carefully); beyond that, second-year tools.

Example 17.22 (Odd denominators, half the telescope)

Compute n114n21\sum_{n \geq 1} \dfrac{1}{4n^2 - 1}. Partial fractions: 1(2n1)(2n+1)=12(12n112n+1)\frac{1}{(2n-1)(2n+1)} = \frac12\bigl(\frac{1}{2n-1} - \frac{1}{2n+1}\bigr), so

n=1N14n21=12(112N+1)12.\sum_{n=1}^{N} \frac{1}{4n^2 - 1} = \frac12\Bigl(1 - \frac{1}{2N+1}\Bigr) \longrightarrow \frac12 .

Compare with 1n(n+1)=1\sum \frac{1}{n(n+1)} = 1 (Exercise 17.1): same telescoping skeleton, but the consecutive terms here are two apart in the odd numbers, and the factor 12\frac12 records the step. The closing insight: telescoping is a change of viewpoint, not a trick — whenever the general term is a difference wnwn+1w_n - w_{n+1} of a sequence with a limit, the sum is w1limww_1 - \lim w, exactly Proposition 17.4 (3).

Remark 17.23 (The analysis pipeline, in retrospect)

This chapter is where the volume’s analysis converges, and each test names its ancestor. Bounded partial sums is the monotone limit theorem (Chapter 11), itself the completeness axiom of Chapter 10; absolute convergence is the Cauchy criterion; the integral test is Chapter 15’s framing of areas; equivalents of general terms are Chapter 16’s expansions; and the alternating theorem is the adjacent-sequences lemma in its Sunday clothes. Read backwards, the pipeline explains what each chapter was for — and the weekend problems threaded through it (bb-adic digits, Cesàro–Stolz, the irrationality machines, Euler’s constant) are the same few ideas meeting at higher and higher altitude. The linear algebra that follows changes subject, not standards: the habit of exact statements with certified error survives the move from limits to dimensions.

Remark 17.24 (Where series go next)

This chapter closes the analysis of the volume and opens three doors. In the Year 2 volume, series acquire a variable (anxn\sum a_n x^n: power series, with their radius of convergence) and then a function-valued theory (Fourier series); the dichotomy absolute-versus-conditional convergence, dramatized in the weekend problem below, becomes the cornerstone of both. In probability (Year 3 volume), expectations of discrete random variables are series, and absolute convergence is what makes them well defined. And the Riemann series ns\sum n^{-s}, pushed to complex ss, becomes the zeta function — the single most studied series in mathematics.

17.4 Exercises

Exercise 17.1

Nature (and sum, when telescoping) of:

n11n(n+1),n2ln(11n2),n03n+4n5n.\sum_{n\geq1} \frac{1}{n(n+1)}, \qquad \sum_{n\geq2} \ln\Bigl(1 - \frac{1}{n^2}\Bigr), \qquad \sum_{n\geq0} \frac{3^n + 4^n}{5^n} .
Solution

Solution of Exercise 17.1.

1n(n+1)=1n1n+1\dfrac{1}{n(n+1)} = \dfrac1n - \dfrac{1}{n+1}: telescoping, SN=11N+11S_N = 1 - \frac{1}{N+1} \to 1. Convergent, sum 11.

ln(11n2)=ln(n1)(n+1)n2=lnn1nlnnn+1\ln\bigl(1 - \frac{1}{n^2}\bigr) = \ln\frac{(n-1)(n+1)}{n^2} = \ln\frac{n-1}{n} - \ln\frac{n}{n+1}: telescoping again, SN=ln12lnNN+1ln2S_N = \ln\frac12 - \ln\frac{N}{N+1} \to -\ln 2. Convergent, sum ln2-\ln 2.

3n+4n5n=(35)n+(45)n\dfrac{3^n + 4^n}{5^n} = \bigl(\frac35\bigr)^n + \bigl(\frac45\bigr)^n: two convergent geometric series, sum 113/5+114/5=52+5=152\frac{1}{1 - 3/5} + \frac{1}{1 - 4/5} = \frac52 + 5 = \frac{15}{2}.

Exercise 17.2

Nature of:   n22n\;\sum \dfrac{n^2}{2^n};   n!nn\;\sum \dfrac{n!}{n^n};   2nn!nn\;\sum \dfrac{2^n\,n!}{n^n};   3nn!nn\;\sum \dfrac{3^n\,n!}{n^n}. (Ratio test; recall (1+1n)ne\bigl(1 + \frac1n\bigr)^n \to \eu.)

Solution

Solution of Exercise 17.2.

Ratio test throughout.

un+1un=(n+1)22n212<1\frac{u_{n+1}}{u_n} = \frac{(n+1)^2}{2n^2} \to \frac12 < 1: convergent.

un+1un=(n+1)!nnn!(n+1)n+1=(nn+1)n=(1+1n)n1e<1\frac{u_{n+1}}{u_n} = \frac{(n+1)!\,n^n}{n!\,(n+1)^{n+1}} = \bigl(\frac{n}{n+1}\bigr)^n = \bigl(1 + \frac1n\bigr)^{-n} \to \frac1\eu < 1: convergent.

With the factor 2n2^n: ratio 2e<1\to \frac2\eu < 1: convergent.

With 3n3^n: ratio 3e>1\to \frac3\eu > 1: divergent (terms tend to ++\infty).

Exercise 17.3

Nature of:   sin1n2\;\sum \sin\dfrac{1}{n^2};   (1cos1n)\;\sum \Bigl(1 - \cos\dfrac1n\Bigr);   1n(n+1)\;\sum \dfrac{1}{\sqrt{n(n+1)}};   lnnn2\;\sum \dfrac{\ln n}{n^2} (compare with n3/2n^{-3/2}).

Solution

Solution of Exercise 17.3.

All nonnegative terms; use equivalents (Theorem 17.7).

sin1n21n2\sin\frac{1}{n^2} \sim \frac{1}{n^2}: convergent (Riemann α=2\alpha = 2).

1cos1n12n21 - \cos\frac1n \sim \frac{1}{2n^2}: convergent.

1n(n+1)1n\frac{1}{\sqrt{n(n+1)}} \sim \frac1n: divergent.

lnnn2=1n3/2lnnn1/2\frac{\ln n}{n^2} = \frac{1}{n^{3/2}}\cdot\frac{\ln n}{n^{1/2}} and lnnn0\frac{\ln n}{\sqrt n} \to 0 (Proposition 4.6): so lnnn21n3/2\frac{\ln n}{n^2} \leq \frac{1}{n^{3/2}} for large nn: convergent.

Exercise 17.4

Prove that n11n2\sum_{n\geq1} \frac{1}{n^2} converges with sum 2\leq 2, using 1n21n(n1)\frac{1}{n^2} \leq \frac{1}{n(n-1)} for n2n \geq 2 and a telescoping bound.

Solution

Solution of Exercise 17.4.

For n2n \geq 2: 1n21n(n1)=1n11n\frac{1}{n^2} \leq \frac{1}{n(n-1)} = \frac{1}{n-1} - \frac1n. Hence

n=1N1n21+n=2N(1n11n)=1+11N<2:\sum_{n=1}^{N} \frac{1}{n^2} \leq 1 + \sum_{n=2}^{N} \Bigl(\frac{1}{n-1} - \frac1n\Bigr) = 1 + 1 - \frac1N < 2 :

partial sums increasing and bounded by 22: convergence (Theorem 17.7), sum 2\leq 2. (The exact value π26\frac{\pi^2}{6} is a second-year celebration.)

Exercise 17.5 ★★

Nature of   (1)nn\;\sum \dfrac{(-1)^n}{\sqrt n}, of   (1)nn+(1)n\;\sum \dfrac{(-1)^n}{n + (-1)^n} (expand: the alternating test does not apply directly — why?), and of   sin(πn2+1)\;\sum \sin\bigl(\pi\sqrt{n^2+1}\,\bigr) (reduce modulo π\pi: n2+1=n+12n+O(n3)\sqrt{n^2+1} = n + \frac{1}{2n} + O(n^{-3})).

Solution

Solution of Exercise 17.5.

(1)nn\sum \frac{(-1)^n}{\sqrt n}: alternating with 1n0\frac{1}{\sqrt n} \downarrow 0: convergent (Theorem 17.18); not absolutely (α=121\alpha = \frac12 \leq 1).

(1)nn+(1)n\sum \frac{(-1)^n}{n + (-1)^n}: the sequence 1n+(1)n\frac{1}{n + (-1)^n} is not decreasing (1n+1\frac{1}{n+1} then 1n\frac{1}{n} alternate badly), so the test does not apply directly. Expand:

(1)nn+(1)n=(1)nn11+(1)nn=(1)nn1n2+O(1n3):\frac{(-1)^n}{n + (-1)^n} = \frac{(-1)^n}{n}\cdot\frac{1}{1 + \frac{(-1)^n}{n}} = \frac{(-1)^n}{n} - \frac{1}{n^2} + O\Bigl(\frac{1}{n^3}\Bigr):

the first series converges (alternating), 1n2\sum \frac{1}{n^2} converges, the O(n3)O(n^{-3}) converges absolutely: the sum of three convergent series converges.

sin(πn2+1)\sin\bigl(\pi\sqrt{n^2+1}\bigr): write n2+1=n+12n+εn\sqrt{n^2 + 1} = n + \frac{1}{2n} + \varepsilon_n with εn=O(n3)\varepsilon_n = O(n^{-3}); then, by π\pi-periodicity of sin\sin up to sign,

sin(πn2+1)=(1)nsin(π2n+πεn).\sin\bigl(\pi\sqrt{n^2+1}\bigr) = (-1)^n \sin\Bigl(\frac{\pi}{2n} + \pi\varepsilon_n\Bigr) .

Set θn=π2n+πεn\theta_n = \frac{\pi}{2n} + \pi\varepsilon_n and an=sinθna_n = \sin\theta_n. For large nn, θn(0,π2)\theta_n \in \intoo{0}{\frac\pi2} and

θnθn+1=π2n(n+1)+π(εnεn+1)=π2n2+O(1n3)>0\theta_n - \theta_{n+1} = \frac{\pi}{2n(n+1)} + \pi(\varepsilon_n - \varepsilon_{n+1}) = \frac{\pi}{2n^2} + O\Bigl(\frac{1}{n^3}\Bigr) > 0

eventually, so (θn)(\theta_n) decreases to 00; since sin\sin is increasing on [0,π2]\intcc{0}{\frac\pi2}, (an)(a_n) decreases to 00 as well. The alternating test applies: convergent — not absolutely, since anπ2na_n \sim \frac{\pi}{2n}.

Exercise 17.6 ★★

For which α>0\alpha > 0 does n21n(lnn)α\sum_{n \geq 2} \dfrac{1}{n (\ln n)^{\alpha}} converge? (Integral comparison; substitute u=lntu = \ln t.)

Solution

Solution of Exercise 17.6.

f(t)=1t(lnt)αf(t) = \frac{1}{t(\ln t)^\alpha} is positive, continuous, decreasing on [2,+)\intco{2}{+\infty}. Substituting u=lntu = \ln t:

2x ⁣dtt(lnt)α=ln2lnx ⁣duuα,\int_2^x \frac{\dd t}{t(\ln t)^\alpha} = \int_{\ln 2}^{\ln x} \frac{\dd u}{u^\alpha},

bounded as xx \to \infty iff α>1\alpha > 1 (Theorem 17.10’s computation). By integral comparison: convergence iff α>1\alpha > 1. (These Bertrand-type series show how fine the boundary of convergence is: nlnnn\ln n diverges, n(lnn)1.01n(\ln n)^{1.01} converges.)

Exercise 17.7 ★★

Let un=1nln(1+1n)u_n = \dfrac{1}{n} - \ln\Bigl(1 + \dfrac1n\Bigr). Prove that 0un12n20 \leq u_n \leq \dfrac{1}{2n^2}, that un\sum u_n converges, and deduce the existence of Euler’s constant:

γ=limN(n=1N1nlnN).\gamma = \lim_{N \to \infty} \Bigl( \sum_{n=1}^{N} \frac 1n - \ln N \Bigr) .
Solution

Solution of Exercise 17.7.

By the tangent-line bounds of Exercise 14.3 rewritten via expansions: for x=1n(0,1]x = \frac1n \in \intoc{0}{1}, Taylor–Lagrange for ln(1+x)\ln(1+x) at order 11 gives ln(1+x)=xx22(1+c)2\ln(1 + x) = x - \frac{x^2}{2(1 + c)^2} for some c(0,x)c \in \intoo{0}{x}, so

0un=1nln(1+1n)12n2.0 \leq u_n = \frac1n - \ln\Bigl(1 + \frac1n\Bigr) \leq \frac{1}{2n^2} .

Comparison with the Riemann series: un\sum u_n converges. Its partial sum telescopes the logarithms:

n=1Nun=HNln(N+1)\sum_{n=1}^{N} u_n = H_N - \ln(N+1)

(since nNlnn+1n=ln(N+1)\sum_{n\leq N} \ln\frac{n+1}{n} = \ln(N+1)). So HNln(N+1)H_N - \ln(N+1) converges; adding lnN+1N0\ln\frac{N+1}{N} \to 0, the sequence HNlnNH_N - \ln N converges. Its limit is γ0.5772\gamma \approx 0.5772.

Exercise 17.8 ★★

Compute the sums

n=11n(n+2)andn=0n2n.\sum_{n=1}^{\infty} \frac{1}{n(n+2)} \qquad\text{and}\qquad \sum_{n=0}^{\infty} \frac{n}{2^n} .

(For the first: partial fractions. For the second: compute n=1Nnxn1\sum_{n=1}^{N} n x^{n-1} in closed form and let NN \to \infty at x=12x = \frac12.)

Solution

Solution of Exercise 17.8.

1n(n+2)=1/2n1/2n+2\dfrac{1}{n(n+2)} = \dfrac{1/2}{n} - \dfrac{1/2}{n+2}: the partial sum telescopes with a lag of 22,

SN=12(1+121N+11N+2)34.S_N = \frac12\Bigl(1 + \frac12 - \frac{1}{N+1} - \frac{1}{N+2}\Bigr) \longrightarrow \frac34 .

n2n\sum \frac{n}{2^n}: for x<1\abs x < 1, differentiating the finite geometric sum and passing to the limit (all series here converge absolutely, ratio test): from n0xn=11x\sum_{n\geq0} x^n = \frac{1}{1-x}, one gets by direct computation with partial sums

n=1Nnxn1=1(N+1)xN+NxN+1(1x)2N1(1x)2(x<1),\sum_{n=1}^{N} n x^{n-1} = \frac{1 - (N+1)x^N + N x^{N+1}}{(1 - x)^2} \xrightarrow[N\to\infty]{} \frac{1}{(1-x)^2} \quad (\abs x < 1),

(the boundary terms NxN0N x^N \to 0). At x=12x = \frac12: n1n(12)n1=4\sum_{n\geq1} n\bigl(\frac12\bigr)^{n-1} = 4, so n0n2n=12×4=2\sum_{n\geq0} \frac{n}{2^n} = \frac12 \times 4 = 2.

Exercise 17.9 ★★★

(Cauchy condensation) Let (un)(u_n) be nonnegative and decreasing. Prove that

n1un converges    k02ku2k converges,\sum_{n \geq 1} u_n \text{ converges} \iff \sum_{k \geq 0} 2^k\, u_{2^k} \text{ converges},

by comparing packets of terms between consecutive powers of 22. Recover from it the Riemann criterion and Exercise 17.6.

Solution

Solution of Exercise 17.9.

Group the terms of un\sum u_n in packets between powers of 22. Upper packets: for 2kn<2k+12^k \leq n < 2^{k+1} there are 2k2^k terms, each u2k\leq u_{2^k}:

n=12K+11un=k=0Kn=2k2k+11unk=0K2ku2k.\sum_{n=1}^{2^{K+1}-1} u_n = \sum_{k=0}^{K} \sum_{n=2^k}^{2^{k+1}-1} u_n \leq \sum_{k=0}^{K} 2^k u_{2^k} .

Lower packets: each term of the same packet is u2k+1\geq u_{2^{k+1}}, so n=2k2k+11un2ku2k+1=122k+1u2k+1\sum_{n=2^k}^{2^{k+1}-1} u_n \geq 2^k u_{2^{k+1}} = \frac12 \cdot 2^{k+1} u_{2^{k+1}}, whence

n=12K+11un12k=1K+12ku2k.\sum_{n=1}^{2^{K+1}-1} u_n \geq \frac12 \sum_{k=1}^{K+1} 2^{k} u_{2^{k}} .

Both partial-sum comparisons go both ways (nonnegative terms, Theorem 17.7): the two series have the same nature.

Riemann: un=nαu_n = n^{-\alpha} gives 2ku2k=2k(1α)2^k u_{2^k} = 2^{k(1-\alpha)}, a geometric series, convergent iff 21α<12^{1 - \alpha} < 1 iff α>1\alpha > 1. Bertrand (Exercise 17.6): un=1n(lnn)αu_n = \frac{1}{n(\ln n)^\alpha} gives 2ku2k=1(kln2)α2^k u_{2^k} = \frac{1}{(k\ln 2)^\alpha}, a Riemann series in kk: convergent iff α>1\alpha > 1.

Exercise 17.10 ★★★

Using the integral identity of Example 17.19 adapted to 11+t2\frac{1}{1+t^2}, prove Leibniz’s formula

π4=n=0(1)n2n+1=113+1517+\frac{\pi}{4} = \sum_{n=0}^{\infty} \frac{(-1)^n}{2n+1} = 1 - \frac13 + \frac15 - \frac17 + \cdots

with the error bound RN12N+3\abs{R_N} \leq \frac{1}{2N+3}.

Solution

Solution of Exercise 17.10.

Finite geometric identity with ratio t2-t^2:

11+t2=k=0n1(1)kt2k+(1)nt2n1+t2.\frac{1}{1 + t^2} = \sum_{k=0}^{n-1} (-1)^k t^{2k} + \frac{(-1)^n t^{2n}}{1 + t^2} .

Integrate over [0,1]\intcc{0}{1} (the left side integrates to arctan1=π4\arctan 1 = \frac\pi4, Proposition 4.10):

π4=k=0n1(1)k2k+1+(1)n01t2n1+t2 ⁣dt,001t2n1+t2 ⁣dt01t2n ⁣dt=12n+1.\frac{\pi}{4} = \sum_{k=0}^{n-1} \frac{(-1)^k}{2k+1} + (-1)^n \int_0^1 \frac{t^{2n}}{1+t^2}\,\dd t, \qquad 0 \leq \int_0^1 \frac{t^{2n}}{1+t^2}\,\dd t \leq \int_0^1 t^{2n}\dd t = \frac{1}{2n+1} .

Letting nn \to \infty proves the formula, and the displayed bound on the integral is exactly the remainder bound: after summing up to NN (i.e. n=N+1n = N + 1 terms), RN12N+3\abs{R_N} \leq \frac{1}{2N + 3}.

Exercise 17.11 ★★

Nature of n11n1+1/n\displaystyle\sum_{n \geq 1} \frac{1}{n^{1 + 1/n}}. (Compute the limit of n1/nn^{1/n} and find an equivalent of the general term: the Riemann test needs a fixed exponent.)

Solution

Solution of Exercise 17.11.

n1/n=elnnne0=1n^{1/n} = \eu^{\frac{\ln n}{n}} \to \eu^0 = 1 (Proposition 4.6). Hence

1n1+1/n=1nelnnn1n,\frac{1}{n^{1 + 1/n}} = \frac{1}{n}\,\eu^{-\frac{\ln n}{n}} \sim \frac{1}{n} ,

and the equivalents test (Theorem 17.7) compares with the divergent harmonic series: divergent, although every exponent 1+1n1 + \frac1n exceeds 11. The Riemann criterion concerns a fixed exponent α\alpha; an exponent sliding down to 11 can lose all its margin, as here.

Exercise 17.12 ★★★

Let (un)(u_n) be nonnegative and decreasing with un\sum u_n convergent. Prove that nun0n\,u_n \to 0 (bound nu2nn\,u_{2n} by a slice k=n+12nuk\sum_{k=n+1}^{2n} u_k and use the Cauchy criterion). Show that the converse fails, and that the monotonicity hypothesis cannot be removed.

Solution

Solution of Exercise 17.12.

Let ε>0\varepsilon > 0. By the Cauchy criterion for the convergent series (Theorem 11.20 applied to the partial sums), there is NN with k=n+12nukε\sum_{k=n+1}^{2n} u_k \leq \varepsilon for nNn \geq N. By monotonicity each of these nn terms is u2n\geq u_{2n}:

nu2nk=n+12nukε2nu2n2ε,n\,u_{2n} \leq \sum_{k=n+1}^{2n} u_k \leq \varepsilon \quad\Longrightarrow\quad 2n\,u_{2n} \leq 2\varepsilon ,

and for odd indices (2n+1)u2n+1(2n+1)u2n2(2nu2n)4ε(2n+1)\,u_{2n+1} \leq (2n+1)\,u_{2n} \leq 2\bigl(2n\,u_{2n}\bigr) \leq 4\varepsilon for nNn \geq N: in both parities, nun0n u_n \to 0.

Converse false: un=1nlnnu_n = \frac{1}{n\ln n} has nun=1lnn0n u_n = \frac{1}{\ln n} \to 0, yet the series diverges (Exercise 17.6, α=1\alpha = 1). Monotonicity necessary: let un=1nu_n = \frac1n when nn is a perfect square and un=2nu_n = 2^{-n} otherwise: the series converges (the square terms sum like 1k2\sum \frac{1}{k^2}, the rest geometrically), but nun=1n u_n = 1 along the squares.

17.5 Problem: Euler’s constant and the series that changes its sum

Problem 17.1

Weekend problem — Hn=lnn+γ+12n+O(n2)H_n = \ln n + \gamma + \frac{1}{2n} + O(n^{-2}), and rearranging 112+131 - \frac12 + \frac13 - \dots to ln22\frac{\ln 2}{2}

Two stories share the harmonic series. First, the exact bookkeeping of its divergence: HnlnnH_n - \ln n converges to Euler’s constant γ\gamma (Exercise 17.7), and this problem sharpens the statement into a two-sided law 12(n+1)Hnlnnγ12n\frac{1}{2(n+1)} \leq H_n - \ln n - \gamma \leq \frac{1}{2n}, certifying γ=0.5772\gamma = 0.5772\dots by hand. Second, the scandal of conditional convergence: the alternating harmonic series sums to ln2\ln 2 (Example 17.19), yet the same terms, in a different order, sum to ln22\frac{\ln 2}{2} — or to ln2+12lnpq\ln 2 + \frac12\ln\frac pq for any p,qp, q, or to any real whatsoever (Riemann). The two stories are one: the rearranged sums are computed with the γ\gamma-law.

Part I — γ\gamma, bracketed. Set an=Hnlnna_n = H_n - \ln n and bn=Hnln(n+1)b_n = H_n - \ln(n+1).

  1. Using t1+tln(1+t)t\frac{t}{1+t} \leq \ln(1 + t) \leq t, show that (an)(a_n) decreases, (bn)(b_n) increases, and that they are adjacent; their common limit is γ\gamma, with bnγanb_n \leq \gamma \leq a_n for every nn.
  2. Numerical first shot: from H10=2.928968H_{10} = 2.928968\dots, bracket γ\gamma between b10=0.5311b_{10} = 0.5311 and a10=0.6264a_{10} = 0.6264. How large an nn would this crude bracket need for four decimals?
  3. Show the exact tail representation anγ=knwka_n - \gamma = \sum_{k \geq n} w_k (limit of partial sums), where

    wk=akak+1=ln(1+1k)1k+1=kk+1(k+1t)t(k+1) ⁣dt,w_k = a_k - a_{k+1} = \ln\Bigl(1 + \frac1k\Bigr) - \frac{1}{k+1} = \int_k^{k+1} \frac{(k + 1 - t)}{t\,(k+1)}\,\dd t ,

    and deduce from the integral form the two-sided bound 12(k+1)2wk12k(k+1)\dfrac{1}{2(k+1)^2} \leq w_k \leq \dfrac{1}{2k(k+1)}.

Part II — The 12n\frac{1}{2n} law.

  1. Sum the bounds of question 3 (both sides telescope or compare to telescopes) and conclude the law:

    12(n+1)    Hnlnnγ    12n(n1).\frac{1}{2(n+1)} \;\leq\; H_n - \ln n - \gamma \;\leq\; \frac{1}{2n} \qquad (n \geq 1).
  2. Deduce Hn=lnn+γ+12n+O(1n2)H_n = \ln n + \gamma + \frac{1}{2n} + O\bigl(\frac{1}{n^2}\bigr); precisely, show that γn=Hnlnn12n\gamma_n = H_n - \ln n - \frac{1}{2n} satisfies 12n(n+1)γnγ0-\frac{1}{2n(n+1)} \leq \gamma_n - \gamma \leq 0.
  3. Certify four decimals with n=100n = 100: given H100=5.1873775H_{100} = 5.1873775\dots, compute γ100=0.577207\gamma_{100} = 0.577207\dots and conclude γ=0.5772±5105\gamma = 0.5772 \pm 5\cdot10^{-5} (true value 0.57721560.5772156\dots).
  4. Two dividends of the law, both needed later: as mm \to \infty,

    H2mHm=ln214m+O(1m2),j=1m12j1=lnm2+ln2+γ2+o(1),H_{2m} - H_m = \ln 2 - \frac{1}{4m} + O\Bigl(\frac{1}{m^2}\Bigr), \qquad \sum_{j=1}^{m} \frac{1}{2j-1} = \frac{\ln m}{2} + \ln 2 + \frac\gamma2 + o(1) ,

    the second via jm12j1=H2m12Hm\sum_{j \leq m} \frac{1}{2j-1} = H_{2m} - \frac12 H_m, and likewise j=1m12j=lnm2+γ2+o(1)\sum_{j=1}^{m} \frac{1}{2j} = \frac{\ln m}{2} + \frac\gamma2 + o(1).

Part III — The alternating harmonic series, to second order.

  1. Show (induction, or grouping) the identity k=12m(1)k1k=H2mHm\sum_{k=1}^{2m} \frac{(-1)^{k-1}}{k} = H_{2m} - H_m, and deduce both the sum ln2\ln 2 (again) and the exact speed:

    k=12m(1)k1k=ln214m+O(1m2).\sum_{k=1}^{2m} \frac{(-1)^{k-1}}{k} = \ln 2 - \frac{1}{4m} + O\Bigl(\frac{1}{m^2}\Bigr) .
  2. Deduce the asymptotic error of the alternating harmonic series at any index: SSN(1)N2NS - S_N \sim \frac{(-1)^N}{2N} — twice smaller than the worst-case bound aN+11Na_{N+1} \approx \frac1N of Theorem 17.18.
  3. (Acceleration for free) Show that the averaged sums S~N=SN+SN+12\tilde S_N = \frac{S_N + S_{N+1}}{2} satisfy S~N=ln2+O(1N2)\tilde S_N = \ln 2 + O\bigl(\frac{1}{N^2}\bigr). Check: S10=0.64563S_{10} = 0.64563, S11=0.73654S_{11} = 0.73654, S~10=0.69109\tilde S_{10} = 0.69109, against ln2=0.69315\ln 2 = 0.69315: one average buys two decimal places.
  4. Explain in two sentences why no such trick can help a positive divergent-tail phenomenon like question 2’s bracket: the alternating error oscillates (sign (1)N(-1)^N), so averaging cancels its leading term, while the γ\gamma-bracket error 12n\frac{1}{2n} has constant sign. (Averaging ana_n and bnb_n does help: relate an+bn2\frac{a_n + b_n}{2} to the midpoint estimate Hnln(n+12)H_n - \ln\bigl(n + \frac12\bigr) and show its error is O(1n2)O\bigl(\frac{1}{n^2}\bigr).)

Part IV — Rigidity and its failure.

  1. Show that the positive part 12j1\sum \frac{1}{2j-1} and the negative part 12j\sum \frac{1}{2j} of the alternating harmonic series both diverge — the signature of conditional convergence.
  2. Prove the general statement behind question 12: if un\sum u_n converges but un\sum \abs{u_n} diverges, then the series of positive parts un+\sum u_n^+ and of negative parts un\sum u_n^- both diverge (from un±=un±un2u_n^\pm = \frac{\abs{u_n} \pm u_n}{2}: if one converged, so would the other, hence un\sum\abs{u_n}). This inexhaustible reservoir of positive and negative mass is what Riemann’s recipe will spend.
  3. (Rigidity) Prove: if un\sum u_n converges absolutely and σ ⁣:NN\sigma \colon \N \to \N is a bijection, then uσ(n)\sum u_{\sigma(n)} converges to the same sum (for NN large the first MM rearranged terms contain u0,,uNu_0, \dots, u_N; compare partial sums through the tail n>Nun\sum_{n > N}\abs{u_n}).
  4. (Riemann’s recipe) Let tRt \in \R. Describe the greedy rearrangement of the alternating harmonic series: take positive terms 1,13,15,1, \frac13, \frac15, \dots until the partial sum first exceeds tt, then negative terms 12,14,-\frac12, -\frac14, \dots until it first drops below tt, and repeat. Show that every term is used exactly once, that after the first crossing the partial sums stay within the last used term of tt, and conclude that the rearranged series converges to tt: any prescribed sum is attainable.

Part V — The (p,q)(p, q) formula. Fix integers p,q1p, q \geq 1. Rearrange the alternating harmonic series in blocks: pp positive terms (the next odd reciprocals), then qq negative terms (the next even reciprocals), and repeat.

  1. Check that this is a genuine rearrangement (every term exactly once), and that for (p,q)=(1,2)(p, q) = (1, 2) it reads

    11214+131618+15110112+1 - \frac12 - \frac14 + \frac13 - \frac16 - \frac18 + \frac15 - \frac1{10} - \frac1{12} + \dots
  2. (The exact halving) For (p,q)=(1,2)(p, q) = (1, 2), prove the block identity

    12k114k214k=12(12k112k),\frac{1}{2k-1} - \frac{1}{4k-2} - \frac{1}{4k} = \frac12\Bigl(\frac{1}{2k-1} - \frac{1}{2k}\Bigr),

    and deduce the exact relation T3K=12S2KT_{3K} = \frac12 S_{2K} between the rearranged partial sums and the original ones: the halving of the sum is visible at every finite stage, not only in the limit.

  3. Show that the partial sum after KK complete blocks equals j=1pK12j1j=1qK12j\sum_{j=1}^{pK} \frac{1}{2j-1} - \sum_{j=1}^{qK} \frac{1}{2j}, and compute its limit with question 7:

    ln2+12lnpq.\ln 2 + \frac12 \ln\frac pq .
  4. Control the partial sums inside a block (the terms tend to 00) and conclude that the (p,q)(p, q)-rearranged series converges to ln2+12lnpq\ln 2 + \frac12\ln \frac pq. In particular (1,2)(1, 2) gives ln22\frac{\ln 2}{2}: verify against the first nine terms, T9=0.3083T_9 = 0.3083, creeping toward 0.34660.3466.
  5. Sanity checks and range: (1,1)(1,1) recovers ln2\ln 2; (2,1)(2,1) gives 32ln2\frac32\ln 2; which sums are reachable by (p,q)(p, q)-blocks, and how does this countable menu compare with Riemann’s full carte (question 14)?

Part VI — Epilogue: γ\gamma at work, and synthesis.

  1. Identify the sum of the convergent series k1(1klnk+1k)\sum_{k\geq1} \bigl(\frac1k - \ln\frac{k+1}{k}\bigr) (Exercise 17.7): show it equals γ\gamma.
  2. Run Riemann’s recipe (question 14) for the target t=1t = 1 and list the first twelve terms produced (1,13,12,15,14,17,19,16,111,113,18,1151, \frac13, -\frac12, \frac15, -\frac14, \frac17, \frac19, -\frac16, \frac1{11}, \frac1{13}, -\frac18, \frac1{15}), computing the partial sum (0.980\approx 0.980) — watch the algorithm breathe around its target.
  3. Show that some rearrangement of the alternating harmonic series diverges to ++\infty (blocks of positive terms long enough to gain 11 each time, using question 12, separated by single negative terms).
  4. Sharpen Example 17.11 with the γ\gamma-law: show that the first index with HN20H_N \geq 20 satisfies N=e20γ(1+o(1))2.7108N = \eu^{\,20 - \gamma}\,(1 + o(1)) \approx 2.7\cdot10^{8}Euler’s constant is exactly the correction the crude framing was missing.
  5. Synthesis, one sentence each: (i) the γ\gamma-law and what each of its three pieces (lnn\ln n, γ\gamma, 12n\frac{1}{2n}) contributes; (ii) why conditional convergence makes the sum order-dependent while absolute convergence forbids it; (iii) how the (p,q)(p,q) formula was a computation with the γ\gamma-law rather than an abstract existence claim; (iv) where these threads continue — power series and products of series in the Year 2 volume, and the Year 3 volume’s weekend problem on Stirling’s formula, where the same sum-versus-integral bookkeeping runs at full power.
Solution

Solution of Problem 17.1.

1. an+1an=1n+1lnn+1n0a_{n+1} - a_n = \frac{1}{n+1} - \ln\frac{n+1}{n} \leq 0 because ln(1+1n)1/n1+1/n=1n+1\ln(1 + \frac1n) \geq \frac{1/n}{1 + 1/n} = \frac{1}{n+1}; and bn+1bn=1n+1lnn+2n+10b_{n+1} - b_n = \frac{1}{n+1} - \ln\frac{n+2}{n+1} \geq 0 because ln(1+1n+1)1n+1\ln(1 + \frac{1}{n+1}) \leq \frac{1}{n+1}. Their gap anbn=ln(1+1n)0a_n - b_n = \ln(1 + \frac1n) \to 0: adjacent (Theorem 11.11), with common limit liman=γ\lim a_n = \gamma (Exercise 17.7), and bnγanb_n \leq \gamma \leq a_n.

2. b10=2.928968ln11=0.5311b_{10} = 2.928968 - \ln 11 = 0.5311 and a10=2.928968ln10=0.6264a_{10} = 2.928968 - \ln 10 = 0.6264: so γ[0.5311,0.6264]\gamma \in \intcc{0.5311}{0.6264}. The gap is ln1.10.095\ln 1.1 \approx 0.095 and shrinks like 1n\frac1n: four decimals (gap104\text{gap} \leq 10^{-4}) would need n104n \approx 10^4 — the brackets are correct but slow.

3. Telescoping anam+1=k=nmwka_n - a_{m+1} = \sum_{k=n}^{m} w_k and letting mm \to \infty: anγ=knwka_n - \gamma = \sum_{k\geq n} w_k (limit of partial sums). Moreover

wk=kk+1 ⁣dtt1k+1=kk+1(1t1k+1) ⁣dt=kk+1k+1tt(k+1) ⁣dt.w_k = \int_k^{k+1} \frac{\dd t}{t} - \frac{1}{k+1} = \int_k^{k+1} \Bigl(\frac1t - \frac{1}{k+1}\Bigr)\dd t = \int_k^{k+1} \frac{k + 1 - t}{t\,(k+1)}\,\dd t .

On [k,k+1]\intcc{k}{k+1}: 1(k+1)21t(k+1)1k(k+1)\frac{1}{(k+1)^2} \leq \frac{1}{t(k+1)} \leq \frac{1}{k(k+1)}, and kk+1(k+1t) ⁣dt=12\int_k^{k+1}(k + 1 - t)\dd t = \frac12: hence 12(k+1)2wk12k(k+1)\frac{1}{2(k+1)^2} \leq w_k \leq \frac{1}{2k(k+1)}.

4. Upper: kn12k(k+1)=12kn(1k1k+1)=12n\sum_{k \geq n} \frac{1}{2k(k+1)} = \frac12\sum_{k\geq n}\bigl(\frac1k - \frac{1}{k+1}\bigr) = \frac{1}{2n} (telescoping). Lower: 12(k+1)212(k+1)(k+2)\frac{1}{2(k+1)^2} \geq \frac{1}{2(k+1)(k+2)}, whose sum telescopes to 12(n+1)\frac{1}{2(n+1)}. With question 3:

12(n+1)Hnlnnγ12n.\frac{1}{2(n+1)} \leq H_n - \ln n - \gamma \leq \frac{1}{2n} .

5. Subtract 12n\frac{1}{2n}: γnγ[12(n+1)12n,0]=[12n(n+1),0]\gamma_n - \gamma \in \intcc{\frac{1}{2(n+1)} - \frac{1}{2n}}{0} = \intcc{-\frac{1}{2n(n+1)}}{0}: the corrected estimate is exact to O(1n2)O\bigl(\frac{1}{n^2}\bigr), and always from below.

6. γ100=5.1873775ln1000.005=0.5772073\gamma_{100} = 5.1873775 - \ln 100 - 0.005 = 0.5772073, with 0γγ100120200<51050 \leq \gamma - \gamma_{100} \leq \frac{1}{20200} < 5\cdot10^{-5}: hence 0.577207γ0.5772570.577207 \leq \gamma \leq 0.577257, i.e. γ=0.5772±5105\gamma = 0.5772 \pm 5\cdot10^{-5} (true value 0.57721560.5772156\dots) — four certified decimals from a hundred terms, against ten thousand for question 2.

7. First dividend:

H2mHm=(ln2m+γ+14m)(lnm+γ+12m)+O(1m2)=ln214m+O(1m2).H_{2m} - H_m = \Bigl(\ln 2m + \gamma + \frac{1}{4m}\Bigr) - \Bigl(\ln m + \gamma + \frac{1}{2m}\Bigr) + O\Bigl(\frac{1}{m^2}\Bigr) = \ln 2 - \frac{1}{4m} + O\Bigl(\frac{1}{m^2}\Bigr).

Second: the even reciprocals up to 2m2m sum to 12Hm\frac12 H_m, so j=1m12j1=H2m12Hm=12lnm+ln2+γ2+o(1)\sum_{j=1}^{m}\frac{1}{2j-1} = H_{2m} - \frac12 H_m = \frac12 \ln m + \ln 2 + \frac\gamma2 + o(1), and j=1m12j=12lnm+γ2+o(1)\sum_{j=1}^m \frac{1}{2j} = \frac12\ln m + \frac\gamma2 + o(1).

8. Splitting off the even terms twice: k=12m(1)k1k=H2m212Hm=H2mHm\sum_{k=1}^{2m}\frac{(-1)^{k-1}}{k} = H_{2m} - 2\cdot\frac12 H_m = H_{2m} - H_m. By question 7 this equals ln214m+O(m2)\ln 2 - \frac{1}{4m} + O(m^{-2}): the sum is ln2\ln 2 (Example 17.19 again) with its speed.

9. For N=2mN = 2m: SSN=14m+O(m2)=12N+O(N2)S - S_N = \frac{1}{4m} + O(m^{-2}) = \frac{1}{2N} + O(N^{-2}). For N=2m+1N = 2m + 1: SN=S2m+12m+1S_{N} = S_{2m} + \frac{1}{2m+1}, so

SSN=(14m12m+1)+O(1m2)=14m+O(1m2)=12N+O(1N2).S - S_N = \Bigl(\frac{1}{4m} - \frac{1}{2m+1}\Bigr) + O\Bigl(\frac{1}{m^2}\Bigr) = -\frac{1}{4m} + O\Bigl(\frac{1}{m^2}\Bigr) = -\frac{1}{2N} + O\Bigl(\frac{1}{N^2}\Bigr).

In both cases SSN(1)N2NS - S_N \sim \frac{(-1)^N}{2N}: half the worst-case bound aN+1a_{N+1}, with a known, alternating sign.

10. Averaging kills the oscillating leading term:

SS~N=(SSN)+(SSN+1)2=(1)N2(12N12(N+1))+O(1N2)=O(1N2).S - \tilde S_N = \frac{(S - S_N) + (S - S_{N+1})}{2} = \frac{(-1)^N}{2}\Bigl(\frac{1}{2N} - \frac{1}{2(N+1)}\Bigr) + O\Bigl(\frac{1}{N^2}\Bigr) = O\Bigl(\frac{1}{N^2}\Bigr).

Numerically: S10=0.645635S_{10} = 0.645635, S11=0.736544S_{11} = 0.736544, S~10=0.691089\tilde S_{10} = 0.691089, and ln2=0.693147\ln 2 = 0.693147: the error drops from 4.81024.8\cdot10^{-2} to 2.11032.1\cdot10^{-3} — one addition, twenty times better.

11. The alternating error changes sign at every step, so consecutive partial sums straddle the limit and their mean cancels the first-order term; the bracket error Hnlnnγ12nH_n - \ln n - \gamma \approx \frac{1}{2n} has constant sign, so no averaging along nn can cancel it. Averaging the two brackets does help: an+bn2=Hnlnn(n+1)\frac{a_n + b_n}{2} = H_n - \ln\sqrt{n(n+1)}, and since lnn(n+1)=ln(n+12)+O(n2)\ln\sqrt{n(n+1)} = \ln\bigl(n + \frac12\bigr) + O(n^{-2}),

Hnln(n+12)=(Hnlnn12n)+18n2+O(1n3)=γ+O(1n2)H_n - \ln\Bigl(n + \frac12\Bigr) = \Bigl(H_n - \ln n - \frac{1}{2n}\Bigr) + \frac{1}{8n^2} + O\Bigl(\frac{1}{n^3}\Bigr) = \gamma + O\Bigl(\frac{1}{n^2}\Bigr)

(question 5 and ln(1+12n)=12n18n2+O(n3)\ln(1 + \frac{1}{2n}) = \frac{1}{2n} - \frac{1}{8n^2} + O(n^{-3})). Check at n=10n = 10: H10ln10.5=0.57759H_{10} - \ln 10.5 = 0.57759, already within 41044\cdot10^{-4} of γ\gamma.

12. jm12j1jm12j=12Hm+\sum_{j\leq m} \frac{1}{2j-1} \geq \sum_{j \leq m} \frac{1}{2j} = \frac12 H_m \to +\infty: both the positive and the negative part of the alternating harmonic series diverge.

13. Write un±=un±un20u_n^\pm = \frac{\abs{u_n} \pm u_n}{2} \geq 0, so un=un+unu_n = u_n^+ - u_n^- and un=un++un\abs{u_n} = u_n^+ + u_n^-. If un+\sum u_n^+ converged, then un=(un+un)\sum u_n^- = \sum (u_n^+ - u_n) would converge (difference of convergent series), hence un\sum \abs{u_n} too: contradiction with conditional convergence. By symmetry both un±\sum u_n^\pm diverge (to ++\infty): an infinite reservoir of positive and of negative mass.

14. Let S=unS = \sum u_n, ε>0\varepsilon > 0, and NN with n>Nunε\sum_{n > N} \abs{u_n} \leq \varepsilon (Cauchy criterion for un\sum\abs{u_n}). Let M0M_0 be large enough that σ({0,,M0}){0,,N}\sigma(\{0, \dots, M_0\}) \supseteq \{0, \dots, N\}. For MM0M \geq M_0, the difference mMuσ(m)nNun\sum_{m \leq M} u_{\sigma(m)} - \sum_{n \leq N} u_n is a finite sum of distinct terms unu_n with n>Nn > N, hence of absolute value ε\leq \varepsilon; and SnNunε\abs{S - \sum_{n\leq N} u_n} \leq \varepsilon as well. So the rearranged partial sums are within 2ε2\varepsilon of SS eventually: uσ(n)=S\sum u_{\sigma(n)} = S. Absolute convergence is rearrangement-proof.

15. Each phase of the greedy procedure ends after finitely many terms, because the remaining positive (respectively negative) terms alone have divergent partial sums (question 12): the running sum must eventually cross tt. The procedure therefore alternates infinitely many finite phases, consuming the positive terms in order and the negative terms in order: every term is used exactly once — a rearrangement. After the first crossing, between two consecutive crossings the partial sums move monotonically toward tt, and at a crossing they overshoot by at most the term just added; since the terms used at the jj-th crossing have index at least jj in their class, these overshoots tend to 00. Hence the partial sums converge to tt: every real number is the sum of some rearrangement.

16. The positive slots receive 12j1\frac{1}{2j-1} for j=1,2,j = 1, 2, \dots in order, the negative slots 12j\frac{1}{2j} in order: every term of the alternating harmonic series appears exactly once. For (p,q)=(1,2)(p, q) = (1, 2), the blocks are (1,12,14)\bigl(1, -\frac12, -\frac14\bigr), (13,16,18)\bigl(\frac13, -\frac16, -\frac18\bigr), (15,110,112)\bigl(\frac15, -\frac1{10}, -\frac1{12}\bigr), … — the displayed series.

17. Since 14k2=1212k1\frac{1}{4k-2} = \frac12\cdot\frac{1}{2k-1}:

12k114k214k=1212k11212k=12(12k112k).\frac{1}{2k-1} - \frac{1}{4k-2} - \frac{1}{4k} = \frac12\,\frac{1}{2k-1} - \frac12\,\frac{1}{2k} = \frac12\Bigl(\frac{1}{2k-1} - \frac{1}{2k}\Bigr).

Summing over k=1,,Kk = 1, \dots, K: T3K=12k=1K(12k112k)=12S2KT_{3K} = \frac12 \sum_{k=1}^{K}\bigl(\frac{1}{2k-1} - \frac{1}{2k}\bigr) = \frac12 S_{2K}: at every third partial sum, the rearranged series is exactly half the original one.

18. After KK complete blocks, the rearranged partial sum is j=1pK12j1j=1qK12j\sum_{j=1}^{pK}\frac{1}{2j-1} - \sum_{j=1}^{qK}\frac{1}{2j}, and question 7 evaluates it:

(ln(pK)2+ln2+γ2)(ln(qK)2+γ2)+o(1)=ln2+12lnpq+o(1):\Bigl(\frac{\ln(pK)}{2} + \ln 2 + \frac\gamma2\Bigr) - \Bigl(\frac{\ln(qK)}{2} + \frac\gamma2\Bigr) + o(1) = \ln 2 + \frac12\ln\frac pq + o(1) :

the γ\gammas cancel, the lnK\ln Ks cancel, the ratio pq\frac pq survives.

19. A partial sum inside block K+1K + 1 differs from the KK-block sum by at most p+qp + q terms, each of absolute value 12qK\leq \frac{1}{2qK}-ish, hence by O(1K)0O\bigl(\frac1K\bigr) \to 0: the full sequence of partial sums has the same limit ln2+12lnpq\ln 2 + \frac12\ln\frac pq. For (1,2)(1, 2): ln2+12ln12=ln22=0.34657\ln 2 + \frac12\ln\frac12 = \frac{\ln 2}{2} = 0.34657\dots, and indeed T9=0.30833T_9 = 0.30833 creeps toward it: by question 17, T3K=12S2KT_{3K} = \frac12 S_{2K} converges with exactly half the alternating-harmonic error. Same terms, half the sum.

20. (1,1)(1,1): ln2+12ln1=ln2\ln 2 + \frac12\ln 1 = \ln 2 — the original order, consistency. (2,1)(2,1): 32ln21.0397\frac32\ln 2 \approx 1.0397. The (p,q)(p,q) menu reaches exactly the countable dense family ln2+12lnr\ln 2 + \frac12\ln r, rQ>0r \in \Q_{>0}; Riemann’s greedy recipe (question 15) reaches every real. Structure buys formulas; greed buys totality.

21. The partial sums telescope: k=1N(1klnk+1k)=HNln(N+1)=bNγ\sum_{k=1}^{N} \bigl(\frac1k - \ln\frac{k+1}{k}\bigr) = H_N - \ln(N+1) = b_N \to \gamma: the series of Exercise 17.7 sums exactly to Euler’s constant.

22. Greedy for t=1t = 1: the first positive term brings the sum exactly to 11, not beyond it, so a second positive is taken to cross: 1,131, \frac13 (sum 1.3333>11.3333 > 1), then 12-\frac12 (0.83330.8333), 15\frac15 (1.03331.0333), 14-\frac14 (0.78330.7833), 17,19\frac17, \frac19 (1.03731.0373), 16-\frac16 (0.87060.8706), 111,113\frac1{11}, \frac1{13} (1.03841.0384), 18-\frac18 (0.91340.9134), 115\frac1{15} (0.98010.9801), … — the sums breathe around 11 with ever smaller amplitude, two positives now needed per cycle since the negatives are larger.

23. Build blocks: at stage jj, append enough unused positive terms to raise the partial sum by at least 11 (possible: the remaining positive terms have divergent sums, question 12), then append the single negative term 12j-\frac{1} {2j}. Every positive term is eventually used (each stage uses at least one), every negative one too (one per stage): a rearrangement. Each stage changes the sum by 112j12\geq 1 - \frac{1}{2j} \geq \frac12: the partial sums exceed j2\frac{j}{2} after stage jj and the increments within a stage are positive except the last, bounded by 12j0\frac{1}{2j} \to 0: divergence to ++\infty.

24. By the law, HN20    lnN20γ12N+O(N2)H_N \geq 20 \iff \ln N \geq 20 - \gamma - \frac{1}{2N} + O(N^{-2}): the threshold NN^* satisfies lnN=20γ+o(1)\ln N^* = 20 - \gamma + o(1), i.e. N=e20γ(1+o(1))e19.42282.72108N^* = \eu^{20 - \gamma}(1 + o(1)) \approx \eu^{19.4228} \approx 2.72\cdot10^{8} — inside the crude window [1.8108,4.9108]\intcc{1.8\cdot10^8}{4.9\cdot10^8} of Example 17.11, and pinned by γ\gamma.

25. (i) In Hn=lnn+γ+12n+O(n2)H_n = \ln n + \gamma + \frac{1}{2n} + O(n^{-2}): the lnn\ln n is the integral, γ\gamma the price of replacing a sum by an integral (a genuinely new constant of analysis), and 12n\frac{1}{2n} the first correction — the trapezoid’s shadow. (ii) Conditional convergence leans on cancellation between two infinite reservoirs (question 13), so reordering re-weights the reservoirs; absolute convergence has finite total mass, and question 14’s tail estimate is order-blind. (iii) The (p,q)(p,q) sums were computed: the γ\gamma-law turned each rearranged partial sum into ln2+12lnpq+o(1)\ln 2 + \frac12\ln\frac pq + o(1), with γ\gamma itself canceling — an asymptotic bookkeeping exercise, not an abstract argument. (iv) Next: products and unconditional summability for power series in the Year 2 volume; and the Year 3 volume’s weekend problem on Stirling’s formula, where sum-versus-integral bookkeeping, pushed one order further, produces 2π\sqrt{2\pi} itself.