University Physics — Year 3 · Bachelor Year 3
17The Canonical Ensemble
Isolated systems are a theorist’s fiction: real samples sit in thermostats, rooms, oceans of air — in contact with a reservoir that fixes not their energy but their temperature. The Year 2 volume met the resulting law empirically: the probability of a state of energy carries the factor . This chapter derives that Boltzmann factor in four lines from the counting of Chapter 16, then builds the machine that makes statistical physics an industrial discipline: the partition function , one sum from which energy, entropy, pressure, heat capacity and fluctuations all fall by differentiation. The machine’s first victories are recounted here: why heat capacities die at low temperature (Einstein, 1907 — the first quantum theory of matter), why hydrogen’s heat capacity climbs a staircase, why the sky thins exponentially — and how Perrin, watching microscopic grains settle in a drop of water, counted Avogadro’s number and ended the debate about the reality of atoms.
17.1 The Boltzmann distribution, derived
Theorem 17.1 (Canonical distribution)
A system exchanging energy with a large reservoir at temperature occupies its microstate (energy ) with probability
( hereafter). , the partition function, normalises the probabilities — and turns out to hold the entire thermodynamics of the system.
Proof. The system in state leaves the reservoir the energy : by the fundamental postulate applied to the whole, . Expand the reservoir’s entropy, huge and smooth, to first order: by the definition of temperature. Hence . (Higher orders die with the reservoir’s size.) ∎
Proposition 17.2 (The machine)
From :
where is the free energy; and the heat capacity is a fluctuation:
For independent, distinguishable subsystems ; for identical particles in a common box, . At fixed and , equilibrium minimises : nature trades energy against entropy at the exchange rate — the single most useful principle in the physics of matter.
Partial proof. ; one more derivative gives , and the chain rule converts to . The identifications of , , follow by comparing with the thermodynamic ; factorisation is the exponential of a sum. The minimum principle: decreasing is increasing, since . ∎
17.2 First victories
Example 17.3 (Two levels, in two lines)
For levels : , giving — the result that cost the microcanonical route a page of Stirling (Exercise 16.8). The canonical formalism is the microcanonical one with the combinatorics pre-digested; the Schottky bump in follows by one differentiation.
Example 17.4 (Einstein’s solid, and the death of Dulong–Petit)
Model a crystal as quantum oscillators of frequency (Chapter 9). Per oscillator,
At high : per oscillator, — the Dulong–Petit law of the Year 1 volume, explained. At low the quantum becomes unaffordable and collapses exponentially — as measured, and inexplicable classically. Einstein’s 1907 curve, one parameter per element, was the first application of quanta to ordinary matter; diamond, with stiff bonds and light atoms (), is still “frozen” at room temperature — the anomaly that had puzzled chemists for eighty years (Exercise 17.6).
Theorem 17.5 (Equipartition, with its licence)
Every coordinate or momentum entering the energy quadratically contributes, in the classical (high-temperature) regime,
to the mean energy: for a monatomic gas atom, for a rotating diatomic, for an oscillator. The licence expires when falls below the mode’s level spacing: the mode freezes out and its contribution vanishes — the resolution of the nineteenth century’s heat-capacity scandals, drawn as the staircase above.
Example 17.6 (The gas, canonically)
One atom in a box: (the state count of Proposition 7.5 weighted by Boltzmann); identical atoms: . Then , and differentiation delivers , the Sackur–Tetrode entropy, and — the whole ideal gas from one Gaussian integral. The Boltzmann factor applied to a molecule’s kinetic energy gives the Maxwell speed distribution of the Year 1 volume, now derived; applied to its potential energy it gives the exponential atmosphere — and, in a drop of water, Perrin’s ladder of grains (Problem 17.1).
Method 17.7 (Canonical craft)
(1) List the states and energies of one unit; compute . (2) Factorise: (or for identical particles sharing space); take early. (3) Differentiate: for energy, for entropy via , for pressure; a second derivative for and fluctuations. (4) Check both ends: high must reproduce equipartition, low must freeze with an tail. (5) Competitions (folding, binding, alignment): write for each alternative and let the smaller win — the crossover sits at .
17.3 Exercises
Exercise 17.1 ★
(a) Write the population ratio of two levels split by at temperature . (b) In a flame, what fraction of sodium atoms sits in the excited state of the D line (ground degeneracy 2, excited 6: population ratio )? (c) Why does the flame nonetheless blaze yellow (how many atoms per cm suffice)? (d) At what temperature would the excited fraction reach ?
Solution
Solution of Exercise 17.1.
(a) . (b) : fraction . (c) A flame carries sodium atoms per cm: even of them, cycling every few nanoseconds, pour out yellow photons per second — blinding. (d) : — a stellar photosphere, not a flame.
Exercise 17.2 ★
A three-level system: . (a) Write . (b) Compute and check both temperature limits. (c) At what is the middle level maximally populated in absolute terms? (d) Show that no temperature, however high, makes a higher level more populated than a lower one — which chapter-16 concept would that require?
Solution
Solution of Exercise 17.2.
(a) . (b) : at low , (the mean level) at high. (c) grows monotonically with , approaching its supremum only as . (d) Boltzmann weights only decrease with energy at ; a population inversion needs the negative temperatures of Example 16.8, unreachable by any reservoir.
Exercise 17.3 ★
The isothermal atmosphere. (a) Apply the Boltzmann factor to the potential energy and derive . (b) Compute the scale height for air () at . (c) Everest’s summit pressure as a fraction of sea level. (d) Why is the real atmosphere’s fall-off close to but not exactly exponential (what did we hold constant that is not)?
Solution
Solution of Exercise 17.3.
(a) The Boltzmann factor on at uniform . (b) . (c) : one-third of an atmosphere — why summiteers carry oxygen. (d) The real atmosphere is not isothermal: temperature falls with height, so the profile bends away from a single exponential.
Exercise 17.4 ★
Equipartition bookkeeping. Count the quadratic terms and predict the molar of (a) argon; (b) N at room temperature (rotation on, vibration frozen); (c) N at ; (d) a crystalline solid (Dulong–Petit). Where do the measured values , , , agree, and what does each discrepancy teach?
Solution
Solution of Exercise 17.4.
(a) Three translations: , agreed exactly. (b) Add two rotations: , as measured: vibration is frozen. (c) predicted; the measured shows vibration only partly thawed (). (d) : Dulong–Petit, obeyed at room temperature by most metals and failed by diamond — the freezing story of Exercise 17.6.
Exercise 17.5 ★★
The quantum oscillator, canonically. (a) Sum the geometric series for . (b) Derive and identify — the result of Exercise 9.6, now effortless. (c) Differentiate for and verify the two limits. (d) Why is ’s form about to become famous (Chapter 20)?
Solution
Solution of Exercise 17.5.
(a) . (b) gives the stated form with . (c) at high ; at low. (d) With the energy of a light quantum, is the thermal photon number per mode: Planck’s law is one chapter away.
Exercise 17.6 ★★
Einstein versus the data. (a) From the figure’s formula, at what has fallen to half of Dulong–Petit? (b) Diamond: — compute at and explain the nineteenth century’s “anomaly of diamond”. (c) Lead: — why was lead always “well-behaved”? (d) Measurements at very low show , not exponential: which of Einstein’s assumptions fails (all oscillators one frequency), and who repaired it (Chapter 20)?
Solution
Solution of Exercise 17.6.
(a) Numerically, near . (b) : — diamond at room temperature has barely a quarter of the classical heat capacity: the “anomaly” is quantum freezing in plain sight. (c) puts lead deep in the classical regime at . (d) The single-frequency assumption: real solids have a spectrum of modes down to long-wavelength sound, whose cheap quanta give the law — Debye’s repair, in Chapter 20.
Exercise 17.7 ★★
Maxwell’s tail and the missing hydrogen. (a) From the Boltzmann factor on kinetic energy, write the speed distribution and locate the most probable speed for N and H at . (b) Earth’s escape speed is : compute for both gases. (c) The escaping fraction goes as : compare the two exponents and conclude which gas leaks over geological time. (d) Connect to the observed composition of Earth’s (no free H) versus Jupiter’s (mostly H) atmospheres — what two parameters flip the verdict?
Solution
Solution of Exercise 17.7.
(a) : : for N, for H. (b) for N, for H. (c) is never; per residence time is slow — but the hot upper atmosphere () softens the hydrogen exponent to : hydrogen bleeds away over geological time, nitrogen stays. (d) Escape speed and exospheric temperature: Jupiter’s well makes even hydrogen’s exponent astronomical — gas giants keep what small warm worlds lose.
Exercise 17.8 ★★
Fluctuations meet response. (a) Prove from two derivatives of . (b) Verify it explicitly on the two-level system. (c) For independent units, show the relative energy fluctuation falls as . (d) State the moral: what a system’s willingness to absorb heat (a response) has to do with how much its energy jitters (a fluctuation) — statistical physics’ recurring bargain.
Solution
Solution of Exercise 17.8.
(a) , and . (b) Both sides give . (c) , . (d) How strongly a system responds to heating equals how much its energy spontaneously jitters — response and fluctuation are two readings of the same second derivative, a pattern (fluctuation–dissipation) that recurs throughout physics.
Exercise 17.9 ★★
Boltzmann in the chemistry lab. Reaction rates carry the factor (crossing an activation barrier — Arrhenius). (a) Show the rule of thumb “rate doubles every near room temperature” corresponds to . (b) By what factor does that reaction slow in a refrigerator ()? (c) Cooking an egg at altitude: water boils at on a pass — estimate the extra cooking time. (d) Why does a barrier tail, not the mean energy, rule chemistry (which molecules react)?
Solution
Solution of Exercise 17.9.
(a) with , : . (b) From to : factor slower — why refrigerators preserve food. (c) : rate falls by : the eleven-minute egg needs a quarter of an hour. (d) Reactions are won by the exponential tail of molecules above the barrier: shift the temperature slightly and the tail’s population shifts enormously — the mean hardly matters.
Exercise 17.10 ★★★
Two-state folding. A biomolecule is folded (energy , one configuration) or unfolded (energy , configurations). (a) Write the folded fraction versus . (b) Show the “melting” midpoint is and interpret as an tie. (c) With and (a small protein’s cooperative unit): compute and the width of the transition. (d) Why does cooperativity (many contacts breaking together, large and ) sharpen melting — and how do DNA thermal-cycling machines (PCR) exploit exactly this?
Solution
Solution of Exercise 17.10.
(a) with the unfolded state’s entropy folded into its free energy. (b) At the two free energies tie: half and half. (c) (); width . (d) Cooperativity multiplies both and by the number of contacts breaking together, keeping but shrinking the width : DNA strands separate over a couple of kelvin, which is what lets a PCR machine cycle cleanly between “melted” and “annealed”.
Exercise 17.11 ★★★
Paramagnetism and magnetic cooling. spins of moment in field . (a) Show and expand to Curie’s law . (b) Evaluate the alignment for electron moments at , and at . (c) Adiabatic demagnetisation: magnetise at , isolate, reduce tenfold — show constant entropy means constant , so drops tenfold. (d) What sets the floor of this refrigerator (interactions between the spins — estimate the dipolar scale for , in temperature units)?
Solution
Solution of Exercise 17.11.
(a) ; for small argument: Curie’s . (b) : at ; at — from indifferent to strongly aligned. (c) depends on alone; lowering at fixed entropy drags down proportionally: . (d) When reaches the spin–spin energy the entropy is no longer field-controlled: — the classic floor (nuclear moments, a thousand times weaker, push it to microkelvins).
Exercise 17.12 ★★★
The rotational staircase, quantitatively. A diatomic’s rotational levels are , degeneracy (Chapter 10). (a) Write and show that for the sum becomes the integral : equipartition’s in regained. (b) Define and evaluate for H () and N (): which gas shows the rotational step at accessible temperatures? (c) Sketch hydrogen’s full staircase with its three plateaus and two risers, placing numbers on both. (d) The measured low- behaviour of H is further complicated by the 3:1 ortho–para mixture of Exercise 14.8: state in one sentence how nuclear spin statistics reaches into a gas’s heat capacity.
Solution
Solution of Exercise 17.12.
(a) : then and . (b) H: — the step sits in the laboratory range; N: , frozen out only near liquid helium, so nitrogen always shows . (c) Plateaus (below ), (from to ), rising toward near . (d) Odd and even belong to different nuclear spin species that interconvert slowly, so cold hydrogen’s depends on its ortho–para history — nuclear statistics audited by a calorimeter.
17.4 Problem: Counting Avogadro in a drop of water
Problem 17.1
Weekend problem — Perrin’s grains and the reality of atoms
In 1908 Jean Perrin suspended microscopic resin grains in water, let them settle, and counted them layer by layer under a microscope. The exponential ladder he found was the Boltzmann factor made visible — and from its scale height he extracted Avogadro’s number, convincing the last sceptics that atoms exist. Nobel Prize, 1926. Data: gamboge grains of radius , density ; water ; ; .
Part I — The visible Boltzmann factor.
- A grain in water feels gravity minus buoyancy: compute its effective mass and weight.
- Write the equilibrium concentration profile from the Boltzmann factor.
- Compute the scale height with the modern .
- Why must the grains be so precisely mono-sized (how does depend on )?
- Compare with the same formula for air molecules: why is the grains’ atmosphere micrometres tall while the air’s is kilometres?
- Perrin counted (in one run) relative concentrations at four equally spaced depths apart: check that this is an exponential ladder and extract its .
Part II — Weighing the invisible.
- Invert: from the measured of item 6 and the known , extract .
- The gas constant was known from macroscopic chemistry: combine with your to obtain Avogadro’s number .
- Perrin’s runs gave between and : compare with the modern and comment on the achievement given his microscope and stopwatch.
- From , compute the mass of a single hydrogen atom — the number the atomists had wanted for a century.
- Explain the logical structure: which macroscopic measurements (; grain size and density; the ladder) combine to weigh one atom, with no atom ever seen?
- Why do the grains — atomic masses each — obey the same Boltzmann statistics as molecules (what in the derivation of Theorem 17.1 cares about size)?
Part III — The jitter that seals it.
- The same grains jitter: Einstein’s 1905 formula for Brownian motion gives with (water: ). Compute for Perrin’s grains.
- How far does a grain wander in one minute? Could Perrin measure it with a micrometer eyepiece and a stopwatch?
- Perrin verified and extracted again, independently: why did two unrelated routes (a static ladder; a dynamic jitter) to one number carry such evidential weight?
- The jitter is equipartition applied to the grain: each velocity component carries . Estimate the grain’s r.m.s. thermal speed ().
- Why is that speed never seen directly (what interrupts the free flight after nanometres), and what is seen instead?
- State which two chapters of this book meet in the observation: the mechanics of drag (Year 2 volume, viscosity) and the statistics of this chapter.
Part IV — What was settled.
- Ostwald and Mach had held atoms to be bookkeeping fictions: state in one sentence why a counted from grain ladders ended that position.
- List three other 1900s routes that converged on the same (blue of the sky, Exercise 16.12; electrolysis plus the electron charge; radioactivity’s helium production) — why did convergence matter more than any single value?
- Perrin’s ladder is an equilibrium between which two currencies of this chapter (energy pulling down, entropy spreading up), priced at which rate?
- Modern uses of the same physics: analytical ultracentrifuges spin proteins at to compress their “atmospheres” into measurable ladders — show that multiplying by divides by the same factor, and estimate for a protein of effective mass at , .
- Doubling the grain radius divides by eight: bracket the practical window of grain sizes between “ladder too tall to see a gradient” and “ladder thinner than one grain” for a microscope field deep.
- Since 2019 the SI defines and exactly: state what an exact Perrin-style experiment measures today (a consistency check, or a calibration of the apparatus and grains) — and why the physics is unchanged.
- Summarise the named result: a grain’s concentration halves every of height; read with , that ladder yielded — atoms counted, not conjectured, in a drop of water on a microscope stage.
Solution
Solution of Problem 17.1.
1. : , weight . 2. : the barometric law, shrunk to a microscope slide. 3. . 4. : a spread in radius is a spread in scale height — polydisperse grains smear the ladder into mush. Perrin fractionated for months by repeated centrifugation. 5. Same formula, masses apart: the grain “atmosphere” is times shallower — kilometres shrink to tens of micrometres, which is precisely what makes it observable whole under a microscope. 6. Successive ratios , , : constant within counting error — exponential. . 7. . 8. . 9. Within a few per cent here (with idealised data); Perrin’s real runs scattered by around the modern value — astonishing for hand-counted grains, and utterly decisive for the order of magnitude. 10. . 11. Macroscopic chemistry supplies ; light microscopy and weighing supply ; counting supplies the ladder: three tabletop measurements triangulate the mass of an atom no one can see. 12. Nothing: the derivation used only “system exchanging energy with a reservoir” — Boltzmann’s factor is size-blind, which is exactly what Perrin verified. 13. . 14. per minute: comfortably measurable with an eyepiece graticule and patience. 15. Two independent phenomena, two independent formulas, one number: agreement of the static ladder and the dynamic jitter left no niche for coincidence — the molecular hypothesis predicted both. 16. per component. 17. The grain is struck times per second and forgets its velocity within nanometres: the ballistic flight is unobservable, and what the eye sees is its integral — the diffusive random walk. 18. Stokes drag (the viscosity of the Year 2 volume’s fluids) supplies the ; the canonical ensemble supplies the : Einstein’s is their quotient, mechanics and statistics in one fraction. 19. A fiction cannot be counted: once is the ratio of two measured numbers, with error bars, atoms are objects of experiment — Ostwald conceded in print in 1909. 20. Sky-blue scattering, electrolysis with the measured electron charge, helium accumulated from radium: four unrelated physical channels converging on one made the number a property of nature rather than of any theory. 21. Gravitational energy pulling the grains down, configurational entropy spreading them up, traded at the rate : the ladder is the minimum of . 22. : at , for the protein — sedimentation equilibrium, Perrin’s experiment run daily in biochemistry departments. 23. From “too tall” ( field depth: no visible gradient) to “too thin” (): usable radii span roughly – — Perrin’s choice was not luck but design. 24. With now exact by definition, the same experiment calibrates the grains (their size or density) or audits the setup: the physics — Boltzmann’s ladder — is untouched; only which quantity counts as unknown has moved. 25. A grain’s population halves every ; read through , the ladder returned : Avogadro’s number counted grain by grain — and the atomic debate closed on a microscope stage.