University Physics — Year 3 · Bachelor Year 3
16The Microcanonical Ensemble
A cubic centimetre of air holds molecules. No computer will ever integrate their equations of motion, and no experiment could supply the initial conditions — yet the gas obeys laws of splendid simplicity, and the thermodynamics of the Year 1 volume described them without ever mentioning a molecule. This chapter builds the bridge: statistical physics, which derives the laws of heat from mechanics plus honest counting. The whole edifice stands on one postulate — an isolated system is equally likely to be in any microscopic state compatible with its energy — made legitimate by Liouville’s theorem (Chapter 2) and made powerful by the sheer size of the numbers: when configurations are counted in units of , “overwhelmingly probable” and “certain” become indistinguishable, and probability hardens into law. Out of the counting come entropy, temperature, pressure and the second law — and, at the chapter’s end, the reason a rubber band pulls back.
16.1 Microstates, macrostates, and the postulate
Definition 16.1 (Microstates and macrostates)
A microstate is a complete microscopic specification of a system — every quantum number of every particle (or, classically, every position and momentum, counted in phase-space cells of per particle, Proposition 7.5). A macrostate is what thermodynamics can see: energy , volume , particle number , magnetisation… The multiplicity is the number of microstates wearing the same macrostate.
Theorem 16.2 (The fundamental postulate)
An isolated system in equilibrium is found with equal probability in each of its accessible microstates. All of equilibrium statistical physics follows from this single sentence. Its credentials: Liouville’s theorem shows the uniform distribution over the energy shell is the one that dynamics preserves — no flow ever bunches phase-space probability — and a century and a half of consequences have never disagreed with an experiment.
Proof. Admitted at this level. ∎
Example 16.3 (A magnet of coins)
independent spins, each up or down: microstates. The macrostate “ up” has multiplicity , overwhelmingly peaked at with relative width . For : the all-up state is one; the balanced macrostate holds . For , deviations of even in the up-fraction are suppressed by factors like : the system is at its peak, and what we call equilibrium is the macrostate with the most microstates.
16.2 Entropy is a count
Definition 16.4 (Boltzmann entropy)
The statistical entropy of a macrostate is
The logarithm makes entropy additive where multiplicities multiply: for independent systems and ; Boltzmann’s constant calibrates the count to the kelvin-and-joule units thermodynamics had already chosen. This , we will verify, is the entropy of the Year 1 volume’s second law — now with a microscopic meaning: entropy measures, in logarithmic currency, how many ways the macrostate can be realised.
Proposition 16.5 (Entropy of the ideal gas)
Counting the quantum states of identical atoms in a box (Proposition 7.5, one cell of per atom in phase space, divided by for identity — Exercise 14.10) gives
(the Sackur–Tetrode formula; , the thermal de Broglie wavelength, is the size of an atom’s wave packet at temperature ). Two remarkable audits: the formula is extensive only thanks to the ; and its absolute value — including the — matches calorimetric entropies of real gases (Exercise 16.11): classical thermodynamics, measured in the nineteenth century, already knew Planck’s constant without knowing it.
Proof. Admitted at this level. ∎
16.3 Temperature is a derivative of counting
Theorem 16.6 (Equilibrium and temperature)
Let two systems exchange energy, the total fixed. The joint multiplicity is maximal — overwhelmingly so — at the partition where
Defining
equilibrium is equality of temperature, and energy flows spontaneously from high to low because that direction increases the total count. The same logic applied to volume and particle exchange yields and : all of thermodynamics’ intensive quantities are derivatives of the count.
Proof. Maximise over : the stationarity condition is the stated equality. Sharpness: the peak’s width is (Exercise 16.7), so the maximum is the observed state. If , moving energy into 1 raises : the colder body (larger ) absorbs — heat flows hot to cold as a counting statement. Check on the ideal gas: gives , i.e. — the kinetic-theory result of the Year 1 volume, recovered from pure counting. ∎
16.4 The second law, and stranger things
Proposition 16.7 (Irreversibility is arithmetic)
A constraint released (a wall removed, a valve opened) can only enlarge the accessible count: grows, grows — the second law of the Year 1 volume, now as a statement about probability. Reversals are not forbidden but discounted: a gas of molecules re-gathering into the left half has probability , and for one cubic centimetre of air the waiting time exceeds the age of the universe by a factor with digits. The arrow of time, at this level, is the direction in which counts increase.
Partial proof. Removing a constraint makes every formerly accessible microstate still accessible and adds new ones: cannot decrease. The free-expansion count: each molecule doubles its accessible volume, , so — exactly the thermodynamic result for isothermal free doubling. ∎
Example 16.8 (Negative temperature)
A system whose energy is bounded above — spins in a field, energy from to — has rising then falling: beyond the balanced point, adding energy reduces the count. There : the temperature is negative. Such states exist (population inversions — the working state of every laser medium — and spin systems prepared by field reversal) and they are not cold but hotter than every positive temperature: energy flows from any body into any body. The honest ordering of temperatures runs : what orders naturally, garbles (Exercise 16.9).
Method 16.9 (Microcanonical craft)
(1) Enumerate: what is a microstate here, and what does the macrostate fix? (2) Count — combinatorics for discrete units, phase-space volume over for gases. (3) Take the logarithm early: Stirling () turns products into tractable sums. (4) Differentiate : energy derivative for , volume for , number for ; length or magnetisation derivatives for tensions and fields (Problem 16.1). (5) Trust the peak: fluctuations are down by , so replace “most probable” by “equals” and apologise to no one.
16.5 Exercises
Exercise 16.1 ★
Four spins. (a) List the multiplicities of the macrostates “ up”. (b) The probability of each macrostate under the postulate. (c) The entropy (in units of ) of each. (d) Which macrostate is “equilibrium”, and how bad an approximation is “the system is surely there” at ?
Solution
Solution of Exercise 16.1.
(a) . (b) Over : , , , , . (c) , , , , . (d) , holding only of the probability: at , “equilibrium” is merely a plurality — the sharpness that licenses thermodynamics is bought with large .
Exercise 16.2 ★
Stirling in practice. (a) Compare with for and (use , ). (b) Show the relative error falls like . (c) Use Stirling to show const. (d) Why is dropping the utterly safe in a mole?
Solution
Solution of Exercise 16.2.
(a) : against ( off); : against (). (b) The neglected term is : relative error . (c) Apply Stirling to the three factorials. (d) At the dropped term is against : twenty-two orders below the leading one.
Exercise 16.3 ★
(a) Show that for two independent systems . (b) A system’s doubles: by how much does rise — and what physical act (Proposition 16.7) does that correspond to for one particle? (c) Compute the entropy, in and in J/K, of a shuffled deck of 52 cards (). (d) Why is card entropy thermodynamically negligible while molecular entropy is not?
Solution
Solution of Exercise 16.3.
(a) . (b) — one particle offered a doubled volume. (c) . (d) Thermodynamic entropies carry factors of : all the shuffling in every casino on Earth is invisible next to a breath of warm air.
Exercise 16.4 ★
Free expansion, audited. One mole doubles its volume into vacuum. (a) from the counting argument. (b) The probability of observing the gas back in the original half. (c) Estimate the time scale for such a fluctuation given molecular rearrangement times of — and compare with the age of the universe (). (d) In what precise sense is the second law “only” probabilistic?
Solution
Solution of Exercise 16.4.
(a) . (b) . (c) Even sampling configurations every , the expected wait dwarfs by a factor whose exponent has twenty-three digits. (d) Not impossible — unwitnessable: the law is probabilistic in principle and absolute in any world that contains observers with finite patience.
Exercise 16.5 ★★
Ideal-gas counting. Starting from (momentum-shell volume ): (a) show const. (b) Show that without the , doubling the system (both and ) would not double — the extensivity failure of Exercise 14.10. (c) With Stirling, put the result in the form const. (d) Which physical inputs fixed the two “consts” history left undetermined (quantum cell size; particle identity)?
Solution
Solution of Exercise 16.5.
(a) Take the logarithm of the product. (b) Doubling at fixed : without , gains an extra -type excess — the Gibbs failure. (c) Stirling on delivers the and combinations. (d) Planck’s cell fixes the entropy’s zero; identity of particles fixes the — two quantum inputs hiding in classical thermodynamics.
Exercise 16.6 ★★
Thermodynamics from derivatives. Using the form of Exercise 16.5(c): (a) compute and recover ; (b) compute and recover ; (c) derive the adiabatic invariant: at constant and , show is fixed, i.e. — and match to the of the Year 1 volume; (d) state what has been achieved: which empirical laws just became theorems of counting.
Solution
Solution of Exercise 16.6.
(a) . (b) : the ideal-gas law, from counting. (c) Constant : fixed, so constant; with : constant, equivalent to . (d) The gas law, the energy–temperature relation and the adiabatic exponent — three empirical pillars of the Year 1 volume — are now theorems.
Exercise 16.7 ★★
Sharpness of equilibrium. Two equal ideal-gas blocks share total energy . (a) Show is maximal at the even split. (b) Expand to second order in the imbalance and show the probability is (each block degrees of freedom — keep factors loose). (c) For : the r.m.s. imbalance. (d) The temperature difference that imbalance represents, for gas at : could any thermometer see it?
Solution
Solution of Exercise 16.7.
(a) Symmetry (equal blocks). (b) Each : expanding about the even split gives a Gaussian in of variance . (c) . (d) : nano-nanokelvins — fluctuations exist, and are unmeasurably tame at laboratory scale.
Exercise 16.8 ★★
The two-level (Schottky) solid: sites, each of energy or ; excited. (a) and . (b) With and Stirling, derive
(c) Sketch and the heat capacity: a bump (the Schottky anomaly) near — why does vanish at both ends? (d) Where has the occupation formula’s shape appeared before, and where will it return (Chapter 19)?
Solution
Solution of Exercise 16.8.
(a) , . (b) ; solve for . (c) rises from to the saturation ; vanishes at low (no quantum can be afforded) and at high (both levels equally full, nothing left to absorb): a bump between — the calorimetric fingerprint of any two-level population, used to find magnetic impurities in solids. (d) It is the thermal two-level occupation — and, with , it will reappear verbatim as the Fermi–Dirac distribution.
Exercise 16.9 ★★
Below zero. For the spin system of Example 16.8 with level splitting : (a) show exactly when more than half the spins are up (population inverted). (b) Compute for a 60:40 inversion with . (c) Show energy always flows from negative- to positive- bodies (compare ). (d) Why can a system with unbounded energy (a gas) never reach ?
Solution
Solution of Exercise 16.9.
(a) exactly when . (b) . (c) A negative- body gains entropy by losing energy, a positive- body gains by receiving: both counts grow when energy flows negative positive — the inverted system is the universal donor, i.e. hotter than everything. (d) With unbounded energy, never turns over: stays positive at any finite energy.
Exercise 16.10 ★★★
Mixing, quantitatively. Two different gases ( each, volumes ) are joined. (a) Compute by counting. (b) Same gas: show, ’s included, . (c) Helium-3 and helium-4 are different: joining them does create — yet no heat flows and no work is done: where is the entropy increase physically (what would separating them again cost)? (d) The minimum work to re-separate at temperature : express it, and name the modern industry built on paying it (isotope separation).
Solution
Solution of Exercise 16.10.
(a) Each gas doubles its accessible volume: . (b) The ’s of the merged populations exactly absorb the apparent gain: . (c) The entropy increase is the loss of sortedness: no macroscopic variable moved, but re-separating now requires work — the increase is stored as a future bill. (d) ; isotope-separation plants (uranium centrifuge cascades, helium-3 recovery) pay this thermodynamic minimum many times over in practice.
Exercise 16.11 ★★★
The tables knew about . Sackur–Tetrode for argon () at , (): (a) compute ; (b) compute ; (c) compare with the calorimetric value , i.e. ; (d) explain what is being tested: which two quantum inputs sit inside a number measured with ice calorimeters before 1912?
Solution
Solution of Exercise 16.11.
(a) . (b) : , so . (c) Dead on the calorimetric . (d) The absolute entropy contains (through ) and the : heat measurements from the age of steam confirm, to three digits, the quantum of action and the identity of atoms.
Exercise 16.12 ★★★
Fluctuations you can see. The number of molecules in a small volume of gas fluctuates; the probability of a relative deviation is ( — accept this Gaussian, or derive from the binomial). (a) For a cube of side at atmospheric density: and the r.m.s. . (b) Why are these permanent few-per-mille density ripples at optical scales exactly what Problem 13.1 needed to let air scatter at all? (c) At what (hence what scale) would fluctuations reach ? (d) Close the loop in one sentence: the blue of the sky is a statement about statistics.
Solution
Solution of Exercise 16.12.
(a) : , . (b) A perfectly uniform medium would scatter nothing sideways (Problem 13.1, Part III): these irreducible ripples in every optical cell are precisely the disorder that lets the sky exist. (c) : . (d) The sky is blue because air is made of countable molecules whose numbers fluctuate as — Einstein used exactly this to argue molecules were real.
16.6 Problem: The entropic spring
Problem 16.1
Weekend problem — why rubber pulls back
Stretch a rubber band and it snaps back — yet its molecules’ bonds are barely deformed and its internal energy barely changes. Rubber’s restoring force is not energy seeking a minimum but entropy seeking a maximum: the first great victory of pure counting over mechanism, with the same mathematics running today’s single-molecule DNA experiments. Model: a chain of rigid links, each of length , each pointing left or right along the pull axis; end-to-end extension .
Part I — Counting configurations.
- Express in terms of and , and write the multiplicity .
- Where is maximal, and what does that say about a free chain’s preferred extension?
With Stirling, show for :
- The chain’s energy is (in this model) independent of : justify calling any restoring force “entropic”.
- The r.m.s. extension of the free chain is (random walk): for and , compare the coil size with the stretched length .
- Real rubber is a network of such chains between cross-links: which single parameter of the model does vulcanisation (more cross-links) change?
Part II — The force of counting.
For a system held at temperature , the tension required to hold extension is (accept this from at constant energy): derive
- Hooke’s law has emerged with spring constant : evaluate it for one chain with , at .
- The startling factor is : what should a rubber band under fixed load do when heated? Contrast with a steel spring.
- Estimate the force to stretch one chain to half its full length, and the force scale at which the linear model fails.
- A rubber band of cross-section contains effective chains in parallel: estimate its spring constant and compare with experience.
- Why does rubber stiffen (not soften) with temperature, gram for gram, while metals soften?
Part III — The Gough–Joule kitchen.
- Stretch a rubber band quickly (adiabatically) against your lip: it warms. Explain with the entropy budget: stretching reduces configurational entropy, so where must entropy (heat) go at constant total?
- Release it quickly: it cools. Complete the symmetric argument.
- A weighted rubber band is gently heated (hair dryer): which way does the weight move, and why is this the clean signature of entropic elasticity?
- Design the counter-experiment with a steel spring: what happens instead, and why (which kind of elasticity)?
- An engine: a wheel with rubber spokes, heated on one side, turns steadily. Trace one cycle’s logic (heated spokes contract, unbalancing the wheel).
- The same law, measured by optical tweezers on single DNA molecules (with , for a bacterial genome fragment), gives forces in which range? (Compute .) Why did this make the model directly testable on one molecule?
Part IV — The moral.
- The chain model has no interactions and no energy scale, yet produces a force law: state precisely where the force “comes from” in the microcanonical language of this chapter.
- Why does the force vanish at — and what does that say about the nature of elasticity in a world without thermal agitation?
- Compare the entropic spring constant’s -linearity with the ideal-gas pressure’s -linearity: show both are the same phenomenon (counting configurations against a constraint) in different clothes.
- The heated band lifts a weight, doing real work: trace the energy’s source and route (heat in from the dryer, entropy bookkeeping, work out) and confirm the first law is untouched.
- The ideal chain ignores self-avoidance and link-bending energy: name one measured feature of real rubber each omission hides (sharp stiffening near full extension; strain-induced crystallisation and hysteresis).
- Proteins fold, membranes flicker, polymers coil: why is at body temperature the natural force currency ( in piconewtons — compute it) of all soft and living matter?
- Summarise the named result: a chain of blind links, counted honestly, yields Hooke’s law with , predicts that rubber warms when stretched and lifts weights when heated — entropy acting as a force, verified from bicycle inner tubes to single DNA molecules at scales.
Solution
Solution of Problem 16.1.
1. ; . 2. At : the free chain coils; full extension has . 3. Stirling on the binomial, expanded to second order in : the stated Gaussian entropy. 4. With independent of , any pull toward small can only come from the count: entropic by construction. 5. Coil against : the free chain is a hundred times shorter than its contour — crumpled almost entirely. 6. , the number of links between cross-links: vulcanisation shortens the effective chains, stiffening the network. 7. . 8. per chain. 9. : heated under fixed load, the band stiffens and contracts, lifting the load; a steel spring merely softens and sags a little. 10. ; the linear law fails as approaches , where the chain nears full extension. 11. chains in parallel and coil-lengths in series along a centimetre: – — the familiar feel of a rubber band. 12. Rubber’s stiffness is per configuration: more agitation, more recoil; metallic stiffness is bond energy, which anharmonic agitation loosens. 13. Stretching cuts the configurational count; done fast (no entropy exchanged with outside), the lost configurational entropy must reappear as thermal entropy: the band warms — -scale, lip-detectable. 14. Releasing restores configurations; the thermal account refunds the difference: it cools. 15. The weight rises: contraction on heating is the entropic signature (energy-elastic materials expand). 16. The steel spring lengthens slightly (thermal expansion) and its modulus drops: opposite sign — elasticity of energy, not of counting. 17. Heated spokes contract, pulling the rim’s mass off-centre toward the cool side; gravity torques the unbalanced wheel; each spoke re-relaxes as it rotates away: a heat engine whose working substance is entropy itself. 18. : piconewtons and below — exactly the optical-tweezer range, so the force–extension law of one DNA molecule could be traced point by point (and matched, with the refinements of item 23). 19. From nowhere but the count: at extension there are fewer microstates than at , and thermal agitation drifts the chain toward the bigger count; the “force” is times the entropy gradient. 20. At nothing explores configurations: the entropic force vanishes with the agitation that powers it — elasticity would be purely energetic, and rubber would behave like a limp thread. 21. Gas: with ; chain: with the Gaussian count — both are counting pushed against a constraint, priced at . 22. The dryer’s heat enters the band; part is converted to work in the isothermal contraction, the books balanced by the entropy carried in and out — a miniature heat engine, first law intact. 23. Finite extensibility (the real force diverges near full stretch — the worm-like-chain refinement) and strain-induced crystallisation (alignment orders the chains, giving hysteresis and heat release beyond the ideal model). 24. : the force at which thermal energy and nanometre displacements trade evenly — molecular motors, folding proteins and stretched DNA all operate within an order of magnitude of it. 25. Ten thousand blind links, counted: Hooke’s law with , warmth on stretching, weights lifted by hot air, and single molecules obeying at — entropy, acting as a force.