University Mathematics — Year 3 · Bachelor Year 3
14The Fourier Transform
Fourier series decompose periodic signals into discrete harmonics; the Fourier transform does the same for signals on the whole line, with a continuum of frequencies. It converts differentiation into multiplication, convolution into products, and Gaussians into Gaussians — the reasons it solves differential equations, drives signal processing, and will prove the central limit theorem in Chapter 23. This chapter develops the theory (Riemann–Lebesgue, inversion, injectivity), the Schwartz class where the transform is a perfect bijection, and the theory (Plancherel: the transform is, up to a constant, a unitary operator), with two showpiece applications: the heat equation, solved end to end in the weekend problem, and the Poisson summation formula. Convention:
14.1 The transform on
Proposition 14.1
For : is well defined, bounded (), continuous, and:
- and ;
- for ;
- if , then is with ;
- if with (and at , automatic here), then ;
- for .
Proof. Boundedness: . Continuity: DCT with dominator (Theorem 10.14). (1), (2): substitutions (Theorem 11.10). (3): differentiation under the integral, dominator (Theorem 10.15). (4): first, has a limit at (), which must be (); then integrate by parts on and let . (5): Fubini, legitimate since is absolutely integrable (Theorem 11.9):
∎
Example 14.2
The Gaussian: for ,
by Exercise 10.7 (the ODE trick, rescaled), or by (3): satisfies (integrate by parts), . Gaussians are fixed points of the transform up to scaling — the deep reason they rule the central limit theorem.
Theorem 14.3 (Riemann–Lebesgue)
For : as . Thus (continuous functions vanishing at infinity).
Proof. For an indicator of an interval, ; hence for step functions. Step functions are dense in (Theorem 12.6(1) plus approximation of finite-measure sets by finite unions of intervals, Exercise 9.7), and the transform is - continuous: for , . ∎
14.2 Inversion and injectivity
Lemma 14.4 (Multiplication formula)
For : .
Proof. Both sides equal (Tonelli–Fubini: the double integral of the absolute value is ). ∎
Theorem 14.5 (Inversion)
Let .
(Gaussian summability) For every ,
and in as .
If moreover , then for almost every
and has a continuous representative.
- (Injectivity) If then a.e.
Proof. (1) Fix and apply Lemma 14.4 to and : by Example 14.2 (with the modulation rule),
so . The are an approximate identity: , (Gaussian integral), concentrating at ; the proof of Theorem 12.9(2) applies verbatim (only and concentration were used: for the tail, ): .
(2) If : the right side of (1) converges, by DCT (dominator ), to for every , and this limit function is continuous (DCT again). On the other hand in , so along a subsequence a.e. (Theorem 12.4): the two limits agree a.e.
(3) makes the right side of (1) vanish: for all , and in : a.e. ∎
14.3 The Schwartz class
Definition 14.6
The Schwartz class consists of the functions with for all (all derivatives decay faster than any power). Examples: , . Clearly for every (bound by ), and is stable under derivatives, multiplication by polynomials, and products.
Theorem 14.7
The Fourier transform maps bijectively onto itself, with inverse .
Proof. Let . Iterating Proposition 14.1(3), (each ); iterating (4) with (all of whose derivatives are integrable), . Combining,
uniformly in : . Since , inversion (Theorem 14.5(2)) holds everywhere (both sides continuous): , and symmetrically (the check transform is , again preserving ): bijection. ∎
14.4 Plancherel and
Theorem 14.8 (Plancherel)
For :
Consequently extends uniquely to a continuous linear map with ; is bijective, with where , and it preserves inner products up to the factor .
Proof. Let and with . Then (Theorem 11.9), is continuous and bounded (Exercise 12.6: ), , and (compute ). Apply Theorem 14.5(1) to at :
As : the left side tends to ( continuous bounded: by splitting small/large ); the right side increases to by MCT (). Hence , finite or not a priori — and finite, proving both membership and the identity.
Extension: is dense in (Theorem 12.6); the transform is -isometric there, so extends uniquely to an isometry-up-to-constant on (Theorem 7.2). Inversion for (Theorem 14.7) transfers by the same density (both sides -continuous): on , hence on : bijectivity. Inner products: polarization from the norm identity. ∎
Theorem 14.9 (Poisson summation)
Let (continuous with suffices). Then
Proof. Let : the series converges normally on compacts (decay of ), so is continuous, and it is -periodic. Its Fourier coefficients (period : ):
(normal convergence justifies the interchange; the phase is -periodic). The series converges (decay of ), so the Fourier series of converges normally; its sum is a continuous function with the same Fourier coefficients as , hence equals (injectivity on the circle: the difference has zero coefficients, and Theorem 13.9 gives zero in , hence everywhere by continuity). Evaluate at . ∎
Example 14.10 (The theta identity)
Applying Poisson to (), whose transform is (Example 14.2 with ):
the functional equation of Jacobi’s theta function, key to the functional equation of Riemann’s — and a spectacular numerical accelerator: for small, the left side converges slowly, the right side blazingly fast.
Method 14.11
Working ranges: — transform defined pointwise, inversion needs ; — everything is legal, prove here first; — transform defined by density (not by the integral!), perfect symmetry, Parseval bookkeeping. To compute a transform: reduce to the table (indicator, exponential, Gaussian) by the rules of Proposition 14.1; to prove an identity: establish it on (or ) and extend by density and continuity (Method 12.13); to solve a linear PDE or ODE with constant coefficients: transform, divide, invert.
14.5 Exercises
Exercise 14.1 ★
Compute the Fourier transforms of: ; (); the tent function ; (use inversion on the second). Record the emerging table.
Solution
Solution of Exercise 14.1.
(value at ). . Tent: , so its transform is . Last: , so inversion (Theorem 14.5(2)) applied to gives, after renaming variables,
Exercise 14.2 ★
Let . Express in terms of the transforms of: , , , , . Verify each rule on the Gaussian.
Solution
Solution of Exercise 14.2.
From Proposition 14.1: ; ; (); ; . On the Gaussian () each rule is a one-line check — e.g. has transform , which the direct computation (complete the square) confirms.
Exercise 14.3 ★★
(a) Show that has transform , and deduce by Plancherel — or by inversion at . Compare Problem 10.1. (b) Compute via Plancherel applied to .
Solution
Solution of Exercise 14.3.
(a) has ; inversion at , where :
consistent with (Problem 10.1).
(b) Plancherel for : reads : .
Exercise 14.4 ★★
(Heat kernel algebra) With : (a) verify ; (b) deduce the semigroup law without any integral computation; (c) show and .
Solution
Solution of Exercise 14.4.
(a) : by Example 14.2 with , . (b) , and the transform is injective on (Theorem 14.5(3)): . (c) (Gaussian integral); .
Exercise 14.5 ★★
Show that if is even and real, is even and real; if is odd and real, is odd and purely imaginary. What does compute? Deduce that forces , and interpret for probability densities (Chapter 23: a characteristic function has modulus , attained at ).
Solution
Solution of Exercise 14.5.
For real even : (the sine part cancels): real and even. Odd: : odd, purely imaginary. : the total mass. If : , so the sup is attained at . For a probability density, is the characteristic function of Chapter 23: modulus everywhere, at the origin.
Exercise 14.6 ★★★
(Non-surjectivity) Show that is injective and continuous, but not surjective, in three steps. (i) Injectivity (Theorem 14.5) and continuity (), and is a Banach space (closed in ). (ii) If the map were surjective, it would be bijective, and the open mapping theorem (Theorem 8.12) would give a constant with for all . (iii) Contradict this with : its transform is (up to constants) the convolution -type trapezoid — show uniformly, while by counting the arches of on (where the second factor is bounded below), as in Theorem 8.11.
Solution
Solution of Exercise 14.6.
(i) Injectivity is Theorem 14.5(3); continuity is (with values in by Riemann–Lebesgue); is closed in the sup norm (uniform limits of vanishing-at-infinity functions vanish at infinity): Banach.
(ii) A continuous bijection between Banach spaces has continuous inverse (Theorem 8.12): there would be with .
(iii) Let : a product of two functions, and at infinity, so . Since has -transform , the product formula (valid for with ; check it on Schwartz functions by Fubini and extend by -continuity of both sides via Plancherel) gives
a trapezoid of height : for every . But on , , so
(arch-counting, as in Theorem 8.11). The bound fails for large : not surjective. (The image is a dense — by Stone–Weierstrass-type arguments — but proper subspace of .)
Exercise 14.7 ★★
(Smoothness decay dictionary) Prove: with for some implies has a representative. Conversely implies . Illustrate both directions on the tent function.
Solution
Solution of Exercise 14.7.
If : then for (integrable at infinity by the decay, locally by continuity of ). Inversion (Theorem 14.5(2)) represents a.e. by , and differentiation under the integral (dominators ) makes this representative . Conversely for : iterating Proposition 14.1(4), , so . Tent function: continuous with compact support (: transform bounded), and its transform returns, by the first direction, a representative — both sharp: the tent is not , and its transform decays no faster than .
Exercise 14.8 ★★★
(Heisenberg’s inequality) For real with , prove
with equality for Gaussians. (Write by parts, bound by Cauchy–Schwarz, and convert by Plancherel.) Interpretation: a signal and its spectrum cannot both be concentrated.
Solution
Solution of Exercise 14.8.
Integration by parts (; boundary terms vanish):
Plancherel and : . Squaring the display:
Equality requires equality in Cauchy–Schwarz: with (integrability), i.e. : Gaussians. A signal concentrated in (small ) must have spread-out spectrum, and conversely: the uncertainty principle.
Exercise 14.9 ★★
Justify Example 14.10 in detail (hypotheses of Poisson for the Gaussian), and use the identity to evaluate to six decimals with three terms. How many terms of the defining series would the same accuracy require at , versus the transformed series?
Solution
Solution of Exercise 14.9.
The Gaussian is Schwartz, so Theorem 14.9 applies, and ; at the right side becomes : the theta identity. At :
accurate to decimals with three terms (). At : the defining series needs , i.e. — about terms — while the transformed series is , where already the term is : one term suffices.
Exercise 14.10 ★★
(Band-limited functions) Let with supported in . Show that has a representative extending each of whose values is recoverable from samples: prove the Shannon interpolation at the integers,
by expanding in the Fourier basis of (Theorem 13.9) and transforming back term by term.
Solution
Solution of Exercise 14.10.
(finite measure), so inversion gives the continuous representative , with
in the notation of Theorem 13.9. Expanding in that Hilbert basis: in . Apply the -continuous term by term:
giving in : a band-limited signal is determined by its integer samples — Shannon’s sampling theorem.
Exercise 14.11 ★★
(The transform as an operator of order four) On , let . (a) Using the inversion formula, show , and deduce . (b) Deduce that every eigenvalue of on belongs to , and exhibit an eigenfunction for (which function of this chapter is proportional to its own transform?). (c) Show that even functions satisfy and odd ones ; produce an eigenfunction for the eigenvalue from by computing its transform (differentiate the Gaussian’s transform).
Solution
Solution of Exercise 14.11.
(a) Inversion on : , i.e. . Applying twice: .
(b) If with : , so : . The Gaussian has (Example 14.2 at ): eigenfunction for .
(c) equals according to parity. For : differentiating with the rule :
an eigenfunction for . (The Hermite functions continue the pattern, cycling through the four eigenvalues — the discrete Fourier clock.)
Exercise 14.12 ★★
(Autocorrelation and Wiener’s lemma) For define and the autocorrelation . (a) Show that is a bounded continuous function with for all (Exercise 12.6 and Cauchy–Schwarz). (b) Show, first for , that : the autocorrelation has nonnegative transform — spectra of autocorrelations are power spectra. (c) Deduce the identity (inversion; justify its applicability when has ), and evaluate it for at : recover .
Solution
Solution of Exercise 14.12.
(a) with ; Exercise 12.6 (conjugate exponents ) makes bounded and uniformly continuous, with
by Cauchy–Schwarz.
(b) For : too, and the convolution theorem gives ; computing, : .
(c) When , inversion applies to the continuous (its transform is integrable; Theorem 14.5):
For : , and at :
(), i.e. — Plancherel’s favorite integral, recovered by autocorrelation.
14.6 Problem: the heat equation on the line
Problem 14.1
Weekend problem — , solved end to end
Heat spreads; the equation says its density diffuses at a rate given by the local curvature of the temperature profile. We solve the Cauchy problem on — given , find for with — prove the solution’s remarkable properties, and see why time cannot be reversed. Throughout, is the heat kernel and .
Part I — Deriving the kernel. Work formally first: suppose solves the equation, and let be the transform in .
- Show (formally) , hence , and recognize (Exercise 14.4). This motivates the definition of ; everything is now proved directly, for (bounded continuous) or .
Part II — Verification.
- Show that for , is well defined for , and that is in on (differentiate under the integral; dominate Gaussian derivatives locally uniformly in ).
- Verify by direct computation, and deduce for .
- (Initial condition) Show that for , as , uniformly on compacts (approximate identity: split , ); for (), show .
- (Instant smoothing) Conclude: even for merely bounded continuous , the solution is for every — heat instantly erases roughness. Compute explicitly for (an error function) and sketch its profile for three values of .
Part III — Structural properties.
- (Positivity and comparison) If then for all (strictly, unless a.e.); if then . A cold spot warms instantly: comment.
- (Conservation) For : for all (Tonelli) — total heat is conserved.
- (Dissipation) For , show via Plancherel that is nonincreasing, strictly unless , and compute its limit as . Show moreover : heat spreads and dies.
- (Uniqueness, class) Let be a solution with for all , in the natural sense and in as ; admitting that the transform converts it to pointwise a.e. in for a.e. (justified by testing against in — outline this), show , hence uniqueness in this class.
Part IV — The arrow of time.
- Show that the backward problem is ill-posed: for the solution to exist at time () with data at time — i.e. for to have a solution — it is necessary that : an extreme decay condition on . Exhibit an explicit smooth for which no backward solution exists on any time interval: take the function with — identify (Exercise 14.1) and show for every .
- (Smoothing vs. information) Explain in a short paragraph, using questions 5, 9 and 10, why the heat semigroup is injective but not surjective on , and why this expresses the irreversibility of diffusion.
Part V — Shannon’s sampling theorem. A function is band-limited to if a.e. outside ; write (Paley–Wiener space) for these.
- Show that every agrees a.e. with the function (justify smoothness and the identification), with all derivatives bounded: band limitation is an extreme form of regularity. From now on denotes this representative.
Expand in the Fourier basis of that interval and identify the coefficients as samples of :
Deduce the sampling theorem: for ,
with convergence in and uniformly on (inject the series of question 13 into the inversion formula and compute the elementary integral): a band-limited signal is entirely determined by its values on a grid of step — the Nyquist rate.
- Show that the functions , , form an orthogonal family in with constant norm , and deduce the energy identity .
- (Aliasing) Exhibit a nonzero vanishing at every sample point (consider and check its band): sampling below the Nyquist rate loses information — two different signals can share all samples: the stroboscopic wagon-wheel effect, mathematized.
- (Degrees of freedom) Using questions 14–15, justify the engineering rule: a signal band-limited to whose energy is essentially carried by a time window of length is described by approximately real samples — make “essentially” precise through the energy identity and the tail .
- (Consistency checks) Verify the sampling theorem by hand on two members of : (a) , whose samples are ; (b) -type narrowband signals — more precisely, show that for with , the -rate series also reconstructs (oversampling is harmless), by embedding .
Part VI — Uncertainty, twice more. Heisenberg’s inequality (Exercise 14.8) bounds how concentrated and can jointly be; here are its all-or-nothing sibling and its exact saturation.
Let with . Show that is the sum of an everywhere-convergent power series:
(expand and justify the interchange by normal convergence): the transform is real-analytic, with infinite radius of convergence at every point.
- Deduce the support dichotomy: a real-analytic function vanishing on a nonempty open interval vanishes identically (the set where all derivatives vanish is open and closed — work out the Taylor argument); conclude that no nonzero has both and compactly supported, and that contains no nonzero compactly supported function — band-limited signals last forever, and time-limited signals leak into all frequencies.
- (Saturation of Heisenberg) On the Gaussian family , compute both concentration factors and verify that the normalized product equals for every — the equality family of Exercise 14.8 in the flesh; explain by a scaling argument why the product must be constant along the family.
- Explain the physical reading (position/momentum densities of a quantum state; in the normalization gives ), and connect across the chapter: instant smoothing (Part II), irreversibility (Part IV), sampling (Part V), Heisenberg and the support dichotomy are five expressions of one law — the behavior of at infinity legislates what may do anywhere.
Part VII — The kernel’s algebra, and one solvable example.
(Semigroup) Prove the Chapman–Kolmogorov identity for (via the convolution theorem and injectivity of the transform on ), and deduce : evolving for time is evolving for , then for . Sharpen the dissipation of question 8: writing , show by Cauchy–Schwarz that
the energy does not merely decrease, it decreases in a log-convex way.
(Where the heat goes) Let , , with . Show that for all
the center of heat never moves, and the variance grows linearly in time — the diffusive scaling , to be reread when Brownian motion appears in Chapter 22. (Compute the first two moments of and use Tonelli on the convolution.)
(The Gaussian, solved end to end) For , establish the closed form
and verify on it, by hand: the equation ; conservation ; the dissipation law (compare its decay with the sup-norm decay of question 8); and the exact variance growth of question 24. At : the peak has dropped to of its initial height while the profile is five times wider — same heat, spread out.
Solution
Solution of Problem 14.1.
1. Transforming the equation in (formally): , an ODE in for each frequency: . Since (Exercise 14.4), the product is the transform of .
2. : well defined. On : each mixed derivative is a polynomial in and times , bounded for by , an integrable dominator independent of in the window (and bounded for ): repeated differentiation under the integral (Theorem 10.15) applies: .
3. With :
(differentiate twice in : , ). By question 2 the derivatives pass under the integral: .
4. . Given a compact and : uniform continuity of on a neighborhood of gives with for , ; the tail contributes -mass beyond , which is as . For : (Minkowski/Jensen as in Theorem 12.9), split the same way using Theorem 12.6(3).
5. Instant smoothing is question 2 ( is for with no smoothness of used). For :
a smoothed step whose transition zone widens like (profiles at : ever flatter ramps through ).
6. The integrand is and the kernel is strictly positive: would force a.e. Monotonicity in is monotonicity of the integral. A spot where on an interval still has there for every : heat propagates at infinite speed (any positivity anywhere is felt everywhere instantly).
7. Tonelli ( is integrable on ): .
8. Plancherel: , nonincreasing in (pointwise), strictly unless a.e. (), with limit as by DCT. And .
9. For , is with derivative — precisely, transfers the equation. Then for a.e. , the absolutely continuous function has derivative in the integrated sense: it is constant, and letting ( in , a.e. along a subsequence): a.e. Two solutions in the class have the same transform: they are equal.
10. with forces , i.e. . Take : then (Exercise 14.1, inversion), a perfectly smooth function; but : for every . The Cauchy profile is never the result of prior diffusion.
11. The heat semigroup multiplies transforms by , which vanishes nowhere: injective — formally, no information is destroyed. But its range consists of functions whose transforms decay like : a tiny, dense-but-proper subspace of (question 10 shows even excellent functions lie outside). Inverting would amplify the frequency by : unbounded, hence unstable against any perturbation. Diffusion is irreversible not because the map forgets, but because its inverse cannot be continuous — an arrow of time made of functional analysis.
12. (Cauchy–Schwarz on a bounded interval), so is defined everywhere, and differentiation under the integral (dominated by on the band) makes it with everywhere. And a.e.: both sides have the same transform, and the transform is injective on (Theorem 14.8 and its extension).
13. The exponentials , , form a Hilbert basis of (Theorem 13.9, rescaled). The coefficient of along the -th one is
by question 12’s formula at : the stated expansion holds in of the band.
14. Insert the expansion into the inversion formula of question 12; the exchange of sum and integral is the continuity of the pairing against (of norm , independent of — whence uniformity):
since .
15. Reading question 14’s computation backwards, the transform of is . Plancherel:
an orthogonal family of constant norm . Taking norms in question 14’s expansion: .
16. vanishes at every grid point (including , by the limit) and is not identically zero. Its band: write ; modulation by shifts the transform by , so is supported in (indeed in the union of two shifted bands): , invisible to -rate sampling — aliasing incarnate.
17. By question 15 the samples carry the energy democratically: . If the signal’s energy outside the time window is , the samples outside the window satisfy (up to boundary terms controlled by the uniform bound of question 12) : truncating the sampling series to the in-window indices reconstructs up to relative error . Hence the time–bandwidth product counts the effective real degrees of freedom of the signal — the rule behind every audio format.
18. (a) has samples : the series reduces to its term, — the theorem reproduces its own kernel. (b) If is supported in , every step of questions 13–14 runs verbatim with the larger band (the expansion of on the bigger interval is still legitimate): sampling faster than one’s own Nyquist rate changes nothing in the reconstruction — oversampling is harmless, and in practice beneficial (faster-decaying reconstruction kernels can then be used).
19. Expand inside the integral; on the series converges normally (), so integration term by term is legitimate:
The bound makes the series converge for every complex ; around any point , regrouping (absolute convergence) gives a power series in : is real-analytic with infinite radius everywhere.
20. Let be real-analytic on (Taylor series converging to near each point) and . is closed (intersection of closed sets); it is open, since at the local Taylor expansion of is the zero series, so vanishes identically near , together with all derivatives. If vanishes on an interval, ; by connectedness of , : . Now if had compact support together with : question 19 makes real-analytic, vanishing outside a compact, hence on intervals: , so a.e. by injectivity — contradiction. Likewise a nonzero cannot be compactly supported (swap the roles of and via inversion): band-limited signals never die, time-limited signals occupy unbounded spectrum.
21. For : and (Gaussian second moment); (Example 14.2) and
Normalized product: , independent of . Scaling explains the constancy: replacing by multiplies by and by : the product is a dilation invariant, and the Gaussians form one dilation orbit.
22. With the position density and the momentum density of a quantum state (physical units insert ), Exercise 14.8 reads : no state is sharp in both observables. Across the chapter, one law wears five suits: heat instantly smooths because annihilates high frequencies (Part II); the flow cannot run backward because restoring them is unbounded (Part IV); a band-limited signal is rigid enough to live on a countable grid (Part V); no function beats Heisenberg’s floor; and no function is compactly supported on both sides of the transform (questions 19–20). What does at infinity governs what may do anywhere.
23. Both and are in with (question 1’s computation), so the convolution theorem gives ; two functions with the same transform agree a.e. (injectivity, via the inversion theorem — here both sides are continuous, so they agree everywhere): . Consequently (associativity of convolution, Tonelli). Log-convexity: let (Plancherel, question 8). For , write
and Cauchy–Schwarz gives : is midpoint-convex, and being continuous (dominated convergence in ), convex; so is . Decay with a convex logarithm: the heat flow cannot lose energy in a burst and then stall.
24. The kernel’s moments: (question 7 with , or directly the Gaussian integral), (odd integrand), and, substituting ,
Substituting in the convolution and noting (each of , is finite for , using ), Fubini and Tonelli apply to the moment integrals below:
which is the first claim; and
the second. Means add, variances add, and the kernel contributes mean and variance : after time the heat has spread over a width of order — distance grows like the square root of time, the signature of diffusion (and of the Brownian paths of Chapter 22).
25. Transform side: , so , which is the transform of (the Gaussian dictionary with ): the closed form. Direct check, with :
both sides computed from . Conservation: for all . Dissipation:
so , nonincreasing with convex logarithm (question 23); the norm decays like , exactly half the exponent of — consistent with and conservation of . Variance: , as question 24 predicts (, ). At : , peak height versus , width scale times the initial one, and throughout: the spot is five times lower, five times wider, and not a calorie is missing.