High School Mathematics · Grades 10–12
17Descriptive Statistics
Statistics compresses a list of numbers into a few meaningful summaries: where the data sits (mean, median), and how spread out it is (quartiles, variance, standard deviation). This chapter works everything out on one running example. The same summaries reappear for random variables in Chapter 18, and their probabilistic laws in Chapter 34.
Throughout the chapter, our running dataset is the marks (out of ) of a class of students:
17.1 Mean and median
Definition 17.1 (Mean)
The mean of the values is
If the value appears with frequency (with ), then .
Definition 17.2 (Median)
A median of a sorted dataset is a value that splits it in half: at least half the values are it, and at least half are it. In practice, sort the values; if is odd, the median is the middle value; if is even, take the midpoint of the two middle values.
Example 17.3
For the running dataset, the sum is , so . The two middle values (th and th of the sorted list) are both , so the median is too. Mean and median need not coincide: the median ignores how far the extreme values are, the mean does not. Replacing the top mark by moves the mean to but leaves the median at .
17.2 Quartiles
Definition 17.4 (Quartiles, interquartile range)
The first quartile is the smallest value such that at least a quarter of the data is ; the third quartile is the smallest value such that at least three quarters of the data is . The interquartile range is : the width of the central half of the data.
Example 17.5
: a quarter is , so is the rd sorted value: . Three quarters is , so is the th value: . The interquartile range is : the central half of the class sits within marks.
17.3 Variance and standard deviation
Definition 17.6 (Variance, standard deviation)
The variance of the dataset is the mean of the squared deviations from the mean:
and the standard deviation is , expressed in the same unit as the data.
Proposition 17.7 (Shortcut formula)
The variance is the mean of the squares minus the square of the mean:
Proof. Expand each squared deviation: . Summing and dividing by :
The same identity, for random variables, is Proposition 18.13. ∎
Example 17.8
For the running dataset, the deviations from are , , , , , , , , , , , ; their squares sum to
Hence
Roughly speaking, a typical mark sits about marks away from the mean.
Proposition 17.9 (Change of units)
If every value is transformed by , then
Proof. . Then : each deviation is scaled by (the shift cancels), so each squared deviation is scaled by , and so is their mean. Taking square roots gives . ∎
Example 17.10
Temperatures recorded in degrees Celsius with mean and standard deviation convert to Fahrenheit by : the mean becomes , the standard deviation . Shifting a dataset does not change its spread; rescaling it rescales the spread.
Method 17.11 (Summarizing and comparing datasets)
To compare two datasets, put side by side: mean (or median) for position, standard deviation (or interquartile range) for spread. The pair (median, interquartile range) is robust to extreme values; the pair (mean, standard deviation) uses every value and feeds probability theory.
Example 17.12
Two archers each shoot arrows; scores average for both, but the standard deviations are and . Same level on average — but the first archer is far more consistent.
17.4 Exercises
Exercise 17.1 ★
Compute the mean, median, quartiles and interquartile range of the dataset
Solution
Solution of Exercise 17.1.
, sum : mean . Median: midpoint of the th and th values, . Quartiles: a quarter of is , so is the nd value, ; three quarters is , so is the th value, . Interquartile range: .
Exercise 17.2 ★
Compute the variance and standard deviation of the dataset (mean first, then the shortcut formula of Proposition 17.7).
Solution
Solution of Exercise 17.2.
Sum , so . Sum of squares: . By the shortcut formula,
Exercise 17.3 ★
A die is rolled times; the outcomes are summarized by frequencies:
| outcome | 1 | 2 | 3 | 4 | 5 | 6 |
|---|---|---|---|---|---|---|
| frequency | 6 | 9 | 8 | 10 | 9 | 8 |
Exercise 17.4 ★★
A class of students has mean mark . A th student joins and scores . What is the new class mean?
Solution
Solution of Exercise 17.4.
The total of the marks is ; with the newcomer, .
Exercise 17.5 ★★
The mean of the dataset is . Find , then compute the standard deviation of the completed dataset.
Solution
Solution of Exercise 17.5.
gives , so . The deviations of from the mean are , with squares summing to : and .
Exercise 17.6 ★
Marks with mean and standard deviation are rescaled by . Give the new mean and the new standard deviation.
Solution
Solution of Exercise 17.6.
By Proposition 17.9 with , : new mean ; new standard deviation .
Exercise 17.7 ★★
Group A ( values) has mean ; group B ( values) has mean . Compute the mean of the values pooled together. Is it the midpoint ? Why not?
Exercise 17.8 ★★
Two production lines fill -kg sugar bags. Samples give: line 1: mean kg, standard deviation kg; line 2: mean kg, standard deviation kg. Which line should be recalibrated first, and why?
Solution
Solution of Exercise 17.8.
Both lines are nearly on target on average ( and kg), but line 2’s standard deviation is three times larger: its bags vary much more, producing far more noticeably under- and over-filled bags. Line 2 should be dealt with first — consistency, not just the mean, is what needs fixing.
Exercise 17.9 ★★
A dataset of values has and . Compute its mean, variance and standard deviation.
Solution
Solution of Exercise 17.9.
; ; .
Exercise 17.10 ★★★
The dataset contains an outlier.
- Compute the mean and median with and without the value .
- Compute the interquartile range with and without .
- Which summaries are robust to the outlier? Conclude with a recommendation.
Solution
Solution of Exercise 17.10.
1. With : sum , mean ; median = midpoint of th and th values . Without : sum , mean ; median (5th of 9 values) .
2. With (): is the rd value (), the th (): interquartile range . Without (): is the rd value (), the th (): still .
3. The single outlier drags the mean from up to but leaves the median and the interquartile range unchanged: those two are robust. When a dataset may contain aberrant values, report the median and interquartile range rather than the mean and standard deviation.
17.5 Problem: The z-score, a universal ruler
Problem 17.1
Weekend problem — standard deviations compare apples with oranges, Chebyshev’s inequality turns into a guarantee, and the mean wins its own medal
Is on a hard exam better than on an easy one? Is a in a list of small numbers an accident or an outlier? Raw numbers cannot say — but divided by the right standard deviation they all speak one language, the z-score. This problem masters the variance machinery (Definition 17.6, Proposition 17.7), builds the universal ruler, and proves the remarkable inequality that turns from a descriptive number into a guarantee.
Part I — Variance mechanics.
- For the dataset : compute the mean, then the variance straight from the definition, then .
- Recompute the variance with the shortcut formula (Proposition 17.7) — mean of squares minus square of mean — and check the agreement.
- With frequencies: marks , , obtained by , , students. Compute mean, variance and (two decimals).
- Temperatures have mean and (degrees Celsius). Give the mean and in Fahrenheit (; Proposition 17.9).
- Prove the two rules just used: adding a constant to every value shifts the mean by and leaves unchanged; multiplying by multiplies the mean by and by .
Part II — The universal ruler. The z-score of a value in a dataset of mean and standard deviation is : the number of standard deviations separating from the mean.
- Exam A has mean and ; exam B has mean and . Alice scored on A, Bob on B. Compute both z-scores: whose performance stands further above the crowd?
- Compute the five z-scores of the dataset of question 1, and verify that they have mean and standard deviation . Explain from question 5 why standardization always produces mean and .
- An aptitude test has mean and . What raw score has ? What is the z-score of ?
- A pediatrician records a baby’s weight as “”. Say what this means, and why growth is tracked in z-scores rather than kilograms as the child ages.
- The outlier of Exercise 17.10 (dataset ): compute the mean, , and the z-score of . The classic alarm threshold is : verdict?
- Recompute without the value , and the z-score that would have against the clean data’s mean and . What did the outlier do to the very ruler meant to measure it, and what does Exercise 17.10 suggest as a countermeasure?
Part III — Chebyshev’s guarantee.
Prove the Bienaymé–Chebyshev inequality for a dataset: if a proportion of the values satisfy , then, keeping only those terms in the variance sum,
- What does the inequality guarantee about the proportion of any dataset beyond of its mean? Beyond ? Check the statement on the dataset of question 1.
- A factory produces bolts with mean mm and mm. What does Chebyshev guarantee about the proportion of bolts outside ? (Real production does far better — the bell curve of grade 12 turns this cautious into a fraction of a percent.)
- Two funds both return per year on average, with for fund A and for fund B. For each fund, what does Chebyshev say about the probability-like proportion of years with returns below ? What is ’s financial name?
Part IV — The mean’s medal, and a warning.
Let be the mean of the squared deviations from an arbitrary center . Prove the identity
and conclude: the mean is the unique minimizer of mean squared deviation — its medal, matching the median’s minimization of absolute deviations in Problem 8.1.
- Verify the identity on the dataset of question 1 with : compute directly and via the formula.
- Same summaries, different data: check that and share the same mean but not the same variance; then construct a dataset of the form with exactly the mean and variance of — yet a shape all its own.
- Prove that forces all values equal. (What must every term of a zero sum of squares be?)
- Finale — the statistician’s ladder, one line per rung: centers (mean, median), spreads (, IQR), the universal ruler (), the guarantee (Chebyshev), and the warning of question 18: summaries compress, and compression loses — with the bell curve of grade 12 waiting to turn z-scores into exact probabilities.
Solution
Solution of Problem 17.1.
1. Mean . Deviations squared: : variance , so .
2. Mean of squares: ; minus : variance . Same answer, half the work.
4. Mean: F; : F — the shift spreads nothing.
5. Adding : every deviation is unchanged, so the variance is. Multiplying by : deviations are multiplied by , their squares by , the variance by , and by .
6. ; . Alice stands further above her crowd: the harder exam’s beats the easier exam’s .
7. -scores: : mean , standard deviation . In general, standardizing subtracts (making the mean , untouched) then divides by (making the new equal to ): question 5 twice.
8. : . And .
9. The baby is standard deviations below the mean weight of babies its age — alarmingly light for its cohort. Raw kilograms cannot be compared across ages (all babies gain weight); z-scores measure each child against its own age group, one ruler for all ages.
10. Mean ; mean of squares , variance , ; : just under the alarm threshold — the test barely blinks.
11. Without : mean , variance , ; against the clean ruler, scores : a monster. The outlier inflated both the mean and , camouflaging itself — which is why Exercise 17.10 recommends robust summaries (median, IQR) when contamination threatens.
12. In the variance sum , keep only the terms with : there are of them, each at least , so : divide by (nonzero spread): .
13. Beyond : at most of any dataset whatsoever; beyond : at most . Question 1’s data: beyond from the mean means or : none of the five values — , as promised.
14. Outside means beyond : at most of production, whatever the shape of the distribution — Chebyshev asks nothing but a mean and a . Bell-shaped production concentrates far better (about beyond ): the normal law, grade 12.
15. sits points below the mean . Fund B: : Chebyshev allows up to of years that bad. Fund A: : at most . Same average, incomparable dangers — is what finance calls risk (or volatility).
16. Expand around : . Averaging: the middle term dies (deviations from the mean sum to zero), leaving — minimal exactly at , with minimum . The mean is the least-squares center, as the median is the least-absolute center (Problem 8.1).
17. Directly: deviations from are , squares : . Formula: . Agreement.
18. Both have mean ; variances: : ; : : different spreads behind one mean. For : variance gives : the dataset carries the exact mean and variance of with a completely different profile — summaries compress, and compression loses.
19. means a sum of squares vanishes; squares are , so a zero sum forces every term to be zero: for all — all values equal.
20. Centers say where the data lives; spreads say how loosely; the z-score lays one ruler across all datasets, exams, ages and currencies; Chebyshev converts into an unconditional guarantee; and question 18 keeps us honest — no handful of numbers ever contains the whole story. Next year the bell curve sharpens the ruler into exact probabilities.