5.1 - Mean and standard deviation
Two datasets can have the same centre but very different spreads, and one unusual observation can change some summaries far more than others. In this part of 5.1, you will choose and calculate measures of location and spread, find means and standard deviations from frequencies, and work with coded or combined totals. You will also see exactly what is estimated when observations have been grouped into intervals.
Location and spread
Can changing just one of nine observations make the mean increase by , while the median stays fixed? Comparing two short lists will show both why that happens and why a single “average” can be misleading.
A measure of location describes the centre or a representative value. The mean uses every value, the median uses order, and the mode uses frequency.
Mean, median and mode
The mean is the total of the observations divided by their number. The median is the middle ordered observation, or the mean of the two middle observations for an even count. A mode is a most frequent value: a dataset can have more than one mode, or no single most frequent value.
Spread describes how far observations extend or vary. The range is maximum minus minimum. The interquartile range, or IQR, is upper quartile minus lower quartile and describes the middle half. Find the raw-data quartiles as the medians of the lower and upper halves, leaving out the overall median when the total count is odd. The standard deviation measures spread about the mean, using every observation; its calculation comes in the next part.
Worked example 1: a balanced dataset
Question. Find the mean, median, mode, range and interquartile range of
Plan. Add for the mean, use the ordered middle for the median, count repeats for the mode, and subtract extremes or quartiles for spread.
The sum is , so the mean is . The fifth observation is , giving the median. The mode is , occurring three times.
For quartiles, exclude the middle . The lower half has median . The upper half has median .
Answer. Mean , median , mode , range , IQR .
Check. Values balance around : the distances below it are , matching the distances above it . This agrees with mean .
Change only the final value from to . Its position in the order is unchanged, but its contribution to the total is much larger.
Worked example 2: one extreme observation
Question. Find the same five summaries for
and explain which centre and spread best describe the main cluster.
Plan. Update the sum and maximum, then check whether the median, mode and quartile positions change.
The sum increases by , giving . Thus the mean is . The fifth observation and most frequent value are still . The lower-half median is still , and the upper half still has median .
Answer. Mean , median , mode , range , IQR . The median and IQR describe the central cluster more faithfully here: the isolated pulls up the mean and greatly increases the range.
Check. A total increase of over nine observations must increase the mean by , exactly the change from to . The unchanged middle positions confirm the median and quartiles.
An outlier is an observation unusually far from the main body of data; no numerical outlier rule is needed to see the isolated here. Mean and standard deviation use every value, so both respond to extreme observations. Median and IQR are less sensitive to extremes and often suit skewed data. For a roughly symmetric distribution without isolated extremes, mean and standard deviation are often useful summaries. A long upper tail often pulls the mean above the median, but the ordering of two summaries alone does not prove a particular shape.
A mode is useful for the most common category or value, but it may conceal much of a numerical distribution. Whichever summaries you choose, compare location and spread separately and interpret them in context. For example, a smaller SD of journey times means less variation, not necessarily shorter journeys.
Watch out
Equal means do not imply equal spreads. The datasets and both have mean , but the second is more spread out. A statement about consistency needs a spread measure.
Choose summaries that resist an isolated extreme observation.
Raw and grouped data
The deviations from a mean add to zero, so simply averaging signed deviations cannot measure spread. Square them first, average the squares, then take a square root to return to the original units.
Variance and standard deviation of a dataset
For observations with mean , the variance is the mean squared deviation . The standard deviation is its non-negative square root. Variance has squared units; standard deviation has the same units as the data. The standard deviation is zero exactly when all observations are equal.
Here you are describing the given set of data, so the divisor is . On a calculator, choose the descriptive or population SD result, often labelled , rather than the sample-estimate result often labelled . The divisor used for an unbiased estimate of a wider population variance is a different task, studied later.
Mean and descriptive standard deviation
For raw data,
If value occurs with frequency , put :
In the formula booklet, including the equivalent squared-deviation form for frequency data.
The shortcut follows by expanding the squares:
because . Divide by and take the square root. Notice that means “square each value, then add”; it does not mean .
Worked example 3: an exact frequency table
Question. A discrete variable has the following frequencies. Find its mean and standard deviation.
| Total |
Plan. Calculate the weighted totals, then use mean of squares minus square of mean.
Answer. Mean ; standard deviation .
Check. Direct squared deviations give . The independent definition agrees with the shortcut.
Now change only the information about : instead of exact values , suppose the table gives intervals centred at those values. The calculations look identical, but their status changes from exact to estimated.
Continue this lesson.
You’re previewing NovaLearn without an account. Create a free account to read the rest.
Create free account