FS1 1.1 - Mean and variance of discrete distributions
A probability distribution tells you how often each value occurs; expectation and variance turn that information into a centre and a measure of spread. You will calculate both, find expectations of transformed values, work with linear coding, and use the results to judge whether a model describes the situation sensibly.
Expectation as a probability-weighted mean
A game pays the square of your score. Can you predict the average prize just by squaring the average score?
Start with a score taking values , with probabilities . In a long run of independent plays under this model, the middle score occurs about twice as often as either extreme. A simple average of the three distinct values would ignore that unequal weighting.
You already know
From A-level Mathematics, a discrete random variable has separate possible values and an associated probability distribution. Each probability is between and , inclusive, and the probabilities over all possible values sum to . Check these conditions before treating a table as a distribution.
Multiply each outcome by its probability, then add. This is the probability version of dividing a frequency-weighted total by the total frequency.
Expectation
The expectation, or mean, of is its probability-weighted average, denoted . It describes the long-run average under the model, not a guaranteed result on the next trial. It need not be one of the possible values of .
The probabilities already add to one, so do not divide the resulting weighted sum by the number of outcomes again.
Mean of a discrete distribution
If takes values with probabilities , then
Sum over every possible value, using a valid probability distribution. For infinitely many possible values, the expectation must exist; all tables in this lesson are finite. In the formula booklet.
Negative outcomes contribute negative terms, while an outcome of zero contributes zero.
Worked example 1: unequal probability weights
Question. Find for the distribution below.
Plan. Check the probabilities, then add the outcome-probability products.
Why this step? Each probability represents the proportion of trials contributing that score to the long-run total.
Answer. .
Check. The distribution is symmetric about : scores two units either side have equal probability, so is a sensible balance point.
Worked example 2 changes only the highest score, from to . Its probability stays fixed, so you can predict which way the mean moves.
Worked example 2: the mean need not be attainable
Question. Find the mean for scores with respective probabilities .
Plan. Keep the same weights and update the final weighted term.
Why this step? Increasing one score by , with probability , increases the mean by .
Answer. , even though the score can never equal .
Check. The mean lies between the smallest and largest possible values, and , and is half a unit above the previous mean.
Expectation is a balance point, not another outcome to add to the table.
Watch out
Wrong: divide by the number of listed values. Right: the probabilities already supply normalised weights, so the sum itself is the mean.
Change the highest score once more in your turn.
Variance measures squared spread
The mean alone cannot tell you whether scores cluster tightly or vary widely, so measure their squared distances from the mean.
The average signed deviation is always zero: . Squaring before averaging prevents positive and negative deviations cancelling. The result is the variance ; its non-negative square root is the standard deviation.
Variance of a discrete distribution
For a valid distribution with finite second moment,
where and . In the formula booklet.
The shortcut follows by expanding the square: . Variance is non-negative, and is zero exactly when the variable is constant with probability one. Its units are the square of the variable's units; standard deviation returns to the original units. Use ; this square-root relation is not printed as a separate formula in the booklet, so learn it.
Worked example 3: calculate the second moment first
Question. Find the variance of scores , with probabilities .
Plan. Use the mean , calculate the weighted squares, then subtract the square of the mean.
Why this step? and are different quantities: the square goes inside the weighted sum in the first one.
Answer. , so the standard deviation is .
Check. Using squared deviations directly gives .
Worked example 4 changes only the highest score to , as in the earlier mean calculation. Recalculate both moments; the old mean no longer applies.
Worked example 4: both moments change
Question. Find the variance of scores , with probabilities .
Plan. Use the new mean and calculate the new second moment exactly.
Why this step? A wider upper tail changes the centre as well as the spread, so holding the old mean fixed would not calculate variance.
Answer. .
Check. Direct squared deviations give .
Keep exact fractions or full calculator precision until the final answer. A rounded mean gets squared, which can magnify an early rounding error.
Watch out
Wrong: . Right: subtract . A negative variance is a warning to check the arithmetic, probabilities and brackets.
Use a new set of scores for the next calculation.
Expectations and variances of transformed values
To average a function of a random value, apply the function to each possible outcome before taking the probability-weighted mean.
The outcome probabilities do not get squared when the outcomes do. If different original outcomes give the same transformed value, add their probabilities when writing the new distribution.
Expectation of a function
For a valid discrete distribution and a real-valued function , provided the expectation exists,
If has a finite second moment, calculate its variance as . This uses the supplied expectation and variance formulae. In the formula booklet.
For , this means . The required fourth power comes from squaring the transformed variable, not from an extra rule to memorise.
Worked example 5: a square can merge outcomes
Question. For scores with probabilities , let . Find and .
Plan. Form the transformed values, merge repeated outcomes, then apply the usual moment formulae.
Why this step? Both and produce , so its probability is .
Answer. and .
Check. Directly from , , matching .
Continue this lesson.
You’re previewing NovaLearn without an account. Create a free account to read the rest.
Create free account