FS2 6.1 - Testing and estimating a normal variance

FS2 6.1 - Testing and estimating a normal variance

A process can keep its average while becoming much less consistent. You will test a normal population variance with a chi-squared statistic, find critical regions and construct confidence intervals for variance, keeping standard deviations and squared units distinct.

A sampling distribution for spread

If a sample estimates a variance as 9 mm29\,\mathrm{mm^2}, why might a confidence interval extend much further above 99 than below it?

Variance cannot be negative, and its sampling distribution is not symmetric. For the sample of 1111 measurements used later, a 95%95\% interval will be approximately (4.39,27.7) mm2(4.39,27.7)\,\mathrm{mm^2}. Its unequal margins are part of the method, not an arithmetic accident.

You already know

The unbiased sample variance is s2=∑(xi−xˉ)2/(n−1)s^2=\sum(x_i-\bar x)^2/(n-1). A confidence-interval rule has a repeated-sampling coverage rate; after observing the data, its endpoints are fixed. Neither unbiased estimation nor confidence makes the unknown parameter random.

Write S2S^2 for the random variance estimator and s2s^2 for its observed value. We require independent observations from the same normal population. A large sample alone does not turn the following exact normal-population result into an assumption-free procedure.

Sampling distribution of a normal sample variance

For a random sample X1,…,XnX_1,\ldots,X_n from N(μ,σ2)\mathrm{N}(\mu,\sigma^2), with n≥2n\ge2 and σ2>0\sigma^2>0,

S2=∑(Xi−Xˉ)2n−1,(n−1)S2σ2∼χn−12S^2=\frac{\sum(X_i-\bar X)^2}{n-1}, \qquad \frac{(n-1)S^2}{\sigma^2}\sim\chi^2_{n-1}

Here χν2\chi^2_\nu denotes the chi-squared distribution with ν\nu degrees of freedom. Both the estimator and this sampling distribution are supplied. In the formula booklet.

The n−1n-1 degrees of freedom match estimating the population mean from the sample: the deviations from Xˉ\bar X sum to zero. Use this stated result; no density formula or proof is needed. We are not assuming that the population mean is known.

The booklet's chi-squared table gives a value cc for which P(Q>c)P(Q>c) equals the column heading. Thus, for Q∼χ102Q\sim\chi^2_{10}, the 0.0500.050 column gives 18.30718.307, but the lower 5%5\% cutoff is 3.9403.940, from column 0.9500.950. The curve is positive and skewed; the lower cutoff is not the negative of the upper one.

Key idea

Under a proposed variance, unusually large sample spread gives a large chi-squared statistic; unusually small spread gives a small positive statistic.

Check the assumptions before treating an observed variance as evidence.

Testing for increased or reduced variation

State hypotheses about the population variance σ2\sigma^2, not the sample estimate s2s^2. Under H0:σ2=σ02H_0:\sigma^2=\sigma_0^2, substitute the null variance in the denominator.

A one-sample variance test statistic

For a random sample of size nn from a normal population, under H0:σ2=σ02H_0:\sigma^2=\sigma_0^2,

Q=(n−1)S2σ02∼χn−12Q=\frac{(n-1)S^2}{\sigma_0^2}\sim\chi^2_{n-1}

For H1:σ2>σ02H_1:\sigma^2>\sigma_0^2, reject in the upper tail. For H1:σ2<σ02H_1:\sigma^2<\sigma_0^2, reject in the lower tail. This is the supplied sampling-distribution result evaluated under the null hypothesis. In the formula booklet.

A claim about a standard deviation must first be squared. A stated standard deviation of 2 mm2\,\mathrm{mm} means the null variance is 4 mm24\,\mathrm{mm^2}.

Worked example 1: has the variance increased?

Question. A normal production process previously had standard deviation 2 mm2\,\mathrm{mm}. A random sample of 1111 independent measurements gives unbiased sample variance 9 mm29\,\mathrm{mm^2}. Test at 5%5\% for increased population variance.

Plan. Form the null-scaled statistic and use an upper-tail cutoff with 1010 degrees of freedom.

H0:σ2=4,H1:σ2>4q=10(9)22=22.5square the null standard deviationc=18.307χ102, upper probability 0.05022.5>18.307in the upper critical region\begin{aligned} H_0&:\sigma^2=4,\qquad H_1:\sigma^2>4\\ q&=\frac{10(9)}{2^2}=22.5 &&\text{square the null standard deviation}\\ c&=18.307 &&\chi^2_{10},\text{ upper probability }0.050\\ 22.5&>18.307 &&\text{in the upper critical region} \end{aligned}

Why this step? Increased variance produces larger values of the sample spread and therefore of QQ.

Answer. Reject H0H_0. There is sufficient evidence at 5%5\% that the population variance of the process measurements has increased.

Check. The upper-tail p-value is about 0.01280.0128, below 0.050.05, agreeing with the critical-value decision.

Worked example 2 changes only the pre-specified question to whether the population variance has decreased. This is a different investigation, not a change of direction chosen after seeing the sample.

Worked example 2: a lower-tail question

Question. Test for decreased population variance at 5%5\%, retaining the same sample and normal-population assumption.

Plan. Keep the statistic but select the lower tail.

H0:σ2=4,H1:σ2<4q=10(9)4=22.5c=3.940P(Q>3.940)=0.95022.5>3.940outside the lower critical region\begin{aligned} H_0&:\sigma^2=4,\qquad H_1:\sigma^2<4\\ q&=\frac{10(9)}4=22.5\\ c&=3.940 &&P(Q>3.940)=0.950\\ 22.5&>3.940 &&\text{outside the lower critical region} \end{aligned}

Why this step? A reduction requires unusually small spread. A large statistic cannot support that directional claim.

Answer. Do not reject H0H_0. There is insufficient evidence at 5%5\% of reduced population variance.

Check. The lower-tail p-value is about 0.9870.987; this observation is far from the lower rejection tail.

If asked for the critical region in S2S^2, rearrange the statistic inequality. For example, the upper 5%5\% test above rejects when

10S24>18.307⟺S2>7.3228 mm2\frac{10S^2}{4}>18.307 \quad\Longleftrightarrow\quad S^2>7.3228\,\mathrm{mm^2}

This is a rule for future sample variances under a fixed null value, rather than a confidence interval for σ2\sigma^2.

Watch out

Wrong: divide by the null standard deviation 22, or use column 0.0500.050 for a lower 5%5\% tail. Right: divide by 22=42^2=4; the lower cutoff uses upper probability 0.9500.950.

Change only the observed sample variance from Worked example 2.

Detecting a change in either direction

A two-tailed variance test must allow both unusually small and unusually large spread. Split the significance level equally between the tails, using their own positive chi-squared cutoffs.

At 5%5\% with 1010 degrees of freedom, the lower and upper cutoffs are 3.2473.247 and 20.48320.483. The table headings are 0.9750.975 and 0.0250.025, because they describe the area to the right of each value.

Worked example 3: a two-tailed test from summaries

Question. A random sample of 1111 independent measurements from a normal process gives

∑x=110,∑x2=1190\sum x=110,\qquad\sum x^2=1190

where measurements are in millimetres. Test at 5%5\% whether the population variance differs from 4 mm24\,\mathrm{mm^2}.

Plan. Recover the unbiased sample variance, then compare the null-scaled statistic with both 2.5%2.5\% tail cutoffs.

H0:σ2=4,H1:σ2≠4s2=1190−1102/1110=9divide the centred total by n−1q=10(9)4=22.5critical region: Q<3.247 or Q>20.4832.5% in each tail22.5>20.483\begin{aligned} H_0&:\sigma^2=4,\qquad H_1:\sigma^2\ne4\\ s^2&=\frac{1190-110^2/11}{10}=9 &&\text{divide the centred total by }n-1\\ q&=\frac{10(9)}4=22.5\\ \text{critical region: }&Q<3.247\text{ or }Q>20.483 &&2.5\%\text{ in each tail}\\ 22.5&>20.483 \end{aligned}

Why this step? The alternative permits either direction, so the upper 5%5\% cutoff alone would assign the wrong total significance level.

Answer. Reject H0H_0. There is sufficient evidence at 5%5\% that the population variance of the process measurements differs from 4 mm24\,\mathrm{mm^2}.

Check. The same critical region in sample-variance units is S2<1.2988S^2<1.2988 or S2>8.1932S^2>8.1932, in mm2\mathrm{mm^2}. The observed 99 reaches the upper region.

Continue this lesson.

You’re previewing NovaLearn without an account. Create a free account to read the rest.

Create free account