5.07f - Normal approximations for Wilcoxon tests

5.07f - Normal approximations for Wilcoxon tests

Large rank sums can be tested using a normal approximation rather than a small-sample table. In 5.07f you will choose the correct signed-rank or rank-sum distribution, apply a continuity correction, and make one-sided or two-sided decisions without confusing a raw rank sum with a folded statistic.

Which rank sum is approximately normal?

With 3030 signed ranks, the positive ranks sum to 330330. Is that unusually large, or simply a large number because there are many ranks? The total available is 1+⋯+30=4651+\cdots+30=465; under the null, the expected positive share is half, 232.5232.5. You need its spread before judging the evidence.

You already know

Write a normal distribution as N(μ,σ2)\mathrm{N}(\mu,\sigma^2), with variance second. A signed-rank test uses absolute differences and their signs; a rank-sum test uses one independent sample's positions in a pooled ranking. Small-sample tables use the smaller of two reflected sums.

For signed ranks, under a continuous symmetric null population, each rank is equally likely to receive a positive or negative sign. The positive sum is therefore a sum of independent contributions: rank rr contributes either 00 or rr, each with probability 1/21/2. Many contributions produce a roughly bell-shaped distribution. The normal approximation concerns W+W^+ or W−W^- separately.

The minimum T=min⁡(W+,W−)T=\min(W^+,W^-) cannot exceed half the total. Its distribution is folded and is not the normal distribution printed in the booklet. Similarly, for independent samples the normal approximation applies to the raw rank sum RmR_m, not to the folded small-sample-table statistic WW.

Raw and folded rank sums

A raw rank sum retains which sign group or sample it belongs to: W+W^+, W−W^- or RmR_m. A folded statistic takes the smaller of a sum and its reflection. The booklet's large-sample normal approximations describe the raw sums; the table headings TT and WW must not obscure that distinction.

The large-sample approximation keeps the original sampling assumptions. Signed-rank observations, or paired differences, must be independent and continuous with a symmetric population distribution. For rank-sum tests, the two random samples must be independent, with identical continuous population distributions under the null. There are no zero signed differences or tied ranks in the calculations here.

Use the signed-rank approximation for sufficiently large nn; the supplied exact table runs to n=20n=20. For the rank-sum approximation both sample sizes must be sufficiently large. One large group does not by itself justify approximating a tiny group's rank-sum distribution. There is no single universal sample-size cut-off that replaces checking the model and the question's stated conditions.

Key idea

Normal approximations use the distribution of a specified raw rank sum under the null, with the same design assumptions as the exact test and a continuity correction for integer ranks.

The error below occurs before any standardisation. A correct variance cannot repair the wrong random variable.

A normal approximation for signed ranks

Use the observed positive rank sum and choose its tail from the median alternative. An integer sum includes a whole unit-wide interval in the continuous approximation.

Under the null, rank rr's mean contribution is r/2r/2 and its variance is r2/4r^2/4. Adding these contributions explains the supplied mean and variance: half the rank total is the mean, and a quarter of the sum of squared ranks is the variance.

Signed-rank normal approximation

For sufficiently large nn, with independent non-zero differences from a continuous symmetric population and no tied absolute differences, under the zero-centre null,

W+≈N(n(n+1)4,n(n+1)(2n+1)24)W^+\approx\mathrm{N}\left( \frac{n(n+1)}4, \frac{n(n+1)(2n+1)}{24} \right)

The same approximation applies to W−W^- separately. For a one-sample test, differences are taken from the hypothetical median; for paired data, they are the defined within-pair differences.

In the formula booklet.

The continuity correction follows the event. For an integer statistic SS, the event S≥sS\ge s becomes Y>s−0.5Y>s-0.5; S≤sS\le s becomes Y<s+0.5Y<s+0.5, where YY is the continuous approximation. Strict inequalities first become their equivalent inclusive integer events: S>sS>s means S≥s+1S\ge s+1, hence boundary s+0.5s+0.5. This event rule is not printed in the booklet: learn it.

[DIAGRAM: asset_name: A rank sum includes its whole unit interval; asset_slug: h245_5_07_continuity_correction; caption: An upper-tail event from 330 starts at 329.5 in the normal approximation; description: A normal curve with mean 232.5 and standard deviation about 48.62 has the area to the right of 329.5 shaded blue. An enlarged integer strip below shows blocks for rank sums 328 through 332, with the block centred at 330 spanning 329.5 to 330.5 and a vertical dashed boundary at 329.5.]
An upper-tail event from 330 starts at 329.5 in the normal approximation

The boundary lies half a unit before the first included integer. It is chosen from the event, not from whether the observed sum happens to lie above or below its mean.

Worked example 1: a large positive rank sum

Question. A random independent sample of 3030 observations comes from a continuous symmetric population with median mm. Signed ranks relative to 5050 give W+=330W^+=330. Use a normal approximation to test H0:m=50\mathrm{H}_0:m=50 against H1:m>50\mathrm{H}_1:m>50 at 5%5\%. There are no zero differences or tied absolute differences.

Plan. Model W+W^+ under the null and calculate its continuity-corrected upper-tail probability.

μ=30(31)4=232.5null meanσ2=30(31)(61)24=2363.75null variancep=P(W+≥330)large positive sum supports H1≈P(Z>329.5−232.52363.75)continuity correction=P(Z>1.995128…)=0.023014…Z∼N(0,1)\begin{aligned} \mu&=\frac{30(31)}4=232.5 &&\text{null mean}\\ \sigma^2&=\frac{30(31)(61)}{24}=2363.75 &&\text{null variance}\\ p&=\mathrm{P}(W^+\ge330) &&\text{large positive sum supports }\mathrm{H}_1\\ &\approx\mathrm{P}\left(Z>\frac{329.5-232.5}{\sqrt{2363.75}}\right) &&\text{continuity correction}\\ &=\mathrm{P}(Z>1.995128\ldots)=0.023014\ldots &&Z\sim\mathrm{N}(0,1) \end{aligned}

Why this step? The event includes the observed integer 330330. Its normal area begins at 329.5329.5, not 330.5330.5.

Answer. Since 0.0230<0.050.0230<0.05, reject H0\mathrm{H}_0. There is significant evidence that the population median exceeds 5050.

Check. W−=465−330=135W^-=465-330=135; the positive sum is the larger one, consistent with the direction of the alternative.

Worked example 2 reflects the evidence: the alternative is now a smaller median and the positive rank sum is 135135. The corrected lower tail should give the same probability.

Worked example 2: the corresponding lower tail

Question. Under the same sampling assumptions, a second sample of 3030 observations gives W+=135W^+=135. Test H0:m=50\mathrm{H}_0:m=50 against H1:m<50\mathrm{H}_1:m<50 at 5%5\%.

Plan. Use the same null mean and variance, but include the observed integer in a lower-tail event.

p=P(W+≤135)small positive sum supports H1≈P(Z<135.5−232.52363.75)include the whole 135 interval=P(Z<−1.995128…)=0.023014…normal lower tailp<0.05reject the null\begin{aligned} p&=\mathrm{P}(W^+\le135) &&\text{small positive sum supports }\mathrm{H}_1\\ &\approx\mathrm{P}\left(Z<\frac{135.5-232.5}{\sqrt{2363.75}}\right) &&\text{include the whole }135\text{ interval}\\ &=\mathrm{P}(Z<-1.995128\ldots)=0.023014\ldots &&\text{normal lower tail}\\ p&<0.05 &&\text{reject the null} \end{aligned}

Why this step? A lower-tail event through 135135 ends at 135.5135.5. Adding half a unit here includes the observed outcome rather than making an arbitrary adjustment towards the mean.

Answer. There is significant evidence that the population median is less than 5050.

Check. 135.5−232.5=−(329.5−232.5)135.5-232.5=-(329.5-232.5), so the two examples have equal normal-tail probabilities.

Both examples answer the opening question: 330330 is roughly two null standard deviations above the expected positive sum, with one-sided approximate probability 0.02300.0230.

Watch out

Wrong: divide by 2363.752363.75 when standardising. Right: divide by 2363.75\sqrt{2363.75}, because the second parameter of N(μ,σ2)\mathrm{N}(\mu,\sigma^2) is a variance, not a standard deviation.

Use the same event-first reasoning with a different sample size and supplied hypotheses.

A normal approximation for independent rank sums

For two independent groups, approximate the raw sum of the smaller sample's pooled ranks. There is no subtraction of paired measurements and no signed-rank sample size.

Let the sample sizes be m≤nm\le n. Under identical continuous population distributions, each of the mm observations has expected pooled rank (m+n+1)/2(m+n+1)/2. Multiplying by mm gives the null rank-sum mean. The ranks are sampled without replacement, so the supplied variance accounts for their dependence; treating the ranks as independent uniform draws would give a different variance.

Continue this lesson.

You’re previewing NovaLearn without an account. Create a free account to read the rest.

Create free account