DF5 - Mixed strategies

DF5 - Mixed strategies

A game without a saddle point can reward a player who randomises their choices. You will turn probabilities into expected pay-offs, find optimal two-by-two mixtures, and use lower and upper envelopes for larger games with two strategies on one side. You will also recognise pure boundary solutions, tied optima and cases where equalising two expressions is not enough.

Expected pay-offs from random choices

Can randomising turn a worst-case loss of 2 into a guaranteed expected pay-off of zero? Consider the row-player matrix

XYA4−2B−21.\begin{array}{c|rr} &X&Y\\\hline A&4&-2\\ B&-2&1 \end{array}.

Both row minima are −2-2. Always choosing A or always choosing B therefore lets the opponent impose a loss of 2. Randomisation can conceal which row will be chosen on a particular play.

Mixed strategy

A mixed strategy assigns a nonnegative probability to each pure strategy, with probabilities summing to 1. For two rows, write P(A)=pP(A)=p, P(B)=1−pP(B)=1-p, where 0≤p≤10\leq p\leq1. A pure strategy is the boundary case p=0p=0 or p=1p=1.

The opponent may know your probabilities but does not observe your realised choice before choosing. Choices are made independently for that play. “Play A every third turn” is predictable; choosing A randomly with probability 1/31/3 is a different rule.

For pay-offs a,ba,b with probabilities p,1−pp,1-p, expectation is pa+(1−p)bpa+(1-p)b. If the opponent chooses X, our matrix gives 4p−2(1−p)=6p−24p-2(1-p)=6p-2; against Y it gives −2p+(1−p)=1−3p-2p+(1-p)=1-3p. These are straight lines in pp.

Worked example 1: a proposed row mixture

Question. For the displayed matrix, find the expected pay-off against each pure column if the row player chooses A with probability 1/21/2. State the worst expected pay-off.

Plan. Weight each column's two entries by the row probabilities, then take the smaller result.

EX=12(4)+12(−2)=1,EY=12(−2)+12(1)=−12.E_X=\tfrac12(4)+\tfrac12(-2)=1,\qquad E_Y=\tfrac12(-2)+\tfrac12(1)=-\tfrac12.

Answer. The row player guarantees expected pay-off −1/2-1/2, since the opponent can choose Y. This improves the pure-strategy guarantee −2-2, but is not yet proved optimal.

Check. Each result lies between its two possible pay-offs. The opponent's mixture gives a weighted average of 1 and −1/2-1/2, so cannot reduce expectation below −1/2-1/2.

Keep the row mixture fixed and change only the opponent's choice from a pure column to a mixture. This distinguishes an expectation against one opponent from a guarantee against all opponents.

Worked example 2: both players randomise

Question. For the same matrix, the row player uses P(A)=1/2P(A)=1/2, and the column player uses P(X)=2/3P(X)=2/3. Find the expected pay-off. Does it replace the guarantee found above?

Plan. Average the two conditional column expectations using the column probabilities.

E=23(1)+13(−12)=12.E=\tfrac23(1)+\tfrac13(-\tfrac12)=\tfrac12.

Answer. Against this particular mixture the expected pay-off is 1/21/2. The row player's guarantee remains −1/2-1/2, because Y alone is still available to the opponent.

Check. The four joint probabilities are 1/3,1/6,1/3,1/61/3,1/6,1/3,1/6, in row order. Directly summing gives 4/3−2/6−2/3+1/6=1/24/3-2/6-2/3+1/6=1/2, agreeing with the conditional calculation.

A guarantee of zero expectation does not promise zero on every play or an exactly balanced finite sequence. Individual gains still fluctuate; optimality here concerns expected pay-off against the opponent's choices.

Watch out

Use probabilities, not the ratio of the two pay-offs. Against each opposing pure strategy, calculate a separate expectation. A favourable expectation against one chosen mixture is not a worst-case guarantee.

Calculate new column expectations.

Optimal two-by-two mixtures

The row player maximises the smaller of the two column expectation lines. In an interior optimum for a genuine two-by-two mixed game, the lines meet: if the binding line can still be raised without the other becoming smaller, the guarantee was not maximal. Check the endpoints as well; the intersection must lie in [0,1][0,1] and actually maximise the lower envelope.

To find the column player's mixture, write P(X)=qP(X)=q, P(Y)=1−qP(Y)=1-q. Equalise the row expectations when both rows are used in an interior optimal mixture. This prevents the row player improving by switching to a different pure row.

Worked example 3: answering the opening question

Question. Find both optimal mixtures and the value for (4−2−21)\begin{pmatrix}4&-2\\-2&1\end{pmatrix}.

Plan. Equalise the two column expectations for pp, then the two row expectations for qq, and verify both guarantees.

6p−2=1−3p⇒p=13,v=0.6p-2=1-3p\quad\Rightarrow\quad p=\tfrac13,\quad v=0.

For the column player, the row expectations are 6q−26q-2 and 1−3q1-3q. Equalising gives q=1/3q=1/3, also with pay-off zero.

Answer. Each player chooses their first strategy with probability 1/31/3 and second with probability 2/32/3. The value for both is zero.

Check. The row mixture gives zero against either column, hence against every column mixture. The column mixture gives zero against either row, hence against every row mixture. These opposing guarantees prove optimality. At p=0,1p=0,1, the row guarantees are both −2-2, so the interior mixture improves on both endpoints.

Change only the top-left pay-off from 4 to 7. The more rewarding entry is chosen less often in the new optimum: its threat allows a smaller probability to balance the opposing responses.

Worked example 4: one pay-off changes the balance

Question. Find both optimal mixtures and the value for (7−2−21)\begin{pmatrix}7&-2\\-2&1\end{pmatrix}.

Plan. Rebuild the affected expectation, then use the same equalisation and guarantee checks.

EX=9p−2,EY=1−3p9p−2=1−3p⇒p=14,v=14\begin{aligned} E_X&=9p-2,\quad E_Y=1-3p\\ 9p-2&=1-3p\quad\Rightarrow\quad p=\tfrac14,\quad v=\tfrac14 \end{aligned}

Row expectations against the column mixture are 9q−29q-2 and 1−3q1-3q, so q=1/4q=1/4.

Answer. Both players use probabilities (1/4,3/4)(1/4,3/4). The value is 1/41/4 for the row player and −1/4-1/4 for the column player.

Check. Substitution into all four expectation expressions gives 1/41/4. The row mixture guarantees that value against all columns, and the column mixture caps it against all rows. The pure row guarantees are −2-2, so the endpoints cannot be better.

For (abcd)\begin{pmatrix}a&b\\c&d\end{pmatrix}, the same calculation gives a useful formula, but its conditions are part of the rule.

Interior two-by-two solution

Let D=a−b−c+d≠0D=a-b-c+d\ne0. The equalising candidates are

p=d−cD,q=d−bD,v=ad−bcD.p=\frac{d-c}{D},\qquad q=\frac{d-b}{D},\qquad v=\frac{ad-bc}{D}.

Use these as an interior mixed solution only when 0<p<10<p<1, 0<q<10<q<1, and the corresponding opposing guarantees are verified. Boundary, parallel and tied cases require direct envelope or saddle analysis. Not in the formula booklet: learn the expectation method.

The guaranteed pay-off is a minimum of lines, so the formula is a shortcut to a candidate, not a substitute for interpreting the game.

Watch out

Define which strategy receives pp and which receives qq. Do not use a probability outside [0,1][0,1], or divide by D=0D=0. Equalising only one player's expressions does not by itself state both players' optimal strategies.

Balance a new pair of expectation lines.

Graphical lower and upper envelopes

For a two-by-nn game, define pp as the probability of row 1. Draw one expected-pay-off line per column on 0≤p≤10\leq p\leq1. The opponent can choose the smallest, so the guaranteed pay-off follows the lower envelope, the bottom edge formed by these lines. Choose its highest point.

For an mm-by-two game, define qq as the probability of column 1. Draw one expected-pay-off line per row. The row player can choose the largest, so the column player faces the upper envelope and chooses its lowest point. All vertical values still record the row player's gain; taking an upper envelope does not change viewpoint.

Continue this lesson.

You’re previewing NovaLearn without an account. Create a free account to read the rest.

Create free account