C11 - Diagonalisation and matrix powers
Repeated matrix multiplication can become a calculation with ordinary powers. You will choose independent eigenvectors, place their eigenvalues in a matching diagonal matrix, and use the resulting diagonalisation to find matrix powers. You will also decide when this method is available over the real numbers.
Building U from independent eigenvectors
Can you find for without carrying out 19 successive matrix products? Its eigenvectors suggest a better coordinate system: along it multiplies by 4, and along it multiplies by 2.
In two dimensions, two nonparallel vectors let you express every vector uniquely as a combination of them. For example,
These two eigenvectors form a basis. In that basis, the matrix just scales the two coefficients separately. In three dimensions you need three linearly independent vectors: none can be a combination of the others.
Eigenvector matrix
For an real matrix with linearly independent real eigenvectors , form
The eigenvectors go in the columns of . Each must correspond to column . Independence makes invertible: equivalently, .
The choices are not unique. You can rescale an eigenvector by any nonzero scalar, or reorder the columns, provided the eigenvalues follow the same order.
Worked example 1: choosing a basis and a matching diagonal
Question. The eigenpairs of include and . Construct and , and check that is invertible.
Plan. Use the listed order for both matrices and calculate a determinant.
Answer. The displayed matrices give a valid ordered eigenvector basis and matching eigenvalues.
Check. Compare the column products:
Right multiplication by scales column 1 by 4 and column 2 by 2, exactly as required.
Swap the two eigenvectors but leave their lengths unchanged. Only their positions and the matching diagonal positions change.
Worked example 2: a different valid order
Question. Construct another valid pair by placing first.
Plan. Move its eigenvalue 2 into the first diagonal position and check independence again.
Answer. This is another valid ordered pair for the same matrix.
Check.
Keeping after swapping these columns would fail this check.
For a matrix the construction is identical, with three columns. Even three distinct-looking nonzero vectors are unsuitable if one is a linear combination of the other two. A nonzero determinant checks the whole set.
Watch out
Two different multiples of the same eigenvector do not form a basis. Columns and give determinant zero, so they cannot form an invertible . Also, write vectors as columns, then match the diagonal order to those columns.
Choose the matching order for a new matrix.
Diagonalising a matrix
The equality packages the individual eigenvector equations together. Multiplying on the right by gives the diagonalisation of .
Diagonalisation
If the columns of an invertible matrix are eigenvectors of , with corresponding eigenvalues in the same order on the diagonal of , then
For a real diagonalisation, choose real eigenvectors and real eigenvalues. Real eigenvalues alone do not guarantee an invertible eigenvector matrix.
Not in the formula booklet: learn it.
Read from right to left. First finds the coefficients of in the eigenvector basis. Then scales those coefficients. Finally rebuilds the output in ordinary coordinates. This explains both the order and the usefulness of the factorisation.
Worked example 3: completing the factorisation
Question. Diagonalise using .
Plan. Use the corresponding diagonal , find the inverse, and multiply to verify.
Thus
Answer. , with the inverse above.
Check. For , its basis coefficients are . Scaling gives ; rebuilding gives , agreeing with direct multiplication by .
Now use the alternative column order from Worked example 2. The original matrix must stay the same even though all three factors look different.
Worked example 4: verifying the reordered factorisation
Question. Diagonalise the same using .
Plan. Use and compute the new inverse.
Then
Answer. The reordered factors give another correct diagonalisation of .
Check. , so changing to this basis really does produce the claimed diagonal matrix.
The same reasoning works for a full three-dimensional eigenbasis. For , take
The first two coordinates use the calculation above and the third contributes , giving .
Watch out
, while . Reversing the outer factors usually gives a different matrix. Track what each factor does instead of rearranging matrix factors as if they were numbers.
Complete a new factorisation.
Calculating matrix powers
The benefit appears when you square the factorisation. Associativity lets adjacent inverse factors cancel, without swapping any factors:
Repeating this cancellation leaves only a diagonal power to calculate.
Powers from diagonalisation
If , then for every positive integer ,
It also holds for , using . Negative integer powers require to be invertible, equivalently all its eigenvalues to be nonzero. Fractional powers need further choices and are not assumed here.
Not in the formula booklet: learn it.
An ordinary matrix power multiplies matrices. It does not raise each individual entry to that power. A diagonal matrix is a special case where taking powers of the diagonal entries works.
Worked example 5: a formula for every positive integer power
Question. Find for positive integers , where , and hence find .
Plan. Use the first diagonalisation, raise 4 and 2 to power , then multiply the two small matrices.
Answer. The displayed general formula gives
No long chain of products is needed.
Check. Directly squaring gives . The formula at gives the same matrix. At it recovers .
Divide every entry of by 4. The eigenvectors stay the same and the eigenvalues become 1 and . This controlled change makes a long-term limit visible.
Worked example 6: repeated transformations with a limit
Question. Let . Find for positive integers and its limit as .
Plan. Keep and its inverse, but use . Then take the limit of the scalar powers.
Since , each entry has a limit.
Answer.
Check. The limit sends to itself and to zero. That matches repeated scaling by 1 and : the first component survives and the second shrinks away.
This is a useful surprise: repeated transformations can settle to a nonzero matrix even though one direction disappears. Limits must be checked from the actual eigenvalue powers. For example, an eigenvalue produces , which oscillates; real eigenvalues do not by themselves guarantee convergence.
For the three-dimensional in part 2, the identical multiplication gives a top-left block equal to , zero entries linking to the third coordinate, and bottom-right entry . Thus the same method works in either dimension.
Watch out
Wrong: , found by squaring each entry. Correct matrix multiplication gives . Also, raise the entries of , not the entries of or .
Apply a supplied diagonalisation to a fresh matrix.
When a real eigenbasis exists
A real diagonalisation exists exactly when an real matrix has linearly independent real eigenvectors. Finding real eigenvalues is part of the job; finding enough independent vectors is the decisive check.
Distinct eigenvalues give independent eigenvectors. For two vectors, you can see why: if with , then applying the matrix would give both and . Equality would force . The general result also holds for larger sets. Hence a real matrix with two distinct real eigenvalues, or a real matrix with three distinct real eigenvalues, can be diagonalised over the reals.
A repeated eigenvalue needs more care. Compare
Both have characteristic equation . For , every nonzero vector is an eigenvector for 2, so and form a basis; is already diagonal. For , the equations for eigenvalue 2 are
Every eigenvector is a multiple of . Any two such columns give determinant zero, so cannot be diagonalised.
In three dimensions, has two independent vectors in the plane for eigenvalue 2 and one on the third axis for 5: three in total. In contrast, gives only one independent vector for 2 and one for 5, so two in total. A repeated root may or may not supply enough directions.
Finally, a real matrix with a non-real eigenvalue cannot have a diagonalisation with real and real . For example, the quarter-turn matrix has eigenvalues and no real eigenvectors. A diagonalisation using complex vectors is a different question. Here the factorisations use real eigenbases.
Key idea
Check the number of independent real eigenvectors, not just the number of roots counting repeats. Repeated eigenvalues neither guarantee nor rule out diagonalisation; real eigenvalues alone are insufficient.
Decide what a repeated root actually tells you.
Quick Recap
- Put a full set of independent eigenvectors in the columns of , with their eigenvalues in the same order in .
- gives .
- For positive integers , use ; negative powers additionally require invertibility.
- Repeated real eigenvalues may or may not provide an eigenbasis. Solve for the vectors and check independence.
Yes: the opening matrix has , found from two scalar powers and the diagonalisation.