9. Determinants

Definition

In many applications we will use the notion of determinant of a matrix. The determinant of a matrix makes sense for square matrices only and is defined recursively:

  • \det[a]=a
  •     \[\det \left[\begin{array}{cccc}a_{1,1}&a_{1,2}&\ldots&a_{1,n}\\a_{2,1}&a_{2,2}&\ldots&a_{2,n}\\\ldots&\ldots&&\ldots\\ a_{n,1}&a_{n,2}&\ldots&a_{n,n}\end{array}\right]=\]

        \[=a_{1,1}\det A_{1,1}-a_{1,2}\det A_{1,2}+a_{1,3}\det A_{1,3}-\ldots\pm a_{1,n}\det A_{1,m},\]

where A_{i,j} is matrix A with i-th row and j-th column crossed out. So (the determinant is denoted by \det or by using absolute value style brackets around a matrix):

    \[\left|\begin{array}{cc}a&b\\c&d\end{array}\right|=ad-bc,\]

therefore:

    \[\left|\begin{array}{ccc}a&b&c\\k&l&m\\x&y&z\end{array}\right|=a\left|\begin{array}{cc}l&m\\y&z\end{array}\right|-b\left|\begin{array}{cc}k&m\\x&z\end{array}\right|+c\left|\begin{array}{cc}k&l\\x&y\end{array}\right|=\]

    \[=a(lz-my)-b(kz-mx)+c(ky-lx)=alz+bmx+cky-amy-bkz-clx.\]

And so on. E.g.:

    \[\left|\begin{array}{cccc}1&0&2&0\\2&3&0&-1\\3&-1&-1&0\\0&1&-1&-2\end{array}\right|=\]

    \[=1\left|\begin{array}{ccc}3&0&-1\\-1&-1&0\\1&-1&-2\end{array}\right|-0\left|\begin{array}{cccc}2&0&-1\\3&-1&0\\0&-1&-2\end{array}\right|+2\left|\begin{array}{cccc}2&3&-1\\3&-1&0\\0&1&-2\end{array}\right|-0\left|\begin{array}{cccc}2&3&0\\3&-1&-1\\0&1&-1\end{array}\right|=\]

    \[=1\cdot 0-0+2\cdot 19-0=38\]

Laplace expansion

The above definition is only a special case of a more general fact called Laplace expansion. Instead of using the first row we can use any row or column (choose always the one with most zeros). So:

    \[\det \left[\begin{array}{cccc}a_{1,1}&a_{1,2}&\ldots&a_{1,n}\\a_{2,1}&a_{2,2}&\ldots&a_{2,n}\\\ldots&\ldots&&\ldots\\ a_{n,1}&a_{n,2}&\ldots&a_{n,n}\end{array}\right]=\]

    \[=(-1)^i\left(a_{i,1}\det A_{i,1}-a_{i,2}\det A_{i,2}+a_{i,3}\det A_{i,3}-\ldots\pm a_{i,n}\det A_{i,m}\right),\]

for any row w_i. Analogical fact is true for any column.

E.g. for the below matrix it is easiest to use the third column:

    \[\left|\begin{array}{cccc}1&1&0&-1\\2&0&-1&-1\\3&-1&0&1\\0&1&0&-2\end{array}\right|=(-1)^3\cdot(-1)\cdot \left|\begin{array}{cccc}1&1&-1\\3&-1&1\\0&1&-2\end{array}\right|=10\]

Determinant and operations on a matrix

Notice first that from the Laplace expansion we easily get that if a matrix has a row of zeros (or column) its determinant equals zero.

Consider now different operations on rows of a matrix, which we use to calculate a ,,stair-like” form of a matrix. Using Laplace expansion we can prove that swapping two rows multiplies the determinant by -1 — indeed calculating the determinant using the first column we see that the signs in the sum may change, but also the rows in the minor matrices get swapped.

Immediately we can notice that multiplying a row by a number multiplies also the determinant by this number — you can see it easily calculating Laplace expansion using this row.

Therefore multiplying whole matrix by a number multiplies the determinant by this number many times, precisely:

    \[\det (aA)=a^n \det A, \]

where A is a matrix of size n\times n.

Notice also, that the determinant of a matrix with two identical rows equals zero, because swapping those rows does not change the matrix but multiplies the determinant by -1, so \det A=-\det A, therefore \det A=0. So because of the row multiplication rule, if two rows in a matrix are linearly dependent, then its determinant equals 0.

Also the Laplace expansion implies that if matrices A, B, C differ only by i-th row in the way that this row in matrix C is a sum of i-th rows in matrices B and C, then the determinant of C is the sum of determinants of A and B, e.g.:

    \[\left|\begin{array}{ccc}1&3&-1\\0&1&2\\0&3&3\end{array}\right|=\left|\begin{array}{ccc}0&1&4\\0&1&2\\0&3&3\end{array}\right|+\left|\begin{array}{ccc}1&2&-5\\0&1&2\\0&3&3\end{array}\right|.\]

But it can be easily seen that in general \det(A+B)\neq \det A+\det B!

Finally, consider the most important operation of adding to a row another row multiplied by a number. Then we actually deal with the situation described above. The resulting matrix is matrix C, which differs from A and B only by the row we sum to. Matrix A is the original matrix and matrix C is matrix A, in which we substitute the row we sum to with the row we are summing multiplied by a number. Therefore \det A=\det B+\det C, but C has two linearly dependent rows, so \det C=0 and \det B=\det A. Therefore the operation of adding a row multiplied by a number to another row does not change the determinant of a matrix.

Finally, the matrix multiplication. All the above operations can be written as multiplication by a special matrix. E.g. swapping of 2-nd and 3-rd rows in a matrix of size 3\times 3, is actually the following:

    \[\left[\begin{array}{ccc}1&0&0\\0&0&1\\0&1&0\end{array}\right]\cdot\]

multiplication of the 3-rd row by scalar 4, is:

    \[\left[\begin{array}{ccc}1&0&0\\0&1&0\\0&0&4\end{array}\right]\cdot\]

adding to the third row the second multiplied by 2 is:

    \[\left[\begin{array}{ccc}1&0&0\\2&1&0\\0&0&1\end{array}\right]\cdot\]

It is relatively easy to see that even in the general case the matrix, which changes rows has determinant (-1), the matrix multiplying a row by scalar a, has determinant a, and matrix of adding to a row another row multiplied by a scalar has determinant 1. Therefore multiplying by those matrices (called the elementary matrices) multiplies the determinant of a matrix by their determinants. Moreover, every matrix can be created by multiplying elementary matrix, which gives the following important conclusion:

    \[\det (A\cdot B)=\det A\cdot \det B\]

Calculating the determinant via triangular form of matrix

If you look closely enough you will see that the Laplace expansion also implies that the determinant of a matrix in an echelon form (usually called triangular for square matrices) equals the product of elements on the diagonal of the matrix, so e.g.:

    \[\left|\begin{array}{ccc}-1&3&-1\\0&1&2\\0&0&3\end{array}\right|=(-1)\cdot 1\cdot 3=-3.\]

Because we know how the elementary operations change, to calculate the determinant of a matrix we can calculate a triangular form, calculate its determinant and recreate the determinant of the original matrix. This method is especially useful for large matrices, e.g.:

    \[\left[\begin{array}{ccccc}1&2&0&3&1\\2&6&2&0&2\\3&9&1&1&-1\\1&2&0&3&4\\1&2&0&1&1\end{array}\right]\underrightarrow{w_2-2w_1,w_3-3w_1,w_4-w_1,w_5-w_1}\]

    \[\left[\begin{array}{ccccc}1&2&0&3&1\\0&2&2&-6&0\\0&3&1&-8&-4\\0&0&0&0&3\\0&0&0&-2&0\end{array}\right]\underrightarrow{w_2\cdot\frac{1}{2}}\]

    \[\left[\begin{array}{ccccc}1&2&0&3&1\\0&1&1&-3&0\\0&3&1&-8&-4\\0&0&0&0&3\\0&0&0&-2&0\end{array}\right]\underrightarrow{w_3-3w_2, w_4\leftrightarrow w_5} \left[\begin{array}{ccccc}1&2&0&3&1\\0&1&1&-3&0\\0&0&-2&1&-4\\0&0&0&-2&0\\0&0&0&0&3\end{array}\right]\]

Therefore, the determinant of the last matrix is 1\cdot 1\cdot (-2)\cdot (-2)\cdot 3=12. On our way we have swapped rows once and we have multiplied one row by \frac{1}{2}, therefore the determinant of the first matrix equals \frac{12\cdot(-1)}{\frac{1}{2}}=-24.

The above fact also implies how to calculate the determinant of a matrix which is in the block form: \left[\begin{array}{cc}A&C\\0&B\end{array}\right] with left bottom block of zeros. The determinant of such a matrix equals \det A\cdot \det B, e.g.:

    \[\left|\begin{array}{ccccc}1&2&0&3&1\\2&6&2&0&2\\3&9&1&1&-1\\0&0&0&3&4\\0&0&0&1&1\end{array}\right|= \left|\begin{array}{ccc}1&2&0\\2&6&2\\3&9&1\end{array}\right|\cdot\left|\begin{array}{cc}3&4\\1&1\end{array}\right|.\]