Module

for

The Matrix Inverse

     

Background

Theorem (
Inverse Matrix) Assume that [Graphics:Images/InverseMatrixMod_gr_1.gif] is an [Graphics:Images/InverseMatrixMod_gr_2.gif] nonsingular matrix. Form the augmented matrix [Graphics:Images/InverseMatrixMod_gr_3.gif] of dimension  [Graphics:Images/InverseMatrixMod_gr_4.gif].  Use Gauss-Jordan elimination to reduce the matrix [Graphics:Images/InverseMatrixMod_gr_5.gif] so that the identity [Graphics:Images/InverseMatrixMod_gr_6.gif] is in the first [Graphics:Images/InverseMatrixMod_gr_7.gif] columns.  Then the inverse [Graphics:Images/InverseMatrixMod_gr_8.gif] is located in columns [Graphics:Images/InverseMatrixMod_gr_9.gif].  The augmented matrix [Graphics:Images/InverseMatrixMod_gr_10.gif] looks like:

    [Graphics:Images/InverseMatrixMod_gr_11.gif]

Proof  The Inverse Matrix  The Inverse Matrix  

 

We can use the previously developed Gauss-Jordan subroutine to find the inverse of a matrix.

 

Computer Programs  The Inverse Matrix  The Inverse Matrix  

Algorithm  (Complete Gauss-Jordan Elimination).  Construct the solution to the linear system  [Graphics:Images/InverseMatrixMod_gr_12.gif]  by using Gauss-Jordan elimination.  Provision is made for row interchanges if they are needed.  

Mathematica Subroutine (Complete Gauss-Jordan Elimination).

[Graphics:Images/InverseMatrixMod_gr_13.gif]

Example 1.  Use Gauss-Jordan elimination to find the inverse of the matrix  [Graphics:Images/InverseMatrixMod_gr_14.gif].  
Solution 1.

 

 

Definition (Hilbert Matrix).  The elements of the Hilbert matrix  [Graphics:Images/InverseMatrixMod_gr_56.gif] of order n are  [Graphics:Images/InverseMatrixMod_gr_57.gif]  for  [Graphics:Images/InverseMatrixMod_gr_58.gif]  and  [Graphics:Images/InverseMatrixMod_gr_59.gif].  

            [Graphics:Images/InverseMatrixMod_gr_60.gif]
Some Hilbert Matrices.

 

Example 2.  Find the inverse of the 5×5 Hilbert matrix  [Graphics:Images/InverseMatrixMod_gr_72.gif].  
Solution 2.

 

 

Example 3.  Hilbert matrices are known to be ill-conditioned. Consider the matrix A given by

    [Graphics:Images/InverseMatrixMod_gr_125.gif]  
    
Find the inverse of the 5×5 matrix A that approximates the inverse of the  5×5 Hilbert matrix [Graphics:Images/InverseMatrixMod_gr_126.gif].
Remark. The entries in the matrix for this exercise must be typed in by hand in order to make sure that only six decimal places are stored in the computer.
Solution 3.

 

 

The Inverse Hilbert Matrix

    The formula for the elements of the inverse Hilbert matrix  [Graphics:Images/InverseMatrixMod_gr_169.gif] of order  n  is known to be

        [Graphics:Images/InverseMatrixMod_gr_170.gif]

which can be expressed using binomial coefficients

        [Graphics:Images/InverseMatrixMod_gr_171.gif] .

When exact computations are needed these formulas should be used instead of using a subroutine or built in procedure for computing the inverse of  [Graphics:Images/InverseMatrixMod_gr_172.gif].  
Verification.

 

 

Application to Continuous Least Squares Approximation

    The continuous least squares approximation to a function  [Graphics:Images/InverseMatrixMod_gr_179.gif] on the interval [0,1] for the set of functions  [Graphics:Images/InverseMatrixMod_gr_180.gif]  can solved by using the normal equations

(1)        [Graphics:Images/InverseMatrixMod_gr_181.gif]   for   [Graphics:Images/InverseMatrixMod_gr_182.gif].

Where the inner product is [Graphics:Images/InverseMatrixMod_gr_183.gif].  Solve the linear system (1) for the coefficients [Graphics:Images/InverseMatrixMod_gr_184.gif] and construct the approximation function
        
        [Graphics:Images/InverseMatrixMod_gr_185.gif].

 

Definition (Gram Matrix).  The Gram matrix G is a matrix of inner products where the elements are  [Graphics:Images/InverseMatrixMod_gr_186.gif].  

    The case when the set of functions is  [Graphics:Images/InverseMatrixMod_gr_187.gif]  will produce the Hilbert matrix.  Since we require the computation to be as exact as possible and an exact formula is known for the inverse of the Hilbert matrix, this is an example where an inverse matrix comes in handy.

 

Example 4.  Find the continuous least squares polynomial of degree n=4 that approximates the function  [Graphics:Images/InverseMatrixMod_gr_188.gif]  over the interval  [Graphics:Images/InverseMatrixMod_gr_189.gif].  
Solution 4.

 

Old Lab Project (Matrix Inversion  Matrix Inversion).   Internet hyperlinks to an old lab project.  

 

Research Experience for Undergraduates

The Inverse Matrix  The Inverse Matrix  Internet hyperlinks to web sites and a bibliography of articles.  

The Hilbert Matrix  The Hilbert Matrix   Internet hyperlinks to web sites and a bibliography of articles.  

 

Download this Mathematica Notebook The Matrix Inverse

 

Return to Numerical Methods - Numerical Analysis

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(c) John H. Mathews 2004