The pseudoinverse is an extension of the idea of the inverse of a nonsingular sq. matrix to singular matrices and rectangular matrices. It’s one in all many generalized inverses, however the one most helpful in apply because it has plenty of particular properties.
The pseudoinverse of a matrix is an matrix that satisfies the Moore–Penrose situations
Right here, the superscript denotes the conjugate transpose. It may be proven that there’s a distinctive satisfying these equations. The pseudoinverse is denoted by ; some authors write .
An important property of the pseudoinverse is that for any system of linear equations (overdetermined or underdetermined) minimizes and has the minimal -norm over all minimizers. In different phrases, the pseudoinverse offers the minimal -norm least squares answer to .
The pseudoinverse might be expressed by way of the singular worth decomposition (SVD). If is an SVD, the place the matrix and matrix are unitary and with (in order that ) with , then
the place the diagonal matrix is . This formulation provides a simple method to show many identities glad by the pseudoinverse. In MATLAB, the operate pinv
computes utilizing this formulation.
From the Moore–Penrose situations or (1) it may be proven that and .
For full rank we’ve got the concise formulation
Consequently,
Some particular instances are price noting.
The pseudoinverse differs from the standard inverse in numerous respects. For instance, the pseudoinverse of a triangular matrix is just not essentially triangular (right here we’re utilizing MATLAB with the Symbolic Math Toolbox):
>> A = sym([1 1 1; 0 0 1; 0 0 1]), X = pinv(A) A = [1, 1, 1] [0, 0, 1] [0, 0, 1] X = [1/2, -1/4, -1/4] [1/2, -1/4, -1/4] [ 0, 1/2, 1/2]
Moreover, it’s not typically true that for and . A enough situation for this equality to carry is that .
It’s not normally essential to compute the pseudoinverse, however whether it is required it may be obtained utilizing (1) or (2) or from the Newton–Schulz iteration
for which as if . The convergence is at an asymptotically quadratic price. Nonetheless, about iterations are required to achieve the asymptotic part, the place , so the iteration is gradual to converge when is unwell conditioned.
Notes and References
The pseudoinverse was first launched by Eliakim Moore in 1920 and was independently found by Roger Penrose in 1955. For extra on the pseudoinverse see, for instance, Ben-Israel and Greville (2003) or Campbell and Meyer (2009). For evaluation of the Newton–Schulz iteration see Pan and Schreiber (1991).
- Adi Ben-Israel and Thomas N. E. Greville, Generalized Inverses: Concept and Purposes, second version, Springer-Verlag, New York, 2003
- Stephen Campbell and Carl Meyer, Generalized Inverses of Linear Transformations, Society for Industrial and Utilized Arithmetic, Philadelphia, PA, USA, 2009. printed (Initially printed by Pitman in 1979.)
- Victor Pan and Robert Schreiber, An Improved Newton Iteration for the Generalized Inverse of a Matrix, with Purposes, SIAM J. Sci. Statist. Comput. 12 (5), 1109–1130, 1991.