In numerical analysis, different decompositions are used to implement efficient matrix algorithms.
For example, when solving a system of linear equations A x = b {\displaystyle A\mathbf {x} =\mathbf {b} } , the matrix A can be decomposed via the LU decomposition. The LU decomposition factorizes a matrix into a lower triangular matrix L and an upper triangular matrix U. The systems L ( U x ) = b {\displaystyle L(U\mathbf {x} )=\mathbf {b} } and U x = L − 1 b {\displaystyle U\mathbf {x} =L^{-1}\mathbf {b} } require fewer additions and multiplications to solve, compared with the original system A x = b {\displaystyle A\mathbf {x} =\mathbf {b} } , though one might require significantly more digits in inexact arithmetic such as floating point.
Similarly, the QR decomposition expresses A as QR with Q an orthogonal matrix and R an upper triangular matrix. The system Q(Rx) = b is solved by Rx = QTb = c, and the system Rx = c is solved by 'back substitution'. The number of additions and multiplications required is about twice that of using the LU solver, but no more digits are required in inexact arithmetic because the QR decomposition is numerically stable.
Main article: LU decomposition
Main article: LU reduction
Main article: Block LU decomposition
Main article: Rank factorization
Main article: Cholesky decomposition
Main article: QR decomposition
Main article: RRQR factorization
Main article: Interpolative decomposition
Main article: Eigendecomposition (matrix)
The Jordan normal form and the Jordan–Chevalley decomposition
Main article: Schur decomposition
Main article: QZ decomposition
Main article: Singular value decomposition
Refers to variants of existing matrix decompositions, such as the SVD, that are invariant with respect to diagonal scaling.
Analogous scale-invariant decompositions can be derived from other matrix decompositions; for example, to obtain scale-invariant eigenvalues.45
Main article: Complete orthogonal decomposition
Main article: Polar decomposition
Main article: Sinkhorn's theorem
Main article: Square root of a matrix
There exist analogues of the SVD, QR, LU and Cholesky factorizations for quasimatrices and cmatrices or continuous matrices.16 A ‘quasimatrix’ is, like a matrix, a rectangular scheme whose elements are indexed, but one discrete index is replaced by a continuous index. Likewise, a ‘cmatrix’, is continuous in both indices. As an example of a cmatrix, one can think of the kernel of an integral operator.
These factorizations are based on early work by Fredholm (1903), Hilbert (1904) and Schmidt (1907). For an account, and a translation to English of the seminal papers, see Stewart (2011).
Lay, David C. (2016). Linear algebra and its applications. Steven R. Lay, Judith McDonald (Fifth Global ed.). Harlow. p. 142. ISBN 978-1-292-09223-2. OCLC 920463015.{{cite book}}: CS1 maint: location missing publisher (link) 978-1-292-09223-2 ↩
If a non-square matrix is used, however, then the matrix U will also have the same rectangular shape as the original matrix A. And so, calling the matrix U upper triangular would be incorrect as the correct term would be that U is the 'row echelon form' of A. Other than this, there are no differences in LU factorization for square and non-square matrices. ↩
Piziak, R.; Odell, P. L. (1 June 1999). "Full Rank Factorization of Matrices". Mathematics Magazine. 72 (3): 193. doi:10.2307/2690882. JSTOR 2690882. /wiki/Doi_(identifier) ↩
Uhlmann, J.K. (2018), "A Generalized Matrix Inverse that is Consistent with Respect to Diagonal Transformations", SIAM Journal on Matrix Analysis and Applications, 239 (2): 781–800, doi:10.1137/17M113890X /wiki/Doi_(identifier) ↩
Uhlmann, J.K. (2018), "A Rank-Preserving Generalized Matrix Inverse for Consistency with Respect to Similarity", IEEE Control Systems Letters, 3: 91–95, arXiv:1804.07334, doi:10.1109/LCSYS.2018.2854240, ISSN 2475-1456, S2CID 5031440 /wiki/ArXiv_(identifier) ↩
Choudhury & Horn 1987, pp. 219–225 - Choudhury, Dipa; Horn, Roger A. (April 1987). "A Complex Orthogonal-Symmetric Analog of the Polar Decomposition". SIAM Journal on Algebraic and Discrete Methods. 8 (2): 219–225. doi:10.1137/0608019. https://doi.org/10.1137%2F0608019 ↩
Bhatia, Rajendra (2013-11-15). "The bipolar decomposition". Linear Algebra and Its Applications. 439 (10): 3031–3037. doi:10.1016/j.laa.2013.09.006. /wiki/Doi_(identifier) ↩
Horn & Merino 1995, pp. 43–92 - Horn, Roger A.; Merino, Dennis I. (January 1995). "Contragredient equivalence: A canonical form and some applications". Linear Algebra and Its Applications. 214: 43–92. doi:10.1016/0024-3795(93)00056-6. https://doi.org/10.1016%2F0024-3795%2893%2900056-6 ↩
Mostow, G. D. (1955), Some new decomposition theorems for semi-simple groups, Mem. Amer. Math. Soc., vol. 14, American Mathematical Society, pp. 31–54 https://archive.org/details/liealgebrasandli029541mbp ↩
Nielsen, Frank; Bhatia, Rajendra (2012). Matrix Information Geometry. Springer. p. 224. arXiv:1007.4402. doi:10.1007/978-3-642-30232-9. ISBN 9783642302329. S2CID 118466496. 9783642302329 ↩
Zhang, Fuzhen (30 June 2014). "A matrix decomposition and its applications". Linear and Multilinear Algebra. 63 (10): 2033–2042. doi:10.1080/03081087.2014.933219. S2CID 19437967. https://zenodo.org/record/851661 ↩
Drury, S.W. (November 2013). "Fischer determinantal inequalities and Highamʼs Conjecture". Linear Algebra and Its Applications. 439 (10): 3129–3133. doi:10.1016/j.laa.2013.08.031. https://doi.org/10.1016%2Fj.laa.2013.08.031 ↩
Idel, Martin; Soto Gaona, Sebastián; Wolf, Michael M. (2017-07-15). "Perturbation bounds for Williamson's symplectic normal form". Linear Algebra and Its Applications. 525: 45–58. arXiv:1609.01338. doi:10.1016/j.laa.2017.03.013. S2CID 119578994. /wiki/ArXiv_(identifier) ↩
Townsend & Trefethen 2015 - Townsend, A.; Trefethen, L. N. (2015), "Continuous analogues of matrix factorizations", Proc. R. Soc. A, 471 (2173): 20140585, Bibcode:2014RSPSA.47140585T, doi:10.1098/rspa.2014.0585, PMC 4277194, PMID 25568618 https://ui.adsabs.harvard.edu/abs/2014RSPSA.47140585T ↩