by Enrique S. Quintana-ort'i, Antoine Petitet
http://phys.kookmin.ac.kr/lapack/lawns/lawn113.ps
Add To MetaCart
Abstract:
The linear least squares problem arises in many areas of sciences and engineerings. When the coefficient matrix has full rank, the solution can be obtained in a fast way by using QR factorization with BLAS-3. In contrast, when the matrix is rank-deficient, or the rank is unknown, other slower methods should be applied: the SVD or the complete orthogonal decompositions. The SVD gives more reliable determination of rank but is computationally more expensive. On the other hand, the complete orthogonal decomposition is faster and in practice works well. We present several new implementations for solving the linear least squares problem by means of the complete orthogonal decomposition that are faster than the algorithms currently included in LAPACK. Experimental comparison of our methods with the LAPACK implementations on a wide range of platforms (such as IBM RS/6000-370, SUN HyperSPARC, SGI R8000, DEC Alpha/AXP, HP 9000/715, etc.) show considerable performance improvements. Some of the new code has been already included in the latest release of LAPACK (3.0). In addition, for full-rank matrices the performances of the new methods are very close to the performance of the fast method based on QR factorization with BLAS-3, thus providing a valuable general tool for full-rank matrices and rank-deficient matrices, as well as those matrices with unknown rank. Key words. linear least squares, complete orthogonal factorization, QR factorization
Citations
|
617
|
A set of level 3 basic linear algebra subprograms
– Dongarra, Croz, et al.
- 1990
|
|
395
|
Basic linear algebra subprograms for Fortran usage
– Lawson, Hanson, et al.
- 1979
|
|
366
|
An extended set of Fortran basic linear algebra subprograms: model implementation and test programs
– Dongarra, Croz, et al.
- 1988
|
|
276
|
LINPACK Users' Guide
– Dongarra, Bunch, et al.
- 1979
|
|
243
|
Solving Least Squares Problems
– Lawson, Hanson
- 1974
|
|
243
|
Introduction to Matrix Computations
– Stewart
- 1973
|
|
78
|
Design of a parallel nonsymmetric eigenroutine toolbox, Part I
– Bai, Demmel
- 1993
|
|
75
|
Rank revealing QR factorizations
– Chan
- 1987
|
|
44
|
A storage efficient WY representation for products of Householder transformations
– Schreiber, Loan
- 1989
|
|
40
|
Numerical methods for solving linear least squares problems”, Numerische Mathematik 7
– Golub
- 1965
|
|
33
|
LAPACK Users' Guide Release 2.0
– Anderson, Bai, et al.
- 1995
|
|
30
|
An efficient algorithm for computing a strong rank–revealing QR factorization
– Gu, Eisenstat
- 1996
|
|
27
|
On updating signal subspaces
– BISCHOF, SHROFF
- 1992
|
|
26
|
On rank-revealing QR factorizations
– Chandrasekaran, Ipsen
- 1994
|
|
19
|
Bounds on singular values revealed by QR factorizations
– Pan, Tang
- 1999
|
|
18
|
Computing rank-revealing QR factorizations of dense matrices
– Bischof, Quintana-Orti
- 1996
|
|
15
|
Structure-preserving and rank-revealing QR factorizations
– Bischof, Hansen
- 1991
|
|
14
|
Truncated SVD solutions to discrete ill-posed problems with ill-determined numerical rank
– HANSEN
- 1990
|
|
12
|
A block QR factorization algorithm using restricted pivoting
– Bischof
- 1989
|
|
11
|
A comparison between some direct and iterative methods for certain large scale geodetic least-squares problem
– GOLUB, MANNEBACK, et al.
- 1986
|
|
11
|
An iterative method for computing multivariate C piecewise polynomial interpolants
– Grandine
- 1987
|
|
10
|
The Levenberg-Marquardt algorithm: Implementation and theory
– e
- 1978
|
|
9
|
An application of systolic arrays to linear discrete ill-posed problems
– en, Schreiber
- 1986
|
|
8
|
deficient interpolation and optimal design: An example
– Rank
- 1989
|
|
8
|
The modified truncated SVD method for regularization in general form
– Hansen, Sekii, et al.
- 1992
|
|
7
|
Using a Fast Signal Processor to Solve the Inverse Kinematic Problem with Special Emphasis on the Singularity Problem
– en
- 1991
|
|
4
|
Numerical Methods for Least Squares Problems
– ork
- 1996
|
|
3
|
Condition Estimator
– Incremental
- 1990
|
|
3
|
A robust incremental condition scheme, Argonne preprint MCS-P225-0391
– Bischof, Tang
- 1991
|
|
3
|
The rank-revealing QR decomposition and SVD
– HONG, PAN
- 1992
|
|
3
|
Sparse rank-revealing QR factorization
– Pierce, Lewis
- 1992
|
|
3
|
A BLAS-3 version of the QR factorizaton with column pivoting
– i, Sun, et al.
- 1995
|
|
3
|
Quintana-Ort' i, Guaranteeing termination of Chandrasekaran & Ipsen's algorithm for computing rank-revealing QR factorizations
– i, S
- 1996
|