(Enter summary)
Abstract: In this expository paper, we survey some of the latest developments on using preconditioned conjugate gradient methods for solving Toeplitz systems. One of the main results is that the complexity of solving a large class of n-by-n Toeplitz systems is reduced to O(n log n) operations as compared to O(n log 2 n) operations required by fast direct Toeplitz solvers. Different preconditioners proposed for Toeplitz systems are reviewed. Applications to Toeplitz-related systems arising from partial... (Update)
Cited by: More
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 52, NO. 8.. - Stationary Time Series
(Correct)
Comprehensive Summaries of Uppsala Dissertations - From The Faculty
(Correct)
A Computationally Efficient Superresolution Image.. - Nguyen, Milanfar, Golub (1999)
(Correct)
Similar documents (at the sentence level):
10.9%: Scientific Applications of Iterative Toeplitz Solvers - Ng, Chan
(Correct)
6.1%: Iterative Methods for Linear Systems with Matrix Structure - Chan, Ng
(Correct)
Active bibliography (related documents): More All
27.4: Conjugate Gradient Methods for Toeplitz Systems - Chan, Ng (1996)
(Correct)
2.0: Fast Iterative Methods For Least Squares Estimations - Michael Ng And (1994)
(Correct)
1.5: A look-ahead Bareiss algorithm for general Toeplitz matrices - Freund (1994)
(Correct)
Similar documents based on text: More All
0.4: Preconditioners for non-Hermitian Toeplitz systems - Chan, Potts, Steidl (2001)
(Correct)
0.4: Classical Foundations of Algorithms for Solving Positive Definite.. - Ammar
(Correct)
0.4: Multigrid Method for Ill-Conditioned Symmetric - Toeplitz Systems Raymond
(Correct)
Related documents from co-citation: More All
33: An optimal circulant preconditioner for Toeplitz systems (context) - Chan - 1988
22: The John Hopkins University Press (context) - Golub, Van Loan - 1989
19: Iterative Methods for Sparse Linear Systems (context) - Saad - 1996
BibTeX entry: (Update)
R. Chan and M. Ng, "Conjugate gradient methods for Toeplitz systems", SIAM Review 38, pp. 427--482, 1996. http://citeseer.ist.psu.edu/article/chan96conjugate.html More
@article{ chan96conjugate,
author = "Raymond H. Chan and Michael K. Ng",
title = "Conjugate Gradient Methods for {Toeplitz} Systems",
journal = "SIAM Review",
volume = "38",
number = "3",
pages = "427--482",
year = "1996",
url = "citeseer.ist.psu.edu/article/chan96conjugate.html" }
Citations (may not include all citations):
2441
The Johns Hopkins University Press (context) - Golub, Van Loan et al. - 1989
815
Adaptive Filter Theory (context) - Haykin - 1991
715
GMRES: A Generalized Minimal Residual Algorithm for Solving .. (context) - Saad, Schultz - 1986
654
Fundamentals of Digital Image Processing (context) - Jain - 1989
530
Linear and Nonlinear Programming (context) - Luenberger - 1984
348
Parallel and Distributed Computation: Numerical Methods (context) - Bertsekas, Tsitsiklis - 1989
272
Time Series: Theory and Methods (context) - Brockwell, Davis - 1991
206
An Algorithm for the Machine Calculation of Complex Fourier .. (context) - Cooley, Tukey - 1965
197
Spectral Analysis and Time Series (context) - Priestley - 1981
151
Iterative Solutions of Linear Systems
- Freund, Golub et al. - 1992
140
Finite Element Solution of Boundary Value Problems (context) - Axelsson, Barker - 1984
135
Computational Frameworks for the Fast Fourier Transform (context) - Van Loan - 1992
131
A Transpose-free Quasi-minimal Residual Algorithm for Non-He.. (context) - Freund - 1993
127
Digital Image Restoration (context) - Andrews, Hunt - 1977
123
Toeplitz Forms and Their Applications (context) - Grenander, Szego - 1984
120
Circulant Matrices (context) - Davis - 1979
113
The Design and Analysis of Parallel Algorithms (context) - Akl - 1989
103
Introduction to Approximation Theory (context) - Cheney - 1966
92
An Optimal Circulant Preconditioner for Toeplitz Systems (context) - Chan - 1988
84
Cambridge University Press (context) - Zygmund, Series - 1968
79
A Class of First Order Factorization Methods (context) - Gustafsson - 1978
73
Fast Solution of Toeplitz Systems of Equations and Computati.. (context) - Brent, Gustavson et al. - 1980
66
Introduction to Statistical Time Series (context) - Fuller - 1976
65
A Proposal for Toeplitz Matrix Calculations (context) - Strang - 1986
64
Digital Image Restoration (context) - Katsaggelos - 1991
55
Multiprocessor FFTs (context) - Swarztrauber - 1987
53
The Theory of Tikhonov Regularization for Fredholm Equations.. (context) - Groetsch - 1984
50
Toeplitz Equations by Conjugate Gradients with Circulant Pre.. (context) - Chan, Strang - 1989
50
Stability of Methods for Solving Toeplitz Systems of Equatio.. (context) - Bunch - 1985
47
Superfast Solution of Real Positive Definite Toeplitz System.. (context) - Ammar, Gragg - 1988
46
Fast Parallel Algorithms for QR and Triangular Factorization (context) - Chun, Kailath et al. - 1987
45
Asymptotically Fast Solution of Toeplitz and Related Systems.. (context) - Bitmead, Anderson - 1980
42
Root-Mean-Square) Error Criterion in Filter Design and Predi.. (context) - Levinson, RMS - 1946
42
Some Domain Decomposition Algorithms for Elliptic Problems (context) - Dryja, Widlund - 1989
40
Computational Methods for Integral Equations (context) - Delves, Mohamed - 1985
40
An Algorithm for the Inversion of Finite Toeplitz Matrices (context) - Trench - 1964
40
Iterative Substructuring Methods: Algorithms and Theory for .. (context) - Widlund - 1988
38
Convolution Equations and Projection Methods for Their Solut.. (context) - Gohberg, Fe - 1974
37
Optimal and Superoptimal Circulant Preconditioners (context) - Tyrtyshnikov - 1992
35
Collectively Compact Operator Approximation Theory and Appli.. (context) - Anselone - 1971
33
Circulant Preconditioners for Hermitian Toeplitz Systems
- Chan - 1989
33
Iterative Methods for Image Deblurring (context) - Biemond, Lagendijk et al. - 1990
27
the Inversion of Finite Toeplitz Matrices and Their Continuo.. (context) - Gohberg, Semencul - 1972
27
Toeplitz Preconditioners for Toeplitz Systems with Nonnegati..
- Chan - 1991
26
Preconditioning Methods for Improved Convergence Rates in It.. (context) - Clinthorne, Pan et al. - 1993
26
Circulant and Skew-circulant Matrices for Solving Toeplitz M.. (context) - Huckle - 1992
26
Circulant Preconditioned Toeplitz Least Squares Iterations (context) - Chan, Nagy et al. - 1994
25
Circulant Preconditioners for Toeplitz Matrices with Piecewi..
- Yeung, Chan - 1993
25
FFT-Based Preconditioners for Toeplitz-Block Least Squares P..
- Chan, Nagy et al. - 1993
25
An Approximate Factorization Procedure for Solving Self-adjo.. (context) - Dupont, Kendall et al. - 1968
25
Circulant Preconditioners for Toeplitz Matrices with Positiv..
- Chan, Yeung - 1992
24
Stable Row Recurrences for the Pad'e Table and Generically S.. (context) - Gutknecht - 1993
23
Doubling Algorithms for Toeplitz and Related Equations (context) - Morf - 1980
23
a Method of Investigating Periodicities in Disturbed Series .. (context) - Yule - 1927
23
QR Factorization of Toeplitz Matrices (context) - Bojanczyk, Brent et al. - 1986
23
Least Squares Methods (context) - Bjorck - 1989
22
Sine Transform Based Preconditioners for Symmetric Toeplitz ..
- Chan, Ng et al.
22
Parallel Algorithms for Banded Linear Systems (context) - Wright - 1991
21
Circulant Preconditioners Constructed from Kernels
- Chan, Yeung - 1992
21
A Unifying Approach to Some Old and New Theorems on Distribu.. (context) - Tyrtyshnikov
20
Circulant Preconditioners for Elliptic Problems
- Chan, Chan - 1992
20
Formally Biorthogonal Polynomials and a Look-ahead Levinson ..
- Freund, Zha - 1993
20
The Circulant Operator in the Banach Algebra of Matrices (context) - Chan, Jin et al. - 1991
19
Fast Transform Based Preconditioners for Toeplitz Equations (context) - Boman, Koltracht - 1995
19
A Look-Ahead Levinson Algorithm for General Toeplitz Systems (context) - Chan, Hansen - 1992
17
the Eigenvalues of Certain Hermitian Forms (context) - Kac, Murdock et al. - 1953
17
Fast Toeplitz Orthogonalization (context) - Sweet - 1984
17
A Family of Block Preconditioners for Block Systems (context) - Chan, Jin - 1992
17
Generalization of Strang's Preconditioner with Applications ..
- Chan, Ng et al.
16
Fast Preconditioned Conjugate Gradient Algorithms for Wiener.. (context) - Gohberg, Hanke et al. - 1994
16
Adaptive Signal Processing (context) - Alexander - 1986
16
The Use of Pivoting to Improve the Numerical Performance of .. (context) - Sweet - 1993
15
Fast Toeplitz Orthogonalization Using Inner Products (context) - Cybenko - 1987
14
Spectral Properties of Preconditioned Rational Toeplitz Matr.. (context) - Ku, Kuo - 1993
14
Iterative Methods for Overflow Queueing Models
- Chan - 1987
14
The Spectrum of a Family of Circulant Preconditioned Toeplit..
- Chan - 1989
14
Least Square Estimation with Applications to Digital Signal .. (context) - Giordano, Hsu - 1985
14
A New Preconditioner for the Parallel Solution of Positive D.. (context) - Bini, Di Benedetto - 1990
14
A New Algorithm for Solving Toeplitz Systems of Equations (context) - de Hoog - 1987
14
A Fast Algorithm for Linear Complex Chebyshev Approximations (context) - Tang - 1988
14
Spectral Properties of Preconditioned Rational Toeplitz Matr.. (context) - Ku, Kuo - 1993
13
Circulant Preconditioners for Toeplitz-block Matrices (context) - Chan, Olkin - 1994
13
Circulant Preconditioners with Unbounded Inverses (context) - Tyrtyshnikov
13
Toeplitz-Circulant Preconditioners for Toeplitz Systems and ..
- Chan, Ching
13
Preconditioning for Toeplitz Matrices (context) - Di Benedetto, Fiorentino et al. - 1993
12
Matrix Methods for Queueing Problems (context) - Kaufman - 1983
12
New Inversion Formulas for Matrices Classified in Terms of T.. (context) - Friedlander, Morf et al. - 1979
11
A Decomposition of Toeplitz Matrices and Optimal Circulant P.. (context) - Tismenetsky - 1991
11
Divide-and-Conquer Solutions of Least-Squares Problems for M.. (context) - Chun, Kailath - 1991
11
The Spectra of Super-Optimal Circulant Preconditioned Toepli.. (context) - Chan, Jin et al. - 1991
11
A Look-ahead Bareiss Algorithm for General Toeplitz Matrices
- Freund - 1994
11
Displacement Preconditioner for Toeplitz Least Squares Itera..
- Chan, Nagy et al. - 1994
10
Some Aspects of Circulant Preconditioners (context) - Huckle - 1993
10
Preconditioning Strategies for Hermitian Toeplitz Systems wi.. (context) - Serra
10
A Generalization of the Levinson Algorithm for Hermitian Toe.. (context) - Delsarte, Genin et al. - 1985
10
Fast Decimation-in-time Algorithms for a Family of Discrete .. (context) - Yip, Rao - 1984
10
Total Variation Based Restoration of Noisy (context) - Rudin, Osher et al. - 1993
9
Some Fast Toeplitz Least Squares Algorithms (context) - Nagy, Plemmons - 1991
9
Multigrid Methods for Toeplitz Matrices (context) - Fiorentino, Serra - 1991
9
Optimal Regularization Parameter Estimation for Image Restor.. (context) - Reeves, Mersereau - 1991
9
Fast Band-Toeplitz Preconditioners for Hermitian Toeplitz Sy..
- Chan, Tang - 1994
9
Fast RLS Adaptive Filtering by FFT-based Conjugate Gradient .. (context) - Ng, Plemmons - 1996
9
Restoration of Scanned Photographic Images (context) - Tekalp, Pavlovi'c - 1991
8
Oxford University Press (context) - Walker, Analysis - 1988
8
On Coding and Filtering Stationary Signals by Discrete Fouri.. (context) - Pearl - 1973
8
Sine Transform Based Preconditioners for Elliptic Problems
- Chan, Wong
8
Iterative Solution Methods and Preconditioners for Blocktrid.. (context) - Holmgren, Otto - 1992
8
Fast Transforms for Tridiagonal Linear Equations (context) - Huckle - 1994
8
a Matrix Algebra Related to the Discrete Hartley Transform (context) - Bini, Favati - 1993
8
Toeplitz Preconditioners for Hermitian Toeplitz Systems (context) - Chan, Ng - 1993
7
Fast Restoration of Atmospherically Blurred Images (context) - Nagy, Plemmons et al. - 1994
7
Preconditioning Strategies for Asymptotically Ill-Conditione.. (context) - Serra - 1994
7
and Hankel Matrices with Singular Leading Principal Submatri.. (context) - Zarowski, for et al. - 1991
7
Fast Iterative Methods for Least Squares Estimations
- Ng, Chan - 1994
7
Multivariate Estimation of Conditional Performance Measure i.. (context) - Seila - 1990
7
Design and Analysis of Toeplitz preconditioners (context) - Ku, Kuo - 1992
7
Fast Iterative Solvers for Toeplitz-Plus-Band Systems (context) - Chan, Ng - 1993
7
A New Autoregressive Spectrum Analysis Algorithm (context) - Marple - 1980
7
Preconditioned Conjugate Gradient Methods for Integral Equat..
- Chan, Lin
7
Toeplitz Approximate Inverse Preconditioner for Banded Toepl.. (context) - Hanke, Nagy - 1994
7
Regularization and Superresolution (context) - Abbiss, Earwicker et al. - 1987
7
Moment Analysis for Traffic Associated with Markovian Queuei.. (context) - Oda - 1991
6
Inversion of Toeplitz Matrices which are not Strongly Nonsin.. (context) - Gover, Barnett - 1985
6
A Modified Direct Preconditioner for Indefinite Symmetric To.. (context) - Concus, Saylor
6
Multigrid Methods for Symmetric Positive Definite Block Toep.. (context) - Fiorentino, Serra
6
Application of Approximation Theory Methods to Recursive Dig.. (context) - Chui, Chan - 1982
6
A Preconditioned Domain Decomposition Algorithm for the Solu.. (context) - Kiss, Moln'arka - 1992
6
A Preconditioned Domain Decomposition Algorithm for the Solu.. (context) - Kiss, Moln'arks - 1991
6
the Spectrum of a Family Preconditioned Block Toeplitz Matri.. (context) - Ku, Kuo - 1992
6
Preconditioning of Block Toeplitz Matrices by Sine Transform.. (context) - Di Benedetto
6
Polynomials Defined By a Difference System (context) - Baxter - 1961
6
Analysis of Preconditioners for Hyperbolic Partial Different.. (context) - Otto
6
Linear and Nonlinear Deconvolution Problems (context) - Olkin - 1986
6
New Analog of Split Algorithms for Arbitrary Toeplitz-plus-H.. (context) - Yagle - 1991
6
Optimal Trigonometric Preconditioners for Elliptic Problems ..
- Chan, Ching et al. - 1996
5
Fast Recursive Algorithms for a Class of Linear Equations (context) - Carayannis, Kalouptsidis et al. - 1982
5
Digital Filtering in One and Two Dimensions: Design and Appl.. (context) - King - 1989
5
Personal Correspondence (context) - Carreras - 1993
5
Skew-circulant Matrices as Preconditioners for Hermitian Toe.. (context) - Huckle - 1991
5
A Minimum-phase LU Factorization Preconditioner for Toeplitz.. (context) - Ku, Kuo - 1992
5
Best Conditioned Circulant Preconditioners
- Chan, Wong - 1995
5
Circulant Preconditioners for Complex Toeplitz Matrices
- Chan, Yeung - 1993
5
Integral Equation Methods (context) - Green - 1969
5
Linear Prediction in the Singular Case and the Stability of .. (context) - Gueguen - 1981
5
Iterative Solution of Linear Systems with Low Displacement R.. (context) - Freund, Huckle - 1993
5
The Numerical Solution of the Biharmonic Equation by Conform..
- Chan, DeLillo et al. - 1995
5
Circulant and Skew-circulant Preconditioners for Skew-Hermit.. (context) - Chan, Jin - 1991
5
The Solution of a Toeplitz Set of Linear Equations (context) - Zohar - 1974
5
Preconditioned Iterative Deconvolution (context) - Nagy, Plemmons et al.
4
A note on Skew-circulant Preconditioners for Elliptic Proble.. (context) - Huckle - 1992
4
CG-like Iterative Methods and Semicirculant Preconditioners .. (context) - Holmgren - 1992
4
A Comparison of Preconditioned Iterative Methods for Nonsymm.. (context) - Holmgren, Otto - 1990
4
Semicirculant Preconditioners for First-order Partial Differ.. (context) - Holmgren, Otto - 1994
4
Arithmetic Complexity of Iterative Toeplitz Solvers (context) - Linzer
4
Plemmons Preconditioned Iterative Regularization for Ill--po.. (context) - Hanke, Nagy - 1993
4
Semicirculant Solvers and Boundary Corrections for First-ord.. (context) - Holmgren, Otto
4
Efficient Least Squares FIR System Identification (context) - Marple - 1981
4
Influence of Matrix Operations on the Distribution of Eigenv.. (context) - Tyrtyshnikov - 1994
4
Total Variation Regularization of Ill-posed Problems (context) - Vogel - 1993
4
Iterative Methods for Toeplitz-like Matrices
- Huckle - 1994
4
Toeplitz Preconditioners with Block Structure for First-orde.. (context) - Hemmingsson
4
Jackson's Theorem and Circulant Preconditioned Toeplitz Syst..
- Chan, Yeung - 1992
4
An Extended Berlekamp-Massey Algorithm for the Inversion of ..
- Henkel - 1992
3
Fast Algorithms for Linear Prediction and System Identificat.. (context) - Marple - 1982
3
Circulant Preconditioners for Second Order Hyperbolic Equati.. (context) - Jin, Chan - 1992
3
A Note on Circulant Preconditioners for Hyperbolic and Parab.. (context) - Jin - 1993
3
Hankel Matrices (context) - Widom - 1966
3
Fast Inversion of Banded Toeplitz Matrices by Circular Decom.. (context) - Jain - 1978
3
FFT--based RLS in Signal Processing (context) - Plemmons - 1993
3
Circulant Approximations of the Inverses of Toeplitz Matrice.. (context) - Sherman - 1985
3
Analytic and Numerical Aspects of the Observation of the Hea.. (context) - Gilliam, Martin et al. - 1987
3
Preconditioners for Wiener-Hopf Equations with Higher Order ..
- Lin, Ng et al.
3
Numerical Solutions for the Inverse Heat Problems in IR N (context) - Chan - 1992
3
Preconditioned Iterative Methods for Solving Toeplitz-plus-H.. (context) - Ku, Kuo - 1993
3
Fast Computation of Toeplitz Forms under Narrow Band Conditi.. (context) - Steimel - 1980
3
Fast Algorithms for Close-to-Toeplitz-Plus-Hankel Systems an.. (context) - Hsue, Yagle - 1993
2
the Solution of Certain Skew Symmetric Linear Systems (context) - Buckley - 1977
2
Construction of Preconditioners for Wiener-Hopf Equations by..
- Ng, Lin et al. - 1995
2
Decomposition and Construction of Preconditioners for Wiener.. (context) - Ng, Lin - 1996
2
Fast FFT-based Conjugate Gradient Algorithm for Applications.. (context) - Ng - 1993
2
The Toeplitz-Circulant Eigenvalue Problem Ax = Cx (context) - Strang, Edelman - 1987
2
Circulant Integral Operators and Circulant Preconditioners (context) - Chan, Lin - 1993
2
Signal Processing and Systems Theory (context) - Chui, Chen - 1992
2
Adaptive Signal Processing (context) - Sibul - 1987
2
Extended Circulant Conditioning of Toeplitz Systems (context) - Linzer - 1992
2
On Circulant Preconditioning of Elliptic Problems in L-shape.. (context) - Lirkov, Margenov - 1994
2
Hartley Preconditioners for Toeplitz Systems Generated by Po.. (context) - Jin - 1994
2
Band-Toeplitz Preconditioners for Block Toeplitz Systems (context) - Jin
2
Optimal Circulant Preconditioning for Arbitrary Matrices (context) - Sayed, Kailath
2
Which Circulant Preconditioners are Better (context) - Tyrtyshnikov, Strela
1
the Algebraic Structure of the Spaces of Toeplitz and Hankel.. (context) - Pusty, On - 1980
1
Englewood Cliiffs (context) - Hamming, Filters et al. - 1989
1
Approximation Thoery and Numerical Linear Algebra (context) - Trefethen - 1990
1
Plemmons Fast Recursive Least Squares Using the FFT (context) - Ng - 1994
1
Iterative Method for Solving Toeplitz-plus-Hankel Least Squa.. (context) - Ng - 1994
1
Analysis of Semi-Toeplitz Preconditioners for First-order PD.. (context) - Semi, for et al.
1
Zur Theorie der quadratischen und bilinearen Formen von unen.. (context) - Otto - 1911
1
Circulant Integral Operators for Wiener-Hopf Equations (context) - Chan, Jin et al. - 1995
1
Fast Algorithms for Structured Matrices Arbitrary Rank Profi.. (context) - Pal - 1990
The graph only includes citing articles where the year of publication is known.
Documents on the same site (http://www.math.cuhk.edu.hk/~rchan/misc/shortcv.html): More
Circulant preconditioners from B-splines - Chan, Tso, Sun (1997)
(Correct)
Generalization of Strang's Preconditioner with Applications .. - Chan, Ng, Plemmons
(Correct)
The Numerical Solution of the Biharmonic Equation by.. - Chan, DeLillo, Horn (1995)
(Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC