Incremental PCA-LDA Algorithm

Incremental PCA-LDA Algorithm

Cached

by Issam Dagher

Citations:

BibTeX

@MISC{Dagher_incrementalpca-lda,
    author = {Issam Dagher},
    title = { Incremental PCA-LDA Algorithm},
    year = {}
}

Bookmark

OpenURL

Abstract

In this paper a recursive algorithm of calculating the discriminant features of the PCA-LDA procedure is introduced. This algorithm computes the principal components of a sequence of vectors incrementally without estimating the covariance matrix (so covariance-free) and at the same time computing the linear discriminant directions along which the classes are well separated. Two major techniques are used sequentially in a real time fashion in order to obtain the most efficient and linearly discriminative components. This procedure is done by merging the runs of two algorithms based on principal component analysis (PCA) and linear discriminant analysis (LDA) running sequentially. This algorithm is applied to face recognition problem. Simulation results on different databases showed high average success rate of this algorithm compared to PCA and LDA algorithms. The advantage of the incremental property of this algorithm compared to the batch PCA-LDA is also shown.

Citations

2223	Eigenfaces for recognition - Turk, Pentland - 1991
2107	Introduction to statistical pattern recognition - Fukunaga - 1990
1080	Eigenfaces vs. fisherfaces: Recognition using class specific linear projection - Belhumeur, Hespanha, et al. - 1997
846	Visual learning and recognition of 3-d objects from appearance - Murase, Nayar - 1995
329	Using Discriminant Eigenfeatures for Image Retrieval - Swets, Weng, et al. - 1996
219	PCA versus LDA - Martinez, Kak - 2001
142	What does the retina know about natural scenes? Neural Comput - Atick, Redlich - 1992
122	A direct LDA algorithm for high-dimensional data with application to face recognition - Yu, Yang
89	Two-dimensional PCA: A new approach to appearance-based face representation and recognition - Yang, Zhang, et al.
80	Representation and separation of signals using nonlinear PCA type learning - Karhunen, Joutsensalo - 1994
75	Subspace linear discriminant analysis for face recognition - Zhao, Chellapa, et al. - 1999
19	Appearance-based hand sign recognition from intensity image sequences - Cui, Weng
13	IDR/QR: An incremental dimension reduction algorithm via QR decomposition - Ye, Li, et al. - 2005
8	R.Cipolla, "Incremental Linear Discriminant Analysis Using Sufficient Spanning Set Approximations - Kim, Wong, et al.
8	State-based SHOSLIF for indoor visual navigation - Chen, Weng - 2000
6	Incremental LDA Learning by Combining Reconstructive and Discriminative Approaches - Uray, Skočaj, et al. - 2007
6	Face Recognition Using IPCA-ICA Algorithm - Dagher, Nachar - 2006
6	Wilkes and Atalay Barkana, Discriminative Common Vectors for Face Recognition - Cevikalp, Neamtu, et al. - 2005
3	two dimensional FLD for face recognition - Xiong, Swamy, et al. - 2005
2	Moghaddam “A New Incremental Face Recognition System - Ghassabeh, Ghavami
2	Qinglong Chen1, and Jingyu Yang,” A Novel Supervised Dimensionality Reduction Algorithm for Online Image Recognition - Song, Zhang - 2006
2	Jingyu Yang “A highly scalable incremental facial feature extraction method”, Elsevier. Neurocomputing 71 - Liu, Zhang - 2008
2	Vitria “Learning to learn: From smart machines to intelligent machines - Raducanu, J
2	face database,website:http://www1.cs.columbia.edu/~belhumeur/pub/images/yalefaces - Yale
2	Tieniu Tan and Yong Zhu, "Face Verification Based on Singular Value Decomposition and Radial Basis Function Neural Network - Wang - 1000
2	Li Q.,”two dimensional linear discriminant analysis”, NIPS - Ye, Janardan - 2004