Download:
by A. Ben Hamza, Hamid Krim
Lecture Notes in Computer Science
http://www4.ncsu.edu:8030/~abhamza/emmcvpr03.pdf
Add To MetaCart
Abstract:
Abstract. Information theoretic measures provide quantitative entropic divergences between two probability distributions or data sets. In this paper,we analyze the theoretical properties of the Jensen-Rényi divergence which is defined between any arbitrary number of probability distributions. Using the theory of majorization,we derive its maximum value, and also some performance upper bounds in terms of the Bayes risk and the asymptotic error of the nearest neighbor classifier. To gain further insight into the robustness and the application of the Jensen-Rényi divergence measure in imaging,we provide substantial numerical experiments to show the power of this entopic measure in image registration and segmentation. 1
Citations
|
578
|
A Probabilistic Theory of Pattern Recognition
– Devroye, Gyorfi, et al.
- 1996
|
|
537
|
P.: Nearest Neighbor pattern classification
– Cover, Hart
- 1967
|
|
438
|
W.W.: Alignment by maximization of mutual information
– Viola
- 1995
|
|
416
|
On information and sufficiency
– Kullback, Leibler
- 1951
|
|
247
|
Multimodality image registration by maximization of mutual information
– Maes, Collignon, et al.
- 1997
|
|
180
|
Divergence measures based on the Shannon entropy
– Lin
- 1991
|
|
115
|
Unsupervised Learning of Finite Mixture Models
– Figueiredo, Jain
- 2002
|
|
111
|
Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects
– Paragios, Deriche
- 2000
|
|
62
|
Introductory digital image processing: A remote sensing perspective, Prentice-Hall, Englewood Cliffs
– Jensen
- 1986
|
|
46
|
A general class of coefficients of divergence of one distribution from another
– Ali, Silvey
- 1966
|
|
33
|
Applications of entropic spanning graphs
– Hero, Ma, et al.
- 2002
|
|
24
|
Medical image matching---A review with classification
– Elsen, Viergever
- 1993
|
|
14
|
H.: A generalized divergence measure for robust image registration
– He, Ben-Hamza, et al.
|
|
7
|
Francos, “Image retrieval and indexing: A hierarchical approach in computing the distance between textured images
– Stoica, Zerubia, et al.
- 1998
|
|
4
|
An information theoretic measure for isar imagery focusing
– He, Hamza, et al.
- 2000
|
|
3
|
An analysis of edge detection by using the Jensen-Shannon divergence
– Gomez, Martinez, et al.
- 2000
|
|
3
|
Sequence compositional complexity of DNA through an entropic segmentation method
– Roman, Bernaola, et al.
- 1998
|
|
1
|
On Measures of Entropy and Information,Selected Papers of Alfréd Rényi,vol.2,pp
– Rényi
|
|
1
|
Raviv,“Probability of error,equivocation,and the Chernoff bound
– Hellman, J
|
