Download:
by Song Chun, Zhu Nian, Wu David Mumford
http://www.isi.uu.nl/Meetings/../TGV/ZhuWuMumford_MinimaxEntropyPrincipleAndItsApplication2TextureModeling.pdf
Add To MetaCart
Abstract:
This article proposes a general theory and methodology, called the minimax entropy principle, for building statistical models for images (or signals) in a variety of applications. This principle consists of two parts. The first is the maximum entropy principle for feature binding (or fusion): for a certain set of feature statistics, a distribution can be built to bind these feature statistics together by maximizing the entropy over all distributions that reproduce these feature statistics. The second part is the minimum entropy principle for feature selection: among all plausible sets of feature statistics, we choose the set whose maximum entropy distribution has the minimum entropy. Computational and inferential issues in both parts are addressed, in particular, a feature pursuit procedure is proposed for approximately selecting the optimal set of features. The model complexity is restricted because of the sample variation in the observed feature statistics. The minimax entropy principle is applied to texture modeling, where a novel Markov random field (MRF) model, called FRAME (Filter, Random field, And Minimax Entropy), is derived, and encouraging results are obtained in experiments on a variety of texture images. Relationship between our theory and the mechanisms of neural computation is also discussed.
Citations
|
2322
|
Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images
– Geman, Geman
- 1984
|
|
850
|
Principal Component Analysis
– Jolliffe
- 1986
|
|
615
|
Spatial interaction and the statistical analysis of lattice systems (with discussion
– Besag
- 1974
|
|
593
|
Hierarchical Mixtures of Experts and the EM algorithm
– Jordan, Jacobs
- 1993
|
|
588
|
Information Theory and Statistics
– Kullback
- 1959
|
|
536
|
Visual Reconstruction
– Blake, Zisserman
- 1987
|
|
439
|
Theory of communication
– Gabor
- 1946
|
|
433
|
Optimal approximations by piecewise smooth functions and associated variational problems
– Mumford, Shah
- 1989
|
|
406
|
On information and sufficiency
– Kullback, Leibler
- 1951
|
|
358
|
Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters
– Daugman
- 1985
|
|
309
|
Multiresolution approximation and wavelet orthonormal bases of L2
– Mallat
- 1989
|
|
306
|
Shiftable multiscale transforms
– Simoncelli, Adelson, et al.
- 1992
|
|
279
|
Information theory and statistical mechanics
– Jaynes
- 1957
|
|
257
|
Spectral Analysis and Time Series
– Priestley
- 1981
|
|
254
|
Pyramid-Based Texture Analysis/Synthesis
– Heeger, Bergen
- 1995
|
|
197
|
Markov random field texture models
– Cross, Jain
- 1983
|
|
146
|
Image analysis, random fields, and dynamic Monte Carlo methods : a mathematical introduction. Berlin
– Winkler
- 1995
|
|
133
|
Filters, random fields and maximum entropy (frame
– Zhu, Wu, et al.
- 1998
|
|
96
|
Reaction-diffusion textures
– Kass
- 1991
|
|
95
|
Visual pattern discrimination
– Julesz
- 1962
|
|
73
|
Entropy based algorithms for best basis selection
– Coifman, Wickerhauser
- 1992
|
|
67
|
Ideal denoising in an orthonormal basis chosen from a library of bases
– Donoho, Johnstone
- 1994
|
|
47
|
Finding minimum entropy codes
– Barlow, Kaushal, et al.
- 1989
|
|
46
|
On the computational architecture of the neocortex. II. The role of cortico-cortical loops
– Mumford
- 1992
|
|
37
|
On entropy maximization principle
– Akaike
- 1977
|
|
36
|
Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity
– Karni, Sagi
- 1991
|
|
28
|
Dialogues on Perception
– Julesz
- 1995
|
|
24
|
Orthogonal distribution analysis: A new approach to the study of texture perception
– Chubb, Landy
- 1991
|
|
17
|
Ying-Yang machine: a Bayesian-Kullback scheme for unified learnings and new results on vector quantization
– Xu
- 1995
|
|
15
|
Learning Generic Prior Models for Visual Computation
– Zhu, Mumford
- 1997
|
|
11
|
Spatial-frequency organization in primate striate cortex
– Silverman, Grosof, et al.
- 1989
|
|
5
|
Theories of visual texture perception." Spatial Vision D.Regan (eds
– Bergen, Adelson
- 1991
|
|
4
|
The Helmholtz machine", Neural Computation
– Dayan, Hinton, et al.
- 1995
|
|
3
|
What is the goal of sensory coding?", Neural Computation
– Field
- 1994
|
|
3
|
A society of models for video and image libraries", MIT media lab. technical report No.360
– Picard
- 1996
|
|
3
|
Estimation and annealing for Gibbsian fields (STMA V30 1845). Annales de l'Institut Henri Poincare, Section B, Calcul des Probabilities et Statistique
– Younes
- 1988
|
|
3
|
Statistical and Computatinal Theories for Image Segmentation, Texture Modeling and Object Recognition
– Zhu
- 1996
|
