Download:
by Ravi Ramamoorthi, Melissa Koudelka, Peter Belhumeur
IEEE Transactions on Pattern Analysis and Machine Intelligence
http://www1.cs.columbia.edu/~ravir/shadows.pdf
Add To MetaCart
Abstract:
Abstract. Cast shadows can be significant in many computer vision applications such as lighting-insensitive recognition and surface reconstruction. However, most algorithms neglect them, primarily because they involve non-local interactions in non-convex regions, making formal analysis difficult. While general cast shadowing situations can be arbitrarily complex, many real instances map closely to canonical configurations like a wall, a V-groove type structure, or a pitted surface. In particular, we experiment on 3D textures like moss, gravel and a kitchen sponge, whose surfaces include canonical cast shadowing situations like V-grooves. This paper shows theoretically that many shadowing configurations can be mathematically analyzed using convolutions and Fourier basis functions. Our analysis exposes the mathematical convolution structure of cast shadows, and shows strong connections to recently developed signal-processing frameworks for reflection and illumination. An analytic convolution formula is derived for a 2D V-groove, which is shown to correspond closely to many common shadowing situations, especially in 3D textures. Numerical simulation is used to extend these results to general 3D textures. These results also provide evidence that a common set of illumination basis functions may be appropriate for representing lighting variability due to cast shadows in many 3D textures. We derive a new analytic basis suited for 3D textures to represent illumination on the hemisphere, with some advantages over commonly used Zernike polynomials and spherical harmonics. New experiments on analyzing the variability in appearance of real 3D textures with illumination motivate and validate our theoretical analysis. Empirical results show that illumination eigenfunctions often correspond closely to Fourier bases, while the eigenvalues drop off significantly slower than those for irradiance on a Lambertian curved surface. These new empirical results are explained in this paper, based on our theory. 1
Citations
|
1026
|
A Wavelet Tour of Signal Processing
– Mallat
- 1998
|
|
268
|
Reflectance and texture of real-world surfaces
– DANA, GINNEKEN, et al.
- 1999
|
|
239
|
Theory for off-specular reflection from roughened surfaces
– Torrance, Sparrow
- 1967
|
|
184
|
Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments
– Sloan, Kautz, et al.
- 2002
|
|
146
|
Lambertian Reflectance and Linear Subspaces
– Basri, Jacobs
- 2003
|
|
99
|
A Low-Dimensional Representation of Human Faces For Arbitrary Lighting Conditions
– Hallinan
- 1994
|
|
94
|
Predicting reflectance functions from complex surfaces
– WESTIN, ARVO, et al.
- 1992
|
|
92
|
A signal-processing framework for inverse rendering
– Ramamoorthi, Hanrahan
- 2001
|
|
79
|
Fast calculation of soft shadow textures using convolution
– SOLER, SILLION
- 1998
|
|
73
|
Polynomial texture maps
– MALZBENDER, GELB, et al.
- 2001
|
|
53
|
On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object
– Ramamoorthi, Hanrahan
- 2001
|
|
52
|
Bidirectional reflection distribution function expressed in terms of surface scattering modes
– Koenderink, Doorn, et al.
- 1996
|
|
46
|
Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object
– Ramamoorthi
- 2002
|
|
44
|
Generalization of Lambert’s reflectance model
– Oren, Nayar
- 1994
|
|
38
|
Histogram model for 3d textures
– Dana, Nayar
- 1998
|
|
37
|
Illumination distribution from brightness in shadows: Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions
– Sato, Sato, et al.
- 1999
|
|
21
|
Spherical harmonics; an elementary treatise on harmonic functions, with applications
– MacRobert
- 1948
|
|
20
|
Phenomenological description of bidirectional surface reflection
– KOENDERINK, DOORN
- 1998
|
|
15
|
Improved diffuse reflection models for computer vision
– Wolff, Nayar, et al.
- 1998
|
|
13
|
Analyzing the bidirectional texture function
– Suen, Healey
- 1998
|
|
10
|
5 plus or minus 2 eigenimages suffice: An empirical investigation of low-dimensional lighting models
– Epstein, Hallinan, et al.
- 1995
|
|
10
|
Acquisition, compression, and synthesis of bidirectional texture functions
– KOUDELKA, MAGDA, et al.
- 2003
|
|
10
|
Analysis of planar light fields from homogeneous convex curved surfaces under distant illumination
– Ramamoorthi, Hanrahan
- 2001
|
|
5
|
Analysis of radiative transfer between surfaces by hemispherical harmonics
– Makhotkin
- 1996
|
|
3
|
A Novel Hemispherical Basis for Accurate and Efficient
– Gautron, Krivanek, et al.
- 2004
|
|
1
|
Cast Shadows and Linear Subspaces
– Thornber, Jacobs
- 2001
|