Abstract:
Inferring both 3D structure and motion of nonrigid objects from monocular images is an important problem in computational vision. The challenges stem not only from the absence ofpoint correspondences but also from the structure ambiguity. In this paper, a hierarchical method which integrates both local patch analysis and global shape descriptions is devised to solve the dual problem of structure and nonrigid motion recovery by using an elastic geometric model|extended superquadrics. The nonrigid object of interest is segmented into many small areas and local analysis is performed torecover small details for each small area, assuming that each small area is undergoing similar nonrigid motion. Then, a recursive algorithm is proposed to guide and regularize local analysis with global information by using an appropriate global shape model. This local-global hierarchy enables us to capture both local and global deformations accurately and robustly. Experimental results on both simulation and real data are presented to validate and evaluate the e ectiveness and robustness of the proposed approach. 1
Citations
|
186
|
Constraints on deformable models: Recovering 3-D shape and nonrigid motions
– Terzopoulos, Witkin, et al.
- 1988
|
|
154
|
Analysis and synthesis of facial image sequences using physical and anatomical models
– �Terzopoulos, Waters
- 1993
|
|
146
|
Shape and nonrigid motion estimation through physics-based synthesis
– Metaxas, Terzopoulos
- 1993
|
|
116
|
3D motion estimation in model-based facial image coding
– Li, Roivainen, et al.
- 1993
|
|
109
|
Recognizing facial expressions in image sequences using local parameterized models of image motion
– Yacoob
- 1997
|
|
93
|
Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection
– Kakadiaris, Metaxas
|
|
57
|
A finite element model for 3D shape reconstruction and nonrigid motion tracking
– McInerney, Terzopoulos
- 1993
|
|
47
|
3D Scene Analysis through Synthesis Feedback Control
– Koch, ”Dynamic
- 1993
|
|
39
|
Deformable model-based shape and motion analysis from images using motion residual error
– DeCarlo, Metaxas
- 1998
|
|
24
|
Structure from controlled motion
– Chaumette, Boukir, et al.
- 1996
|
|
24
|
Nonrigid motion analysis
– Kambhamettu, Goldgof, et al.
- 1993
|
|
23
|
Adaptive-size meshes for rigid and nonrigid shape analysis and synthesis
– Huang, Goldgof
- 1993
|
|
21
|
Explanation-based facial motion tracking using a piecewise bezier volume deformation model
– Tao, Huang
- 1999
|
|
7
|
Recovery of nonridid motion and structure
– Pentland, Horowitz
- 1991
|
|
3
|
High-speed extraction of 3D structure of selectable quality using a translating camera
– Dalmia, Trivedi
- 1996
|
|
2
|
Dmitry Goldgof. Extraction of mpeg-4 fap parameters from 3d face data sequences
– Chen, Kambhamettu
- 1997
|
|
2
|
Interpretation of image ow: A spatio-temporal approach
– Subbarao
- 1989
|
|
2
|
Displacement estimates through adaptive a nities
– Werkhoveh, Toet, et al.
- 1990
|