Download:
by Peter Eisert, Eckehard Steinbach, Bernd Girod
IEEE Transactions on Circuits and Systems for Video Technology: Special Issue on 3D Video Technology
http://bs.hhi.de/~eisert/papers/trcsvt00b.pdf
Add To MetaCart
Abstract:
A system for the automatic reconstruction of real world objects from multiple uncalibrated camera views is presented. The camera position and orientation for all views, the 3-D shape of the rigid object as well as associated color information are recovered from the image sequence. The system proceeds in four steps. First, the internal camera parameters describing the imaging geometry of the camera are calibrated using a reference object. Second, an initial 3-D description of the object is computed from two views. This model information is then used in a third step to estimate the camera positions for all available views using a novel linear 3-D motion and shape estimation algorithm. The main feature of this third step is the simultaneous estimation of 3-D camera motion parameters and object shape refinement with respect to the initial 3-D model. The initial 3-D shape model exhibits only a few degrees of freedom and the object shape refinement is defined as flexible deformation of the initial shape model. Our formulation of the shape deformation allows the object texture to slide on the surface, which differs from traditional flexible body modeling. This novel combined shape and motion estimation using sliding texture considerably improves the calibration data of the individual views in comparison to fixed-shape model-based camera motion estimation. Since the shape model used for model-based camera motion estimation is approximate only, a volumetric 3-D reconstruction process is initiated in the fourth step that combines the information from all views simultaneously. The recovered object consists of a set of voxels with associated color information that describe even fine structures and details of the object. New views of the object can be rendered from the recovered 3-D model, which has potential applications in virtual reality or multimedia systems and the emerging field of video coding using 3-D scene models. 1 1
Citations
|
1131
|
Robot Vision
– Horn
- 1986
|
|
697
|
A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses
– Tsai
- 1987
|
|
518
|
A volumetric method for building complex models from range images”, SIGGRAPH '96
– Curless, Levoy
- 1996
|
|
365
|
Three-Dimensional Computer Vision
– Faugeras
- 1993
|
|
266
|
Photorealistic scene reconstruction by voxel coloring
– Seitz, Dyer
- 1999
|
|
253
|
Uniqueness and estimation of three dimensional motion parameters of rigid objects with curved surface
– Tsai, Huang
- 1984
|
|
237
|
Estimation of relative camera positions for uncalibrated cameras
– Hartley
- 1992
|
|
212
|
Gool. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters
– Pollefeys, Koch, et al.
- 1999
|
|
183
|
3D model acquisition from extended image sequences
– Beardsley, Torr, et al.
- 1996
|
|
162
|
Rapid octree construction from image sequences
– Szeliski
|
|
125
|
Automatic camera recovery for closed or open image sequences
– Fitzgibbon, Zisserman
- 1998
|
|
122
|
3-D motion estimation in model-based facial image coding
– Roivainen, Li, et al.
- 1993
|
|
87
|
Multi viewpoint stereo from uncalibrated video sequences
– Koch, Pollefeys, et al.
- 1998
|
|
61
|
Automatic 3D Model Construction for Turn-Table Sequences
– Cross, Zisserman
- 1998
|
|
52
|
Automatic model construction, pose estimation, and object recognition from photographs using triangular splines
– Sullivan, Ponce
|
|
48
|
Dynamic 3-d scene analysis through synthesis feedback control
– Koch
- 1993
|
|
40
|
Multi-hypothesis, Volumetric Reconstruction of 3-D Objects from Multiple Calibrated Camera Views
– Eisert, Steinbach, et al.
- 1999
|
|
29
|
Automatic reconstruction of 3D objects using a mobile monoscopic camera
– Niem, Wingbermuhle
- 1997
|
|
28
|
Depth Estimation from Stereoscopic Image Pairs Assuming Piecewise Continuos Surfaces”, European Workshop on Combined real and synthetic image processing for broadcast and video productions
– Falkenhagen
- 1994
|
|
28
|
3-d model construction from multiple views using range and intensity data
– Vemuri, Aggarwal
- 1986
|
|
23
|
Detection of intensity changes with subpixel accuracy using Laplacian-Gaussian masks
– Huertas, Medioni
- 1986
|
|
20
|
Object models from contour sequences
– Boyer
- 1996
|
|
15
|
Algorithms for estimation of three-dimensional motion
– Netravali, Salz
- 1985
|
|
10
|
Model-based 3D motion estimation with illumination compensation
– Eisert, Girod
- 1997
|
|
7
|
A comparison of some techniques for the subpixel location of discrete target images
– Shortis, Clarke, et al.
- 1994
|
|
7
|
Motion-based analysis and segmentation of image sequences using 3-d scene models
– Steinbach, Eisert, et al.
- 1998
|
|
5
|
Gool, “Flexible acquisition of 3D structure from motion
– Pollefeys, Koch, et al.
- 1998
|
|
5
|
Robust Estimation of Multi-Component Motion in Image Sequences Using the Epipolar Constraint
– Steinbach, Chaudhuri, et al.
- 1997
|
|
2
|
A new method for simultaneous estimation of displacement, depth, and rigid body motion parameters
– Girod, Steinbach
- 1996
|
|
1
|
Camera self-calibration—Theory and experiments
– Faugeras, Luong, et al.
- 1992
|
|
1
|
Video representation with 3D entities
– Martins, Moura
- 1998
|
