Augmented reality deals with the problem of dynamically augmenting or enhancing (images or live video of) the real world with computer generated data (e.g., graphics of virtual objects). This poses two major problems: (a) determining the precise alignment of real and virtual coordinate frames for overlay, and (b) capturing the 3D environment including camera and object motions. The latter is important for interactive augmented reality applications where users can interact with both real and virtual objects. In this paper we address the problem of accurately tracking the 3D motion of a monocular camera in a known 3D environment and dynamically estimating the 3D camera location. We utilize fully automated landmark-based camera calibration to initialize the motion estimation and employ extended Kalman filter techniques to track landmarks and to estimate the camera location. The implementation of our approach has been proven to be efficient and robust and our system successfully tracks in real-time at approximately 15 Hz.
|
1021
|
Three Dimensional Computer Vision: A Geometric Viewpoint
– Faugeras
- 1993
|
|
244
|
Clasical Mechanics
– GOLDSTEIN
- 1950
|
|
145
|
Robust model-based motion tracking through the integration of search and estimation
– Lowe
- 1992
|
|
133
|
Numerical shape from shading and occluding boundaries, Artif. Intell
– Ikeuchi, Horn
|
|
128
|
Visual tracking of known three-dimensional objects
– Gennery
- 1992
|
|
100
|
Superior Augmented Reality Registration by Integrating Landmark Tracking
– State, Hirota, et al.
- 1996
|
|
93
|
White “An Automatic Registration Method for Frameless Stereotaxy
– Grimson, Lozano-Perez, et al.
- 1994
|
|
72
|
Recursive 3-D motion estimation from a monocular sequence
– Broida, Chandrashekhar, et al.
- 1990
|
|
72
|
Augmented Reality: An Application of Heads-Up Display Technology to Manual Manufacturing Processes
– Caudell, Mizell
- 1992
|
|
62
|
Determining 3-D Motion and Structure from Optical Flow Generated by Several Moving .Objects
– Adiv
- 1984
|
|
58
|
Group-Theoretical Methods in Image Understanding
– Kanatani
- 1990
|
|
53
|
Vision-based object registration for real-time image overlay
– Uenohara, Kanade
- 1994
|
|
39
|
Dynamic registration correction in video-based augmented reality systems
– Bajura, Neumann
- 1995
|
|
34
|
Calibration requirements and procedures for a monitor-based augmented reality system
– Tuceryan, Greer, et al.
- 1995
|
|
31
|
Realtime Camera Calibration for Enhanced Reality Visualization
– Mellor
- 1995
|
|
31
|
Applications of augmented reality for human-robot communication
– Milgram, Shumin, et al.
- 1993
|
|
31
|
Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies
– State, Livingston, et al.
- 1996
|
|
23
|
On the parameterization of the three-dimensional rotation group
– Stuelpnagel
- 1964
|
|
22
|
Interactive Occlusion and Automatic Object Placement for Augmented Reality
– Breen, Whitaker, et al.
- 1996
|
|
20
|
Fuchs and Ohbuchi, “Merging virtual objects with the real world: Seeing ultrasound imagery within the patient,” Computer Graphics
– Bajura, H
- 1992
|
|
20
|
A global algorithm for shape from shading
– Oliensis, Dupuis
- 1993
|
|
19
|
Estimating motion and structure from correspondences of line segments between two perspective images
– Zhang
- 1995
|
|
18
|
Illumination problems in computer augmented reality
– Fournier
- 1994
|
|
14
|
A mathematical morphology toolbox for the khoros system
– Barrera, Banon, et al.
- 1994
|
|
14
|
Annotating real-world objects using augmented reality
– Rose, Breen, et al.
- 1995
|
|
8
|
Calibration of stereo cameras using a non-linear distortion model
– Weng, Cohen, et al.
- 1990
|
|
7
|
Determining three-dimensional motion and structure from perspective views
– Huang
- 1986
|
|
5
|
Composing computer-generated images and video films: An application for visual assessment in urban environments
– Chevrier, Belblidia, et al.
- 1995
|
|
4
|
Xiao-Rong Li, Estimation and Tracking
– Bar-Shalom
- 1993
|
|
4
|
A robust vision-based tracking technique for augmented reality applications
– Koller
- 1997
|
|
4
|
Motion estimation with more then two frames
– Shariat, Price
- 1990
|
|
2
|
Enhancing Reality
– Lorensen, Cline, et al.
- 1993
|
|
1
|
3D Dynamic Scene Analysis. No. 27
– Zhang, Faugeras
- 1992
|
|
