Download:
by Guillaume Dewaele, Frédéric Devernay, Radu Horaud
8th European Conference on Computer Vision. Volume I of LNCS 3021
http://www.inrialpes.fr/movi/publi/Publications/2004/DDH04/hand3d-final.pdf
Add To MetaCart
Abstract:
Abstract. A method is proposed to track the full hand motion from 3D points reconstructed using a stereoscopic set of cameras. This approach combines the advantages of methods that use 2D motion (e.g. optical flow), and those that use a 3D reconstruction at each time frame to capture the hand motion. Matching either contours or a 3D reconstruction against a 3D hand model is usually very difficult due to self-occlusions and the locally-cylindrical structure of each phalanx in the model, but our use of 3D point trajectories constrains the motion and overcomes these problems. Our tracking procedure uses both the 3D point matches between two time frames and a smooth surface model of the hand, build with implicit surface. We used animation techniques to represent faithfully the skin motion, especially near joints. Robustness is obtained by using an EM version of the ICP algorithm for matching points between consecutive frames, and the tracked points are then registered to the surface of the hand model. Results are presented on a stereoscopic sequence of a moving hand, and are evaluated using a side view of the sequence. 1
Citations
|
669
|
Good features to track
– Shi, Tomasi
- 1994
|
|
285
|
A Generalization Of Algebraic Surface Drawing
– Blinn
- 1982
|
|
272
|
Terative point matching for registration of freeform curves and surfaces
– Zhang
- 1994
|
|
243
|
Data structures for soft objects
– Wyvill, McPheeters
- 1986
|
|
198
|
A survey of computer visionbased human motion capture
– Moeslund, Granum
|
|
179
|
Model-based tracking of selfoccluding articulated objects
– Rehg, Kanade
- 1995
|
|
115
|
3D Articulated Models and Multi-view Tracking with Silhouettes
– Delamarre, Faugeras
- 1999
|
|
91
|
Towards 3D hand tracking using a deformable model
– Heap, Hogg
- 1996
|
|
72
|
Rigid, affine and locally affine registration of free-form surfaces
– Feldmar, Ayache
- 1996
|
|
67
|
Rangarajan A.: A new point-matching algorithm for non-rigid registration. Computer Vision and Image Understanding
– Chui
- 2002
|
|
60
|
Capturing natural hand articulation
– Wu, Lin, et al.
- 2001
|
|
56
|
Estimating 3d hand pose from a cluttered image
– Athitsos, Sclaroff
- 2003
|
|
34
|
Multiple-hand-gesture tracking using multiple cameras
– Utsumi, Ohya
- 1999
|
|
33
|
F.: The Softassign Procrustes Matching Algorithm
– Rangarajan, Chui, et al.
- 1997
|
|
26
|
Real-time 3-D hand posture estimation based on 2-D appearance retrieval using monocular camera
– Shimada, Kimura, et al.
- 2001
|
|
20
|
Model based 3D tracking of an articulated hand
– Stenger, Mendonça, et al.
- 2001
|
|
19
|
Using Multiple Cues for Hand Tracking and Model Refinement
– Lu, Metaxas, et al.
- 2003
|
|
18
|
Articulated Soft Objects for Multi-View Shape and Motion Capture
– Plänkers, Fua
- 2003
|
|
17
|
Multi-scale em-icp: A fast and robust approach for surface registration
– Granger, Pennec
- 2002
|
|
16
|
Finding Pose of Hand in video images: a stereo based approach
– Delamarre, Faugeras
- 1998
|
|
6
|
Human hand tracking from binocular image sequences
– Nirei, Saito, et al.
- 1996
|
|
3
|
Medial based vertex deformation
– Bloomenthal
- 2000
|
|
1
|
Rigid, affine and locally addinne registration of freeform surfaces
– Feldmar, Ayache
- 1996
|