Download:
by Zhengyou Zhang
Proc. International Symposium on the CREST Digital Archiving Project
http://www.research.microsoft.com/~zhang/Papers/CREST03.pdf
Add To MetaCart
Abstract:
This paper presents two vision-based interface systems. The first, Visual Screen, uses an inexpensive technique to transform an ordinary screen into a touch screen using an ordinary camera. The setup is easy: position a camera so it can see the whole screen. The system calibration involves the detection of the screen region in the image, which determines the projective mapping between the image plane and the screen. In runtime, our system locates the tip pointer (fingertip in our current implementation) in the image and converts the image position to the cursor position on the screen. The second system, Visual Panel, extends the previous system for mobile applications. It employs an arbitrary quadrangle-shaped panel (e.g., an ordinary piece of paper) and a tip pointer as an intuitive, wireless and mobile input device. The system can accurately and reliably track the panel and the tip pointer. The panel tracking continuously determines the projective mapping between the panel at the current position and the display, which in turn maps the tip position to the corresponding position on the display. The system can fulfill many tasks such as controlling a remote large display, and simulating a physical keyboard. Users can naturally use their fingers or other tip pointers to issue commands and type texts. Furthermore, by tracking the 3D position and orientation of the visual panel, the system can also provide 3D information, serving as a virtual joystick, to control 3D virtual objects. Keywords: Vision-based user interface, Visual Screen, Visual Panel, new input device, new control device, virtual touch screen, virtual mouse,
Citations
|
4364
|
Elements of Information Theory
– Cover, Thomas
- 1991
|
|
1021
|
Three Dimensional Computer Vision: A Geometric Viewpoint
– Faugeras
- 1993
|
|
720
|
Pfinder: Realtime tracking of the human body
– Wren, Azarbayejani, et al.
- 1997
|
|
310
|
A Flexible New Technique for Camera Calibration", IEEE transactions on pattern analysis and machine intelligence
– Zhang
- 2000
|
|
212
|
Introduction to Applied Mathematics
– Strang
- 1986
|
|
203
|
Interacting with paper on the DigitalDesk
– Wellner
- 1993
|
|
179
|
Model-based tracking of selfoccluding articulated objects
– Rehg, Kanade
- 1995
|
|
105
|
A.Pentland. Augmented reality through wearable computing
– Starner, Mann, et al.
- 1997
|
|
60
|
Quikwriting: Continuous stylus-based text entry
– Perlin
- 1998
|
|
56
|
ASL recognition based on a coupling between HMMs and 3D motion analysis
– Vogler, Metaxas
- 1998
|
|
47
|
Introduction to Algebraic Geometry
– Semple, Roth
- 1949
|
|
36
|
Design and technology for collaborage: Collaborative collages of information on physical walls
– Moran, Saund, et al.
- 1999
|
|
35
|
The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring
– Starner, Auxier, et al.
|
|
31
|
Finger tracking as an input device for augmented reality
– Crowley, Berard, et al.
- 1995
|
|
30
|
A Usable Real-Time 3D Hand Tracker
– Ahmad
- 1994
|
|
26
|
A wearable computer based american sign language recognizer
– Starner, al
- 1997
|
|
24
|
de Malsburg. Robust classification of hand postures against complexbackground
– Triesch, von
- 1996
|
|
23
|
Detecting and estimating pointing gestures in dense disparity maps
– Jojic, Brumitt, et al.
- 2000
|
|
23
|
Unencumbered gesture interaction
– Quek
- 1997
|
|
23
|
Visual Panel: Virtual Mouse, Keyboard and 3D Controller with an Ordinary Piece of Paper
– Zhang, Wu, et al.
- 1999
|
|
20
|
Color-Based Hands Tracking System for Sign Language Recognition
– Imagawa, Lu, et al.
- 1998
|
|
18
|
Gesturecomputer - history, design and applications,” Computer Vision for Human-Machine Interaction
– Maggioni, Kammerer
- 1998
|
|
17
|
Things that see: Machine perception for human computer interaction
– Crowley, Coutaz, et al.
- 2000
|
|
17
|
Human hand modeling, analysis and animation in the context of hci
– Wu, Huang
- 1999
|
|
16
|
Magicboard: A contribution to an intelligent office environment
– Hall, Gal, et al.
- 1999
|
|
12
|
Manipulative hand gestures recognition using task knowledge for human computer interaction
– Jo, Kuno, et al.
- 1998
|
|
9
|
Analysis of gesture and action in technical talks for video indexing
– Ju, Black, et al.
- 1997
|
|
5
|
Small-wall: A multimodal human computer intelligent interaction test bed with applications
– Berry
- 1998
|
|
4
|
Cirrin: A world-level unistroke keyboard for pen input
– Mankoff, Abowd
- 1998
|
|
3
|
A visual computing environment for very large scale biomolecular modeling
– Zeller
- 1997
|
|
2
|
Tele-Graffiti: A Pen and Paper-Based Remote Sketching System
– Takao, Shi, et al.
- 2001
|
|
1
|
Visual Screen: Transforming an ordinary screen into a touch screen
– Zhang, Shan
- 2000
|
