Abstract

We introduce the concept of Graspable User Interfaces which allow direct control of electronic or virtual objects through physical handles for control. These physical artifacts are essentially new input devices which can be tightly coupled or “attached ” to virtual objects for manipulation or for expressing action (e.g., to set parameters or for initiating processes). We present three steps in the development of these ideas. First, as a note on research methodology, we outline a series of exploratory studies that were conducted. Secondly, we describe a prototype system called "Bricks " and a sample application, GraspDraw, which was developed to investigate the Graspable UI concepts and to design new one- and twohanded interaction techniques. The physical artifacts, or bricks, operate on top of a large horizontal display surface known as the ActiveDesk. Finally, we conclude by presenting a design space for Bricks which lay the foundation for further exploring and developing graspable user interfaces.

Citations

1087	The computer for the 21st century - Weiser - 1991
300	Interacting with paper on the DigitalDesk - Wellner - 1993
250	Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model - Guiard - 1987
162	Situated information spaces and spatially aware palmtop computers - Fitzmaurice - 1993
155	Passive Real-World Interface Props for Neurosurgical Visualization - Hinckley, Pausch, et al. - 1994
127	Two-handed input in a compound task - Kabbash, Buxton, et al. - 1994
81	Chunking and Phrasing and the Design of HumanComputer Dialogues - Buxton - 1986
67	The Grasping Hand - MacKenzie, Iberall - 1994
65	Behavior Construction Kits - RESNICK - 1993
61	The "Prince" Technique: Fitts‟ Law and Selection Using Area Cursors - Kabbash, Buxton
37	Applying electric field sensing to human-computer interfaces - Zimmerman, Smith, et al.
31	AlgoBlock: a Tangible Programming Language, a Tool for Collaborative Learning - Suzuki, Kato - 1993
16	Synthetic experience: a proposed taxonomy - Robinett - 1992
10	Experiments in the Dynamic and Strategic Control of Cooperating Manipulators - Schneider - 1989
7	Spatial Representation - EILAN, MCCARTHY, et al. - 1993
6	Designing Graphical User Interfaces - Marcus - 1990
3	3-Draw: A tool for the conceptual design of three-dimensional shapes - Sachs, Roberts, et al. - 1990