Download:
by Michael A. Grasso, David Ebert, Tim Finin, Ph. D, Ph. D, Ph. D
ACM Transactions on Computer-Human Interaction
http://www.cs.umbc.edu/~finin/papers/tochi99.pdf
Add To MetaCart
Abstract:
A framework of complementary behavior has been proposed which maintains that direct manipulation and speech interfaces have reciprocal strengths and weaknesses. This suggests that user interface performance and acceptance may increase by adopting a multimodal approach that combines speech and direct manipulation. This effort examined the hypothesis that the speed, accuracy, and acceptance of multimodal speech and direct manipulation interfaces will increase when the modalities match the perceptual structure of the input attributes. A software prototype that supported a typical biomedical data collection task was developed to test this hypothesis. A group of 20 clinical and veterinary pathologists evaluated the prototype in an experimental setting using repeated measures. The results of this experiment supported the hypothesis that the perceptual structure of an input task is an important consideration when designing a multimodal computer interface. Task completion time, the number of speech errors, and user acceptance improved when interface best matched the perceptual structure of the input attributes.
Citations
|
351
|
Direct manipulation: A step beyond programming languages
– Shneiderman
- 1983
|
|
90
|
The processing of information and structure
– Garner
- 1974
|
|
83
|
The role of natural language in a multimodal interface
– Cohen
- 1992
|
|
82
|
Multimodal Interfaces for Dynamic Interactive Maps
– Oviatt
- 1996
|
|
69
|
Integrality and separability of input devices
– JACOB, SIBERT, et al.
- 1994
|
|
36
|
Integration themes in multimodal human-computer interaction
– Oviatt, Olsen
- 1994
|
|
31
|
The challenge of spoken language systems: Research directions for the nineties
– Cole, Hirschmann, et al.
- 1995
|
|
12
|
Integrality versus separability of stimulus dimensions: From an early convergence of evidence to a proposed theoretical basis
– SHEPARD
- 1991
|
|
10
|
The role of voice in human-machine communication
– COHEN, OVIATT
- 1994
|
|
10
|
Design guidelines for speech recognition interfaces, Applied Ergonomics
– Jones, Hapeshi, et al.
- 1989
|
|
10
|
An Introduction to Speech and Speaker Recognition
– Peacocke, Graf
- 1990
|
|
8
|
The Processing of Information and Structure. Lawrence Erlbaum Associates
– Garner
- 1974
|
|
6
|
Spoken Language Interaction: Effects of Vocabulary Size, User Experience, and Expertise on User Acceptance and Performance. Doctoral Dissertation
– Dillon
- 1995
|
|
6
|
Perception of structure: An overview
– Pomerantz, Lockhead
- 1991
|
|
5
|
Feasibility Study of Voice-Driven Data Collection
– Grasso, Grasso
- 1994
|
|
5
|
HCI and the inadequacies of direct manipulation systems
– Buxton
- 1993
|
|
4
|
Effects of Recognition Accuracy and Vocabulary Size of a Speech Recognition System on Task Performance and user Acceptance. Human Factors
– Casali, Williges, et al.
- 1990
|
|
4
|
The Human Factors of Speech-Based Interfaces: A Research Agenda
– Bradford
- 1995
|
|
3
|
Automated Speech Recognition
– Grasso
- 1995
|
|
3
|
Sparks of innovation in human-computer interaction
– Shneiderman
- 1993
|
|
2
|
Evaluations of Interactive Systems
– Johnson
- 1992
|
|
2
|
Introduction to Statistics: A Nonparametric Approach
– Noether
- 1976
|
|
2
|
Speech recognition: Finding its voice
– ALWANG, STINSON
- 1998
|
|
1
|
The Integrality of Speech in Multimodal Interfaces Page 20
– Grasso, Ebert, et al.
- 1997
|
|
1
|
Acceptance of a Speech Interface for Biomedical Data Collection
– Grasso, S, et al.
- 1997
|
|
1
|
Nursing acceptance of a speech-input interface: A preliminary investigation
– DILLON, MCDOWELL, et al.
- 1995
|
|
1
|
Automated speech recognition in medical applications
– GRASO
- 1995
|
|
1
|
Automatic speech recognition—Can it improve the man-machine interface in medical expert systems
– LANDAU, NORMICH, et al.
- 1989
|
|
1
|
Post experiment information system pathology code table reference manual
– NCTR
- 1985
|
