by Nitin Sawhney, Chris Schmandt
ACM Transactions on Computer-Human Interaction
http://www.media.mit.edu/~nitin/NomadicRadio/tochi/tochi2000.ps
Add To MetaCart
Abstract:
Mobile workers need seamless access to communication and information services while on the move. However current solutions overwhelm users with intrusive interfaces and ambiguous notifications. This paper discusses the interaction techniques developed for Nomadic Radio, a wearable computing platform for managing voice and text-based messages in a nomadic environment. Nomadic Radio employs an auditory user interface, which synchronizes speech recognition, speech synthesis, non-speech audio and spatial presentation of digital audio, for navigating among messages as well as asynchronous alerting of newly arrived messages. Emphasis is placed on an auditory modality as Nomadic Radio is designed to be used while performing other tasks in a user's everyday environment; a range of auditory cues provide peripheral awareness of incoming messages. Notification is adaptive and context sensitive; messages are presented as more or less obtrusive based on importance inferred from content filtering, whether the user is engaged in conversation and her recent responses to prior messages. Auditory notifications are dynamically scaled from ambient sound through recorded voice cues up to message summaries. Iterative design and a preliminary user evaluation suggest that audio is an appropriate medium for mobile messaging but care must be taken to minimally intrude on the wearer's social and physical environment.
Citations
|
887
|
Reinforcement learning: A survey
– Kaelbling, Littman, et al.
- 1996
|
|
113
|
Effective sounds in complex systems: The ARKola simulation
– Gaver, Smith, et al.
- 1991
|
|
105
|
A.Pentland. Augmented reality through wearable computing
– Starner, Mann, et al.
- 1997
|
|
92
|
Designing Audio Aura
– Mynatt, Back, et al.
- 1998
|
|
71
|
SpeechSkimmer: A system for interactively skimming recorded speech
– Arons
- 1997
|
|
63
|
A review of the cocktail party effect
– Arons
- 1992
|
|
63
|
Timespace in the workplace: Dealing with interruptions
– O'Conaill, Frohlich
- 1995
|
|
63
|
Voicenotes: a speech interface for a handheld voice notetaker
– Stifleman, Arons, et al.
- 1993
|
|
59
|
Localization in virtual acoustic displays
– WENZEL
- 1992
|
|
51
|
Audio Augmented Reality: A Prototype Automated Tour Guide
– Bederson
|
|
48
|
Expressive richness: a comparison of speech and text as media for revision
– Chalfonte, Fish, et al.
- 1991
|
|
46
|
Hanging on the 'Wire: A Field Study of an Audio-Only Media Space
– Ackerman, Hindus, et al.
- 1997
|
|
41
|
CLUES: Dynamic Personalized Message Filtering
– Marx, Schmandt
- 1996
|
|
39
|
HRTF measurements of a KEMAR
– Gardner, Martin
- 1995
|
|
31
|
Dynamic Soundscape: mapping time to space for audio browsing
– Kobayashi, Schmandt
- 1997
|
|
28
|
Nomadic Radio: Scaleable and Contextual Notification for Wearable Audio Messaging
– Sawhney, Schmandt
- 1999
|
|
28
|
Monitoring Background Activities
– Cohen
- 1994
|
|
27
|
Auditory context awareness via wearable computing
– Clarkson, Sawhney, et al.
- 1998
|
|
27
|
The Utility of Speech Input in User-Computer Interfaces
– Martin
- 1989
|
|
25
|
AudioStreamer: Exploiting Simultaneity for Listening
– Schmandt, Mullins
- 1995
|
|
24
|
All Talk and All Action: Strategies for Managing Voicemail Messages
– Whittaker
- 1998
|
|
24
|
Speaking and listening on the run: Design for wearable audio computing
– Sawhney, Schmandt
- 1998
|
|
22
|
NewsComm: a hand-held interface for interactive access to structured audio
– Roy, Schmandt
- 1996
|
|
20
|
Perception, Attention, and Resources: A Decision-Theoretic Approach to Graphics Rendering
– Horvitz, Lengyel
- 1997
|
|
17
|
Monitoring Background Activities. Auditory Display
– Cohen
- 1994
|
|
17
|
Electronic mail previews using non-speech audio
– HUDSON, SMITH
- 1996
|
|
17
|
Multimedia Nomadic Services on Today’s Hardware
– Schmandt
- 1994
|
|
16
|
SpeechWear: A mobile speech system
– Rudnicky, Reed, et al.
- 1996
|
|
15
|
Situational Awareness from Environmental Sounds
– Sawhney
- 1997
|
|
11
|
Whisper: A Wristwatch Style Wearable Handset
– Fukumoto, Tonomura
- 1999
|
|
8
|
The utility of speech input in user interfaces
– Martin
- 1989
|
|
7
|
Talking vs. Taking: Speech Access to Remote Computers
– Yankelovich
- 1994
|
|
6
|
Speech skimmer: A system for interactively skimming recorded speech
– Arons
- 1997
|