Results 1 -
7 of
7
Conversational agent or direct manipulation in human-system interaction
, 2005
"... In this paper wei)MM:MjkMU theusabi)T( ofspeech-centri multi-cen ilti-cent bycomparij two systems that support the same unfami#jk task,vik bathroomdesioo OneversiW isiW:Tjk aconversatiT#j agent (CA) metaphor, whi, thealternatiN onei based ondiM)( maniTWjkMN# (DM). Twenty subjects, 10 males and 10 fe ..."
Abstract
-
Cited by 3 (3 self)
- Add to MetaCart
In this paper wei)MM:MjkMU theusabi)T( ofspeech-centri multi-cen ilti-cent bycomparij two systems that support the same unfami#jk task,vik bathroomdesioo OneversiW isiW:Tjk aconversatiT#j agent (CA) metaphor, whi, thealternatiN onei based ondiM)( maniTWjkMN# (DM). Twenty subjects, 10 males and 10 females, none of whom had recentexperiMxT wip bathroom(re-)desiN completed the same task wik both systems. After each task we collected objectid measures (taskcompleti) timp taskcompletij rate, number ofactiMx performed, speech and pen recognikMT errors) and subjectik measuresi the form ofLiMU( ScaleratijTT We found that the taskcompletij rate for the CA systemi hitem than for the DM system. Nevertheless, subjects di not agree onthei preference for one of the systems: those subjects who were able to use the DM systeme#ectiN): preferred that system,maiem because i was faster for them, and they felt morei control. We conclude that for multiUNjk CA systems to become wiome accepted substanti# ibstanti#x i system archi tecture andi the performance of almost all ijM)UxMjk modules are needed.
Talking to Agents in Virtual Worlds
- In: Proc of 3 rd UK VR-SIG Conference
, 1996
"... this paper, we discuss technical and design issues which need to be addressed in order to combine a direct manipulation interface to virtual reality with a speech interface. Two prototype systems are then described. The first system provides the user with an interface agent which carries out spoken ..."
Abstract
-
Cited by 3 (2 self)
- Add to MetaCart
(Show Context)
this paper, we discuss technical and design issues which need to be addressed in order to combine a direct manipulation interface to virtual reality with a speech interface. Two prototype systems are then described. The first system provides the user with an interface agent which carries out spoken commands in the virtual world. The second system is based on intelligent agents which provide specialised functions in the virtual world. The agents have simple dialogue capabilities allowing users to directly control them with speech. Keywords: speech, multimodal interaction, human factors, applications 1. Introduction
A Speech Interface to Virtual Environments
"... Virtual reality has sometimes been thought of as embodying a return to a `natural' way of interacting by direct manipulation of objects in a world. However, in the everyday world we also act through language: speaking is a `natural' way of communicating our goals to others, and effect ..."
Abstract
-
Cited by 1 (0 self)
- Add to MetaCart
Virtual reality has sometimes been thought of as embodying a return to a `natural' way of interacting by direct manipulation of objects in a world. However, in the everyday world we also act through language: speaking is a `natural' way of communicating our goals to others, and effecting changes in the world. In this paper, we discuss technical and design issues which need to be addressed in order to combine a direct manipulation interface to virtual reality with a speech interface. We then describe a prototype system based on intelligent agents which provide specialised functions in the virtual world. The agents have simple dialogue capabilities allowing users to directly control them with speech.
September 2002, Edinburgh, UK, Pages 149-154.
- Proceedings of the sixth workshop on the semantics and pragmatics of dialogue (Edilog
, 2002
"... Several features of spoken dialogue systems require advanced reference resolution strategies. This paper presents a knowledge--based strategy for reference resolution implemented over an agent architecture which di#erentiates the Knowledge and Action Managers from the Dialogue Manager. The strategy, ..."
Abstract
- Add to MetaCart
Several features of spoken dialogue systems require advanced reference resolution strategies. This paper presents a knowledge--based strategy for reference resolution implemented over an agent architecture which di#erentiates the Knowledge and Action Managers from the Dialogue Manager. The strategy, in conjunction with the ability of the Dialogue Manager to manipulate the dialogue history, has been applied to a home environment domain to solve successfully di#erent phenomena such as quantification, anaphoric expressions and coordination.
A Speech Interface to Virtual Environments
"... Virtual reality has sometimes been thought of as embodying a return to a ‘natural ’ way of interacting by direct manipulation of objects in a world. However, in the everyday world we also act through language: speaking is a ‘natural ’ way of communicating our goals to others, and effecting changes i ..."
Abstract
- Add to MetaCart
(Show Context)
Virtual reality has sometimes been thought of as embodying a return to a ‘natural ’ way of interacting by direct manipulation of objects in a world. However, in the everyday world we also act through language: speaking is a ‘natural ’ way of communicating our goals to others, and effecting changes in the world. In this paper, we discuss technical and design issues which need to be addressed in order to combine a direct manipulation interface to virtual reality with a speech interface. We then describe a prototype system based on intelligent agents which provide specialised functions in the virtual world. The agents have simple dialogue capabilities allowing users to directly control them with speech. 1.
A Software Framework to Create 3D Browser-Based Speech Enabled Applications
"... Abstract: The advances in automatic speech recognition have pushed the human-computer interface researchers to adopt speech as one mean of input data. It is natural to humans, and complements very well other input interfaces. However, integrating an automatic speech recognizer into a complex system ..."
Abstract
- Add to MetaCart
(Show Context)
Abstract: The advances in automatic speech recognition have pushed the human-computer interface researchers to adopt speech as one mean of input data. It is natural to humans, and complements very well other input interfaces. However, integrating an automatic speech recognizer into a complex system (such as a 3D visualization system or a Virtual Reality system) can be a difficult and time consuming task. In this paper we present our approach to the problem, a software framework requiring minimum additional coding from the application developer. The framework combines voice commands with existing interaction code, automating the task of creating a new speech grammar (to be used by the recognizer). A new listener component for the Xj3D was created, which makes transparent to the user the integration between the 3D browser and the recognizer. We believe this is a desirable feature for virtual reality system developers, and also to be used as a rapid prototyping tool when experimenting with speech technology. 1
