DMCA
When do we interact multimodally? Cognitive load and multimodal communication patterns (2004)
| Venue: | In Proc. of International Conference on Multimodal Interfaces |
| Citations: | 59 - 4 self |
BibTeX
@INPROCEEDINGS{Oviatt04whendo,
author = {Sharon Oviatt and Rachel Coulston and Rebecca Lunsford},
title = {When do we interact multimodally? Cognitive load and multimodal communication patterns},
booktitle = {In Proc. of International Conference on Multimodal Interfaces},
year = {2004},
pages = {129--136},
publisher = {ACM Press}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Mobile usage patterns often entail high and fluctuating levels of difficulty as well as dual tasking. One major theme explored in this research is whether a flexible multimodal interface supports users in managing cognitive load. Findings from this study reveal that multimodal interface users spontaneously respond to dynamic changes in their own cognitive load by shifting to multimodal communication as load increases with task difficulty and communicative complexity. Given a flexible multimodal interface, users ’ ratio of multimodal (versus unimodal) interaction increased substantially from 18.6 % when referring to established dialogue context to 77.1 % when required to establish a new context, a +315 % relative increase. Likewise, the ratio of users’ multimodal interaction increased significantly as the tasks became more difficult, from 59.2 % during low difficulty tasks, to 65.5%
Keyphrases
cognitive load multimodal communication pattern flexible multimodal interface communicative complexity dual tasking low difficulty task dialogue context new context user multimodal interaction major theme load increase relative increase study reveal mobile usage pattern fluctuating level interface user task difficulty
