L. Schomaker, J. Nijtmans, et al.  Home/Search
Context Related
| ai.rug.nl/~lambert...ject8579MIAMI.pdf Cached: PS.gz PS PDF This document uses CoBlitz to cache paper downloads. If your firewall is blocking outgoing connections to port 3125, you can use these links to download local copies.
Image Update HelpPS.gz PS PDF From: ai.rug.nl/~lambert/papers/ (more) (Enter author homepages) |
Rate this article:      (best)Comment on this article |
Abstract: This document has been prepared in the ESPRIT BRA No. 8579, Multimodal Integration for Advanced Multimedia Interfaces --- in the following referred to as --- in order to serve as a basis for future work. The basic terms which will be used in will be defined and an overview on man-machine-interfaces will be given. The term "taxonomy" is used in the following sense, adapted from [217]: "1: the study of the general principles of scientific classification: SYSTEMATICS; 2: CLASSIFICATION;... (Update)
Context of citations to this paper: More
.... There has been discussion in the field on the meaning of and distinction between multimodal and multimedia applications (e.g. [89, 15, 335, 119]) and on related terminology. Several expressions are used: types of information, channel, media, modality, communication means,...
.... by following the capabilities already present in the Human Information Processing System (HIPS) being highly optimized in that respect [12]. Just as in the HIPS, if we assume four levels of observation: physical (device characteristics) information theoretical (digital...
Cited by: More
Software Architecture for Multimodal User Input - FLUID - Ilmonen, Kontkanen (2002) (Correct)
Multimodal Interaction in Music Using the Electromyogram and.. - Tanaka, Knapp (2002) (Correct)
EMBASSI: Electronic Multimedia and Service Assistance - Hildebrand, Sa (2000) (Correct)
Active bibliography (related documents): More All
2.3: Audio-visual and Multimodal Speech Systems - Benoit, Martin, Pelachaud.. (1998) (Correct)
1.3: Modeling Coarticulation in Synthetic Visual Speech - Cohen, Massaro (1993) (Correct)
1.3: Final Report to NSF of the Standards for Facial Animation.. - Pelachaud, Badler, Viaud (1994) (Correct)
Similar documents based on text:
95.0: Unknown - (Correct)
Related documents from co-citation: More All
4: IEEE Computer Graphics and Applications (context) - Sturman - 1998
4: A design space for multimodal systems: Concurrent processing and Data fusion - Coutaz, Coutaz - 1993
4: Kleiser Walczak Construction Comp (context) - for, SIGGRAPH et al. - 1988
BibTeX entry: (Update)
L. Schomaker, J. Nijtmans, A. Camurri, F. Lavagetto, P. Morasso, C. Benoit, T. Guiard-Marigny, B. LeGoff, J. Robert-Ribes, A. Adjoudani, I. Def'ee, S. Munch, K. Hartung, and J. Blauert. A taxonomy of multimodal interaction in the human information processing system. Technical report, Esprit Project 8579 MIAMI, February 1995. http://citeseer.ist.psu.edu/schomaker95taxonomy.html More
@misc{ schomaker95taxonomy,
author = "L. Schomaker and J. Nijtmans and A. Camurri and F. Lavagetto and P. Morasso
and C. Benoit and T. Guiard-Marigny and B. LeGoff and J. Robert-Ribes and
A. Adjoudani and I. Def'ee and S. Munch and K. Hartung and J. Blauert",
title = "A taxonomy of multimodal interaction in the human information processing
system",
text = "L. Schomaker, J. Nijtmans, A. Camurri, F. Lavagetto, P. Morasso, C. Benoit,
T. Guiard-Marigny, B. LeGoff, J. Robert-Ribes, A. Adjoudani, I. Def'ee,
S. Munch, K. Hartung, and J. Blauert. A taxonomy of multimodal interaction
in the human information processing system. Technical report, Esprit Project
8579 MIAMI, February 1995.",
year = "1995",
url = "citeseer.ist.psu.edu/schomaker95taxonomy.html" }
Citations (may not include all citations):480 An overview of the KL-ONE knowledge representation system (context) - Brachman, Schmolze - 1985
328 Digital Image Processing (context) - Pratt - 1991
318 The Psychology of Human-Computer Interaction (context) - Card, Moran et al. - 1983
300 Soar: an architecture for general intelligence (context) - Laird, Newell et al. - 1987
270 The ecological approach to visual perception (context) - Gibson - 1979
144 The role of emotions in believable agents - Bates - 1994
142 A proper treatment of connectionism (context) - Smolensky - 1988
141 Sound Pattern of English (context) - Chomsky, Halle - 1968
136 Hidden Markov Models for Speech Recognition (context) - Huang, Ariki et al. - 1990
128 A muscle model for animating three-dimensional facial expres.. (context) - Waters - 1987
115 Principles of neural sciences (context) - Kandel, Schwartz - 1993
103 The PHANToM Haptic Interface: a Device for Probing Virtual O.. (context) - Massie, Salisbury - 1994
98 Hearing lips and seeing voices (context) - McGurk, MacDonald - 1976
97 The State of the Art in On-line Handwriting Recognition (context) - Tappert, Suen et al. - 1990
97 The information capacity of the human motor system in contro.. (context) - Fitts - 1954
83 Cognitive Engineering (context) - Norman - 1986
72 Consulting Psychologists Press (context) - Ekman, Friesen et al. - 1977
71 The artificial life roots of artificial intelligence - Steels - 1994
65 Intelligent Multimedia Interfaces - Maybury - 1993
64 Automatic Lipreading to Enhance Speech Recognition (context) - Petajan - 1984
63 The senses considered as perceptual systems (context) - Gibson - 1966
62 Project GROPE - Haptic Displays for Scientific Visualization (context) - Brooks - 1990
61 Animating facial expressions (context) - Platt, Badler - 1981
53 An Approach to the Formal Analysis of User Complexity (context) - Kieras, Polson - 1985
52 Designing autonomous agents: Theory and practice from biolog.. (context) - Maes - 1990
51 Visual contribution to speech intelligibility in noise (context) - Sumby, Pollack - 1954
49 Two-Handed Input in a Compound Task (context) - Kabbash, Buxton et al. - 1994
49 Information Processing and Human-Machine Interaction (context) - Rasmussen - 1986
48 TouringMachines: An Architecture for Dynamic (context) - Ferguson - 1992
40 Touch-Typing with a Stylus (context) - Goldberg, Richardson - 1993
40 Improving connected letter recognition by lipreading (context) - Bregler, Hild et al. - 1993
40 What is a Knowledge Representation - Davis, Shrobe et al. - 1993
39 Neural network lipreading system for improved speech recogni.. (context) - Stork, Wol et al. - 1992
38 The Origins of Intelligence in Children (context) - Piaget - 1952
38 The ultimate display (context) - Sutherland - 1965
36 A design space for multimodal systems - concurrent processin.. - Nigay, Coutaz - 1993
34 Intelligent User Interfaces - Sullivan, Tyler - 1991
33 The Keystroke-Level Model for User Performance Time with Int.. (context) - Card, Moran et al. - 1980
31 A comparison of input devices in elemental pointing and drag.. (context) - MacKenzie, Sellen et al. - 1991
30 Computer-generated animation of faces (context) - Parke - 1972
30 Lip reading: Automatic visual recognition of spoken words (context) - Pentland, Masi - 1989
30 The growth of cognitive modeling in human-computer interacti.. (context) - Olson, Olson - 1990
29 Human Information Processing (context) - Lindsay, Norman - 1977
29 Animating speech: an automated approach using speech synthes.. (context) - Hill, Pearce et al. - 1988
29 Merging of the Senses (context) - Stein, Meredith - 1993
29 Animating speech: an automated approach using speech synthes.. (context) - Hill, Pearce et al. - 1989
29 An evaluation of motor models of handwriting (context) - Plamondon, Maarse - 1989
28 Automated lip-synch and speech synthesis for character anima.. (context) - Lewis, Parke - 1987
28 Using Stroke- or Character-based Self-organizing Maps in the.. (context) - Schomaker - 1993
27 IEEE Computer Graphics and Applications (context) - Parke, for - 1981
27 Speech and expression: A computer solution to face animation (context) - Pearce, Wyvill et al. - 1986
27 Computational Imagery (context) - Glasgow, Papadias - 1992
26 A set of french visemes for visual speech synthesis (context) - Benot, Lallouache et al. - 1992
26 Artificial Reality with Force-feedback: Development of Deskt.. (context) - Iwata - 1990
25 Virtual Reality: through the new looking glass (context) - Pimentel, Teixeira - 1993
25 Communication and coarticulation in facial animation (context) - Pelachaud - 1991
24 Extending Fitts' Law to Two-Dimensional Tasks (context) - MacKenzie, Buxton - 1992
23 Principles and techniques for sensor data fusion - Crowley, Demazeau - 1993
22 Ecological Interface Design: Theoretical Foundations (context) - Vicente, Rasmussen - 1992
22 A transformation method for modeling and animation of the hu.. (context) - Kurihara, Arai - 1991
22 Techniques for realistic facial modeling and animation (context) - Terzopoulos, Waters - 1991
22 The Visual Computer (context) - Nahas, Huitric et al. - 1988
21 The Cognitive Coprocessor Architecture for Interactive User .. (context) - Robertson, Card et al. - 1989
19 Virtual Reality Systems (context) - Earnshaw, Gigante et al. - 1993
19 Continuous Automatic Speech Recognition by Lip Reading (context) - Goldschen - 1993
19 Temporal Back-propagation for FIR Neural Networks (context) - Wan - 1990
19 Using and creating auditory icons (context) - Gaver - 1994
18 Linguistics issues in facial animation - Pelachaud, Badler et al. - 1991
18 Modeling Human Sound Source Localization and the Cocktail-Pa.. (context) - Bodden - 1993
18 Facial animation by spatial mapping (context) - Patterson, Litwinowicz et al. - 1991
17 A Survey of Perceptual Feedback Issues in Dexterous Telemani.. (context) - Shimoga - 1993
17 Model-based analysis-synthesis image coding (context) - Aizawa, Harashima et al. - 1989
16 Coarticulation in recent speech production models (context) - Kent, Minifie - 1977
16 Multisensory Shared Autonomy and Tele-Sensor-Programming -- .. (context) - Hirzinger - 1993
15 Nature and Origins of Virtual Environments: A Bibliographica.. (context) - Ellis - 1991
14 Sonic enhancement of two-dimensional graphic display (context) - Blattner - 1994
14 Designing the User Interface: Strategies for E#ective Human-.. (context) - Shneiderman - 1992
14 Special Issue on Intelligent Agents (context) - Riecken - 1994
13 Models of integration given multiple sources of information (context) - Massaro, Friedman - 1990
13 The quantal nature of speech: Evidence from articulatory-aco.. (context) - Stevens - 1972
13 Speech perception: A model of acoustic-phonetic analysis and.. (context) - Klatt - 1979
13 Gesture Driven Interaction as a Human Factor in Virtual Envi.. (context) - Vaananen, Bohm - 1993
12 Placeholder: Landscape and Narrative in Virtual Environments (context) - Laurel, Strickland et al. - 1994
12 Cambridge University Press (context) - Johnson-Laird - 1983
12 Hearing by Eye: The Psychology of Lip-reading (context) - Dodd, Campbell - 1987
11 Software cascadeparallel formant synthesizer (context) - for, formant et al. - 1980
11 Multimedia Interface Design (context) - Blattner, Dannenberg - 1992
10 Simple and complex facial animation: Case studies (context) - Reeves - 1990
10 Creating realistic three-dimensional human shape characters .. - Paouri, Magnenat-Thalmann et al. - 1991
10 Abstract muscle action procedures for human face animation (context) - Magnenat-Thalmann, Primeau et al. - 1988
10 Principles of Binaural Room Simulation (context) - Lehnert, Blauert - 1992
10 The direction of synthetic actors in the film Rendezvous Mon.. (context) - Magnenat-Thalmann, Thalmann - 1987
9 A multi-modal mouse with tactile and force feedback (context) - Akamatsu, Sato - 1994
9 A computer music system that follows a human conductor (context) - Morita, Hashimoto et al. - 1991
9 Motor control of serial ordering of speech (context) - MacNeilage - 1970
9 Interaction of audition and vision in the recognition of ora.. (context) - Erber - 1969
9 Primal Sketch (context) - Todd, Auditory - 1994
9 A structural model of the human face (context) - Platt - 1985
8 Controlling facial expressions and body movements in the com.. (context) - Bergeron, Lachapelle - 1985
8 Easy to hear but hard to understand: A lip-reading advantage.. (context) - Reisberg, McLean - 1987
8 A computational model of cursive handwriting (context) - Schomaker, Thomassen et al. - 1989
8 Crossmodal integration in the identification of consonant se.. (context) - Braida - 1991
8 Evaluation and integration of visual and auditory informatio.. (context) - Massaro, Cohen - 1983
8 Use of visual information for phonetic perception (context) - Summerfield - 1979
8 A media conversion from speech to facial image for intellige.. (context) - Morishima, Harashima - 1991
8 Quantifying the contribution of vision to speech perception .. (context) - MacLeod, Summerfield - 1987
7 Rate-controlled Isometric Joystick (context) - Card, English et al. - 1978
7 Saying and seeing it with feeling: techniques for synthesizi.. - Henton, Litwinowicz - 1994
7 Auditory-visual perception of speech (context) - Erber - 1975
7 Combined Evaluation of Interaural Time and Intensity Di#eren.. (context) - Gaik - 1993
7 Multimedia-Technologie (context) - Steinmetz - 1993
7 Dialogue Management for Gestural Interfaces (context) - Rhyne - 1987
7 accurate way to represent the human face (context) - Kleiser, fast et al. - 1989
7 Computer graphics synthesis of talking faces (context) - Brooke - 1992
6 Virtual Musical Instruments: Accessing the Sound Synthesis U.. - Mulder - 1994
6 The Relation between Pen Force and Pen-Point Kinematics in H.. (context) - Schomaker, Plamondon - 1990
6 Mechanisms underlying achievement of final head position (context) - Bizzi, Polit et al. - 1976
6 Coarticulation of upper lip protrusion in French (context) - Benguerel, Cowan - 1974
6 Applying the Wizard of Oz Technique to the Study of Multimod.. - Salber, Coutaz - 1993
6 Hyperinstruments: Musically intelligent and interactive perf.. (context) - Machover, Chung - 1989
6 Real time neural network processing of gestural and acoustic.. (context) - Lee, Freed et al. - 1991
6 Representations of Musical Signals (context) - De Poli, Piccialli et al. - 1991
6 Evaluating the articulation index for auditory-visual input (context) - Grant, Braida - 1991
6 Modelling coarticulation in synthetic visual speech (context) - Cohen, Massaro - 1993
5 the nature of human interlimb coordination (context) - Kelso, Southard et al. - 1979
5 Emergent frame recognition and its use in artificial creatur.. (context) - Steels - 1991
5 Digital Recording and Processing of Handwriting Movements (context) - Teulings, Maarse - 1984
5 The motor theory of speech perception revisited (context) - Liberman, Mattingly - 1985
5 Generation of mouthshapes for a synthetic talking head (context) - Simons, Cox - 1990
5 the concept of coordinative structures as dissipative struct.. (context) - Kugler, Kelso et al. - 1980
5 Preliminaries to a theory of action with reference to vision (context) - Turvey - 1977
5 An Advanced Telerobotic Control System for a Mobile Robot wi.. - Lin, Wallner et al. - 1995
5 Perception of synthesized audible and visible speech (context) - Massaro, Cohen - 1990
5 Visual perception of anticipatory rounding during pauses: A .. (context) - Cathiard, Tiberghien et al. - 1991
5 Architecture of a Multimodal Dialogue Interface for Knowledg.. (context) - Binot
4 Clarifying the distinction between lexical and gestural comm.. (context) - Morrel-Samuels - 1990
4 The role of visual-auditory compellingness in the ventriloqu.. (context) - Warren, Welch et al. - 1981
4 Auditory and visual contributions to the perception of conso.. (context) - Binnie, Montgomery et al. - 1974
4 On control and coordination of naturally developing systems (context) - Kugler, Kelso et al. - 1982
4 The bimodal perception of speech in infancy (context) - Kuhl, Meltzo - 1982
4 Motor-perceptual interactions (context) - Viviani, Stucchi - 1991
4 Central and peripheral mechanisms in motor control (context) - Bizzi - 1980
4 visage-parole (context) - Lallouache - 1991
4 NUNTIUS: A computer system for the interactive composition a.. (context) - Ungvary, Waters et al. - 1992
4 Music and Multimedia Knowledge Representation and Reasoning:.. (context) - Camurri - 1995
4 Coarticulation and theories of extrinsic timing (context) - Fowler - 1980
4 Virtual Reality: Definitions (context) - Gigante - 1993
3 Animation faciale avec rides d'expression (context) - Viaud - 1993
3 Lipreadable frame animation driven by speech parameters (context) - Lavagetto, Arzarello et al. - 1994
3 Thinking in Sound - The Cognitive Psychology of Human Auditi.. (context) - McAdams, Bigand - 1993
3 The NPL Electronic Paper Project (context) - Brocklehurst - 1994
3 A Special Pen for an XY Tablet (context) - Maarse, Janssen et al. - 1988
3 Gesture and speech (context) - Rime, Schiaratura - 1991
3 The distinctive features and their correlates (context) - Jakobson, Fant et al. - 1951
3 The problem of serial order in behaviour (context) - Lashley - 1951
3 Implications for speech production of a general theory of ac.. (context) - Fowler, Rubin et al. - 1980
3 Hewlett-Packard Company (context) - Frohlich, Space et al. - 1991
3 Analysis of Handwriting Movements (context) - Dooijes - 1983
3 Task action grammar (context) - Payne - 1984
3 Readings in Computer-Generated Music (context) - Baggi - 1992
3 Explaining Emotions (context) - O'Rorke, Ortony - 1994
3 Schema-Based Tone Center Recognition of Musical Signals (context) - Leman - 1994
3 How interactive visualization can benefit from multidimensio.. (context) - Felger - 1992
3 Auditory neuroethology and speech processing: complex-sound .. (context) - Suga - 1988
3 speech perception by ear and eye (context) - Massaro, review - 1989
3 Audibility and stability of articulatory movements: Decipher.. (context) - Abry, Lallouache - 1991
3 Separation of Concurrent Speech Signals: A Cocktail-Party Pr.. (context) - Bodden, Blauert - 1992
3 Architectural Qualities and Principles for Multimodal and Mu.. (context) - Hill - 1992
2 Tools for Interaction with the Creative Process of Compositi.. (context) - Schiphorst - 1990
2 Exploring immersion in virtual space (context) - Psotka, Davison et al. - 1993
2 Phoneme recognition by ear and by eye: a distinctive feature.. (context) - Campbell - 1974
2 Hearing by eye (context) - Campbell, Dodd - 1980
2 Hearing voices and seeing lips: Investigations in the psycho.. (context) - Vroomen - 1992
2 London Pergamon Press (context) - Bernstein, Regulation - 1967
2 A time-delay neural network for speech to lips movements con.. (context) - Casella, Lavagetto et al. - 1994
2 The Use of Acoustical Test Fixures for the Measurement of He.. (context) - Schroter, Posselt - 1986
2 Lexikon der Mensch-Maschine-Kommunikation (context) - Charwat - 1992
2 Visual perception of phonetic gestures (context) - Summerfield - 1991
2 The Use of Acoustical Test Fixures for the Measurement of He.. (context) - Schroter - 1986
2 Pen and voice unite: adding pen and voice input to today's u.. (context) - Crane, Rtischev - 1993
2 Extension of a Binaural Cross-Correlation Model by Means of .. (context) - Lindemann - 1986
2 Extension of a Binaural Cross-Correlation Model by Means of .. (context) - Lindemann - 1986
2 Cross-modal bias and perceptual fusion with auditory visual .. (context) - Bertelson, Radeau - 1981
2 Virtual hand tool with force feedback (context) - Balakrishnan, Ware et al. - 1994
2 Synthetic facial animation (context) - Boston - 1973
2 The contribution of vision to speech perception (context) - Smeele, Sittig - 1990
2 An event approach to the study of speech perception from a d.. (context) - Fowler - 1986
2 XWebster: Webster's 7th Collegiate Dictionary (context) - Mayer - 1963
2 Edge Tracing of Virtual Shape Using Input Device with Force .. (context) - Fukui, Shimojo - 1992
2 Music structure and human movement (context) - Baily - 1985
2 Measurement of Dynamic Digitizer Performance (context) - Meeks, Kuklinski - 1990
2 NASA Virtual Environment Research (context) - Null, Jenkins - 1993
2 Interactions among converging sensory inputs in the superior.. (context) - Meredith, Stein - 1983
2 Conceptual Spaces and the Dimensions of Music (context) - Gardenfors - 1988
2 Mensch-Maschine Kommunikation (context) - Geiser - 1990
2 Interacting with Virtual Environments (context) - MacDonald, Vince - 1994
2 ects of phonetic context on audio-visual intelligibility of .. (context) - Benot, Mohamadi et al. - 1994
2 Auditory-visual spatial interaction and modularity (context) - Radeau - 1994
2 Computer lip reading to augment automatic speech recognition (context) - Smith - 1989
2 ANIMAT: A set of programs to generate (context) - Montgomery, Hoo - 1982
[Article contains additional citations not shown here]
The graph only includes citing articles where the year of publication is known.
Documents on the same site (http://www.ai.rug.nl/~lambert/papers/): More
Figure Captions - Figure And Two (Correct)
An Online Handwriting-Recognition System Based On.. - Teulings.. (1989) (Correct)
Preprint of a paper which later appeared as: Schomaker.. - Force And Pen-Point (Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC