MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Speechreading using shape and intensity information (1996) [16 citations — 8 self]

Download:
Download as a PDF | Download as a PS
by Juergen Luettin, Neil A. Thacker, Steve W. Beet
In: Internat. Conf. Spoken Language Processing
ftp://ftp.idiap.ch/pub/papers/vision/luettin_icslp96speech.ps.gz
Add To MetaCart

Abstract:

We describe a speechreading system that uses both, shape information from the lip contours and intensity information from the mouth area. Shape information is obtained by tracking and parameterising the inner and outer lip boundary in an image sequence. Intensity information is extracted from a grey level model, based on principal component analysis. In comparison to other approaches, the intensity area deforms with the shape model to ensure that similar object features are represented after non-rigid deformation of the lips. We describe speaker independent recognition experiments based on these features and Hidden Markov Models. Preliminary results suggest that similar performance can be achieved by using either shape or intensity information and slightly higher performance by their combined use. 1.

Citations

212 Use Of Active Shape Models For Locating Structure – Cootes, Hill, et al. - 1994
76 Automatic Lipreading to Enhance Speech Recognition – Petajan - 1984
59 Visual speech recognition with stochastic networks – Movellan - 1995
26 Visual Speech Recognition Using Active Shape Models and Hidden Markov Models – Luettin, Thacker, et al. - 1996
26 Integration of acoustic and visual speech signals using neural networks – Yuhas, Goldstein, et al. - 1989
21 Physical characteristics of the lips underlying vowel lipreading performance – Montgomery, Jackson - 1983
19 Lipreading and audio-visual speech perception – Summerfield - 1992
11 Locating and Tracking Facial Speech Features – Luettin, Thacker, et al. - 1996