DMCA
Visuo-Phonetic Decoding using Multi-Stream and Context-Dependent Models for an Ultrasound-based Silent Speech Interface
Cached
Download Links
| Venue: | Interspeech, Brighton |
| Citations: | 5 - 3 self |
BibTeX
@ARTICLE{Hueber_visuo-phoneticdecoding,
author = {Thomas Hueber and Elie-laurent Benaroya and Gérard Chollet and Bruce Denby and Gérard Dreyfus and Maureen Stone},
title = {Visuo-Phonetic Decoding using Multi-Stream and Context-Dependent Models for an Ultrasound-based Silent Speech Interface},
journal = {Interspeech, Brighton},
year = {},
pages = {640--643}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Recent improvements are presented for phonetic decoding of continuous-speech from ultrasound and optical observations of the tongue and lips in a silent speech interface application. In a new approach to this critical step, the visual streams are modeled by context-dependent multi-stream Hidden Markov Models (CD-MSHMM). Results are compared to a baseline system using context-independent modeling and a visual feature fusion strategy, with both systems evaluated on a one-hour, phonetically balanced English speech database. Tongue and lip images are coded using PCA-based feature extraction techniques. The uttered speech signal, also recorded, is used to initialize the training of the visual HMMs. Visual phonetic decoding performance is evaluated successively with and without the help of linguistic constraints introduced via a 2.5k-word decoding dictionary. Index Terms: silent speech interface, visual speech recognition, multi-stream modeling 1.
Keyphrases
context-dependent model visuo-phonetic decoding ultrasound-based silent speech interface silent speech interface application visual phonetic decoding performance new approach recent improvement visual feature fusion strategy context-independent modeling visual speech recognition english speech database baseline system multi-stream modeling context-dependent multi-stream hidden markov model pca-based feature extraction technique linguistic constraint index term phonetic decoding visual hmms lip image critical step 5k-word decoding dictionary uttered speech signal optical observation visual stream silent speech interface
