DMCA
Profile view lip reading (2007)
| Venue: | In IEEE International Conference on Acoustics, Speech and Signal Processing, number 4 |
| Citations: | 7 - 0 self |
BibTeX
@INPROCEEDINGS{Kumar07profileview,
author = {Kshitiz Kumar and Tsuhan Chen and Richard M. Stern},
title = {Profile view lip reading},
booktitle = {In IEEE International Conference on Acoustics, Speech and Signal Processing, number 4},
year = {2007},
pages = {429--432}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
In this paper, we introduce profile view (PV) lip reading, a scheme for speaker-dependent isolated word speech recognition. We provide historic motivation for PV from the importance of profile images in facial animation for lip reading, and we present feature extraction schemes for PV as well as for the traditional frontal view (FV) approach. We compare lip reading results for PV and FV, which demonstrate a significant improvement for PV over FV. We show improvement in speech recognition with the integration of Audio and Visual features. We also found it advantageous to process the visual features over a longer duration than the duration marked by the endpoints of the speech utterance. Index Terms — Speechreading, Visual feature extraction, Audiovisual speech recognition, Profile view
Keyphrases
profile view lip reading profile view lip reading visual feature index term speaker-dependent isolated word speech recognition profile image speech recognition traditional frontal view significant improvement lip reading result present feature extraction scheme speech utterance audiovisual speech recognition historic motivation visual feature extraction facial animation
