| J. Cohn and G. S. Katz. Bimodal Expression of Emotion by Face and Voice. In Workshop on Face/Gesture Recognition and Their Applications, The Sixth ACM International Multimedia Conference, September 1998. |
....in ambiguous situations. At present, most attempts of channel fusion are of the bimodal type and integrate voice in addition to facial expressions. Vocal expressions are conveyed by prosodic features, which include the fundamental frequency, intensity and rhythm of the voice. Cohn and Katz [13] as well as Chen et al. 11] focused on the fundamental frequency, as it is an important voice feature for emotion recognition and can be easily extracted. 5 Discussion In this survey on automatic facial expression analysis we have discussed automatic face analysis with regard to di erent motion ....
J. Cohn and G. S. Katz. Bimodal Expression of Emotion by Face and Voice. In Workshop on Face/Gesture Recognition and Their Applications, The Sixth ACM International Multimedia Conference, September 1998.
....Figure 1 shows the extraction module. For an incoming stream of synchronized audio video we first recognize the phoneme and then map this phoneme to its corresponding viseme and take the corresponding video frame to represent this viseme. The expression recognition unit can be either audio based [2][9] or video based [4] A short sentence like The sharp quick brown fox jumped over the lazy dog. captures all the 12 visemes. Extracted images of visemes expressions Normalization of images Generate complete set of visemes with expressions Optical flow calculation Database of optical flows ....
J. F. Cohn and G. S. Katz, "Bimodal expression of emotion by face and voice," Proceedings of the Sixth ACM International Multimedia Conference on Face/Gesture Recognition and Their Applications, ACM Press, pp. 41-44, 1998.
....to non facial behavior Facial expression is one of several channels of nonverbal communication that may occur together. Contraction of the zygomaticus major (AU 12) for instance, often is associated with positive or happy vocalizations, and smiling tends to increase vocal fundamental frequency [3]. Few research groups, however, have attempted to integrate gesture recognition broadly defined across multiple channels of communication. An important question is whether there are advantages to early rather than late integration. Databases containing multi modal expressive behavior afford ....
J.F. Cohn, G.S. Katz, Bimodal expression of emotion by face and voice. ACM and ATR Workshop on Face/Gesture Recognition and Their Applications, 41-44, 1998.
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC