Cossatto, E., Graf, H. P.: Photo-realistic talking-heads from image samples. IEEE Trans. on Multimedia, 2(3), September 2000.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....systems by Pantic and Rothkrantz [24] The importance of computer facial animation has not gone unnoticed. This is an active and diverse field of research. Applications include intelligent and autonomous agents; automated virtual news readers; talking heads for information presentation [8]; entertainment, such as animated feature films, cartoons and games; virtual videoconferencing; and realistic avatars in virtual environments [17] 2.2.1 Face Models The first major work in computer facial animation was done by Parke [25] who developed a 3 D parameterised face model. Platt et al. ....

Eric Cosatto and Hans Peter Graf. PhotoRealistic Talking Heads from Image Samples. In IEEE Transactions on Multimedia, volume 2, pages 152--163, September 2000.

....to be able to generate animations with new facial expressions. 1. INTRODUCTION A talking face, with lip movements in synchronization with the spoken words along with correct expressions, greatly enhances communication. Many methods have been presented to animate faces in sync with audio [2][5] These methods rely on a viseme based alignment being generated from the incoming audio, where visemes are different, dis tinguishable lip shapes [6, pp. 394 395] For this a speech recognition system is used to generate the phonetic alignment from the incoming audio. Phonetic alignment ....

E. Cosatto and H. P. Graf, "Photo-realistic talking-heads from image samples," IEEE trans. Multimedia, Vol. 2, No. 3, pp. 152-163, September 2000.

....visemes are generated using the optical flows. Morphing based animation has been considered in the past [5] In this paper we seek to extend this to include animation with expression. For a richer scope of animation it is necessary to be able to animate the face with appropriate expressions. In [3] it is assumed that there exists a video database of the head to be synthesized, wherein, the subject is present in the expression to be synthesized at least once. In our system, given visemes with two or more different facial expressions, a method is presented that can generate the remaining ....

E. Cosatto and H. P. Graf, "Photo-realistic talking-heads from image samples," IEEE trans. Multimedia, Vol. 2, No. 3, pp. 152-163, September 2000.

....with a distinctly synthetic look. In order to look credible, a head must show a picture perfect appearance, natural head movements, and good lip sound synchronization. We use sample based graphics to achieve more photo realistic appearances than what is possible with the traditional approach of 3D modeling and texture mapping. For sample based graphics, first parts of faces are cut from recorded images and are stored in a database. New sequences are then synthesized by integrating such parts into whole faces. With sufficient recorded data this approach produces by far the most naturally ....

....first parts of faces are cut from recorded images and are stored in a database. New sequences are then synthesized by integrating such parts into whole faces. With sufficient recorded data this approach produces by far the most naturally looking speech articulation. We are now integrating 3D modeling with the sample based technique in order to enhance its flexibility. This allows, for example, showing the head over a much wider range of orientations. 1. Introduction Animated characters add entertainment value to a computer user interface and can improve the trust a viewer is ....

[Article contains additional citation context not shown here]

Cosatto, E. and Graf, H.P., "Photo-Realistic TalkingHeads from Image Samples", IEEE Trans. Multimedia, pp. 152-163, Sept. 2000.

....frames from a large recorded video database of mouth shapes to generate photo realistic talking head sequences. The synthesized sequence must exhibit precise lip sound synchronization and smooth articulation. The selection process for finding the best lip shapes has been computationally expensive [1], limiting the speed of the synthesis .to far less than real time. In this paper, we propose a rapid unit selection approach based on triphone units. Experiments show that this algorithm can make the synthesis, excluding the rendering, 50 times faster than real time on a standard desktop PC. We ....

....can again be separated into two steps: In the unit selection step, we retrieve multiple candidate units for each ta get unit in the video to be synthesized. In the search step, we find an optimal sequential combination of the units as the result sequence. 2. 1 Frame based unit selection In [1], each instance of a unit in the database is one video frame, labeled with features on three levels: PCA coefficients: Calculated on the mouth region Geometrical features: Mouth width and height Phonetic label and prosody: Each frame in the database is phonetically labeled, as shown in Figure ....

[Article contains additional citation context not shown here]

E. Cosatto and H.P. Graff "Photo-Realistic Talking-Heads from Image Samples," IEEE Trans. On Multimedia, ,ol. 2, No. 3, 2000

....as nods indicating agreement. Our main interest in head and facial movements is to synthesize naturally looking talking heads. With samplebased animation techniques, articulation of speech can be emulated so realistically that synthesized heads are often hard to distinguish from recorded videos [3]. However, this is the case only for short sentences. In longer sequences a lack of naturally appearing head movements give the talking head a synthetic quality. Many of the classical animation techniques have only limited applicability for the types of talking heads we describe here. Artists ....

Cosatto,E.andGraf,H.P.,"Photo-Realistic TalkingHeads from Image Samples", IEEE Trans. Multimedia, pp. 152-163, Sept. 2000.

No context found.

Cossatto, E., Graf, H. P.: Photo-realistic talking-heads from image samples. IEEE Trans. on Multimedia, 2(3), September 2000.

No context found.

E. Cosatto and H. P. Graf. Photo-realistic talking-heads from image samples. IEEE Trans. on Multimedia, 2(3):152--163, 2000.

No context found.

E. Cosatto and H. P. Graf. Photo-realistic talking-heads from image samples. IEEE Trans. on Multimedia, 2(3):152--163, 2000.

No context found.

E. Cosatto, H. P. Graf. Photo-realistic talking-heads from image samples. In IEEE Transactions on Multimedia, vol.2, no.3, pages 152-163, 2000.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC