Creating and sharing knowledge for telecommunications

Automatic Visual Speech Animation

Serra, J. ; Freitas, J.F. ; Dias, M. D. ; Orvalho, V.

Automatic Visual Speech Animation, Proc International Conf. on Computational Processing of Portuguese - PROPOR, Coimbra, Portugal, Vol. 0, pp. 0 - 0, April, 2012.

Digital Object Identifier:

Visual speech animation, also known as lip synchronization, is the process of matching a speech audio le with the lips' movements of a synthetic character. Visual speech is a very demanding task, being either fully manual, which is very time consuming, or with automatic methods based on data analysis. Currently, there is still no automatic method that generates any sequence of visual speech, without requiring further ne tuning. This research focused on the problem of automatically achieving lip-sync and led to a system that relies on speech recognition to obtain the pronounced words, mapping them to the visual poses, thus automatically obtaining visual speech animation. Automatic visual speech animation has great impact in the entertainment industry, where it can reduce the time required to produce the animation of talking characters.