Sketch Express: Facial Expressions Made Easy
; Alvarez, X.
; Orvalho, J.
; Gutierrez, D. G.
; Sousa, A.A.S
Computers and Graphics Vol. 36, Nº 6, pp. 585 - 595, March, 2012.
ISSN (print): 0097-8493
ISSN (online): 0097-8493
Journal Impact Factor: 1,176 (in 2016)
Digital Object Identifier:
Download Full text PDF ( 13 MBs)
One of the most challenging tasks for an animator is to quickly create convincing facial expressions. Finding an eﬀective control
interface to manipulate facial geometry has traditionally required experienced users (usually technical directors), who create and
place the necessary animation controls. Here we present our sketching interface control system, designed to reduce the time and
eﬀort necessary to create facial animations. Inspired in the way artists draw, where simple strokes deﬁne the shape of an object,
our approach allows the user to sketch such strokes either directly on the 3D mesh or on two diﬀerent types of canvas: a 2D ﬁxed
canvas or more ﬂexible 2.5D dynamic screen-aligned billboards. In all cases, the strokes do not control the geometry of the face,
but the underlying animation rig instead, allowing direct manipulation of the rig elements. Additionally, we show how the strokes
can be easily reused in diﬀerent characters, allowing retargeting of poses on several models. We illustrate our interactive approach
using varied facial models of diﬀerent styles showing that ﬁrst time users typically create appealing 3D poses and animations in
just a few minutes. We also present in this article the results of a user study. We deploy our method in an application for an
artistic purpose. Our system has also been used in a pioneer serious game context, where the goal was to teach people with Autism
Spectrum Disorders (ASD) to recognize facial emotions, using real time synthesis and automatic facial expression analysis.