Lightweight Wrinkle Synthesis for 3D Facial Modeling and Animation

Jun Li, Weiwei Xu, Zhiquan Cheng, Kai Xu und Reinhard Klein
In: Computer Aided Design (2015), 58(117-122)
 

Abstract

We present a lightweight non-parametric method to generate wrinkles for 3D facial modeling and animation. The key lightweight feature of the method is that it can generate plausible wrinkles using a single low-cost Kinect camera and one high quality 3D face model with details as the example. Our method works in two stages: (1)offline personalized wrinkled blendshape construction. User-specific expressions are recorded using the RGB-Depth camera, and the wrinkles are generated through examplebased synthesis of geometric details. (2) online 3D facial performance capturing. These reconstructed expressions are used as blendshapes to capture facial animations in real-time. Experiments on a variety of facial performance videos show that our method can produce plausible results, approximating the wrinkles in an accurate way. Furthermore, our technique is low-cost and convenient for common users.

Bilder

Paper herunterladen

Paper herunterladen

Zusätzliches Material

Bibtex

@ARTICLE{Li2014,
    author = {Li, Jun and Xu, Weiwei and Cheng, Zhiquan and Xu, Kai and Klein, Reinhard},
     pages = {117--122},
     title = {Lightweight Wrinkle Synthesis for 3D Facial Modeling and Animation},
   journal = {Computer Aided Design},
    volume = {58},
      year = {2015},
  abstract = {We present a lightweight non-parametric method to generate wrinkles for 3D facial modeling and
              animation. The key lightweight feature of the method is that it can generate plausible wrinkles
              using a single low-cost Kinect camera and one high quality 3D face model with details as the
              example. Our method works in two stages: (1)offline personalized wrinkled blendshape construction.
              User-specific expressions are recorded using the RGB-Depth camera, and the wrinkles are generated
              through examplebased synthesis of geometric details. (2) online 3D facial performance capturing.
              These reconstructed expressions are used as blendshapes to capture facial animations in real-time.
              Experiments on a variety of facial performance videos show that our method can produce plausible
              results, approximating the wrinkles in an accurate way. Furthermore, our technique is low-cost and
              convenient for common users.}
}