Search International and National Patent Collections

1. (WO2015042867) METHOD FOR EDITING FACIAL EXPRESSION BASED ON SINGLE CAMERA AND MOTION CAPTURE DATA

Pub. No.:    WO/2015/042867    International Application No.:    PCT/CN2013/084449
Publication Date: Fri Apr 03 01:59:59 CEST 2015 International Filing Date: Sat Sep 28 01:59:59 CEST 2013
IPC: G06T 13/40
Applicants: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
中国科学院自动化研究所
Inventors: WU, Huaiyu
吴怀宇
PAN, Chunhong
潘春洪
WANG, Shuyang
王舒旸
SHA, Jinzheng
沙金正
Title: METHOD FOR EDITING FACIAL EXPRESSION BASED ON SINGLE CAMERA AND MOTION CAPTURE DATA
Abstract:
Disclosed is a method for editing a virtual facial expression, which comprises an offline process and an online process. The offline process comprises: step 1, utilizing a full face photo to generate a virtual three-dimensional face model of a user; step 2, decoupling motion capture data and separating a gesture from an expression; and step 3, constructing a facial subspace association model. The online process comprises: step 4, performing video analysis on a video image captured in a single camera, using an active appearance model to trace a three-dimensional space position and an orientation of a head and main facial features in a video, and automatically converting the features to two parts of control parameters; and step 5, using the motion capture data after decoupling to perform dynamic data filtering on expression control parameters with loud noise and low resolution, inputting signals after filtering into the facial subspace association model, computing and obtaining a global expression, and finally assigning the global expression to the virtual three-dimensional face generated in the offline process to implement editing of the virtual facial expression.