Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020139054 - APPARATUS AND METHOD FOR GENERATING A VIRTUAL AVATAR

Publication Number WO/2020/139054
Publication Date 02.07.2020
International Application No. PCT/KR2019/018710
International Filing Date 30.12.2019
IPC
G06T 13/40 2011.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
13Animation
203D animation
40of characters, e.g. humans, animals or virtual beings
G06T 7/11 2017.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
7Image analysis
10Segmentation; Edge detection
11Region-based segmentation
G06T 19/00 2011.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
19Manipulating 3D models or images for computer graphics
G06N 3/08 2006.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
08Learning methods
CPC
G06K 9/3241
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
20Image acquisition
32Aligning or centering of the image pick-up or image-field
3233Determination of region of interest
3241Recognising objects as potential recognition candidates based on visual cues, e.g. shape
G06K 9/46
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
G06K 9/6273
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
6267Classification techniques
6268relating to the classification paradigm, e.g. parametric or non-parametric approaches
627based on distances between the pattern to be recognised and training or reference patterns
6271based on distances to prototypes
6272based on distances to cluster centroïds
6273Smoothing the distance, e.g. Radial Basis Function Networks
G06N 3/0454
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
04Architectures, e.g. interconnection topology
0454using a combination of multiple neural nets
G06N 3/0472
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
04Architectures, e.g. interconnection topology
0472using probabilistic elements, e.g. p-rams, stochastic processors
G06N 3/08
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
08Learning methods
Applicants
  • SAMSUNG ELECTRONICS CO., LTD. [KR]/[KR]
Inventors
  • LU, Yanqing
  • CUI, Xiufen
Agents
  • KWON, Hyuk-Rok
  • LEE, Jeong-Soon
Priority Data
201811632024.329.12.2018CN
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) APPARATUS AND METHOD FOR GENERATING A VIRTUAL AVATAR
(FR) APPAREIL ET PROCÉDÉ DE PRODUCTION D'AVATAR VIRTUEL
Abstract
(EN)
The present disclosure discloses a method and apparatus for generating a virtual avatar, comprising: detecting whether a target object to be virtualized in an image wears preset occlusion objects; when the target object wears at least one of the occlusion objects: removing, detected occlusion objects from the image of the target object, by a pre-trained neural network model; generating a corresponding virtual avatar according to the obtained image without the occlusion objects; and selecting, according to preset external features of each occlusion object removed, occlusion object images matching the preset external features from a preset three Dimension image library of occlusion object to load to a corresponding position of the virtual avatar to obtain the virtual avatar of the target object; when the target object does not wear the occlusion objects: directly generating the corresponding virtual avatar according to the image of the target object. Through the present disclosure, the similarity between the virtual avatar and the real image may be improved.
(FR)
La présente invention concerne un procédé et un appareil permettant de produire un avatar virtuel, consistant à : détecter si un objet cible à virtualiser dans une image porte des objets d'occlusion prédéfinis ; lorsque l'objet cible porte au moins un des objets d'occlusion : enlever des objets d'occlusion détectés de l'image de l'objet cible, par un modèle de réseau neuronal préentraîné ; produire un avatar virtuel correspondant selon l'image obtenue sans les objets d'occlusion ; et sélectionner, selon des caractéristiques extérieures prédéfinies de chaque objet d'occlusion enlevé, des images d'objet d'occlusion correspondant aux caractéristiques extérieures prédéfinies à partir d'une bibliothèque d'images tridimensionnelles prédéfinie d'objets d'occlusion pour les charger à une position correspondante de l'avatar virtuel pour obtenir l'avatar virtuel de l'objet cible ; lorsque l'objet cible ne porte pas les objets d'occlusion : produire directement l'avatar virtuel correspondant selon l'image de l'objet cible. Grâce à la présente invention, la similarité entre l'avatar virtuel et l'image réelle peut être améliorée.
Also published as
Latest bibliographic data on file with the International Bureau