Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020222157 - METHOD AND SYSTEM FOR TRACKING, ANALYZING AND REACTING TO USER BEHAVIOUR IN DIGITAL AND PHYSICAL SPACES

Publication Number WO/2020/222157
Publication Date 05.11.2020
International Application No. PCT/IB2020/054078
International Filing Date 30.04.2020
IPC
G06K 9/00 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/46 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
G06K 9/62 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
CPC
G06K 2009/00322
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
00322estimating age from face image; using age information for improving recognition
G06K 9/00302
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
00302Facial expression recognition
G06K 9/00771
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
00771Recognising scenes under surveillance, e.g. with Markovian modelling of scene activity
G06K 9/4628
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
4604Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes, intersections
4609by matching or filtering
4619Biologically-inspired filters, e.g. receptive fields
4623with interaction between the responses of different filters
4628Integrating the filters into a hierarchical structure
G06K 9/6271
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
6267Classification techniques
6268relating to the classification paradigm, e.g. parametric or non-parametric approaches
627based on distances between the pattern to be recognised and training or reference patterns
6271based on distances to prototypes
Applicants
  • EMOJ S.R.L. [IT]/[IT]
  • GIRALDI, Luca [IT]/[IT]
  • MENGONI, Maura [IT]/[IT]
  • GENEROSI, Andrea [IT]/[IT]
Inventors
  • MENGONI, Maura
  • GENEROSI, Andrea
Agents
  • GRANA, Daniele
Priority Data
10201900000602030.04.2019IT
Publication Language English (EN)
Filing Language Italian (IT)
Designated States
Title
(EN) METHOD AND SYSTEM FOR TRACKING, ANALYZING AND REACTING TO USER BEHAVIOUR IN DIGITAL AND PHYSICAL SPACES
(FR) PROCÉDÉ ET SYSTÈME POUR SUIVRE, ANALYSER ET RÉAGIR À UN COMPORTEMENT D'UTILISATEUR DANS DES ESPACES NUMÉRIQUES ET PHYSIQUES
Abstract
(EN)
The computer-implemented method for tracking, analyzing and reacting to user behavior in digital and physical spaces, comprises: a step (49) of acquiring an image using an image acquisition device (19); a step (51) of detecting the face of a user within the acquired image; a step (55) of determining a facial expression from the detected face and, from the facial expression, a relevant and predefined category of emotions; a step (54) of gaze tracking of the user's from the detected face; a step (56) of detecting the gender and age of the user from the detected face; a step (60) of activation of a reaction by means of active interaction means (36, 37) with the user, wherein the reactions are determined on the basis of data about the characteristics and behavior of the user comprising the combination the determined facial expression, the gaze detection and the detected gender and age.
(FR)
La présente invention concerne un procédé mis en œuvre par ordinateur pour suivre, analyser et réagir à un comportement d'utilisateur dans des espaces numériques et physiques, lequel procédé mis en œuvre par ordinateur comprend : une étape (49) consistant à acquérir une image à l'aide d'un dispositif d'acquisition d'image (19) ; une étape (51) consistant à détecter le visage d'un utilisateur à l'intérieur de l'image acquise ; une étape (55) consistant à déterminer une expression faciale à partir du visage détecté et, à partir de l'expression faciale, une catégorie d'émotions pertinente et prédéfinie ; une étape (54) consistant à suivre le regard de l'utilisateur à partir du visage détecté ; une étape (56) consistant à détecter le sexe et l'âge de l'utilisateur à partir du visage détecté ; une étape (60) consistant à activer une réaction par le biais de moyens d'interaction actifs (36, 37) avec l'utilisateur, les réactions étant déterminées sur la base de données concernant les caractéristiques et le comportement de l'utilisateur comprenant la combinaison de l'expression faciale déterminée, de la détection du regard et du sexe et de l'âge détectés.
Latest bibliographic data on file with the International Bureau