Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020068455 - NEURAL NETWORK SYSTEM FOR GESTURE, WEAR, ACTIVITY, OR CARRY DETECTION ON A WEARABLE OR MOBILE DEVICE

Publication Number WO/2020/068455
Publication Date 02.04.2020
International Application No. PCT/US2019/050985
International Filing Date 13.09.2019
IPC
G06F 3/01 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
G02B 27/01 2006.01
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/-G02B26/119
01Head-up displays
G06F 1/16 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
1Details not covered by groups G06F3/-G06F13/82
16Constructional details or arrangements
G06F 3/0346 2013.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
03Arrangements for converting the position or the displacement of a member into a coded form
033Pointing devices displaced or positioned by the user; Accessories therefor
0346with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0354 2013.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
03Arrangements for converting the position or the displacement of a member into a coded form
033Pointing devices displaced or positioned by the user; Accessories therefor
0354with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06N 3/02 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
CPC
G02B 2027/0138
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
01Head-up displays
0101characterised by optical features
0138comprising image capture systems, e.g. camera
G02B 2027/0178
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
01Head-up displays
017Head mounted
0178Eyeglass type, eyeglass details G02C
G02B 2027/0187
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
01Head-up displays
0179Display position adjusting means not related to the information to be displayed
0187slaved to motion of at least a part of the body of the user, e.g. head, eye
G02B 27/017
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
01Head-up displays
017Head mounted
G06F 1/163
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
1Details not covered by groups G06F3/00G06F13/00 and G06F21/00
16Constructional details or arrangements
1613for portable computers
163Wearable computers, e.g. on a belt
G06F 1/1686
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
1Details not covered by groups G06F3/00G06F13/00 and G06F21/00
16Constructional details or arrangements
1613for portable computers
1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
1686the I/O peripheral being an integrated camera
Applicants
  • SNAP INC. [US]/[US]
Inventors
  • ROBERTSON, John James
  • MATHE, Zsolt
Agents
  • WEED, Stephen J.
Priority Data
62/738,09328.09.2018US
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) NEURAL NETWORK SYSTEM FOR GESTURE, WEAR, ACTIVITY, OR CARRY DETECTION ON A WEARABLE OR MOBILE DEVICE
(FR) SYSTÈME DE RÉSEAU NEURONAL POUR DÉTECTION DE GESTE, DE PORT, D'ACTIVITÉ OU DE TRANSPORT SUR UN DISPOSITIF PORTABLE OU MOBILE
Abstract
(EN)
A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.
(FR)
Système de réseau neuronal comprenant un dispositif de lunettes. Le dispositif de lunettes comporte un dispositif de suivi de mouvement, tel qu'un accéléromètre, un gyroscope, ou une unité de mesure inertielle pour mesurer l'accélération et la rotation. Le système de réseau neuronal suit, par l'intermédiaire du dispositif de suivi de mouvement, le mouvement du dispositif de lunettes à partir d'au moins un contact de doigt entré depuis un utilisateur sur une surface d'entrée. Le système de réseau neuronal identifie un geste de doigt par la détection d'au moins un événement tactile détecté sur la base d'une variation du mouvement suivi du dispositif de lunettes sur une période de temps. Le système de réseau neuronal ajuste l'image présentée sur le dispositif d'affichage d'image du dispositif de lunettes sur la base du geste de doigt identifié. Le système de réseau neuronal peut également détecter si l'utilisateur porte le dispositif de lunettes et identifier une activité de l'utilisateur portant le dispositif de lunettes sur la base de la variation du mouvement suivi sur la période de temps.
Latest bibliographic data on file with the International Bureau