Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020005635 - OBJECT-BASED LOCALIZATION

Publication Number WO/2020/005635
Publication Date 02.01.2020
International Application No. PCT/US2019/037587
International Filing Date 18.06.2019
IPC
G06K 9/00 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
CPC
G06K 9/00201
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00201Recognising three-dimensional objects, e.g. using range or tactile information
G06K 9/00664
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
00664Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera
G06K 9/00671
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
00664Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera
00671for providing information about objects in the scene to a user, e.g. as in augmented reality applications
G06K 9/6211
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
6201Matching; Proximity measures
6202Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
6203Shifting or otherwise transforming the patterns to accommodate for positional errors
6211Matching configurations of points or features, e.g. constellation matching
G06K 9/628
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
6267Classification techniques
6279relating to the number of classes
628Multiple classes
G06N 20/00
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
20Machine learning
Applicants
  • MICROSOFT TECHNOLOGY LICENSING, LLC [US]/[US]
Inventors
  • SAWHNEY, Harpreet Singh
  • POLLEFEYS, Marc André Léon
Agents
  • MINHAS, Sandip S.
  • CHEN, Wei-Chen Nicholas
  • HINOJOSA, Brianna L.
  • HOLMES, Danielle J.
  • SWAIN, Cassandra T.
  • WONG, Thomas S.
  • CHOI, Daniel
  • HWANG, William C.
  • WIGHT, Stephen A.
  • CHATTERJEE, Aaron C.
  • JARDINE, John S.
  • GOLDSMITH, Micah P.
Priority Data
16/017,89325.06.2018US
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) OBJECT-BASED LOCALIZATION
(FR) LOCALISATION BASÉE SUR DES OBJETS
Abstract
(EN)
Techniques for localizing a device based on images captured by the device. The techniques include receiving, from a device via a data communication network, image frame data for frames captured by an imaging camera included in the device, the frames including a first frame, automatically detecting real-world objects captured in the image frame data, automatically classifying the detected real-world objects as being associated with respective object classes, automatically identifying object class and instance dependent keypoints for the real-world objects based on the object classes associated with the real-world objects, and estimating a pose of the device for the first frame based on at least the identified object class and instance dependent keypoints.
(FR)
L'invention concerne des techniques destinées à localiser un dispositif d'après des images capturées par le dispositif. Les techniques comprennent les étapes consistant à recevoir, en provenance d'un dispositif via un réseau de communication de données, des données de trames d'images concernant des trames capturées par une caméra d'imagerie comprise dans le dispositif, les trames incluant une première trame, à détecter automatiquement des objets du monde réel capturés dans les données de trames d'images, à classifier automatiquement les objets du monde réel détectés comme étant associés à des classes respectives d'objets, à identifier automatiquement des points-clés dépendant de la classe d'objets et de l'instance pour les objets du monde réel d'après les classes d'objets associées aux objets du monde réel, et à estimer une pose du dispositif pour la première trame d'après au moins les points-clés identifiés dépendant de la classe d'objets et de l'instance.
Also published as
Latest bibliographic data on file with the International Bureau