Processing

Please wait...

PATENTSCOPE will be unavailable a few hours for maintenance reason on Tuesday 25.01.2022 at 9:00 AM CET
Settings

Settings

Goto Application

1. US20210334988 - RGB point clouds based map generation system for autonomous vehicles

Office
United States of America
Application Number 16336872
Application Date 30.01.2019
Publication Number 20210334988
Publication Date 28.10.2021
Grant Number 11227398
Grant Date 18.01.2022
Publication Kind B2
IPC
G06K 9/00
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06T 7/33
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
7Image analysis
30Determination of transform parameters for the alignment of images, i.e. image registration
33using feature-based methods
G06K 9/46
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
G06K 9/62
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
G01S 17/42
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
02Systems using the reflection of electromagnetic waves other than radio waves
06Systems determining position data of a target
42Simultaneous measurement of distance and other coordinates
G01S 17/89
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
88Lidar systems, specially adapted for specific applications
89for mapping or imaging
CPC
G01S 7/4808
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
7Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
48of systems according to group G01S17/00
4808Evaluating distance, position or velocity data
G06T 7/33
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
7Image analysis
30Determination of transform parameters for the alignment of images, i.e. image registration
33using feature-based methods
G01S 17/42
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
02Systems using the reflection of electromagnetic waves other than radio waves
06Systems determining position data of a target
42Simultaneous measurement of distance and other co-ordinates
G01S 17/89
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
88Lidar systems specially adapted for specific applications
89for mapping or imaging
G01S 17/931
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
88Lidar systems specially adapted for specific applications
93for anti-collision purposes
931of land vehicles
G06K 9/00791
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
00791Recognising scenes perceived from the perspective of a land vehicle, e.g. recognising lanes, obstacles or traffic signs on road scenes
Applicants Baidu USA LLC
Baidu.com Times Technology (Beijing) Co., Ltd.
Inventors Yong Xiao
Runxin He
Pengfei Yuan
Li Yu
Shiyu Song
Agents Womble Bond Dickinson (US) LLP
Title
(EN) RGB point clouds based map generation system for autonomous vehicles
Abstract
(EN)

In one embodiment, a system receives a number of point clouds captured by one or more LIDAR sensors of an ADV and corresponding poses. The system receives a number of RGB images from one or more image capturing sensors of the ADV. The system synchronizes the RGB images with the point clouds to obtain RGB point clouds. The system extracts features from the RGB point clouds, the features including contextual and spatial information of the RGB point clouds. The system registers the RGB point clouds based on the extracted features and generates a point cloud map based on the registration of the RGB point clouds.