Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020113166 - EARLY FUSION OF CAMERA AND RADAR FRAMES

Publication Number WO/2020/113166
Publication Date 04.06.2020
International Application No. PCT/US2019/063856
International Filing Date 29.11.2019
IPC
G01S 13/931 2020.01
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
88Radar or analogous systems, specially adapted for specific applications
93for anti-collision purposes
931of land vehicles
G01S 13/86 2006.01
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
86Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
G01S 13/89 2006.01
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
88Radar or analogous systems, specially adapted for specific applications
89for mapping or imaging
G06N 3/02 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
G01S 7/295 2006.01
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
7Details of systems according to groups G01S13/, G01S15/, G01S17/127
02of systems according to group G01S13/58
28Details of pulse systems
285Receivers
295Means for transforming co-ordinates or for evaluating data, e.g. using computers
G06K 9/00 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
CPC
G01S 13/865
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
86Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
865Combination of radar systems with lidar systems
G01S 13/867
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
86Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
867Combination of radar systems with cameras
G01S 13/89
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
88Radar or analogous systems specially adapted for specific applications
89for mapping or imaging
G01S 13/931
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
88Radar or analogous systems specially adapted for specific applications
93for anti-collision purposes
931of land vehicles
G01S 17/931
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
17Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
88Lidar systems specially adapted for specific applications
93for anti-collision purposes
931of land vehicles
G01S 2013/9318
GPHYSICS
01MEASURING; TESTING
SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
13Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
88Radar or analogous systems specially adapted for specific applications
93for anti-collision purposes
931of land vehicles
9318Controlling the steering
Applicants
  • QUALCOMM INCORPORATED [US]/[US]
Inventors
  • GOWAIKAR, Radhika Dilip
  • SUKHAVASI, Ravi Teja
  • FONTIJNE, Daniel Hendricus Franciscus
  • MAJOR, Bence
  • ANSARI, Amin
  • LIM, Teck Yian
  • SUBRAMANIAN, Sundar
  • WU, Xinzhou
Agents
  • OLDS, Mark E.
Priority Data
16/698,60127.11.2019US
62/774,02030.11.2018US
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) EARLY FUSION OF CAMERA AND RADAR FRAMES
(FR) FUSION PRÉCOCE DE TRAMES DE CAMÉRA ET DE RADAR
Abstract
(EN)
Disclosed are techniques for fusing camera and radar frames to perform object detection in one or more spatial domains. In an aspect, an on-board computer of a host vehicle receives, from a camera sensor of the host vehicle, a plurality of camera frames, receives, from a radar sensor of the host vehicle, a plurality of radar frames, performs a camera feature extraction process on a first camera frame of the plurality of camera frames to generate a first camera feature map, performs a radar feature extraction process on a first radar frame of the plurality of radar frames to generate a first radar feature map, converts the first camera feature map and/or the first radar feature map to a common spatial domain, and concatenates the first radar feature map and the first camera feature map to generate a first concatenated feature map in the common spatial domain.
(FR)
L'invention concerne des techniques consistant à fusionner des trames de caméra et de radar pour effectuer une détection d'objet dans un ou plusieurs domaines spatiaux. Selon un aspect, un ordinateur embarqué d'un véhicule hôte reçoit, en provenance d'un capteur de caméra du véhicule hôte, une pluralité de trames de caméra, reçoit, en provenance d'un capteur de radar du véhicule hôte, une pluralité de trames radar, exécute un processus d'extraction de caractéristiques de caméra sur une première trame de caméra de la pluralité de trames de caméra pour générer une première carte de caractéristiques de caméra, exécute un processus d'extraction de caractéristiques de radar sur une première trame de radar de la pluralité de trames de radar pour générer une première carte de caractéristiques de radar, convertit la première carte de caractéristiques de caméra et/ou la première carte de caractéristiques de radar en un domaine spatial commun, et concatène la première carte de caractéristiques de radar et la première carte de caractéristiques de caméra pour générer une première carte de caractéristiques concaténées dans le domaine spatial commun.
Also published as
Latest bibliographic data on file with the International Bureau