Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020196976 - ELECTRONIC DEVICE BASED ON ATTENTION RECURRENT NEURAL NETWORK USING MULTIMODAL DATA AND OPERATION METHOD THEREOF

Publication Number WO/2020/196976
Publication Date 01.10.2020
International Application No. PCT/KR2019/004266
International Filing Date 10.04.2019
IPC
G06N 3/08 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
08Learning methods
G06N 3/04 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
04Architecture, e.g. interconnection topology
Applicants
  • 한국과학기술원 KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY [KR]/[KR]
Inventors
  • 이수영 LEE, Soo-Young
  • 신영훈 SHIN, Young Hoon
  • 김태호 KIM, Taeho
  • 최신국 CHOI, Shinkook
  • 김태훈 KIM, Taehun
Agents
  • 양성보 YANG, Sungbo
Priority Data
10-2019-003265422.03.2019KR
Publication Language Korean (KO)
Filing Language Korean (KO)
Designated States
Title
(EN) ELECTRONIC DEVICE BASED ON ATTENTION RECURRENT NEURAL NETWORK USING MULTIMODAL DATA AND OPERATION METHOD THEREOF
(FR) DISPOSITIF ÉLECTRONIQUE BASÉ SUR UN RÉSEAU NEURONAL RÉCURRENT D'ATTENTION UTILISANT DES DONNÉES MULTIMODALES ET SON PROCÉDÉ DE FONCTIONNEMENT
(KO) 멀티모달 데이터를 이용한 주의집중의 순환 신경망 기반 전자 장치 및 그의 동작 방법
Abstract
(EN)
An electronic device and an operation method thereof according to various embodiments are based on an attention recurrent neural network using multimodal data, and may be configured to: detect multimodal data associated with at least two of a user's image, voice, and text; calculate a first attention variable on the basis of the multimodal data; calculate a second attention variable on the basis of the multimodal data and the first attention variable; and infer a resulting value on the basis of the second attention variable.
(FR)
Un dispositif électronique et son procédé de fonctionnement selon divers modes de réalisation de la présente invention sont basés sur un réseau neuronal récurrent d'attention utilisant des données multimodales, et peuvent être configurés pour : détecter des données multimodales associées à au moins deux éléments parmi l'image, la voix et le texte d'un utilisateur ; calculer une première variable d'attention sur la base des données multimodales ; calculer une seconde variable d'attention sur la base des données multimodales et de la première variable d'attention ; et déduire une valeur résultante sur la base de la seconde variable d'attention.
(KO)
다양한 실시예들에 따른 전자 장치 및 그의 동작 방법은 멀티모달 데이터를 이용한 주의집중의 순환 신경망 기반으로 하며, 사용자의 영상, 음성 또는 텍스트 중 적어도 어느 두 개와 관련되는 멀티모달 데이터를 검출하고, 멀티모달 데이터에 기반하여, 제 1 주의집중 변수를 계산하고, 멀티모달 데이터 및 제 1 주의집중 변수에 기반하여, 제 2 주의집중 변수를 계산하고, 및 제 2 주의집중 변수에 기반하여, 결과값을 추론하도록 구성될 수 있다.
Latest bibliographic data on file with the International Bureau