Search International and National Patent Collections

1. (WO2017155663) RECURRENT NETWORKS WITH MOTION-BASED ATTENTION FOR VIDEO UNDERSTANDING

Pub. No.:    WO/2017/155663    International Application No.:    PCT/US2017/017192
Publication Date: Fri Sep 15 01:59:59 CEST 2017 International Filing Date: Fri Feb 10 00:59:59 CET 2017
IPC: G06N 3/04
Applicants: QUALCOMM INCORPORATED
Inventors: LI, Zhenyang
GAVVES, Efstratios
JAIN, Mihir
SNOEK, Cornelis Gerardus Maria
Title: RECURRENT NETWORKS WITH MOTION-BASED ATTENTION FOR VIDEO UNDERSTANDING
Abstract:
A method of predicting action labels for a video stream includes receiving the video stream and calculating an optical flow of consecutive frames of the video stream. An attention map is generated from the current frame of the video stream and the calculated optical flow. An action label is predicted for the current frame based on the optical flow, a previous hidden state and the attention map.