Search International and National Patent Collections

1. (WO2017034720) GESTURE BASED ANNOTATIONS

Pub. No.:    WO/2017/034720    International Application No.:    PCT/US2016/043802
Publication Date: Fri Mar 03 00:59:59 CET 2017 International Filing Date: Tue Jul 26 01:59:59 CEST 2016
IPC: G06F 17/24
H04L 12/18
H04N 7/15
G10L 15/26
G06F 3/01
Applicants: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventors: RAINISTO, Roope
Title: GESTURE BASED ANNOTATIONS
Abstract:
In an embodiment a device to convert conversations from a meeting to text and annotate the text is disclosed. In an embodiment a device is disclosed, comprising: a microphone; a camera; a processor; and a storage comprising a set of instructions; wherein the set of instructions causes a processor to: receive from the microphone, an audio recording containing speech of a participant of a meeting; receive from the camera, a video of the participant; identify the participant; convert the speech of the participant to a digital text; develop a skeletal map of the participant; recognize a gesture of the participant from the skeletal maps; detect and identify a target of the gesture; based on the target and the gesture determine an annotation for the digital text corresponding to a point of time of the gesture.