Search International and National Patent Collections

1. (WO2018082498) MID-AIR FINGER POINTING DETECTION FOR DEVICE INTERACTION

Pub. No.:    WO/2018/082498    International Application No.:    PCT/CN2017/107832
Publication Date: Sat May 12 01:59:59 CEST 2018 International Filing Date: Fri Oct 27 01:59:59 CEST 2017
IPC: G06F 3/01
Applicants: THE HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
Inventors: HUI, Pan
HASSANI BIJARBOONEH, Farshid
LEE, Lik Hang
Title: MID-AIR FINGER POINTING DETECTION FOR DEVICE INTERACTION
Abstract:
The technology described herein is generally directed towards a free hand, barehanded technique to provide user input to a device, such as to move a cursor on a user interface. Frames of images are captured, and each frame is processed to determine a fingertip position. The processing includes an image segmentation phase that provides a binary representation of the image, a disjoint union arborescence graph construction phase that operates on the binary representation of the image to construct set of arborescence graphs, and a fingertip location estimation phase that selects a graph from among the set of arborescence graphs and uses the root node to estimate the fingertip location. Also described is determining a hand orientation from the set of arborescence graphs.