Search International and National Patent Collections

1. (WO2018040982) REAL TIME IMAGE SUPERPOSITION METHOD AND DEVICE FOR ENHANCING REALITY

Pub. No.:    WO/2018/040982    International Application No.:    PCT/CN2017/098476
Publication Date: Fri Mar 09 00:59:59 CET 2018 International Filing Date: Wed Aug 23 01:59:59 CEST 2017
IPC: G06T 7/00
Applicants: CHENGDU IDEALSEE TECHNOLOGY CO., LTD.
成都理想境界科技有限公司
Inventors: HUANG, Min
黄敏
ZHENG, Lili
郑黎力
Title: REAL TIME IMAGE SUPERPOSITION METHOD AND DEVICE FOR ENHANCING REALITY
Abstract:
A real time image superposition method and device for enhancing reality. The method comprises: acquiring video information of a monocular camera when shooting a preset scene in real time and determining a key frame from within the video information (S1); establishing point cloud data in real time according to a current key frame and a previous key frame of the current key frame, a parallax angle between the current key frame and the previous key frame being greater than a preset parallax angle, and each data point in the cloud data comprising a three-dimensional coordinate (S2); projecting point cloud data corresponding to the current key frame onto the current key frame, and determining planes in the current key frame according to a projection result and a superpixel segmentation result of the current key frame (S3); determining a longest edge line in each plane according to the point cloud data corresponding to each plane in the current key frame (S4); and bonding a bonding surface of a main feature in a virtual image to a first plane when the virtual image is superpositioned on a first plane in the current key frame, and setting a forward edge of the main feature to be parallel or perpendicular to the first plane, the forward edge being an intersection line between a preset orientation surface and a preset bottom surface of the main feature (S5). Using the method, it is possible to provide for a user a visual experience of augmented reality (AR) technology without needing to digitize a real environment in advance, thus having a strong real-time performance.