Search International and National Patent Collections

1. (WO2017065975) AUGMENTING MULTI-VIEW IMAGE DATA WITH SYNTHETIC OBJECTS USING IMU AND IMAGE DATA

Pub. No.:    WO/2017/065975    International Application No.:    PCT/US2016/054218
Publication Date: Fri Apr 21 01:59:59 CEST 2017 International Filing Date: Thu Sep 29 01:59:59 CEST 2016
IPC: G06T 19/00
G06T 7/40
H04N 13/02
Applicants: FYUSION, INC.
Inventors: HOLZER, Stefan Johannes Josef
MILLER, Stephen David
TREVOR, Alexander Jay Bruen
SAELZLE, Martin
RUSU, Radu Bogdan
Title: AUGMENTING MULTI-VIEW IMAGE DATA WITH SYNTHETIC OBJECTS USING IMU AND IMAGE DATA
Abstract:
Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (TMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera's intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.