Processing

Please wait...

Settings

Settings

Goto Application

1. US20160373715 - Multi view synthesis method and display devices with spatial and inter-view consistency

Office
United States of America
Application Number 15189876
Application Date 22.06.2016
Publication Number 20160373715
Publication Date 22.12.2016
Grant Number 10148930
Grant Date 04.12.2018
Publication Kind B2
IPC
H04N 13/04
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
04Picture reproducers
H04N 13/111
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
H04N 13/128
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
128Adjusting depth or disparity
H04N 13/305
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
302for viewing without the aid of special glasses, i.e. using autostereoscopic displays
305using lenticular lenses, e.g. arrangements of cylindrical lenses
G06T 15/08
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
153D  image rendering
08Volume rendering
H04N 13/00
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
CPC
G06T 15/08
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
153D [Three Dimensional] image rendering
08Volume rendering
H04N 13/111
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
H04N 13/128
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
128Adjusting depth or disparity
H04N 13/305
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
302for viewing without the aid of special glasses, i.e. using autostereoscopic displays
305using lenticular lenses, e.g. arrangements of cylindrical lenses
H04N 2013/0081
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
0074Stereoscopic image analysis
0081Depth or disparity estimation from stereoscopic image signals
Applicants The Regents of the University of California
Inventors Truong Q. Nguyen
Lam Tran
Can Bal
Ramsin Khoshabeh
Agents Greer, Burns & Crain, Ltd.
Steven P. Fallon
Title
(EN) Multi view synthesis method and display devices with spatial and inter-view consistency
Abstract
(EN)

An embodiment of the invention is a method that provides common data and enforces multiple view consistency. In a preferred embodiment, a coordinate alignment matrix is generated after initial warped views are formed. The matrix is used efficiently to repair holes/occlusions when synthesizing final views. In another preferred embodiment, a common background layer is generated based upon initial warped views. Holes are repaired on the common background layer, which can then be used for synthesizing final views. The cost of the latter method is sub-linear, meaning that additional views can be generated with lesser cost. Preferred methods of the invention also use a placement matrix to generate initial warped views, which simplifies warping to a look-up operation.


Related patent documents