WIPO logo
Mobile | Deutsch | Español | Français | 日本語 | 한국어 | Português | Русский | 中文 | العربية |
PATENTSCOPE

Search International and National Patent Collections
World Intellectual Property Organization
Search
 
Browse
 
Translate
 
Options
 
News
 
Login
 
Help
 
maximize
Machine translation
1. (WO2013062944) MULTI VIEW SYNTHESIS METHOD AND DISPLAY DEVICES WITH SPATIAL AND INTER-VIEW CONSISTENCY
Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

CLAIMS

1. A method for rendering multiple view data from a stereoscopic video data stream, comprising:

receiving or estimating a disparity map from the stereoscopic data;

forming a placement matrix to warp known pixels onto an image plane of a desired view, the placement matrix at position oris defined as:


where x and y are row and column indices, respectively, and the placement matrix
provides a pixel location
in the reference image that should be mapped on the pixel location (x',y') in the virtual view after warping; and

with the placement matrix, using a look-up table to conduct image warping.

2. The method of claim 1, further comprising resolving any mapping of multiple pixels from different disparity levels onto the same pixel location by favoring pixels with larger disparity when generating foreground and for other occasions where

there exist two pixels with column indices ym and yn , and row index x such that ym≠ yn and y' = ym - αDk (x, ym) = yn - αD k(x,yn), using the following ruls:


3. The method of claim 2, further comprising a refining step to choose final pixel values based upon the neighborhood of a pixel to choose a more likely value amount two or more candidate values.

4. The method of claim 1, further comprising:

conducting coordinate alignment between multiple views; and repairing holes in said multiple views individually with respect to a local background layer; and

generating final views using repaired information from the multiple views.

5. The method of claim 1, further comprising:

generating a common background layer for multiple views; repairing holes in the multiple views on the common background layer; and

generating final views using repaired information from the common background layer.

6. A method for rendering multiple view data from a stereoscopic video data stream, comprising:

receiving or estimating a disparity map from the stereoscopic data;

forming a placement matrix that provides pixel locations in an intended virtual view for pixels in the multiple view data;

waiping pixels onto multiple views via a look-up from the placement matrix;

preparing hole repair data that is common for the multiple views;

generating multiple final views while conducting hole repair with the data that is common.

7. The method of claim 6, further comprising, after said forming,

detecting defects in the placement matrix and correcting the defects by selecting and using surrounding information from background or foreground objects associated with the defect.

8. The method of claim 7, further comprising refining locations having multiple candidate pixels to remove ghost images.

9. The method of claim 6, wherein said warping pixels comprises using a candidate pixel for a certain location when it is the sole candidate for that location and when there are multiple candidates for a certain location from both views, the candidate that is closer to the camera is used initially, while locations having two candidate pixels are remembered for use in hole repair.

10. The method of claim 6, wherein the data that is common comprises a coordinate alignment matrix that identifies occluded regions on a common reference image, and holes are repaired individually from a local background layer for generating the final views.

11. The method of claim 6, wherein the data that is common comprises a common background layer with repaired holes, and holes are repaired with the common background layer when generating the final views.

12. A 3D display device for displaying, comprising:

a 2D display device;

a lenticular screen associated with a 2D display device; and a display engine for the 2D display device to generate a predetermined

number of views for a 3 D display, including code for ,

generating a placement matrix for a predetermined number of views and warping the views with the placement matrix using a look-up operation;

conducting hole repair for the views; and

providing display data to the 2D display device for the predetermined number of views.

13. The device of claim 12, wherein said conducting hole repair comprises aligning coordinates of warped views generated with the placement matrix, repairing holes in warped views individually with respect to a local background layer.

14. The device of claim 12, wherein said conducting hole repair comprises generating a common background layer for warped view generated with the placement matrix and repairing holes on the common background layer.