Processing

Please wait...

Settings

Settings

Goto Application

1. US20140293028 - Multi view synthesis method and display devices with spatial and inter-view consistency

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

[ EN ]

Claims

1. A method for rendering multiple view data from a stereoscopic video data stream, comprising:
receiving or estimating a disparity map from the stereoscopic data;
forming a placement matrix to warp known pixels onto an image plane of a desired view, the placement matrix at position α is defined as:

           P k α( x,y+( k−α) D k( x,y))= y,
where x and y are row and column indices, respectively, and the placement matrix P k α(x′,y′)=ŷ) provides a pixel location in the reference image that should be mapped on the pixel location (x′,y′) in the virtual view after warping; and
with the placement matrix, using a look-up table to conduct image warping.
2. The method of claim 1, further comprising resolving any mapping of multiple pixels from different disparity levels onto the same pixel location by favoring pixels with larger disparity when generating foreground and for other occasions where there exist two pixels with column indices y m and y n, and row index x such that y m≠y n and y′=y m−αD k(x,y m)=y n−aD k(x,y n) using the following rule:
3. The method of claim 2, further comprising a refining step to choose final pixel values based upon the neighborhood of a pixel to choose a more likely value amount two or more candidate values.
4. The method of claim 1, further comprising:
conducting coordinate alignment between multiple views; and
repairing holes in said multiple views individually with respect to a local background layer; and
generating final views using repaired information from the multiple views.
5. The method of claim 1, further comprising:
generating a common background layer for multiple views;
repairing holes in the multiple views on the common background layer; and
generating final views using repaired information from the common background layer.
6. A method for rendering multiple view data from a stereoscopic video data stream, comprising:
receiving or estimating a disparity map from the stereoscopic data;
forming a placement matrix that provides pixel locations in an intended virtual view for pixels in the multiple view data;
warping pixels onto multiple views via a look-up from the placement matrix;
preparing hole repair data that is common for the multiple views;
generating multiple final views while conducting hole repair with the data that is common.
7. The method of claim 6, further comprising, after said forming, detecting defects in the placement matrix and correcting the defects by selecting and using surrounding information from background or foreground objects associated with the defect.
8. The method of claim 7, further comprising refining locations having multiple candidate pixels to remove ghost images.
9. The method of claim 6, wherein said warping pixels comprises using a candidate pixel for a certain location when it is the sole candidate for that location and when there are multiple candidates for a certain location from both views, the candidate that is closer to the camera is used initially, while locations having two candidate pixels are remembered for use in hole repair.
10. The method of claim 6, wherein the data that is common comprises a coordinate alignment matrix that identifies occluded regions on a common reference image, and holes are repaired individually from a local background layer for generating the final views.
11. The method of claim 6, wherein the data that is common comprises a common background layer with repaired holes, and holes are repaired with the common background layer when generating the final views.
12. A 3D display device for displaying, comprising:
a 2D display device;
a lenticular screen associated with a 21) display device; and
a display engine for the 2D display device to generate a predetermined number of views for a 3D display, including code for,
generating a placement matrix for a predetermined number of views and warping the views with the placement matrix using a look-up operation;
conducting hole repair for the views; and
providing display data to the 2D display device for the predetermined number of views.
13. The device of claim 12, wherein said conducting hole repair comprises aligning coordinates of warped views generated with the placement matrix, repairing holes in warped views individually with respect to a local background layer.
14. The device of claim 12, wherein said conducting hole repair comprises generating a common background layer for warped view generated with the placement matrix and repairing holes on the common background layer.