Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020191813 - CODING AND DECODING METHODS AND DEVICES BASED ON FREE VIEWPOINTS

Publication Number WO/2020/191813
Publication Date 01.10.2020
International Application No. PCT/CN2019/081682
International Filing Date 08.04.2019
IPC
H04N 13/243 2018.01
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
20Image signal generators
204using stereoscopic image cameras
243using three or more 2D image sensors
CPC
H04N 21/23418
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
23Processing of content or additional data; Elementary server operations; Server middleware
234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
23418involving operations for analysing video streams, e.g. detecting features or characteristics
H04N 21/23424
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
23Processing of content or additional data; Elementary server operations; Server middleware
234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
23424involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
H04N 21/234309
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
23Processing of content or additional data; Elementary server operations; Server middleware
234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
2343involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
234309by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
H04N 21/2355
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
23Processing of content or additional data; Elementary server operations; Server middleware
235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
2355involving reformatting operations of additional data, e.g. HTML pages
H04N 21/4355
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
4355involving reformatting operations of additional data, e.g. HTML pages on a television screen
H04N 21/44008
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
21Selective content distribution, e.g. interactive television or video on demand [VOD]
40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
44008involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Applicants
  • 北京大学深圳研究生院 PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL [CN]/[CN]
Inventors
  • 王荣刚 WANG, Ronggang
  • 王振宇 WANG, Zhenyu
  • 高文 GAO, Wen
Agents
  • 北京晋德允升知识产权代理有限公司 BEIJING IPKINGDOM INTELLECTUAL PROPERTY AGENCY LTD.
Priority Data
201910240995.128.03.2019CN
Publication Language Chinese (ZH)
Filing Language Chinese (ZH)
Designated States
Title
(EN) CODING AND DECODING METHODS AND DEVICES BASED ON FREE VIEWPOINTS
(FR) PROCÉDÉS ET DISPOSITIFS DE CODAGE ET DE DÉCODAGE BASÉS SUR DES POINTS DE VUE LIBRES
(ZH) 一种基于自由视点的编解码方法及装置
Abstract
(EN)
The embodiments of the present description relate to the technical field of video coding, and provide coding and decoding methods and devices based on free viewpoints. The coding method comprises: generating, on a server, a planar stitched image and stitching information on the basis of a multi-channel single-viewpoint video; generating a planar stitched video on the basis of the planar stitched image; generating camera assistance information of the planar stitched video on the basis of camera assistance information existing in the multi-channel single-viewpoint video; and coding the planar stitched video, the stitching information, and the camera assistance information of the planar stitched video to generate a planar stitched video code stream. The decoding method comprises: decoding, on a client, a planar stitched video code stream; and obtaining virtual viewpoints according to viewpoint information of a viewer. By using the methods provided by the present description, the synthesis of free viewpoints on the client can be implemented, so that the viewing delay is reduced, the calculation pressure of the server is decreased, and the viewing experience is improved.
(FR)
Les modes de réalisation de la présente invention concernent le domaine technique du codage vidéo, et fournissent des procédés et des dispositifs de codage et de décodage basés sur des points de vue libres. Le procédé de codage comprend : la génération, sur un serveur, d'une image assemblée plane et d’informations d'assemblage sur la base d'une vidéo à point de vue unique multicanal ; la génération d'une vidéo assemblée plane sur la base de l'image assemblée plane ; la génération d'informations d'assistance de caméra de la vidéo assemblée plane sur la base d’informations d'assistance de caméra existant dans la vidéo à point de vue unique multicanal ; et le codage de la vidéo assemblée plane, des informations d'assemblage et des informations d'assistance de caméra de la vidéo assemblée plane afin de générer un flux de codes de vidéo assemblée plane. Le procédé de décodage comprend : le décodage, sur un client, d'un flux de codes de vidéo assemblée plane ; et l'obtention de points de vue virtuels en fonction d'informations de point de vue d'un spectateur. En utilisant les procédés fournis par la présente invention, la synthèse de points de vue libres sur le client peut être mise en œuvre, de sorte que le retard de visualisation est réduit, la pression de calcul du serveur diminue, et l'expérience de visualisation est améliorée.
(ZH)
本说明书实施例提供了一种基于自由视点的编解码方法及装置,属于视频编码技术领域。该方法包括:在服务端,基于多路单视点视频,生成平面拼接图及拼接信息;基于所述平面拼接图,生成平面拼接视频;基于多路单视点视频中存在的摄像机辅助信息,生成所述平面拼接视频的摄像机辅助信息;对所述平面拼接视频、所述拼接信息及所述平面拼接视频的摄像机辅助信息进行编码,生成平面拼接视频码流。在客户端,解码平面拼接视频码流,根据观看者的视点信息,得到虚拟视点。采用本说明书提供的方法,能够实现在客户端进行自由视点的合成,从而降低观看延迟,减轻服务端计算压力,改善观看体验。
Also published as
Latest bibliographic data on file with the International Bureau