Processing

Please wait...

Settings

Settings

Goto Application

1. US20200226843 - INSERTION OF VR SPECTATOR IN LIVE VIDEO OF A LIVE EVENT

Office
United States of America
Application Number 16835106
Application Date 30.03.2020
Publication Number 20200226843
Publication Date 16.07.2020
Publication Kind A1
IPC
G06T 19/00
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
19Manipulating 3D models or images for computer graphics
G02B 27/01
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/-G02B26/119
01Head-up displays
H04N 13/117
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
117the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
H04N 13/243
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
20Image signal generators
204using stereoscopic image cameras
243using three or more 2D image sensors
H04N 13/366
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
366using viewer tracking
H04N 13/344
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
332Displays for viewing with the aid of special glasses or head-mounted displays
344with head-mounted left-right displays
CPC
G02B 27/017
GPHYSICS
02OPTICS
BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
27Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
01Head-up displays
017Head mounted
G06T 19/006
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
19Manipulating 3D models or images for computer graphics
006Mixed reality
H04N 13/117
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
10Processing, recording or transmission of stereoscopic or multi-view image signals
106Processing image signals
111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
117the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
H04N 13/243
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
20Image signal generators
204using stereoscopic image cameras
243using three or more 2D image sensors
H04N 13/366
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
366using viewer tracking
H04N 13/344
HELECTRICITY
04ELECTRIC COMMUNICATION TECHNIQUE
NPICTORIAL COMMUNICATION, e.g. TELEVISION
13Stereoscopic video systems; Multi-view video systems; Details thereof
30Image reproducers
332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
344with head-mounted left-right displays
Applicants Sony Interactive Entertainment America LLC
Inventors Mohammed Khan
Bhaswar Sarkar
Title
(EN) INSERTION OF VR SPECTATOR IN LIVE VIDEO OF A LIVE EVENT
Abstract
(EN)

A method is provided, including: receiving, from a client device, a request to spectate a live event by a remote spectator; assigning the remote spectator to a seat in a physical venue; streaming a first video feed, captured by a first camera in the physical venue, to the client device for rendering to a first display for viewing by the remote spectator, wherein the first video feed provides a field of view of the physical venue; rendering a second video feed, from a second camera that captures the seat in the physical venue, to a display device in the physical venue; wherein when the field of view provided by the first video feed includes the display device in the physical venue, then the rendering of the second video feed on the display device that is shown in the field of view is altered, showing the remote spectator in the seat.