Processing

Please wait...

Settings

Settings

Goto Application

1. WO2011000749 - MULTIMODAL INTERACTION ON DIGITAL TELEVISION APPLICATIONS

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

[ EN ]

CLAIMS

1 .- Method of multimodal interaction on interactive Digital TV applications, wherein the television is provided with a network decoder (100) incorporating an associated browser (1 10), characterized by the following steps:

a. Connecting the browser to a network server and downloading a multimodal application and its descriptive tags which are generated in response to an interaction event caused by a user during the human- computer dialogue

b. The browser sending the tags characterizing the multimodal application to an interpreter (300) residing in a network server

c. The interpreter interpreting the tags, which interpreter orders the execution of actions corresponding to the tags

d. Repeating steps a-c until the user exits the application

2.- Method according to claim 1 , characterized in that in step a. the events are graphics and/or speech.

3.- Method according to claim 2, wherein an external module (120) is associated with the browser (1 10) with the function of transferring the descriptive tags of the speech dialogue to the interpreter of said tags (300) by means of an IP protocol.

4.- Method according to claim 3, wherein the interpreter (300) of the descriptive tags of the speech dialogue coordinates and controls all the speech events.

5.- Method according to claim 4, wherein the interpreter (300) of the descriptive tags of the speech dialogue communicates with one or several servers providing speech resources by means of the MRCP protocol..

6.- Method according to claim 5, wherein the interpreter (300) of the descriptive tags of the speech dialogue analyzes the structure of the multimodal application and sends the corresponding commands to the voice server which complies with the MRCP protocol.

7.- Method according to claim 6, wherein the interpreter (300) of the descriptive tags of the speech dialogue communicates with the external module

(120) associated with the browser of the decoder and transfers thereto the data necessary for such module to set up a session by means of SIP with the MRCP voice server (460).

8.- Method according to claim 7, wherein the decoder receives and sends the voice data to the MRCP server (460) by means of the RTP protocol.

9.- Method according to claim 8, characterized in that the external module (120) associated with the browser sets up communication with an RTP client (170), thus obtaining the state of the communication between the decoder and the MRCP voice server (460).

10.- Method according to any of claims 5-9, wherein the decoder (100) has an application (190) capable of collecting the data coming from any external device which collects audio data and is capable of sending them by means of an IP connection to the voice servers.

1 1.- Method according to claim 10, wherein said application is capable of compressing said audio data to the format compatible with an MRCP server and sending them through the RTP protocol to the voice server (400).

12.- Method according to claim 1 1 , wherein the decoder has an application (180) capable of collecting the audio data coming from the RTP channel, decompressing the data to the format playable by the decoder and sending them to an electronic device existing therein in charge of the audio generation.

13.- Method according to any of claims 3-12, wherein the communication between the browser (1 10) existing in the decoder and the external module (120) is performed through an application programming interface.

14.- Method according to any of the previous claims, wherein the multimodal applications executed in the browser (1 10) are pre-processed, separating the multimodal logic from the service logic before being displayed to the user.

15.- System capable of carrying out any of the methods of claims 1 to 14.

16.- Use of the system of claim 15 in a pay-per-view digital television service.