Processing

Please wait...

Settings

Settings

Goto Application

1. WO2016135446 - INTERACTIVE SYSTEM CONTROL APPARATUS AND METHOD

Publication Number WO/2016/135446
Publication Date 01.09.2016
International Application No. PCT/GB2016/050362
International Filing Date 15.02.2016
IPC
G06F 9/44 2006.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
9Arrangements for program control, e.g. control units
06using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
44Arrangements for executing specific programs
G06F 3/14 2006.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
14Digital output to display device
G06T 19/00 2011.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
19Manipulating 3D models or images for computer graphics
G06F 3/01 2006.1
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
CPC
G05B 19/048
GPHYSICS
05CONTROLLING; REGULATING
BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
19Programme-control systems
02electric
04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
048Monitoring; Safety
G05B 2219/40131
GPHYSICS
05CONTROLLING; REGULATING
BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
2219Program-control systems
30Nc systems
40Robotics, robotics mapping to robotics vision
40131Virtual reality control, programming of manipulator
G06F 3/011
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
G06F 3/013
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
013Eye tracking input arrangements
G06F 3/017
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
017Gesture based interaction, e.g. based on a set of recognized hand gestures
G06F 3/0481
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
048Interaction techniques based on graphical user interfaces [GUI]
0481based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Applicants
  • BAE SYSTEMS PLC [GB]/[GB]
Inventors
  • WHITEFORD, Christopher,James
  • COLOSIMO, Nicholas, Giacomo, Robert
  • WRIGHT, Julian, David
Agents
  • BAE SYSTEMS PLC, GROUP IP DEPT
Priority Data
1503116.425.02.2015GB
15275049.325.02.2015EP
Publication Language English (en)
Filing Language English (EN)
Designated States
Title
(EN) INTERACTIVE SYSTEM CONTROL APPARATUS AND METHOD
(FR) APPAREIL ET PROCÉDÉ DE CONTRÔLE INTERACTIF DE SYSTÈME
Abstract
(EN) A mixed reality control apparatus for a system comprising at least one remote data source requiring at least one physical control input, the apparatus comprising a headset (100) for placing over a user's eyes, in use, said headset including a screen(102), the apparatus further comprising a processor(104) configured to receive data from said at least one remote data source and display said data on said screen (102) within a three-dimensional virtual environment, and image capture means (106) for capturing images of the real world environment in the vicinity of the user, the processor (104) being further configured to: -blend at least portions or objects of said images of said real world environment into said three-dimensional virtual environment to create a mixed reality environment, including said data, to be displayed on said screen(102); and -generate a virtual representation of said at least one physical control input and blend said virtual representation into said mixed reality environment at a selected location, and generate a marker representative of said selected location; wherein the apparatus is configured to receive a user input in association with said marker, identify said user input as an action in respect of said control input, or said virtual representation thereof, and generate a control signal to effect said action accordingly.
(FR) Un appareil de contrôle de réalité mixte pour un système comprenant au moins une source de données distante nécessitant au moins une entrée de contrôle physique, l'appareil comprenant un casque d'écoute (100) pour placer sur les yeux d'un utilisateur, en utilisation, ledit casque d'écoute comprenant un écran (102), l'appareil comprenant en outre un processeur (104) configuré pour recevoir des données à partir de ladite au moins une source de données distante et d'afficher lesdites données sur ledit écran (102) à l'intérieur d'un environnement virtuel tridimensionnel, et des moyens de capture d'image (106) pour capturer des images de l'environnement du monde réel dans le voisinage de l'utilisateur, le processeur (104) étant en outre configuré pour : mélanger au moins des parties ou des objets desdites images dudit environnement du monde réel dans ledit environnement virtuel tridimensionnel pour créer un environnement de réalité mixte, comprenant lesdites données, de façon à être affichée sur ledit écran (102); et générer une représentation virtuelle de ladite au moins une entrée de contrôle physique et mélanger ladite représentation virtuelle dans ledit environnement de réalité mixte à un emplacement sélectionné, et générer un marqueur représentatif de ladite position sélectionnée; dans lequel l'appareil est configuré pour recevoir une entrée utilisateur en association avec ledit marqueur, identifier ladite entrée utilisateur sous la forme d'une action en rapport de ladite entrée de contrôle, ou ladite représentation virtuelle de celle-ci, et générer un signal de contrôle afin d'effectuer ladite action en conséquence.
Related patent documents
Latest bibliographic data on file with the International Bureau