Processing

Please wait...

Settings

Settings

Goto Application

1. WO2010006087 - PROCESS FOR PROVIDING AND EDITING INSTRUCTIONS, DATA, DATA STRUCTURES, AND ALGORITHMS IN A COMPUTER SYSTEM

Publication Number WO/2010/006087
Publication Date 14.01.2010
International Application No. PCT/US2009/049987
International Filing Date 09.07.2009
IPC
G10L 15/00 2006.01
GPHYSICS
10MUSICAL INSTRUMENTS; ACOUSTICS
LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
15Speech recognition
CPC
G06F 2203/0381
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
2203Indexing scheme relating to G06F3/00 - G06F3/048
038Indexing scheme relating to G06F3/038
0381Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
G06F 3/017
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
017Gesture based interaction, e.g. based on a set of recognized hand gestures
G06F 3/038
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
03Arrangements for converting the position or the displacement of a member into a coded form
033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/0482
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
048Interaction techniques based on graphical user interfaces [GUI]
0481based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
0482interaction with lists of selectable items, e.g. menus
G06F 3/04845
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
048Interaction techniques based on graphical user interfaces [GUI]
0484for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
04845for image manipulation, e.g. dragging, rotation
G06F 3/0485
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
3Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
01Input arrangements or combined input and output arrangements for interaction between user and computer
048Interaction techniques based on graphical user interfaces [GUI]
0484for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
0485Scrolling or panning
Applicants
  • SEABERG, David [US]/[US]
Inventors
  • SEABERG, David
Priority Data
61/134,19608.07.2008US
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) PROCESS FOR PROVIDING AND EDITING INSTRUCTIONS, DATA, DATA STRUCTURES, AND ALGORITHMS IN A COMPUTER SYSTEM
(FR) PROCÉDÉ DE FOURNITURE ET D'ÉDITION D'INSTRUCTIONS, DE DONNÉES, DE STRUCTURES DE DONNÉES ET D'ALGORITHMES DANS UN SYSTÈME D'ORDINATEUR
Abstract
(EN)
A method and system for computer programming using speech and one or two hand gesture input is described. The system generally uses a plurality of microphones and cameras as input devices. A configurable event recognition system is described allowing various software objects in a system to respond to speech and hand gesture and other input. From this input program code is produced that can be compiled at any time. Various speech and hand gesture events invoke functions within programs to modify programs, move text and punctuation in a word processor, manipulate mathematical objects, perform data mining, perform natural language internet search, modify project management tasks and visualizations, perform 3D modeling, web page design and web page data entry, and television and DVR programming.
(FR)
L'invention porte sur un procédé et un système pour programmer un ordinateur à l'aide de la voix et d'une ou deux entrées par geste de la main. Le système utilise généralement une pluralité de microphones et de caméras en tant que dispositifs d'entrée. Un système de reconnaissance d'événement configurable est décrit, permettant à divers objets logiciels dans un système de répondre à la voix et aux gestes de la main et à une autre entrée. A partir de cette entrée, un code de programme est produit qui peut être compilé à tout moment. Divers événements de parole et de geste de la main invoquent des fonctions dans des programmes pour modifier des programmes, déplacer du texte et de la ponctuation dans un système de traitement de texte, manipuler des objets mathématiques, effectuer une exploration de données, effectuer une recherche Internet en langue naturelle, modifier des tâches de gestion de projet et des visualisations, effectuer une modélisation en 3D, une conception de page Internet et une entrée de données de page Internet, et une programmation de télévision et d'enregistreur vidéo numérique.
Also published as
Latest bibliographic data on file with the International Bureau