Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020142680 - LOCAL ARTIFICIAL INTELLIGENCE ASSISTANT SYSTEM WITH EAR-WEARABLE DEVICE

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

[ EN ]

The Claims Are:

1. A method of a local assistant system responding to voice input using an ear-wearable device, wherein the ear- wearable device comprises a first speaker, a first microphone, a first processor, a first memory storage, and a first wireless

communication device, the method comprising:

detecting a wake-up signal, wherein the wake-up signal comprises a vibration sequence comprising a plurality of taps on the ear- wearable device or a keyword in an audio input stream;

after detecting the wake-up signal, receiving a first voice input communicating a first query content, wherein the local assistant system comprises:

speech recognition circuitry programmed to recognize speech within the first voice input to determine the first query content,

speech generation circuitry programmed to generate speech output to the first speaker of the ear- wearable device, and

an input database stored in computer-readable memory comprising locally-handled user inputs;

processing the first voice input to determine the first query content;

determining whether the first query content matches one of the locally-handled user inputs; and

if the first audio input matches one of the locally-handled user inputs, then taking a local responsive action;

if the first audio input does not match one of the locally-handled user inputs, then transmitting at least a portion of the first query content over a wireless network to a network resource.

2. The method of claim 1, wherein the local assistant responds to voice input using the ear-wearable device and a gateway device, wherein the gateway device comprises a gateway processor, a gateway memory storage, a first gateway wireless communication device for communicating with the ear- wearable device, and a second gateway wireless communication device for communicating with a pervasive wireless network, wherein the speech recognition circuitry, the speech generation circuitry, and the input database resides in the gateway device, wherein the processing of the first voice input and the determining are performed by the local assistant system on the gateway device.

3. The method of claim 2, further comprising:

detecting, at a sensor of the ear- wearable device, biological information about a wearer of the ear- wearable device;

wirelessly transmitting, by the ear-wearable device, to the gateway device, the biological information for storage at the gateway memory storage;

identifying the biological information on the gateway memory storage in response to the first voice input, wherein the first query content is a bioinformatic request to report the biological information to the wearer, wherein the bioinformatic request is a locally-handled user input;

formulating, by the gateway device, content for an audio response reporting the biological information;

wirelessly transmitting an audio response to the ear-wearable device; and playing the audio response on the first speaker of the ear-wearable device to provide the biological information to the wearer.

4. The method of any of claims 1-3, wherein the wake-up signal comprises the plurality of taps on the ear-wearable device being detected by the first microphone or by an inertial motion sensor in the ear- wearable device.

5. The method of any of claims 1-4, wherein taking the local responsive action comprises:

obtaining locally-available information and providing an audio response on the ear-wearable device to provide the locally-available information to the user; or

acting upon the ear- wearable device or another local device.

6. The method of any of claims 1-5, wherein the locally-handled user inputs comprise:

a request to report on hardware functionality,

a request to check battery power of the ear- wearable device,

a request to check battery power of a local device,

a request to check ear-wearable device functionality,

a request to adjust a setting of a local device,

a request to adjust a setting of the ear-wearable device,

a request to adjust the volume of the ear- wearable device,

a request for the ear- wearable device to block a sound,

a request for the ear-wearable device to wirelessly pair to a local device, a request for a phone to wirelessly pair to another local device,

a request to provide information based on locally- stored data,

a request to provide a reminder from a calendar stored on a cellular phone, a request to provide content from a list, or

a request to provide activity data.

7. The method of any of claims 1-6, wherein the local assistant system operates on the ear-wearable device, on the ear- wearable device and on a second ear-wearable device, on a gateway device that is in wireless communication with the ear-wearable device, or on a combination of these.

8. A local assistant system for responding to voice input, comprising:

an ear- wearable device comprising a first speaker, a first microphone, a first processor, a first memory storage, and a first wireless communication device;

detection circuitry programmed to detect a wake-up signal, wherein the wake-up signal comprises a vibration sequence comprising a plurality of taps on the ear-wearable device or a keyword in an audio input stream;

input circuitry programmed to, after detecting the wake-up signal, receive, at the local assistant system, a first voice input communicating a first query content;

speech recognition circuitry programmed to recognize speech within the first voice input to determine the first query content,

speech generation circuitry programmed to generate speech output to the speaker of the ear- wearable device,

an input database stored in computer-readable memory comprising locally-handled user inputs;

triage circuitry to determine whether the first query content matches one of the locally-handled user inputs;

local response circuitry, programmed to, if the first audio input matches one of the locally-handled user inputs, then take a local responsive action; and

network communication circuitry, configured to, if the first audio input does not match one of the locally-handled user inputs, transmit at least a portion of the first query content over a wireless network to a network resource.

9. The system of claim 8, further comprising:

a gateway device comprising a gateway processor, a gateway memory storage, a first gateway wireless communication device for communicating with the ear-wearable device, and a second gateway wireless communication device for communicating with a pervasive wireless network;

wherein the speech recognition circuitry, the input database, and the triage circuitry resides in the gateway device.

10. The system of claim 9, wherein the ear-wearable device further comprises a sensor configured to detect biological information about a wearer of the ear-wearable device, wherein the system is configured to:

wirelessly transmit, by the ear-wearable device, to the gateway device, the biological information for storage at the gateway memory storage;

identify the biological information on the gateway memory storage in response to the first voice input, wherein the first query content is a bioinformatic request to report the biological information to the wearer, wherein the bioinformatic request is a locally-handled user input;

formulate, by the gateway device, content for an audio response reporting the biological information;

wirelessly transmit an audio response to the ear-wearable device; and

play the audio response on the first speaker of the ear- wearable device to provide the biological information to the wearer.

11. The system of any of claims 8-10, wherein the ear- wearable device comprises an inertial motion sensor in communication with the detection circuitry.

12. The system of any of claims 8-11, wherein the wake-up signal comprises the plurality of taps on the ear-wearable device being detected by the microphone or by an inertial motion sensor in the ear- wearable device.

13. The system of any of claims 8-12, wherein the local response circuitry is further programmed to:

obtain locally-available information and providing an audio response on the ear-wearable device to provide information to the user; or

act upon the ear- wearable device, a local smart device, or another local device.

14. The system of any of claims 8-13, wherein the locally-handled user inputs comprise:

a request to report on hardware functionality,

a request to check battery power of the ear- wearable device,

a request to check battery power of a cellular phone,

a request to check ear-wearable device functionality,

a request to adjust a setting of a local device,

a request to adjust a setting of the ear-wearable device,

a request to adjust the volume of the ear- wearable device,

a request for the ear- wearable device to block a sound,

a request for the ear-wearable device to wirelessly pair to another device, a request for a phone to wirelessly pair to another device,

a request to provide information based on locally- stored data,

a request to provide a reminder from a calendar stored on a cellular phone, a request to provide content from a list, or

a request to provide activity data.

15. The system of any of claims 8-14, wherein the local assistant operates on the ear- wearable device, on the ear-wearable device and on a second ear-wearable device, on a gateway device that is coupled to the ear- wearable device, or on a combination of these.