Processing

Please wait...

Settings

Settings

1. WO2017136928 - SYSTEM AND METHOD FOR DETECTING INVISIBLE HUMAN EMOTION IN A RETAIL ENVIRONMENT

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

CLAIMS

We claim:

1. A system for detecting invisible human emotion in a retail environment within which a product is displayed in a product display to a person, the system comprising:

a price display device for selectively displaying at least one price of the product, pursuant to a point of sale event;

a camera configured to capture an image sequence of the person before and during the point of sale event; and

a processing unit trained to determine a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, to detect the person's invisible emotional states based on the HC changes, and to output the detected invisible emotional states, the processing unit being trained using a training set comprising HC changes of subjects with known emotional states.

2. The system of claim 1, wherein detecting the person's invisible emotional states based on the HC changes comprises generating an estimated statistical probability that the person's emotional state conforms to a known emotional state from the training set, and a normalized intensity measure of such determined emotional state.

3. The system of claim 1, wherein the point of sale event comprises the price display device displaying a price.

4. The system of claim 1 , wherein the point of sale event comprises the price display device temporarily displaying a discounted price.

5. The system of claim 1, wherein the camera is integral to the price display device.

6. The system of claim 1, further comprising a motion sensor to detect motion in a region proximal the product display, and to, upon detecting motion in the region, trigger the camera to capture the image sequence and the price display device to display the price.

7. The system of claim 1, wherein the processing unit is configured to receive locations of the camera and the product, to perform gaze tracking to analyze the image sequence to determine whether the person is looking at the product during the point of sale event, and to discard the image sequence if the person is not looking at the product during the point of sale event.

8. The system of claim 1, further comprising a notification system to display a notification indicative of the person's detected invisible emotional states.

9. A method for detecting invisible human emotion in a retail environment within which a product is displayed in a product display to a person, the method comprising:

selectively displaying, by a price display device, at least one price of the product, pursuant to a point of sale event;

capturing, by a camera, an image sequence of the person before and during the point of sale event; and

determining, by a processing unit, a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, detecting the person's invisible emotional states based on the HC changes, and outputting the detected invisible emotional states, the processing unit being trained using a training set comprising HC changes of subjects with known emotional states.

10. The method of claim 9, wherein detecting the person's invisible emotional states based on the HC changes comprises generating an estimated statistical probability that the person's emotional state conforms to a known emotional state from the training set, and a normalized intensity measure of such determined emotional state.

11. The method of claim 9, wherein the point of sale event comprises the price display device displaying a price.

12. The method of claim 9, wherein the point of sale event comprises the price display device temporarily displaying a discounted price.

13. The method of claim 9, wherein the camera is integral to the price display device.

14. The method of claim 9, further comprising detecting motion, by a motion sensor, in a region proximal the product display, and, upon detecting motion in the region, triggering the camera to capture the image sequence and the price display device to display the price.

15. The method of claim 9, further comprising receiving, by the processing unit, locations of the camera and the product, performing gaze tracking to analyze the image sequence to determine whether the person is looking at the product during the point of sale event, and discarding the image sequence if the person is not looking at the product during the point of sale event.

16. The method of claim 9, further comprising a notification system to display a notification indicative of the person's detected invisible emotional states.