Processing

Please wait...

Settings

Settings

Goto Application

1. WO2018018022 - INTERACTIVE DISPLAY SYSTEM WITH EYE TRACKING TO DISPLAY CONTENT ACCORDING TO SUBJECT'S INTEREST

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

[ EN ]

Claims

The invention claimed is:

1. A system comprising:

at least a first display;

at least a first imaging device; and

a controller block coupled to the first display and imaging device, wherein the controller block is configured to:

acquire images from the imaging device;

analyze the images from the imaging device to obtain a first analysis; and

alter the content shown on the first display based on the first analysis of the images, wherein the content shown on the first display does not comprise images acquired from the imaging device.

2. The system of claim 1 comprising:

a network, coupled to the controller block, wherein the controller transmits the first analysis to a server; and

the controller block is configured to cause a second display, coupled to the network and separate from the first display, to show a content based on the first analysis.

3. The system of claim 1 wherein the analyze the images from the imaging device to obtain a first analysis comprises the controller block being configured to:

detect a gaze event of a person, wherein the gaze event indicates a selection by the person's eye gaze of either at least a first content or a second content shown on the first display;

upon determining the gaze event is for the first content, display a third content associated with the first content on the first display; and

upon determining the gaze event is for the second content, display a fourth content associated with the second content on the first display.

4. The system of claim 1 wherein the controller is configured to calibrate based on a point of interest at about a frame center, between a frame left edge and a frame right edge of the first display and between a frame top edge and a frame bottom edge of the first display.

5. The system of claim 1 wherein the controller is configured to calibrate based on a point of interest moving from a frame left edge to a frame right edge of the first display or the point of interest moving from the frame right edge to the frame left edge of the first display.

6. The system of claim 1 wherein the controller is configured to calibrate based on a point of interest at one side of a frame of the first display and then at an opposite side of the frame of the first display.

7. The system of claim 1 wherein the controller comprises a real-time processor, and the processor is configured to perform image analysis of gaze click detection, group classification, movement detection, and location estimation.

8. The system of claim 1 wherein the controller comprises embedded storage or is coupled to external storage, the storage is used to store content images received from a server for a presenter and a reporter, and the controller based on image analysis data, determines associated display content.

9. The system of claim 1 wherein the image analysis comprises the controller being configured to determine a gaze duration, estimate face location, and generate a gaze click flag when a duration is greater than a predetermined threshold time value.

10. The system of claim 1 wherein the image analysis comprises the controller being configured to detect a movement of a person's eyes, a movement of a person's head, and movement of a person's body, a person's gender, a person's age, a person's movement behavior or patterns, a person's distance from first display, a person's hair color, a person's clothing color, a person's clothing style such as pants, skirt, or other, appearance, posture, face recognition or face tracking, or any combination of these.

11. The system of claim 1 wherein the alter the content shown on the first display is enabled by generating of a gaze click through flag which comprises a gaze click and weighting factors comprising at least one of a specific gender, age group, specific area, distance, preferred viewers, or other factors, or any combination of these.

12. The system of claim 1 wherein the altered content is migrated from a primary content group to secondary content group to match to a classified viewer's group.

13. The system of claim 1 wherein the altered content can be a content size updated according to viewer's distance, content color to match viewer's dress color, content waving to get attention, content still from waving, or different content, or any combination of these.

14. The system of claim 1 wherein the imaging device located in a separate location than the first display.

15. The system of claim 1 wherein the imaging device is positioned in at least one of a mannequin, a merchandise, a holder, or a stand, separate from the first display.

16. The system of claim 1 wherein the imaging device incorporates a motor to rotate the imaging device itself or to rotate a front mirror to increase its field of view.

17. The system of claim 1 wherein multiple display units and imaging units are linked together, such that when a subject moves from a display unit A's coverage to a display unit B's coverage, a subject's eye is tracked such that display unit B will display content that related to what was displayed in unit A when the subject's gaze was detected in unit A.

18. The system of claim 1 wherein for each instance content is displayed on the first display, captured images associated with the content on the first display are analyzed to determine an interest level, where lower interest content will be replaced with content similar to high interest content either in a single display or using multiple display units.

19. The system of claim 1 wherein the image analysis comprises a gaze blinking which is used to determine if a real human.