Some content of this application is unavailable at the moment.
If this situation persist, please contact us atFeedback&Contact
1. (US20190011705) COMPACT OPTICAL SYSTEM WITH MEMS SCANNERS FOR IMAGE GENERATION AND OBJECT TRACKING
Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

Claims

1. An optical system, comprising:
at least one controller for modulating output signals corresponding to image data defining computer-generated (CG) images, the at least one controller configured for processing tracking data associated with a terrain-mapping protocol for identifying features of a terrain of a real-world environment surrounding the optical system;
an illumination engine to generate electromagnetic (EM) radiation in response to the output signals, wherein the EM radiation includes a first spectral bandwidth for generating the CG images and a second spectral bandwidth for deploying the terrain-mapping protocol;
an optical assembly for receiving the EM radiation from the illumination engine and to cause the first spectral bandwidth and the second spectral bandwidth to propagate along a common optical path, wherein the optical assembly directs the first spectral bandwidth from the common optical path onto an image-generation optical path to generate the CG images, and wherein the optical assembly directs the second spectral bandwidth from the common optical path onto a terrain-mapping optical path to irradiate the terrain;
at least one micro electro mechanical system (MEMS) scanner configured to angularly encode the EM radiation based on the output signals, wherein the output signals cause the at least one MEMS scanner to angularly encode the first spectral bandwidth within an image-generation field-of-view (FOV) to generate the CG images, and wherein the output signals cause the at least one MEMS scanner to angularly encode the second spectral bandwidth within a terrain-mapping FOV to at least partially illuminate the terrain; and
a sensor for receiving a reflected-portion of the second spectral bandwidth that is reflected from the terrain of the real-world environment, the sensor generating object data based on the reflected-portion of the second spectral bandwidth, the object data indicating the features of the terrain.
2. The optical system of claim 1, wherein the optical assembly causes the reflected-portion of the second spectral bandwidth to reverse-propagate along at least one segment of the terrain-mapping optical path, and wherein the optical assembly redirects the reflected-portion from the terrain-mapping optical path to the sensor along at least one segment of the common optical path.
3. The optical system of claim 1, wherein the terrain-mapping protocol causes the at least one MEMS scanner to angularly encode the second spectral bandwidth to emit at least one structured light pattern, and wherein the features of the terrain are determined based on the reflected-portion indicating at least one deformation of the at least one structured light pattern that is caused by a known displacement of the sensor from a source of the second spectral bandwidth, and wherein the sensor is external from the illumination engine.
4. The optical system of claim 1, wherein the optical assembly includes a wavelength selective reflector that is configured to separate the first spectral bandwidth from the second spectral bandwidth at a boundary between the common optical path and the image-generation optical path.
5. The optical system of claim 4, wherein the wavelength selective reflector is configured to transmit the first spectral bandwidth into an in-coupling diffractive optical element (DOE) of a waveguide display, and wherein the second spectral bandwidth passes through a waveplate a first time while propagating toward the wavelength selective reflector, and wherein the wavelength selective reflector is configured to reflect the second spectral bandwidth through the waveplate a second time to enable the second spectral bandwidth to pass through a polarizing beam splitter (PBS) toward the terrain.
6. The optical system of claim 1, wherein the illumination engine includes a plurality of first light sources that are configured to generate visible light within the first spectral bandwidth and at least one second light source that is configured to generate at least one of infrared light or ultra-violet light within the second spectral bandwidth.
7. The optical system of claim 1, wherein the terrain-mapping protocol is a time-of-flight protocol for identifying a distance of at least one object of the terrain from the optical system, and wherein the optical assembly irradiates the at least one object with the second spectral bandwidth via the common optical path and the terrain-mapping optical path substantially contemporaneously with generating the CG images via the common optical path and the image-generation optical path.
8. The optical system of claim 1, wherein the terrain-mapping protocol is a stereo vision protocol associated with receiving the reflected-portion of the second spectral bandwidth that is reflected from the terrain of the real-world environment, and wherein the sensor is external from the illumination engine.
9. A Near-Eye-Display (NED) device, comprising:
an illumination engine to generate electromagnetic (EM) radiation that includes at least a first spectral bandwidth for generating CG images via a display and a second spectral bandwidth for irradiating a terrain of a real-world environment to track one or more features of the terrain;
an optical assembly positioned to receive the EM radiation from the illumination engine, wherein the optical assembly is configured to transmit the first spectral bandwidth into the display to generate the CG images and the second spectral bandwidth into the real-world environment to irradiate the one or more features;
at least one micro electro mechanical system (MEMS) scanner configured to angularly encode the EM radiation within the optical assembly, wherein the at least one MEMS scanner is configured to scan the first spectral bandwidth within an image-generation field-of-view (FOV) to generate the CG images via the display, and wherein the at least one MEMS scanner is configured to scan the second spectral bandwidth within a terrain-mapping FOV to irradiate the one or more features; and
a sensor to generate, based on a reflected-portion of the second spectral bandwidth that is reflected by the one or more features , object data that indicates at least one of a depth of the one or more features or an orientation and relative position of the one or more features.
10. The NED device of claim 9, wherein the optical assembly comprises:
a polarizing beam splitter (PBS) disposed adjacent to the display, the PBS configured to reflect a first polarization state of the EM radiation and transmit a second polarization state of the EM radiation, wherein the first polarization state is orthogonal to the second polarization state;
a first waveplate disposed between the PBS and the at least one MEMS scanner, wherein the EM radiation propagates through the PBS toward the first waveplate in the second polarization state and is transmitted through the first waveplate toward the at least one MEMS scanner, and wherein the EM radiation propagates from the first waveplate to the PBS in the first polarization state and is reflected by the PBS toward the display;
a wavelength selective reflector disposed between the display and the PBS, the wavelength selective reflector configured to transmit the first spectral bandwidth into the display and to reflect the second spectral bandwidth back toward the PBS; and
a second waveplate disposed between the PBS and the wavelength selective reflector, wherein the second spectral bandwidth propagates from the second waveplate to the PBS in the second polarization state and is transmitted through the PBS to irradiate the one or more features within the real-world environment.
11. The NED device of claim 9, wherein the optical assembly comprises a wavelength selective reflector that is positioned along a common optical path of the optical assembly, the wavelength selective reflector to transmit the first spectral bandwidth from the common optical path to an image-generation optical path and to reflect the second spectral bandwidth from the common optical path to a terrain-mapping optical path.
12. The NED device of claim 11, wherein the optical assembly further includes at least one bandpass filter that is positioned to selectively transmit the reflected-portion of the second spectral bandwidth to the sensor.
13. The NED device of claim 9, wherein the optical assembly is configured to transmit the second spectral bandwidth through one or more diffractive optical elements (DOEs) to irradiate an eye of a user with the spectral bandwidth, and wherein the object data indicates an orientation and position of the eye.
14. The NED device of claim 9, wherein the illumination engine includes at least one first light source to generate visible light within the first spectral bandwidth and at least one second light source to generate infrared light within the second spectral bandwidth.
15. The NED device of claim 14, wherein the illumination engine includes a housing that at least partially encloses: the at least one first light source to generate the visible light, the at least one second light source to generate the infrared light, and the sensor to generate the object data.
16. The NED device of claim 10, wherein the first waveplate is configured to alter polarization of the first spectral bandwidth and the second spectral bandwidth, and wherein the second waveplate is configured at least to alter polarization of the second spectral bandwidth.
17. The NED device of claim 9, further comprising:
a first channel that is configured to deploy a first optical assembly for terrain-mapping of the real-world environment; and
a second channel that is configured to deploy a second optical assembly for hand-gesture tracking.
18. An optical system comprising:
a waveguide display comprising one or more optical elements for directing at least a visible-light spectral bandwidth within the waveguide display;
at least one illumination engine to generate electromagnetic (EM) radiation that includes at least the visible-light spectral bandwidth for generating CG images via the waveguide display and an infrared-light spectral bandwidth for irradiating a terrain within a real-world environment, wherein the at least one illumination engine generates object data based on a reflected-portion of the infrared-light spectral bandwidth that is reflected by the terrain;
an optical assembly positioned to receive the EM radiation from the at least one illumination engine, the optical assembly positioned to transmit the visible-light spectral bandwidth into the waveguide display to generate the CG images and the infrared-light spectral bandwidth into the real-world environment to irradiate the terrain;
at least one micro electro mechanical system (MEMS) scanner disposed to angularly encode the EM radiation within the optical assembly to direct the visible-light spectral bandwidth within an image-generation field-of-view (FOV) and the infrared-light spectral bandwidth within a terrain-mapping FOV; and
at least one controller that is communicatively coupled to the at least one illumination engine, the at least one MEMS scanner, and the sensor, wherein the at least one controller is configured to:
cause the at least one MEMS scanner to direct the visible-light spectral bandwidth with respect to the optical assembly to transmit the visible-light spectral bandwidth through the one or more optical elements to generate the CG images through the waveguide display;
cause the at least one MEMS scanner to direct the infrared-light spectral bandwidth with respect to the optical assembly to emit at least one structured light pattern onto the terrain; and
monitor the object data that is generated by the sensor to determine at least one of a depth a feature of the terrain or an orientation of the feature of the terrain.
19. The optical system of claim 18, wherein the at least one controller is configured to:
cause the at least one MEMS scanner to direct the infrared-light spectral bandwidth with respect to the optical assembly to emit a plurality of different structured light patterns onto the terrain, the plurality of different structured light patterns including at least a first structured light pattern emitted at a first time and a second structured light pattern emitted at a second time;
increase a resolution of at least one depth map by combining at least: first object data that is generated by the sensor based on the first structured light pattern, and second object data that is generated by the sensor based on the second structured light pattern.
21. The optical system of claim 18, wherein the optical assembly is configured to transmit the infrared-light spectral bandwidth into at least one of the first waveguide display or a second waveguide display to irradiate the terrain.
22. The optical system of claim 18, wherein an object within the real-world environment includes at least one body part of a user, wherein the MEMS scanner causes the infrared-light spectral bandwidth to emit a plurality of different structured light patterns onto the object, and wherein monitoring the object data further comprises determining a depth the object or an orientation of the object.
23. The optical system of claim 18, further comprising:
a first channel that is configured to emit the infrared-light spectral bandwidth within the terrain-mapping FOV to implement a terrain-mapping protocol; and
a second channel that is configured to emit the infrared-light spectral bandwidth within another FOV to implement a hand-gesture tracking protocol.
24. The optical system of claim 18, wherein the at least one controller is further configured to:
determine a depth of the feature from the optical assembly to an object within the real-world environment;
detect one or more changes to a position of the feature within the terrain-mapping FOV; and
based on at least one of the depth or the one or more changes, generate data indicating an orientation of a head of a user of the optical system.