New Holographic Camera Sees the Unseen – Around Corners, Through Fog and Human Tissue

One setup of a camera prototype in the lab. Credits: Florian Willomitzer / Northwestern University

The device can be seen around the corners and through scattered media such as fog and human tissue.

Northwestern University Researchers have invented a new high-resolution camera that allows you to see invisible things around the corners and through scattering media such as skin, fog, and in some cases human skulls.

This new method, called synthetic wavelength holography, works by indirectly scattering coherent light onto hidden objects, which then scatter again and return to the camera. From there, the algorithm reconstructs the scattered light signal to reveal the hidden object. Due to its high time resolution, this method can also image fast-moving objects such as heartbeats from the chest and speeding up cars on street corners.

This study will be published in the journal today (November 17, 2021). Nature Communications.

A relatively new field of study that images objects behind occlusions or scatter media is called non-line-of-sight (NLoS) imaging. Compared to related NLoS imaging techniques, the northwestern method can quickly capture large area full-field images with submillimeter wave accuracy. At this level of resolution, computational cameras can potentially create images through the skin and even see the smallest capillaries at work.

While this method has obvious potential for non-invasive medical imaging, early warning navigation systems for automobiles, and industrial testing in tight spaces, researchers believe the potential uses are endless. I am.

“Our technology will usher in a new wave of imaging capabilities,” said Florian Willomizer of Northwestern University, the first author of this study. “Our current sensor prototypes use visible or infrared light, but the principle is universal and can be extended to other wavelengths. For example, the same method can be used for space exploration and underwater. It can be applied to radio waves for acoustic imaging. It can be applied to many areas and we just scratched the surface. “

Willomitzer is an assistant professor of electrical and computer engineering at the McCormick Institute of Engineering at Northwestern University. Northwest co-authors include Oliver Cossert, an associate professor of computer science, electrical and computer engineering, and a former PhD. Student Fengqiang Li. Researchers in the northwest have worked closely with all researchers at Southern Methodist University, Plazan Narangarajan, Muraridar Baraj, and Mark Christensen.

Blocking scattered light

Looking around the corners and imaging the internal organs of the human body may seem like very different tasks, but Willomizer said they are in fact closely related. Both deal with scattering media. In a scattering medium, light hits an object and scatters it so that the direct image of the object is invisible.

“If you’ve ever tried to illuminate a flashlight through your hands, you’ve experienced this phenomenon,” Willomizer said. “There is a bright spot on the other side of the hand, but in theory, the bone should cast a shadow and reveal the structure of the bone. Instead, the light passing through the bone is scattered in all directions within the tissue. And the shadow image is completely blurred. “

Therefore, the goal is to block scattered light, reconstruct unique information about its travel time, and reveal hidden objects. But it presents its own challenge.

“Nothing is as fast as the speed of light, so if you want to measure light travel time with high accuracy, you need a very fast detector,” says Willomizer. “Such a detector can be very expensive.”

Tailored wave

To eliminate the need for fast detectors, Willomitzer and his colleagues merged the light waves from the two lasers to produce synthetic light waves that could be specially tuned for holographic imaging in different scattering scenarios. Did.

“If we can capture the entire light field of an object with a hologram, we can reconstruct the entire 3D shape of the object,” explains Willomitzer. “This holographic imaging uses synthetic waves instead of regular light waves, at corners and through scatterers.”

Over the years, there have been many NLoS imaging attempts to recover images of hidden objects. However, these methods usually have one or more problems. They have low resolutions, very small viewing angles, require time-consuming raster scans, or require a large probe area to measure scattered light signals.

However, the new technology overcomes these problems and is the first method of imaging around corners and through scatter media, combining high spatial resolution, high temporal resolution, a small probing area, and a large viewing angle. This means that the camera can image small features in tight spaces or hidden objects in large areas at high resolution, even when the object is moving.

“Turn the wall into a mirror”

Light only follows a straight path, so opaque barriers (walls, shrubs, cars, etc.) must be present for new devices to appear around the corner. Light is emitted from a sensor unit (which can be mounted on top of a car), bounces off a barrier and hits an object around a corner. The light then bounces off the barrier and eventually returns to the sensor unit’s detector.

“It’s like having a virtual computing camera in every remote location and seeing the world from a surface perspective,” says Willomizer.

For those driving on roads around mountain passes or meandering in rural forests, this method can prevent accidents by revealing other cars and deer that are invisible around the corner. “This technology turns the wall into a mirror,” Willomizer said. “This technique works better at night and in foggy weather conditions.”

In this way, high resolution technology can also replace (or supplement) endoscopes for medical and industrial image processing. Instead of requiring a flexible camera that can turn corners and twist tight spaces, such as colonoscopy, synthetic wavelength holography uses light to look around many folds in the intestine. I can.

Similarly, synthetic wavelength holography can image the interior of industrial equipment during operation. This is not possible with current endoscopes.

“If the turbine is running and you want to inspect internal defects, you usually use an endoscope,” says Willomitzer. “But some flaws only appear when the device is moving. You can’t use an endoscope to see the inside of the turbine from the front while it’s running. Our sensors You can look inside a working turbine and detect structures smaller than 1 millimeter. “

This technology is currently a prototype, but Willomizer believes it will eventually be used to help drivers avoid accidents. “There’s still a long way to go before we see these types of imagers built into cars or approved for medical use,” he said. “Maybe more than 10 years, but it will come.”

Reference: “High-resolution, wide-field, high-speed non-line-of-sight imaging using synthetic wavelength holography” November 17, 2021 Nature Communications..
DOI: 10.1038 / s41467-021-26776-w

The study was supported by DARPA (REVEAL Project HR0011-16-C-0028), National Science Foundation Network (CAREER IIS-1453192), and Navy Research Bureau (N00014-15-1-2735).

New Holographic Camera Sees the Unseen – Around Corners, Through Fog and Human Tissue Source link New Holographic Camera Sees the Unseen – Around Corners, Through Fog and Human Tissue

Related Articles

Back to top button