Snapshot 3D image projection using a diffractive decoder
By: Cagatay Isil , Alexander Chen , Yuhang Li and more
Potential Business Impact:
Shows many 3D pictures at once.
3D image display is essential for next-generation volumetric imaging; however, dense depth multiplexing for 3D image projection remains challenging because diffraction-induced cross-talk rapidly increases as the axial image planes get closer. Here, we introduce a 3D display system comprising a digital encoder and a diffractive optical decoder, which simultaneously projects different images onto multiple target axial planes with high axial resolution. By leveraging multi-layer diffractive wavefront decoding and deep learning-based end-to-end optimization, the system achieves high-fidelity depth-resolved 3D image projection in a snapshot, enabling axial plane separations on the order of a wavelength. The digital encoder leverages a Fourier encoder network to capture multi-scale spatial and frequency-domain features from input images, integrates axial position encoding, and generates a unified phase representation that simultaneously encodes all images to be axially projected in a single snapshot through a jointly-optimized diffractive decoder. We characterized the impact of diffractive decoder depth, output diffraction efficiency, spatial light modulator resolution, and axial encoding density, revealing trade-offs that govern axial separation and 3D image projection quality. We further demonstrated the capability to display volumetric images containing 28 axial slices, as well as the ability to dynamically reconfigure the axial locations of the image planes, performed on demand. Finally, we experimentally validated the presented approach, demonstrating close agreement between the measured results and the target images. These results establish the diffractive 3D display system as a compact and scalable framework for depth-resolved snapshot 3D image projection, with potential applications in holographic displays, AR/VR interfaces, and volumetric optical computing.
Similar Papers
Super-resolution image projection over an extended depth of field using a diffractive decoder
Optics
Makes pictures clearer, even far away.
Phase-multiplexed optical computing: Reconfiguring a multi-task diffractive optical processor using illumination phase diversity
Optics
Lets one device do many different computer tasks.
Robust Single-shot Structured Light 3D Imaging via Neural Feature Decoding
CV and Pattern Recognition
Makes 3D cameras see better in tough situations.