Multisource Holography (2309.10816v1)
Abstract: Holographic displays promise several benefits including high quality 3D imagery, accurate accommodation cues, and compact form-factors. However, holography relies on coherent illumination which can create undesirable speckle noise in the final image. Although smooth phase holograms can be speckle-free, their non-uniform eyebox makes them impractical, and speckle mitigation with partially coherent sources also reduces resolution. Averaging sequential frames for speckle reduction requires high speed modulators and consumes temporal bandwidth that may be needed elsewhere in the system. In this work, we propose multisource holography, a novel architecture that uses an array of sources to suppress speckle in a single frame without sacrificing resolution. By using two spatial light modulators, arranged sequentially, each source in the array can be controlled almost independently to create a version of the target content with different speckle. Speckle is then suppressed when the contributions from the multiple sources are averaged at the image plane. We introduce an algorithm to calculate multisource holograms, analyze the design space, and demonstrate up to a 10 dB increase in peak signal-to-noise ratio compared to an equivalent single source system. Finally, we validate the concept with a benchtop experimental prototype by producing both 2D images and focal stacks with natural defocus cues.
- On the fringing-field effect in liquid-crystal beam-steering devices. Applied Optics 43, 1 (2004), 11–19.
- Neural Etendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display. arXiv (2021).
- Compact noise-filtering volume gratings for holographic displays. Optics Letters 44, 9 (2019), 2133–2136.
- Pupil-aware holography. arXiv (2022).
- Wirtinger holography for near-eye displays. ACM Transactions on Graphics (TOG) 38, 6 (2019), 213.
- Learned hardware-in-the-loop phase retrieval for holographic near-eye displays. ACM Transactions on Graphics 39, 6 (2020). https://doi.org/10.1145/3414685.3417846
- Time-multiplexed neural holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators. In ACM SIGGRAPH 2022 Conference Proceedings. 1–9.
- Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays. ACM Transactions on Graphics 40, 6 (2021). https://doi.org/10.1145/3478513.3480542
- Optimizing image quality for holographic near-eye displays with Michelson holography. Optica 8, 2 (2021), 143–146.
- Creating the perfect illusion: What will it take to create life-like virtual reality headsets?. In Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications. 7–12.
- DCGH: Dynamic computer generated holography for speckle-free, high fidelity 3D displays. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 1–9.
- Yuanbo Deng and Daping Chu. 2017. Coherence properties of different light sources and their effect on the image sharpness and speckle of holographic displays. Scientific Reports 7, 1 (2017), 5893.
- Jean Duchon. 1977. Splines minimizing rotation-invariant semi-norms in Sobolev spaces. In Constructive Theory of Functions of Several Variables: Proceedings of a Conference Held at Oberwolfach April 25–May 1, 1976. Springer, 85–100.
- James R Fienup. 1982. Phase retrieval algorithms: a comparison. Applied Optics 21, 15 (1982), 2758–2769.
- Memory effects in propagation of optical waves through disordered media. Physical Review Letters 61, 20 (1988), 2328.
- Aspects of hologram calculation for video frames. Journal of Optics A: Pure and Applied Optics 10, 3 (2008), 035302.
- Micron-scale light transport decomposition using interferometry. ACM Transactions on Graphics (ToG) 34, 4 (2015), 1–14.
- Joseph W Goodman. 2005. Introduction to Fourier optics. Roberts and Company publishers.
- Joseph W Goodman. 2007. Speckle phenomena in optics: theory and applications. Roberts and Company Publishers.
- Unfiltered holography: Optimizing high diffraction orders without optical filtering for compact holographic displays. Optics Letters 46, 23 (2021), 5822–5825.
- Volume holographic storage and retrieval of digital data. Science 265, 5173 (1994), 749–752.
- Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (2008), 33–33.
- Multi-illumination 3D holographic display using a binary mask. Optics Letters 47, 10 (2022), 2482–2485.
- Realistic defocus blur for multiplane computer-generated holography. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 418–426.
- Learned holographic light transport. Applied Optics 61, 5 (2022), B50–B55.
- Accommodative holography: Improving accommodation response for perceptually realistic holographic displays. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1–15.
- Holographic glasses for virtual reality. In ACM SIGGRAPH 2022 Conference Proceedings. 1–9.
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv (2014).
- Interferometric transmission probing with coded mutual intensity. ACM Transactions on Graphics (TOG) 39, 4 (2020), 74–1.
- Swept-angle synthetic wavelength interferometry. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8233–8243.
- LED near-eye holographic display with a large non-paraxial hologram generation. Optics Express 30, 24 (2022), 43551–43565.
- High resolution étendue expansion for holographic displays. ACM Transactions on Graphics (TOG) 39, 4 (2020), 66.
- High-contrast, speckle-free, true 3D holography via binary CGH optimization. Scientific Reports 12, 1 (2022), 2811.
- Wide-angle speckleless DMD holographic display using structured illumination with temporal multiplexing. Optics Letters 45, 8 (2020), 2148–2151.
- Speckle reduction for holographic display using optical path difference and random phase generator. IEEE Transactions on Industrial Informatics 15, 11 (2019), 6170–6178.
- Light source optimization for partially coherent holographic displays with consideration of speckle contrast, resolution, and depth of field. Scientific Reports 10, 1 (2020), 18832.
- Holographic near-eye displays for virtual and augmented reality. ACM Transactions on Graphics (TOG) 36, 4 (2017), 85.
- Kyoji Matsushima and Tomoyoshi Shimobaba. 2009. Band-limited angular spectrum method for numerical simulation of free-space propagation in far and near fields. Optics Express 17, 22 (2009), 19662–19673.
- Holographic head-mounted display with RGB light emitting diode light source. Optics Express 22, 6 (2014), 6526–6534.
- Model-based compensation of pixel crosstalk in liquid crystal spatial light modulators. Optics Express 27, 18 (2019), 25046–25063.
- Holographic near-eye displays based on overlap-add stereograms. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–13.
- Jae-Hyeung Park and Byoungho Lee. 2022. Holographic techniques for augmented reality and virtual reality near-eye displays. Light: Advanced Manufacturing 3, 1 (2022), 137–150.
- Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration. Science Advances 7, 46 (2021), eabg5040.
- Neural holography with camera-in-the-loop training. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1–14.
- Mix-and-match holography. ACM Trans. Graph. 36, 6 (2017), 191–1.
- Reducing the effect of pixel crosstalk in phase only spatial light modulators. Optics Express 20, 20 (2012), 22334–22343.
- P-203: Late-News Poster: Integrated Full-Color RGB Superluminescent LED Module for Micro-Displays. In SID Symposium Digest of Technical Papers, Vol. 50. Wiley Online Library, 1731–1734.
- Kornia: An open source differentiable computer vision library for Pytorch. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 3674–3683.
- W.O. Saxton and R.W. Gerchberg. 1972. Gerchberg—Saxton algorithm: Experimental realisation and modification for the problem of formation of multimode laser beams. Optik 35, 2 (1972), 237–246. https://doi.org/10.1070/qe2009v039n06abeh013642
- Towards real-time photorealistic 3D holography with deep neural networks. Nature 591, 7849 (2021), 234–239.
- Holographic display method to suppress speckle noise based on effective utilization of two spatial light modulators. Optics Express 27, 8 (2019), 11617–11625.
- Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. (2012).
- Diffraction-engineered holography: Beyond the depth representation limit of holographic displays. Nature Communications 13, 1 (2022), 6012.
- Toward BxDF display using multilayer diffraction. ACM Transactions on Graphics (TOG) 33, 6 (2014), 1–14.
- Optimization of computer-generated holograms featuring phase randomness control. Optics Letters 46, 19 (2021), 4769–4772.
- Speckle reduction in holographic display with partially spatial coherent illumination. Optics Communications 507 (2022), 127604.