Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Neural Étendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display (2109.08123v4)

Published 16 Sep 2021 in eess.IV, cs.CV, and physics.optics

Abstract: Holographic displays can generate light fields by dynamically modulating the wavefront of a coherent beam of light using a spatial light modulator, promising rich virtual and augmented reality applications. However, the limited spatial resolution of existing dynamic spatial light modulators imposes a tight bound on the diffraction angle. As a result, modern holographic displays possess low \'{e}tendue, which is the product of the display area and the maximum solid angle of diffracted light. The low \'{e}tendue forces a sacrifice of either the field-of-view (FOV) or the display size. In this work, we lift this limitation by presenting neural \'{e}tendue expanders. This new breed of optical elements, which is learned from a natural image dataset, enables higher diffraction angles for ultra-wide FOV while maintaining both a compact form factor and the fidelity of displayed contents to human viewers. With neural \'{e}tendue expanders, we experimentally achieve 64$\times$ \'{e}tendue expansion of natural images in full color, expanding the FOV by an order of magnitude horizontally and vertically, with high-fidelity reconstruction quality (measured in PSNR) over 29 dB on retinal-resolution images.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Towards real-time photorealistic 3d holography with deep neural networks. Nature 591, 234–239 (2021).
  2. Towards indistinguishable augmented reality: A survey on optical see-through head-mounted displays. ACM Computing Surveys (CSUR) 54, 1–36 (2021).
  3. Dorrah, A. H. et al. Light sheets for continuous-depth holography and three-dimensional volumetric displays. Nature Photonics 17, 427–434 (2023).
  4. Wakunami, K. et al. Projection-type see-through holographic three-dimensional display. Nature Communications 7, 12954 (2016).
  5. Model-based compensation of pixel crosstalk in liquid crystal spatial light modulators. Optics Express 27, 25046–25063 (2019).
  6. Space–bandwidth product of optical signals and systems. JOSA A 13, 470–473 (1996).
  7. High resolution étendue expansion for holographic displays. ACM Transactions on Graphics (TOG) 39, 1–14 (2020).
  8. Holographic near-eye display with continuously expanded eyebox using two-dimensional replication and angular spectrum wrapping. Optics Express 28, 533–547 (2020).
  9. Wide viewing angle dynamic holographic stereogram with a curved array of spatial light modulators. Optics Express 16, 12372–12386 (2008).
  10. Lee, B. et al. Wide-angle speckleless dmd holographic display using structured illumination with temporal multiplexing. Optics Letters 45, 2148–2151 (2020).
  11. Kim, M. et al. Expanded exit-pupil holographic head-mounted display with high-speed digital micromirror device. ETRI Journal 40 (2018).
  12. Angular and spatial light modulation by single digital micromirror device for multi-image output and nearly-doubled étendue. Optics express 27 15, 21477–21496 (2019).
  13. Optical image processing using light modulation displays. Computer Graphics Forum 29 (2010).
  14. Blanche, P.-A. et al. Holographic three-dimensional telepresence using large-area photorefractive polymer. Nature 468, 80–83 (2010).
  15. Tay, S. et al. An updatable holographic three-dimensional display. Nature 451, 694–698 (2008).
  16. Ersumo, N. T. et al. A micromirror array with annular partitioning for high-speed random-access axial focusing. Light: Science & Applications 9, 1–15 (2020).
  17. Yang, D. et al. Diffraction-engineered holography: Beyond the depth representation limit of holographic displays. Nature Communications 13 (2022).
  18. Viewing angle enhancement for two- and three-dimensional holographic displays with random superresolution phase masks. Applied Optics 45, 7334–7341 (2006).
  19. Huang, K. et al. Ultrahigh-capacity non-periodic photon sieves operating in visible light. Nature Communications 6, 7059 (2015).
  20. Ultrahigh-definition dynamic 3d holographic display by active control of volume speckle fields. Nature Photonics 11, 186–192 (2017).
  21. Ultrathin wide-angle large-area digital 3d holographic display using a non-periodic photon sieve. Nature Communications 10, 1304 (2019).
  22. Yu, P. et al. Ultrahigh-density 3d holographic projection by scattering-assisted dynamic holography. Optica 10, 481–490 (2023).
  23. Light in tiny holes. Nature 445, 39–46 (2007).
  24. Controlling waves in space and time for imaging and focusing in complex media. Nature Photonics 6, 283–292 (2012).
  25. Conkey, D. B. et al. Super-resolution photoacoustic imaging through a scattering wall. Nature Communications 6, 7902 (2015).
  26. Exploiting disorder for perfect focusing. Nature Photonics 4, 320–322 (2010).
  27. Popoff, S. M. et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. Physical Review Letters 104, 100601 (2010).
  28. Analyzing phase masks for wide étendue holographic displays. In 2022 IEEE International Conference on Computational Photography (ICCP), 1–12 (2022).
  29. Exponentially-wide etendue displays using a tilting cascade. In 2022 IEEE International Conference on Computational Photography (ICCP), 1–12 (2022).
  30. Sterling, R. Jvc d-ila high resolution, high contrast projectors and applications. In Proceedings of the 2008 Workshop on Immersive Projection Technologies/Emerging Display Technologiges (2008).
  31. Wheelwright, B. et al. Field of view: not just a number. In Digital Optics for Immersive Displays, vol. 10676, 1 – 7 (International Society for Optics and Photonics, 2018).
  32. Chaves, J. Introduction to nonimaging optics (2008).
  33. Gerchberg, R. W. A practical algorithm for the determination of phase from image and diffraction plane pictures. Optik 35, 237–246 (1972).
  34. Aspects of hologram calculation for video frames. Journal of Optics A: Pure and Applied Optics 10, 035302 (2008).
  35. Wirtinger holography for near-eye displays. ACM Transactions on Graphics (TOG) 38, 1–13 (2019).
  36. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR) (2015).
  37. Chakravarthula, P. et al. Pupil-aware holography. ACM Transactions on Graphics (TOG) 41 (2022).
  38. Metasurfaces make it practical. Nature nanotechnology 10, 296–298 (2015).
  39. Metasurface optics for on-demand polarization transformations along the optical path. Nature Photonics 15, 287–296 (2021).
Citations (16)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now