Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Holo-VQVAE: VQ-VAE for phase-only holograms (2404.01330v1)

Published 29 Mar 2024 in cs.CV, cs.GR, cs.LG, and eess.IV

Abstract: Holography stands at the forefront of visual technology innovation, offering immersive, three-dimensional visualizations through the manipulation of light wave amplitude and phase. Contemporary research in hologram generation has predominantly focused on image-to-hologram conversion, producing holograms from existing images. These approaches, while effective, inherently limit the scope of innovation and creativity in hologram generation. In response to this limitation, we present Holo-VQVAE, a novel generative framework tailored for phase-only holograms (POHs). Holo-VQVAE leverages the architecture of Vector Quantized Variational AutoEncoders, enabling it to learn the complex distributions of POHs. Furthermore, it integrates the Angular Spectrum Method into the training process, facilitating learning in the image domain. This framework allows for the generation of unseen, diverse holographic content directly from its intricately learned latent space without requiring pre-existing images. This pioneering work paves the way for groundbreaking applications and methodologies in holographic content creation, opening a new era in the exploration of holographic content.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Balancing reconstruction error and kullback-leibler divergence in variational autoencoders. IEEE Access, 8:199440–199448, 2020.
  2. Jörgen Bengtsson. Kinoform design with an optimal-rotation-angle method. Applied optics, 33(29):6879–6884, 1994.
  3. Strategies for reducing speckle noise in digital holography. Light: Science & Applications, 7(1):48, 2018.
  4. Pierre-Alexandre Blanche. Holography, and the future of 3d display. Light: Advanced Manufacturing, 2(4):446–459, 2021.
  5. Speckle-suppressed phase-only holographic three-dimensional display based on double-constraint gerchberg–saxton algorithm. Applied optics, 54(23):6994–7001, 2015.
  6. Speckle reduced lensless holographic projection from phase-only computer-generated hologram. Optics Express, 25(6):6568–6580, 2017.
  7. Pixelsnail: An improved autoregressive generative model. In International Conference on Machine Learning, pages 864–872. PMLR, 2018.
  8. Design of computer-generated beam-shaping holograms by iterative finite-element mesh adaption. Applied Optics, 35(35):6865–6874, 1996.
  9. Taming transformers for high-resolution image synthesis. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12873–12883, 2021.
  10. Ralph W Gerchberg. A practical algorithm for the determination of plane from image and diffraction pictures. Optik, 35(2):237–246, 1972.
  11. Joseph W Goodman. Introduction to Fourier optics. Roberts and Company publishers, 2005.
  12. Vectorial beam shaping. Optics Express, 16(10):7203–7213, 2008.
  13. Compression of phase-only holograms with jpeg standard and deep learning. Applied Sciences, 8(8):1258, 2018.
  14. Perceptual losses for real-time style transfer and super-resolution. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, pages 694–711. Springer, 2016.
  15. Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196, 2017.
  16. Polymorphic-gan: Generating aligned samples across multiple domains with learned morph maps. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10630–10640, 2022.
  17. Deep learning-based compression for phase-only hologram. IEEE Access, 9:79735–79751, 2021.
  18. Mnist handwritten digit database, 2010.
  19. Deep learning for hologram generation. Optics Express, 29(17):27373–27395, 2021.
  20. Binary fraunhofer holograms, generated by computer. Applied optics, 6(10):1739–1748, 1967.
  21. Band-limited angular spectrum method for numerical simulation of free-space propagation in far and near fields. Optics express, 17(22):19662–19673, 2009.
  22. Encoding complex fields by using a phase-only optical element. Optics letters, 39(7):1740–1743, 2014.
  23. Noise-free quantitative phase imaging in gabor holography with conditional generative adversarial network. Optics Express, 28(18):26284–26301, 2020.
  24. Non-iterative phase-only fourier hologram generation with high image quality. Optics Express, 25(13):14323–14333, 2017.
  25. Mix-and-match holography. ACM Trans. Graph., 36(6):191–1, 2017.
  26. Neural holography with camera-in-the-loop training. ACM Transactions on Graphics (TOG), 39(6):1–14, 2020.
  27. Srobb: Targeted perceptual loss for single image super-resolution. In Proceedings of the IEEE/CVF international conference on computer vision, pages 2710–2719, 2019.
  28. Generating diverse high-fidelity images with vq-vae-2. Advances in neural information processing systems, 32, 2019.
  29. Phase recovery and holographic image reconstruction using deep learning in neural networks. Light: Science & Applications, 7(2):17141–17141, 2018.
  30. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022.
  31. Phase retrieval with application to optical imaging: a contemporary overview. IEEE signal processing magazine, 32(3):87–109, 2015.
  32. Review of fast algorithms and hardware implementations on computer holography. IEEE Transactions on Industrial Informatics, 12(4):1611–1622, 2015.
  33. Shane D Sims. Frequency domain-based perceptual loss for super resolution. In 2020 IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP), pages 1–6. IEEE, 2020.
  34. High-fidelity guided image synthesis with latent diffusion models. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5997–6006. IEEE, 2023.
  35. Stylegan-v: A continuous video generator with the price, image quality and perks of stylegan2. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3626–3636, 2022.
  36. Low-cost printed holography for the generation of structured light. Applied Optics, 62(26):7104–7110, 2023.
  37. Generation of phase-only fresnel hologram based on down-sampling. Optics express, 22(21):25208–25214, 2014.
  38. Optimal sampled phase-only hologram (ospoh). Optics Express, 29(16):25488–25498, 2021.
  39. Peter Wai Ming Tsang and T-C Poon. Novel method for converting digital fresnel hologram to phase-only hologram based on bidirectional error diffusion. Optics express, 21(20):23680–23686, 2013.
  40. Neural discrete representation learning. Advances in neural information processing systems, 30, 2017.
  41. Phase imaging with an untrained neural network. Light: Science & Applications, 9(1):77, 2020.
  42. eholonet: a learning-based end-to-end approach for in-line digital holographic reconstruction. Optics express, 26(18):22603–22614, 2018.
  43. Y-net: a one-to-two deep learning framework for digital holographic reconstruction. Optics Letters, 44(19):4765–4768, 2019.
  44. High-fidelity gan inversion for image attribute editing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11379–11388, 2022.
  45. High-speed computer-generated holography using an autoencoder-based deep neural network. Optics Letters, 46(12):2908–2911, 2021.
  46. Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747, 2017.
  47. Digital holographic reconstruction based on deep learning framework with unpaired data. IEEE Photonics Journal, 12(2):1–12, 2019.
  48. Quantized phase optimization of two-dimensional fourier kinoforms by a genetic algorithm. Optics Letters, 20(7):752–754, 1995.
  49. Deep learning for digital holography: a review. Optics Express, 29(24):40572–40593, 2021.
  50. Fast phase retrieval in off-axis digital holographic microscopy through deep learning. Optics express, 26(15):19388–19405, 2018.
  51. Phasegan: a deep-learning phase-retrieval approach for unpaired datasets. Optics express, 29(13):19593–19604, 2021.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets