Transcending shift-invariance in the paraxial regime via end-to-end inverse design of freeform nanophotonics
Abstract: Traditional optical elements and conventional metasurfaces obey shift-invariance in the paraxial regime. For imaging systems obeying paraxial shift-invariance, a small shift in input angle causes a corresponding shift in the sensor image. Shift-invariance has deep implications for the design and functionality of optical devices, such as the necessity of free space between components (as in compound objectives made of several curved surfaces). We present a method for nanophotonic inverse design of compact imaging systems whose resolution is not constrained by paraxial shift-invariance. Our method is end-to-end, in that it integrates density-based full-Maxwell topology optimization with a fully iterative elastic-net reconstruction algorithm. By the design of nanophotonic structures that scatter light in a non-shift-invariant manner, our optimized nanophotonic imaging system overcomes the limitations of paraxial shift-invariance, achieving accurate, noise-robust image reconstruction beyond shift-invariant resolution.
- Joseph W Goodman. Introduction to fourier optics, 3rd ed. CO: Roberts & Co. Publishers, 1, 2005.
- Squeeze free space with nonlocal flat optics. Optica, 7(9):1133–1138, 2020.
- Flat optics with designer metasurfaces. Nature materials, 13(2):139–150, 2014.
- Dielectric metasurfaces for complete control of phase and polarization with subwavelength spatial resolution and high transmission. Nature nanotechnology, 10(11):937–943, 2015.
- Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging. Science, 352(6290):1190–1194, 2016.
- A review of metasurfaces: physics and applications. Reports on Progress in Physics, 79(7):076401, 2016.
- The advantages of metalenses over diffractive lenses. Nature communications, 11(1):1–4, 2020.
- Topology optimization for nano-photonics. Laser & Photonics Reviews, 5(2):308–321, 2011.
- Inverse design in photonics by topology optimization: tutorial. JOSA B, 38(2):496–509, 2021.
- Inverse design in nanophotonics. Nature Photonics, 12(11):659–670, 2018.
- End-to-end optimization of metasurfaces for imaging with compressed sensing. arXiv preprint arXiv:2201.12348, 2022.
- End-to-end optimization of optics and image processing for achromatic extended depth of field and super-resolution imaging. ACM Transactions on Graphics (TOG), 37(4):1–13, 2018.
- End-to-end nanophotonic inverse design for imaging and polarimetry. Nanophotonics, 10(3):1177–1187, 2021.
- End-to-end metasurface inverse design for single-shot multi-channel imaging. Optics Express, 30(16):28358–28370, 2022.
- End-to-end learned, optically coded super-resolution spad camera. ACM Transactions on Graphics (TOG), 39(2):1–14, 2020.
- Differentiable compound optics and processing pipeline optimization for end-to-end camera design. ACM Transactions on Graphics (TOG), 40(2):1–19, 2021.
- Multifunctional wide-angle optics and lasing based on supercell metasurfaces. Nature Communications, 12(1):1–10, 2021.
- An optic to replace space and its application towards ultra-thin imaging systems. Nature communications, 12(1):1–8, 2021.
- Diffractive nonlocal metasurfaces. Laser & Photonics Reviews, 16(8):2100633, 2022.
- Computational inverse design for ultra-compact single-piece metalenses free of chromatic and angular aberration. Applied Physics Letters, 118(4):041104, 2021.
- Miniscope3d: optimized single-shot miniature 3d fluorescence microscopy. Light: Science & Applications, 9(1):171, Oct 2020.
- Lensless imaging with compressive ultrafast sensing. IEEE Transactions on Computational Imaging, 3(3):398–407, 2017.
- Learning fast approximations of sparse coding. In Proceedings of the 27th on International Conference on Machine Learning, ICML’10, page 399–406, Madison, WI, USA, 2010. Omnipress.
- Ista-net: Interpretable optimization-inspired deep network for image compressive sensing. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1828–1837, 2018.
- Physics-based learned diffuser for single-shot 3d imaging. In NeurIPS 2021 Workshop on Deep Learning and Inverse Problems, 2021.
- Implicit differentiation of lasso-type models for hyperparameter optimization. In Proceedings of the 37th International Conference on Machine Learning, 2020.
- Meep: A flexible free-software package for electromagnetic simulations by the fdtd method. Computer Physics Communications, 181(3):687–702, 2010.
- Steven G. Johnson. The NLopt nonlinear-optimization package, 2017.
- Krister Svanberg. A class of globally convergent optimization methods based on conservative convex separable approximations. SIAM journal on optimization, 12(2):555–573, 2002.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- An introduction to compressive sampling. IEEE signal processing magazine, 25(2):21–30, 2008.
- Fullwave maxwell inverse design of axisymmetric, tunable, and multi-scale multi-wavelength metalenses. Optics Express, 28(23):33854–33868, 2020.
- High-performance hybrid time/frequency-domain topology optimization for large-scale photonics inverse design. Optics Express, 30(3):4467–4491, 2022.
- Photonic topology optimization with semiconductor-foundry design-rule constraints. Optics Express, 29(15):23916–23938, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.