invrs-gym: a toolkit for nanophotonic inverse design research
Abstract: The $\textit{invrs-gym}$ is a toolkit for research in nanophotonic inverse design, topology optimization, and AI-guided design. It includes a diverse set of challenges--representing a wide range of photonic design problems--with a common software interface that allows multiple problems to be addressed with a single code. The gym includes lightweight challenges enabling fast iteration as well as challenges involving design of realistic 3D structures, the solutions of which are suitable for fabrication. The gym is designed to be modular, enabling research in areas such as objective functions, design parameterizations, and optimization algorithms, and includes baselines against which new results can be compared. The aim is to accelerate the development and adoption of powerful methods for photonic design.
- Y. Elesin, B. S. Lazarov, J. S. Jensen, and O. Sigmund, “Time domain topology optimization of 3d nanophotonic devices,” \JournalTitlePhotonics and Nanostructures-Fundamentals and Applications 12, 23–33 (2014).
- L. F. Frellsen, Y. Ding, O. Sigmund, and L. H. Frandsen, “Topology optimized mode multiplexing in silicon-on-insulator photonic wire waveguides,” \JournalTitleOptics express 24, 16866–16873 (2016).
- A. M. Hammond, A. Oskooi, S. G. Johnson, and S. E. Ralph, “Photonic topology optimization with semiconductor-foundry design-rule constraints,” \JournalTitleOpt. Express 29, 23916–23938 (2021).
- A. M. Hammond, A. Oskooi, M. Chen, et al., “High-performance hybrid time/frequency-domain topology optimization for large-scale photonics inverse design,” \JournalTitleOpt. Express 30, 4467–4491 (2022).
- D. Vercruysse, N. V. Sapra, L. Su, et al., “Analytical level set fabrication constraints for inverse design,” \JournalTitleScientific Reports 9, 8999 (2019).
- A. Y. Piggott, J. Petykiewicz, L. Su, and J. Vučković, “Fabrication-constrained nanophotonic inverse design,” \JournalTitleScientific reports 7, 1786 (2017).
- A. Y. Piggott, E. Y. Ma, L. Su, et al., “Inverse-designed photonics for semiconductor foundries,” \JournalTitleAcs Photonics 7, 569–575 (2020).
- B. Shen, P. Wang, R. Polson, and R. Menon, “An integrated-nanophotonics polarization beamsplitter with 2.4×\times× 2.4 μ𝜇\muitalic_μm2 footprint,” \JournalTitleNature Photonics 9, 378–382 (2015).
- M. H. Tahersima, K. Kojima, T. Koike-Akino, et al., “Deep neural network inverse design of integrated photonic power splitters,” \JournalTitleScientific Reports 9, 1368 (2019).
- K. Goudarzi and M. Lee, “Inverse design of a binary waveguide crossing by the particle swarm optimization algorithm,” \JournalTitleResults in Physics 34, 105268 (2022).
- Z. Liu, D. Zhu, L. Raju, and W. Cai, “Tackling photonic inverse design with machine learning,” \JournalTitleAdvanced Science 8, 2002923 (2021).
- J. Jiang, M. Chen, and J. A. Fan, “Deep neural networks for the evaluation and design of photonic devices,” \JournalTitleNature Reviews Materials 6, 679–700 (2021).
- P. R. Wiecha, A. Arbouet, C. Girard, and O. L. Muskens, “Deep learning in nano-photonics: inverse design and beyond,” \JournalTitlePhoton. Res. 9, B182–B200 (2021).
- M. Chen, R. E. Christiansen, J. A. Fan, et al., “Validation and characterization of algorithms and software for photonics inverse design,” \JournalTitleJ. Opt. Soc. Am. B 41, A161–A176 (2024).
- M. F. Schubert, A. K. C. Cheung, I. A. D. Williamson, et al., “Inverse design of photonic devices with strict foundry fabrication constraints,” \JournalTitleACS Photonics 9, 2327–2336 (2022).
- D. Donoho, “50 years of data science,” \JournalTitleJournal of Computational and Graphical Statistics 26, 745–766 (2017).
- J. Deng, W. Dong, R. Socher, et al., “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition, (Ieee, 2009), pp. 248–255.
- Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” \JournalTitleProceedings of the IEEE 86, 2278–2324 (1998).
- A. Krizhevsky, G. Hinton et al., “Learning multiple layers of features from tiny images,” (2009).
- M. Buttenschoen, G. M. Morris, and C. M. Deane, “Posebusters: Ai-based docking methods fail to generate physically valid poses or generalise to novel sequences,” \JournalTitleChemical Science 15, 3130–3139 (2024).
- S. Basu and B. Wallner, “Dockq: a quality measure for protein-protein docking models,” \JournalTitlePloS one 11, e0161879 (2016).
- M. J. Salganik, I. Lundberg, A. T. Kindel, et al., “Measuring the predictability of life outcomes with a scientific mass collaboration,” \JournalTitleProceedings of the National Academy of Sciences 117, 8398–8403 (2020).
- G. Angeris, J. Vučković, and S. Boyd, “Heuristic methods and performance bounds for photonic design,” \JournalTitleOpt. Express 29, 2827–2854 (2021).
- O. Sigmund, “On benchmarking and good scientific practise in topology optimization,” \JournalTitleStructural and Multidisciplinary Optimization 65, 315 (2022).
- R. E. Christiansen, J. Vester-Petersen, S. P. Madsen, and O. Sigmund, “A non-linear material interpolation for design of metallic nano-particles using topology optimization,” \JournalTitleComputer Methods in Applied Mechanics and Engineering 343, 23–39 (2019).
- M. F. Schubert, “totypes: Custom types for topology optimization,” https://github.com/invrs-io/totypes (2023).
- F. Wang, B. S. Lazarov, and O. Sigmund, “On projection methods, convergence and robust formulations in topology optimization,” \JournalTitleStructural and Multidisciplinary Optimization 43, 767–784 (2011).
- D. S. Hazineh, S. W. D. Lim, Z. Shi, et al., “D-flat: A differentiable flat-optics framework for end-to-end metasurface visual sensor design,” (2022).
- C. Yeung, B. Pham, R. Tsai, et al., “Deepadjoint: An all-in-one photonic inverse design framework integrating data-driven machine learning with optimization algorithms,” \JournalTitleACS Photonics 10, 884–891 (2023).
- D. Wolpert and W. Macready, “No free lunch theorems for optimization,” \JournalTitleIEEE Transactions on Evolutionary Computation 1, 67–82 (1997).
- D. Sell, J. Yang, S. Doshay, et al., “Large-angle, multifunctional metagratings based on freeform multimode geometries,” \JournalTitleNano Letters 17, 3752–3757 (2017).
- J. Yang, D. Sell, and J. A. Fan, “Freeform metagratings based on complex light scattering dynamics for extreme, high efficiency beam steering,” \JournalTitleAnnalen der Physik 530, 1700302 (2018).
- A. Sabzevari and A. Hatef, “Inverse design and optimization of a one-dimensional metagrating beam deflector by smart pattern search,” \JournalTitleAppl. Opt. 63, 4793–4798 (2024).
- T. Ye, D. Wu, Q. Wu, et al., “Realization of inversely designed metagrating for highly efficient large angle beam deflection,” \JournalTitleOpt. Express 30, 7566–7579 (2022).
- W.-Q. Chen, D.-S. Zhang, S.-Y. Long, et al., “Nearly dispersionless multicolor metasurface beam deflector for near eye display designed by a physics-driven deep neural network,” \JournalTitleAppl. Opt. 60, 3947–3953 (2021).
- Y. Xiao, M. Xu, M. Pu, et al., “Topology-optimized freeform broadband optical metagrating for high-efficiency large-angle deflection,” \JournalTitleJ. Opt. Soc. Am. B 41, A52–A59 (2024).
- R. P. Jenkins, S. D. Campbell, and D. H. Werner, “General-purpose algorithm for two-material minimum feature size enforcement of freeform nanophotonic devices,” \JournalTitleACS Photonics 10, 845–853 (2023).
- M. F. Schubert and A. M. Hammond, “Fourier modal method for inverse design of metasurface-enhanced micro-leds,” \JournalTitleOpt. Express 31, 42945–42960 (2023).
- A. F. Oskooi, D. Roundy, M. Ibanescu, et al., “MEEP: A flexible free-software package for electromagnetic simulations by the FDTD method,” \JournalTitleComputer Physics Communications 181, 687–702 (2010).
- J. P. Hugonin and P. Lalanne, “Reticolo software for grating analysis,” \JournalTitlearXiv preprint arXiv:2101.00901 (2021).
- R. Vandenhouten, A. Hermerschmidt, and R. Fiebelkorn, “Design and quality metrics of point patterns for coded structured light illumination with diffractive optical elements in optical 3D sensors,” in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 10335 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series B. C. Kress, W. Osten, and H. P. Urbach, eds. (2017), p. 1033518.
- O. Barlev and M. A. Golub, “Multifunctional binary diffractive optical elements for structured light projectors,” \JournalTitleOpt. Express 26, 21092–21107 (2018).
- J. E. Jureller, H. Y. Kim, and N. F. Scherer, “Stochastic scanning multiphoton multifocal microscopy,” \JournalTitleOpt. Express 14, 3406–3414 (2006).
- Z. Chen, B. Mc Larney, J. Rebling, et al., “High-speed large-field multifocal illumination fluorescence microscopy,” \JournalTitleLaser & Photonics Reviews 14, 1900070 (2020).
- LightTrans, “Design and rigorous analysis of non-paraxial diffractive beam splitter,” https://www.lighttrans.com/use-cases/application/design-and-rigorous-analysis-of-non-paraxial-diffractive-beam-splitter.html. Version: 3.1.
- D. C. Kim, A. Hermerschmidt, P. Dyachenko, and T. Scharf, “Inverse design and demonstration of high-performance wide-angle diffractive optical elements,” \JournalTitleOpt. Express 28, 22321–22333 (2020).
- R. Pestourie, C. Pérez-Arancibia, Z. Lin, et al., “Inverse design of large-area metasurfaces,” \JournalTitleOptics express 26, 33732–33747 (2018).
- Z. Li, R. Pestourie, J.-S. Park, et al., “Inverse design enables large-scale high-performance meta-optics reshaping virtual reality,” \JournalTitleNature communications 13, 1–11 (2022).
- W. T. Chen, J.-S. Park, J. Marchioni, et al., “Dispersion-engineered metasurfaces reaching broadband 90% relative diffraction efficiency,” \JournalTitleNature Communications 14, 2544 (2023).
- T. Phan, D. Sell, E. W. Wang, et al., “High-efficiency, large-area, topology-optimized metasurfaces,” \JournalTitleLight: Science & Applications 8, 48 (2019).
- Y. Zhou, C. Mao, E. Gershnabel, et al., “Large-area, high-numerical-aperture, freeform metasurfaces,” \JournalTitleLaser & Photonics Reviews p. 2300988 (2024).
- X. Zou, Y. Zhang, R. Lin, et al., “Pixel-level bayer-type colour router based on metasurfaces,” \JournalTitleNature Communications 13, 3288 (2022).
- Y. Q. Peng, H. P. Lu, D. S. Zhang, et al., “Inverse design of a light nanorouter for a spatially multiplexed optical filter,” \JournalTitleOpt. Lett. 48, 6232–6235 (2023).
- M. Miyata, N. Nemoto, K. Shikama, et al., “Full-color-sorting metalenses for high-sensitivity image sensors,” \JournalTitleOptica 8, 1596–1604 (2021).
- B. H. Chen, P. C. Wu, V.-C. Su, et al., “Gan metalens for pixel-level full-color routing at visible light,” \JournalTitleNano Letters 17, 6345–6352 (2017).
- S. Yun, S. Roh, S. Lee, et al., “Highly efficient color separation and focusing in the sub-micron cmos image sensor,” in 2021 IEEE International Electron Devices Meeting (IEDM), (2021), pp. 30.1.1–30.1.4.
- P. B. Catrysse, N. Zhao, W. Jin, and S. Fan, “Subwavelength bayer rgb color routers with perfect optical efficiency,” \JournalTitleNanophotonics 11, 2381–2387 (2022).
- C. Kim, J. Hong, J. Jang, et al., “Freeform metasurface color router for deep submicron pixel image sensors,” \JournalTitleScience Advances 10, eadn9000 (2024).
- N. Zhao, P. B. Catrysse, and S. Fan, “Perfect rgb-ir color routers for sub-wavelength size cmos image sensor pixels,” \JournalTitleAdvanced Photonics Research 2, 2000048 (2021).
- R. Zhong, X. Xu, Y. Zhou, et al., “High-efficiency integrated color routers by simple identical nanostructures for visible and near-infrared wavelengths,” \JournalTitlePhotonics 10 (2023).
- Y. Shao, S. Guo, R. Chen, et al., “Pixelated nir–vis spectral routers based on 2d mie-type metagratings,” \JournalTitleLaser & Photonics Reviews 17, 2300027 (2023).
- Y. J. Hong, B. J. Jeon, Y. G. Ki, and S. J. Kim, “A metasurface color router facilitating rgb-nir sensing for an image sensor application,” \JournalTitleNanophotonics 13, 1407–1415 (2024).
- X. Zou, G. Gong, Y. Lin, et al., “Metasurface-based polarization color routers,” \JournalTitleOptics and Lasers in Engineering 163, 107472 (2023).
- R. E. Christiansen and O. Sigmund, “Inverse design in photonics by topology optimization: tutorial,” \JournalTitleJ. Opt. Soc. Am. B 38, 496–509 (2021).
- Z. Li, R. Pestourie, Z. Lin, et al., “Empowering metasurfaces with inverse design: Principles and applications,” \JournalTitleACS Photonics 9, 2178–2192 (2022).
- M. Khorasaninejad, W. T. Chen, R. C. Devlin, et al., “Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging,” \JournalTitleScience 352, 1190–1194 (2016).
- Z. Lin, B. Groever, F. Capasso, et al., “Topology-optimized multilayered metaoptics,” \JournalTitlePhys. Rev. Appl. 9, 044030 (2018).
- R. E. Christiansen, Z. Lin, C. Roques-Carmes, et al., “Fullwave maxwell inverse design of axisymmetric, tunable, and multi-scale multi-wavelength metalenses,” \JournalTitleOpt. Express 28, 33854–33868 (2020).
- H. Chung and O. D. Miller, “High-na achromatic metalenses by inverse design,” \JournalTitleOpt. Express 28, 6945–6965 (2020).
- I. A. D. Williamson, “Ceviche challenges: photonic inverse design suite,” https://github.com/google/ceviche-challenges (2022).
- T. W. Hughes, I. A. D. Williamson, M. Minkov, and S. Fan, “Forward-mode differentiation of maxwell’s equations,” \JournalTitleACS Photonics 6, 3010–3016 (2019).
- A. M. Ferber, T. Huang, D. Zha, et al., “SurCo: Learning linear SURrogates for COmbinatorial nonlinear optimization problems,” in Proceedings of the 40th International Conference on Machine Learning, vol. 202 of Proceedings of Machine Learning Research A. Krause, E. Brunskill, K. Cho, et al., eds. (PMLR, 2023), pp. 10034–10052.
- R. K. Padhy and A. Chandrasekhar, “Photos: Topology optimization of photonic components using a shape library,” (2024).
- A. Ferber, A. Zharmagambetov, T. Huang, et al., “Genco: Generating diverse solutions to design problems with combinatorial nature,” \JournalTitlearXiv preprint arXiv:2310.02442 (2023).
- A. K. C. Cheung, K. Gadepalli, J. Guan, et al., “Inverse-designed cwdm demultiplexer operated in o-band,” in Optical Fiber Communication Conference (OFC) 2024, (Optica Publishing Group, 2024), p. W1A.6.
- S. Chakravarthi, P. Chao, C. Pederson, et al., “Inverse-designed photon extractors for optically addressable defect qubits,” \JournalTitleOptica 7, 1805–1811 (2020).
- F. Wang, R. E. Christiansen, Y. Yu, et al., “Maximizing the quality factor to mode volume ratio for ultra-small photonic crystal cavities,” \JournalTitleApplied Physics Letters 113 (2018).
- G. Işiklar, P. T. Kristensen, J. Mørk, et al., “On the trade-off between mode volume and quality factor in dielectric nanocavities optimized for purcell enhancement,” \JournalTitleOptics Express 30, 47304–47314 (2022).
- O. D. Miller, A. G. Polimeridis, M. Homer Reid, et al., “Fundamental limits to optical response in absorptive systems,” \JournalTitleOptics express 24, 3329–3364 (2016).
- X. Liang and S. G. Johnson, “Formulation for scalable optimization of microcavities via the frequency-averaged local density of states,” \JournalTitleOptics express 21, 30812–30841 (2013).
- S. G. Johnson, W. Ma, A. Oskooi, et al., “Imageruler: Measure minimum solid/void length scales in binary images,” https://github.com/NanoComp/imageruler (2024).
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.