Perception of Misalignment States for Sky Survey Telescopes with the Digital Twin and the Deep Neural Networks (2311.18214v1)
Abstract: Sky survey telescopes play a critical role in modern astronomy, but misalignment of their optical elements can introduce significant variations in point spread functions, leading to reduced data quality. To address this, we need a method to obtain misalignment states, aiding in the reconstruction of accurate point spread functions for data processing methods or facilitating adjustments of optical components for improved image quality. Since sky survey telescopes consist of many optical elements, they result in a vast array of potential misalignment states, some of which are intricately coupled, posing detection challenges. However, by continuously adjusting the misalignment states of optical elements, we can disentangle coupled states. Based on this principle, we propose a deep neural network to extract misalignment states from continuously varying point spread functions in different field of views. To ensure sufficient and diverse training data, we recommend employing a digital twin to obtain data for neural network training. Additionally, we introduce the state graph to store misalignment data and explore complex relationships between misalignment states and corresponding point spread functions, guiding the generation of training data from experiments. Once trained, the neural network estimates misalignment states from observation data, regardless of the impacts caused by atmospheric turbulence, noise, and limited spatial sampling rates in the detector. The method proposed in this paper could be used to provide prior information for the active optics system and the optical system alignment.
- J. P. Veran, F. Rigaut, H. Maitre, and D. Rouan, “Estimation of the adaptive optics long-exposure point-spread function using control loop data.” \JournalTitleJournal of the Optical Society of America A 14, 3057–3069 (1997).
- E. Gendron, Y. Clénet, T. Fusco, and G. Rousset, “New algorithms for adaptive optics point-spread function reconstruction,” \JournalTitleAstronomy and Astrophysics 457, 359–363 (2006).
- L. Jolissaint, C. Neyman, J. Christou, and P. Wizinowich, “Adaptive optics point spread function reconstruction project at W. M. Keck Observatory: first results with faint natural guide stars,” in Adaptive Optics Systems III, vol. 8447 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series B. L. Ellerbroek, E. Marchetti, and J.-P. Véran, eds. (2012), p. 844728.
- O. A. Martin, C. M. Correia, E. Gendron, et al., “PSF reconstruction validated using on-sky CANARY data in MOAO mode,” in Adaptive Optics Systems V, vol. 9909 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series E. Marchetti, L. M. Close, and J.-P. Véran, eds. (2016), p. 99091Q.
- R. Wagner, C. Hofer, and R. Ramlau, “Point spread function reconstruction for single-conjugate adaptive optics on extremely large telescopes,” \JournalTitleJournal of Astronomical Telescopes, Instruments, and Systems 4, 049003 (2018).
- P. Turri, J. R. Lu, G. Witzel, et al., “AIROPA III: testing simulated and on-sky data,” \JournalTitleJournal of Astronomical Telescopes, Instruments, and Systems 8, 039002 (2022).
- A. F. J. Moffat, “A Theoretical Investigation of Focal Stellar Images in the Photographic Emulsion and Application to Photographic Photometry,” \JournalTitleAstronomy and Astrophysics 3, 455 (1969).
- J. Kormendy, “Calibration of direct photographs using brightness profiles of field stars.” \JournalTitleAstronomical Journal 78, 255–262 (1973).
- P. B. Stetson, “More Experiments with DAOPHOT II and WF/PC Images,” in Astronomical Data Analysis Software and Systems I, vol. 25 of Astronomical Society of the Pacific Conference Series D. M. Worrall, C. Biemesderfer, and J. Barnes, eds. (1992), p. 297.
- M. J. Jee and J. A. Tyson, “Toward Precision LSST Weak-Lensing Measurement. I. Impacts of Atmospheric Turbulence and Optical Aberration,” \JournalTitlePublications of the Astronomical Society of the Pacific 123, 596 (2011).
- Z. Ma, G. Bernstein, A. Weinstein, and M. Sholl, “Diagnosing space telescope misalignment and jitter using stellar images,” \JournalTitlePublications of the Astronomical Society of the Pacific 120, 1307 (2008).
- P. L. Schechter and R. S. Levinson, “Generic misalignment aberration patterns in wide-field telescopes,” \JournalTitlePublications of the Astronomical Society of the Pacific 123, 812 (2011).
- Z. Li, X. Yuan, and X. Cui, “Alignment metrology for the antarctica kunlun dark universe survey telescope,” \JournalTitleMonthly Notices of the Royal Astronomical Society 449, 425–430 (2015).
- Z. Li, X. Yuan, K. Zhang, and B. Li, “Active alignment metrology for multi-channel photometric survey telescope,” in Advances in Optical Astronomical Instrumentation 2019, vol. 11203 (SPIE, 2020), pp. 13–14.
- Q. An, X. Wu, X. Lin, et al., “Alignment of decam-like large survey telescope for real-time active optics and error analysis,” \JournalTitleOptics Communications 484, 126685 (2021).
- Q. An, H. Zhang, X. Wu, et al., “Photonics large-survey telescope internal motion metrology system,” \JournalTitlePhotonics 10, 595 (2023).
- X. Bai, G. Ju, B. Xu, et al., “Active alignment of space astronomical telescopes by matching arbitrary multi-field stellar image features,” \JournalTitleOptics Express 29, 24446–24465 (2021).
- Z. Wu, Y. Zhang, R. Tang, et al., “Machine learning for improving stellar image-based alignment in wide-field telescopes,” \JournalTitleResearch in Astronomy and Astrophysics 22, 015008 (2022).
- X. Zhang, P. Jia, and W. Wang, “A method to build digital twin of atmospheric turbulence phase screens with comprehensible deep neural networks,” in Adaptive Optics Systems VIII, vol. 12185 (SPIE, 2022), pp. 1065–1070.
- P. Jia, X. Li, Z. Li, et al., “Point spread function modelling for wide-field small-aperture telescopes with a denoising autoencoder,” \JournalTitleMonthly Notices of the Royal Astronomical Society 493, 651–660 (2020).
- P. Jia, X. Wu, Z. Li, et al., “Point spread function estimation for wide field small aperture telescopes with deep neural networks and calibration data,” \JournalTitleMonthly Notices of the Royal Astronomical Society 505, 4717–4725 (2021).
- E. Oteo and J. Arasa, “New strategy for misalignment calculation in optical systems using artificial neural networks,” \JournalTitleOptical Engineering 52, 074105 (2013).
- Z. Liu, Q. Peng, Y. Xu, et al., “Misalignment calculation on off-axis telescope system via fully connected neural network,” \JournalTitleIEEE Photonics Journal 12, 1–12 (2020).
- J. Angel, C. Claver, R. Sarlot, et al., “Lsst optical design,” in American Astronomical Society Meeting Abstracts, vol. 199 (2001), pp. 101–07.
- K. Hodapp, N. Kaiser, H. Aussel, et al., “Design of the pan-starrs telescopes,” \JournalTitleAstronomische Nachrichten: Astronomical Notes 325, 636–642 (2004).
- M. R. Ackermann and J. T. McGraw, “Large-aperture, three-mirror telescopes for near-earth space surveillance: A look from the outside in,” in Proceedings of the 2007 AMOS Technical Conference E, vol. 6 (Citeseer, 2007).
- X. Yuan and D.-q. Su, “Optical system of the three antarctic survey telescopes,” \JournalTitleMonthly Notices of the Royal Astronomical Society 424, 23–30 (2012).
- M. Grieves and J. Vickers, “Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems,” in Transdisciplinary perspectives on complex systems, (Springer, 2017), pp. 85–113.
- C. Zhuang, J. Liu, and H. Xiong, “Digital twin-based smart production management and control framework for the complex product assembly shop-floor,” \JournalTitleThe international journal of advanced manufacturing technology 96, 1149–1163 (2018).
- Q.-W. Li, P. Jiang, and H. Li, “Prognostics and health management of FAST cable-net structure based on digital twin technology,” \JournalTitleResearch in Astronomy and Astrophysics 20, 067 (2020).
- T. Bednarz, D. Branchaud, F. Wang, et al., “Digital twin of the australian square kilometre array (askap),” in SIGGRAPH Asia 2020 Posters, (2020), pp. 1–2.
- P. Jia, W. Wang, R. Ning, and X. Xue, “Digital twin of atmospheric turbulence phase screens based on deep neural networks,” \JournalTitleOptics Express 30, 21362–21376 (2022).
- L. Wang and B. Ellerbroek, “Computer simulations and real-time control of elt ao systems using graphical processing units,” in Adaptive Optics Systems III, vol. 8447 (SPIE, 2012), pp. 780–790.
- F. Rigaut and M. Van Dam, “Simulating astronomical adaptive optics systems using yao,” in Proceedings of the Third AO4ELT Conference, (2013), p. 18.
- R. Conan and C. Correia, “Object-oriented matlab adaptive optics toolbox,” in Adaptive optics systems IV, vol. 9148 (SPIE, 2014), pp. 2066–2082.
- J. Peterson, J. Jernigan, S. Kahn, et al., “Simulation of astronomical images from optical survey telescopes using a comprehensive photon monte carlo approach,” \JournalTitleThe Astrophysical Journal Supplement Series 218, 14 (2015).
- M. Perrin, J. Long, E. Douglas, et al., “Poppy: physical optics propagation in python,” \JournalTitleAstrophysics Source Code Library pp. ascl–1602 (2016).
- A. Reeves, “Soapy: an adaptive optics simulation written purely in python for rapid concept development,” in Adaptive Optics Systems V, vol. 9909 (SPIE, 2016), pp. 2173–2183.
- E. H. Por, S. Y. Haffert, V. M. Radhakrishnan, et al., “High contrast imaging for python (hcipy): an open-source adaptive optics and coronagraph simulator,” in Adaptive Optics Systems VI, vol. 10703 (SPIE, 2018), pp. 1112–1125.
- A. G. Basden, N. Bharmal, D. Jenkins, et al., “The durham adaptive optics simulation platform (dasp): Current status,” \JournalTitleSoftwareX 7, 63–69 (2018).
- F. Ferreira, D. Gratadour, A. Sevin, and N. Doucet, “Compass: an efficient gpu-based simulation software for adaptive optics systems,” in 2018 International Conference on High Performance Computing & Simulation (HPCS), (IEEE, 2018), pp. 180–187.
- K. Ren, Y. Chew, Y. Zhang, et al., “Thermal field prediction for laser scanning paths in laser aided additive manufacturing by physics-based machine learning,” \JournalTitleComputer Methods in Applied Mechanics and Engineering 362, 112734 (2020).
- S. Han, H.-S. Choi, J. Choi, et al., “A dnn-based data-driven modeling employing coarse sample data for real-time flexible multibody dynamics simulations,” \JournalTitleComputer Methods in Applied Mechanics and Engineering 373, 113480 (2021).
- I. Trujillo, J. Aguerri, J. Cepa, and C. Gutierrez, “The effects of seeing on sersic profiles–ii. the moffat psf,” \JournalTitleMonthly Notices of the Royal Astronomical Society 328, 977–985 (2001).
- P. Jia, D. Cai, D. Wang, and A. Basden, “Simulation of atmospheric turbulence phase screen for large telescope and optical interferometer,” \JournalTitleMonthly Notices of the Royal Astronomical Society 447, 3467–3474 (2015).
- D.-q. Su, P. Jia, and G. Liu, “Atmospheric dispersion corrector for the large sky area multi-object fibre spectroscopic telescope,” \JournalTitleMonthly Notices of the Royal Astronomical Society 419, 3406–3413 (2012).
- L. McInnes, J. Healy, N. Saul, and L. Großberger, “Umap: Uniform manifold approximation and projection,” \JournalTitleJournal of Open Source Software 3, 861 (2018).
- S. Ambatipudi and S. Byna, “A comparison of hdf5, zarr, and netcdf4 in performing common i/o operations,” (2023).
- P. Jia, A. Basden, and J. Osborn, “Ground-layer adaptive-optics system modelling for the chinese large optical/infrared telescope,” \JournalTitleMonthly Notices of the Royal Astronomical Society 479, 829–843 (2018).
- J. M. Hughes, C. E. DeForest, and D. B. Seaton, “Coma off it: Regularizing variable point-spread functions,” \JournalTitleThe Astronomical Journal 165, 204 (2023).
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, (2016), pp. 770–778.
- J. L. Elman, “Finding structure in time,” \JournalTitleCognitive Science 14, 179–211 (1990).
- S. Hochreiter and J. Schmidhuber, “Long short-term memory,” \JournalTitleNeural Comput. 9, 1735–1780 (1997).
- A. Vaswani, N. Shazeer, N. Parmar, et al., “Attention is all you need,” in Advances in neural information processing systems, (2017), pp. 5998–6008.
- F. Zhuang, Z. Qi, K. Duan, et al., “A comprehensive survey on transfer learning,” (2020).
- D. qiang Su, P. Jia, and G. Liu, “Atmospheric dispersion corrector for the large sky area multi-object fibre spectroscopic telescope,” \JournalTitleMonthly Notices of the Royal Astronomical Society 419, 3406–3413 (2011).
- Y. Xu, L. Xin, J. Wang, et al., “A real-time automatic validation system for optical transients detected by gwac,” \JournalTitlePublications of the Astronomical Society of the Pacific 132, 054502 (2020).
- S. Danieli, D. Lokhorst, J. Zhang, et al., “The dragonfly wide field survey. i. telescope, survey design, and data characterization,” \JournalTitleThe Astrophysical Journal 894, 119 (2020).
- J. Liu, R. Soria, X.-F. Wu, et al., “The sitian project,” \JournalTitleAnais da Academia Brasileira de Ciências 93 (2021).
- N. M. Law, H. Corbett, N. W. Galliher, et al., “Low-cost access to the deep, high-cadence sky: the argus optical array,” \JournalTitlePublications of the Astronomical Society of the Pacific 134, 035003 (2022).
- E. Ofek, S. Ben-Ami, D. Polishook, et al., “The large array survey telescope—system overview and performances,” \JournalTitlePublications of the Astronomical Society of the Pacific 135, 065001 (2023).
- P. Jia, Q. Jia, T. Jiang, and Z. Yang, “A simulation framework for telescope array and its application in distributed reinforcement learning-based scheduling of telescope arrays,” \JournalTitleAstronomy and Computing p. 100732 (2023).
- P. Jia, Q. Jia, T. Jiang, and J. Liu, “Observation strategy optimization for distributed telescope arrays with deep reinforcement learning,” \JournalTitleThe Astronomical Journal 165, 233 (2023).