VisRec: A Semi-Supervised Approach to Radio Interferometric Data Reconstruction (2403.00897v1)
Abstract: Radio telescopes produce visibility data about celestial objects, but these data are sparse and noisy. As a result, images created on raw visibility data are of low quality. Recent studies have used deep learning models to reconstruct visibility data to get cleaner images. However, these methods rely on a substantial amount of labeled training data, which requires significant labeling effort from radio astronomers. Addressing this challenge, we propose VisRec, a model-agnostic semi-supervised learning approach to the reconstruction of visibility data. Specifically, VisRec consists of both a supervised learning module and an unsupervised learning module. In the supervised learning module, we introduce a set of data augmentation functions to produce diverse training examples. In comparison, the unsupervised learning module in VisRec augments unlabeled data and uses reconstructions from non-augmented visibility data as pseudo-labels for training. This hybrid approach allows VisRec to effectively leverage both labeled and unlabeled data. This way, VisRec performs well even when labeled data is scarce. Our evaluation results show that VisRec outperforms all baseline methods in reconstruction quality, robustness against common observation perturbation, and generalizability to different telescope configurations.
- The decam legacy survey. In American Astronomical Society Meeting Abstracts# 228, volume 228, pages 317–01, 2016.
- Computational imaging for vlbi image reconstruction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 913–922, 2016.
- Reconstructing video of time-varying sources from radio interferometric measurements. IEEE Transactions on Computational Imaging, 4(4):512–527, 2018.
- Interferometric imaging directly with closure phases and closure amplitudes. The Astrophysical Journal, 857(1):23, 2018.
- ehtim: Imaging, analysis, and simulation software for radio interferometry. Astrophysics Source Code Library, pages ascl–1904, 2019.
- Deep radio-interferometric imaging with polish: Dsa-2000 and weak lensing. Monthly Notices of the Royal Astronomical Society, 514(2):2614–2626, 2022.
- Rishit Dagli. Astroformer: More data might not be all you need for classification. arXiv preprint arXiv:2304.05350, 2023.
- Measuring robustness in deep learning based compressive sensing. In International Conference on Machine Learning, pages 2433–2444. PMLR, 2021.
- Noise2recon: Enabling snr-robust mri reconstruction with semi-supervised and self-supervised learning. Magnetic Resonance in Medicine, 90(5):2052–2070, 2023.
- Overview of the desi legacy imaging surveys. The Astronomical Journal, 157(5):168, 2019.
- Deep-learning-based radiointerferometric imaging with gan-aided training. Astronomy & Astrophysics, 677:A167, 2023.
- Leung Henry. Galaxy10 decals dataset. https://github.com/henrysky/Galaxy10, 2021.
- JA Högbom. Aperture synthesis with a non-regular distribution of interferometer baselines. Astronomy and Astrophysics Supplement Series, 15:417, 1974.
- On the robustness of deep learning-based mri reconstruction to image transformations. In Workshop on Trustworthy and Socially Responsible Machine Learning, NeurIPS 2022, 2022.
- Focal frequency loss for image reconstruction and synthesis. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13919–13929, 2021.
- Noise2noise: Learning image restoration without clean data. In International Conference on Machine Learning, pages 2965–2974. PMLR, 2018.
- Characterizing beam errors for radio interferometric observations of reionization. Monthly Notices of the Royal Astronomical Society, 514(3):4655–4668, 2022.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- Deep learning-based imaging in radio interferometry. arXiv preprint arXiv:2203.11757, 2022.
- The mayall z-band legacy survey. In American Astronomical Society Meeting Abstracts# 228, volume 228, pages 317–02, 2016.
- Basics of python and scikit image. Practical Machine Learning and Image Processing: For Facial Recognition, Object Detection, and Pattern Recognition Using Python, pages 29–61, 2019.
- He Sun and Katherine L Bouman. Deep probabilistic imaging: Uncertainty quantification and multi-modal solution characterization for computational imaging. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 2628–2637, 2021.
- Interferometry and synthesis in radio astronomy. Springer Nature, 2017.
- A conditional denoising diffusion probabilistic model for radio interferometric image reconstruction. In 26th European Conference on Artificial Intelligence, pages 2499–2506, 2023.
- Neural interferometry: Image reconstruction from astronomical interferometers using transformer-conditioned neural fields. In Proceedings of the AAAI Conference on Artificial Intelligence, 2022.
- A comprehensive survey of image augmentation techniques for deep learning. Pattern Recognition, page 109347, 2023.
- Noise2astro: Astronomical image denoising with self-supervised neural networks. Research Notes of the AAS, 6(9):187, 2022.
- Project overview of the beijing–arizona sky survey. Publications of the Astronomical Society of the Pacific, 129(976):064101, 2017.