Unlocking the Potential: Multi-task Deep Learning for Spaceborne Quantitative Monitoring of Fugitive Methane Plumes (2401.12870v3)
Abstract: As global warming intensifies, increased attention is being paid to monitoring fugitive methane emissions and detecting gas plumes from landfills. We have divided methane emission monitoring into three subtasks: methane concentration inversion, plume segmentation, and emission rate estimation. Traditional algorithms face certain limitations: methane concentration inversion typically employs the matched filter, which is sensitive to the global spectrum distribution and prone to significant noise. There is scant research on plume segmentation, with many studies depending on manual segmentation, which can be subjective. The estimation of methane emission rate frequently uses the IME algorithm, which necessitates meteorological measurement data. Utilizing the WENT landfill site in Hong Kong along with PRISMA hyperspectral satellite imagery, we introduce a novel deep learning-based framework for quantitative methane emission monitoring from remote sensing images that is grounded in physical simulation. We create simulated methane plumes using large eddy simulation (LES) and various concentration maps of fugitive emissions using the radiative transfer equation (RTE), while applying augmentation techniques to construct a simulated PRISMA dataset. We train a U-Net network for methane concentration inversion, a Mask R-CNN network for methane plume segmentation, and a ResNet-50 network for methane emission rate estimation. All three deep networks yield higher validation accuracy compared to traditional algorithms. Furthermore, we combine the first two subtasks and the last two subtasks to design multi-task learning models, MTL-01 and MTL-02, both of which outperform single-task models in terms of accuracy. Our research exemplifies the application of multi-task deep learning to quantitative methane monitoring and can be generalized to a wide array of methane monitoring tasks.
- Giancarlo Alfonsi “Reynolds-Averaged Navier–Stokes Equations for Turbulence Modeling” In Applied Mechanics Reviews 62.4, 2009, pp. 040802
- “Waste management in climate change 2007: Mitigation. contribution of working group iii to the fourth assessment report of the intergovernmental panel on climate change” In Cambridge University Press, Cambridge, 2007
- “Exploring relational context for multi-task dense prediction” In Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 15869–15878
- “Global carbon and other biogeochemical cycles and feedbacks”, 2021
- “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs” In IEEE transactions on pattern analysis and machine intelligence 40.4 IEEE, 2017, pp. 834–848
- “The PRISMA imaging spectroscopy mission: Overview and first performance analysis” In Remote Sensing of Environment 262 Elsevier, 2021, pp. 112499
- “High spatial resolution mapping of elevated atmospheric carbon dioxide using airborne imaging spectroscopy: Radiative transfer modeling and power plant plume detection” In Remote Sensing of Environment 139 Elsevier, 2013, pp. 116–129
- J Andrzej Domaradzki and Eileen M Saiki “A subgrid-scale model based on the estimation of unresolved scales of turbulence” In Physics of Fluids 9.7 American Institute of Physics, 1997, pp. 2148–2164
- “Fast and accurate retrieval of methane concentration from imaging spectrometer data using sparsity prior” In IEEE Transactions on Geoscience and Remote Sensing 58.9 IEEE, 2020, pp. 6480–6492
- “Impact of scene-specific enhancement spectra on matched filter greenhouse gas retrievals from imaging spectroscopy” In Remote Sensing of Environment 264 Elsevier, 2021, pp. 112574
- “Clustering to improve matched filter detection of weak gas plumes in hyperspectral thermal imagery” In IEEE transactions on geoscience and remote sensing 39.7 IEEE, 2001, pp. 1410–1420
- “A dynamic subgrid-scale eddy viscosity model” In Physics of Fluids A: Fluid Dynamics 3.7 American Institute of Physics, 1991, pp. 1760–1765
- Joseph Yossi Gil and Ron Kimmel “Efficient dilation, erosion, opening, and closing algorithms” In IEEE Transactions on Pattern Analysis and Machine Intelligence 24.12 IEEE, 2002, pp. 1606–1617
- “Understanding the potential of Sentinel-2 for monitoring methane point emissions” In Atmospheric Measurement Techniques 16.1 Copernicus GmbH, 2023, pp. 89–107
- “Mapping methane point emissions with the PRISMA spaceborne imaging spectrometer” In Remote Sensing of Environment 265 Elsevier, 2021, pp. 112671
- “Deep residual learning for image recognition” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778
- “Mask r-cnn” In Proceedings of the IEEE international conference on computer vision, 2017, pp. 2961–2969
- “Spatial pyramid pooling in deep convolutional networks for visual recognition” In IEEE transactions on pattern analysis and machine intelligence 37.9 IEEE, 2015, pp. 1904–1916
- “Hashing as tie-aware learning to rank” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4023–4032
- A Iravanian and Sh O Ravari “Types of contamination in landfills and effects on the environment: a review study” In IOP Conference Series: Earth and Environmental Science 614.1, 2020, pp. 012083 IOP Publishing
- “Joint learning of frequency and spatial domains for dense image prediction” In ISPRS Journal of Photogrammetry and Remote Sensing 195, 2023, pp. 14–28
- “Space-to-speed architecture supporting acceleration on VHR image processing” In ISPRS Journal of Photogrammetry and Remote Sensing 198, 2023, pp. 30–44
- “MethaNet – An AI-driven approach to quantifying methane point-source emission from high-resolution 2-D plume imagery” In Remote Sensing of Environment 269, 2022, pp. 112809
- Alex Krizhevsky, Ilya Sutskever and Geoffrey E Hinton “Imagenet classification with deep convolutional neural networks” In Communications of the ACM 60.6 AcM New York, NY, USA, 2017, pp. 84–90
- Min Lin, Qiang Chen and Shuicheng Yan “Network In Network” In arXiv e-prints, 2013, pp. arXiv–1312
- Shikun Liu, Edward Johns and Andrew J Davison “End-to-end multi-task learning with attention” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 1871–1880
- Jonathan Long, Evan Shelhamer and Trevor Darrell “Fully convolutional networks for semantic segmentation” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431–3440
- Cosimo Magazzino, Marco Mele and Nicolas Schneider “The relationship between municipal solid waste and greenhouse gas emissions: Evidence from Switzerland” In Waste Management 113 Elsevier, 2020, pp. 508–520
- “Process performance and methane production optimizing of anaerobic co-digestion of swine manure and corn straw” In Scientific Reports 7.1, 2017, pp. 9379
- “The Parallelized Large-Eddy Simulation Model (PALM) version 4.0 for atmospheric and oceanic flows: model formulation, recent developments, and future perspectives” In Geoscientific Model Development 8.8 Copernicus GmbH, 2015, pp. 2515–2551
- “Instance segmentation of fallen trees in aerial color infrared imagery using active multi-contour evolution with fully convolutional network-based intensity priors” In ISPRS Journal of Photogrammetry and Remote Sensing 178, 2021, pp. 297–313
- Stephen B Pope “Turbulent flows” In Measurement Science and Technology 12.11, 2001, pp. 2020–2021
- “PALM-A large-eddy simulation model performing on massively parallel computers” In Meteorologische Zeitschrift 10.5, 2001, pp. 363–372
- Maithra Raghu “On the expressive power of deep neural networks”, 2016
- Olaf Ronneberger, Philipp Fischer and Thomas Brox “U-net: Convolutional networks for biomedical image segmentation” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, 2015, pp. 234–241 Springer
- “Large eddy simulation for incompressible flows: An introduction. scientific computation series” In Appl. Mech. Rev. 55.6, 2002, pp. B115–B116
- “Deep residual learning for image recognition: a survey” In Applied Sciences 12.18 MDPI, 2022, pp. 8972
- Jacquelyn Shelton, Przemyslaw Polewski and Wei Yao “U-Net for Learning and Inference of Dense Representation of Multiple Air Pollutants from Satellite Imagery” In Proceedings of the 10th International Conference on Climate Informatics, CI2020 virtual, United Kingdom: Association for Computing Machinery, 2021, pp. 128–133
- “Technical summary” In Climate change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change Cambridge University Press, 2013, pp. 33–115
- “A comprehensive review of YOLO: From YOLOv1 to YOLOv8 and beyond” In arXiv preprint arXiv:2304.00501, 2023
- “Loss Functions and Metrics in Deep Learning. A Review” In arXiv preprint arXiv:2307.02694, 2023
- James Theiler and Bernard R Foy “Effect of signal contamination in matched-filter detection of the signal on a cluttered background” In IEEE Geoscience and Remote Sensing Letters 3.1 Ieee, 2006, pp. 98–102
- “Atmospheric correction for global mapping spectroscopy: ATREM advances for the HyspIRI preparatory campaign” In Remote Sensing of Environment 167 Elsevier, 2015, pp. 64–77
- “Airborne DOAS retrievals of methane, carbon dioxide, and water vapor concentrations at high spatial resolution: application to AVIRIS-NG” In Atmospheric Measurement Techniques 10.10 Copernicus GmbH, 2017, pp. 3833–3850
- “High resolution mapping of methane emissions from marine and terrestrial sources using a Cluster-Tuned Matched Filter technique and imaging spectrometry” In Remote Sensing of Environment 134 Elsevier, 2013, pp. 305–318
- “Multi-Task Learning for Dense Prediction Tasks: A Survey”, 2020
- “Quantifying methane point sources from fine-scale satellite observations of atmospheric methane plumes” In Atmospheric Measurement Techniques 11.10 Copernicus GmbH, 2018, pp. 5673–5686
- Andreas Veit, Michael J Wilber and Serge Belongie “Residual networks behave like ensembles of relatively shallow networks” In Advances in neural information processing systems 29, 2016
- “Solov2: Dynamic and fast instance segmentation” In Advances in Neural information processing systems 33, 2020, pp. 17721–17732
- Zhiming Yang, Shigemi Kagawa and Jing Li “Do greenhouse gas emissions drive extreme weather conditions at the city level in China? Evidence from spatial effects analysis” In Urban Climate 37 Elsevier, 2021, pp. 100812
- “Land-use mapping for high-spatial resolution remote sensing image via deep learning: A review” In IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14 IEEE, 2021, pp. 5372–5391
- “Greenhouse gas emissions from landfills: A review and bibliometric analysis” In Sustainability 11.8 MDPI, 2019, pp. 2282
- Lichen Zhou, Chuang Zhang and Ming Wu “D-LinkNet: LinkNet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction” In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2018, pp. 182–186