Causality-informed Rapid Post-hurricane Building Damage Detection in Large Scale from InSAR Imagery (2310.01565v1)
Abstract: Timely and accurate assessment of hurricane-induced building damage is crucial for effective post-hurricane response and recovery efforts. Recently, remote sensing technologies provide large-scale optical or Interferometric Synthetic Aperture Radar (InSAR) imagery data immediately after a disastrous event, which can be readily used to conduct rapid building damage assessment. Compared to optical satellite imageries, the Synthetic Aperture Radar can penetrate cloud cover and provide more complete spatial coverage of damaged zones in various weather conditions. However, these InSAR imageries often contain highly noisy and mixed signals induced by co-occurring or co-located building damage, flood, flood/wind-induced vegetation changes, as well as anthropogenic activities, making it challenging to extract accurate building damage information. In this paper, we introduced an approach for rapid post-hurricane building damage detection from InSAR imagery. This approach encoded complex causal dependencies among wind, flood, building damage, and InSAR imagery using a holistic causal Bayesian network. Based on the causal Bayesian network, we further jointly inferred the large-scale unobserved building damage by fusing the information from InSAR imagery with prior physical models of flood and wind, without the need for ground truth labels. Furthermore, we validated our estimation results in a real-world devastating hurricane -- the 2022 Hurricane Ian. We gathered and annotated building damage ground truth data in Lee County, Florida, and compared the introduced method's estimation results with the ground truth and benchmarked it against state-of-the-art models to assess the effectiveness of our proposed method. Results show that our method achieves rapid and accurate detection of building damage, with significantly reduced processing time compared to traditional manual inspection methods.
- NASA-JPL/Caltech ARIA. 2022. Damage Proxy Map (DPM) for Hurricane Ian using Copernicus Sentinel-1 data. Available at: http://aria-share.jpl.nasa.gov/.
- John A Barras. 2007. Satellite images and aerial photographs of the effects of Hurricanes Katrina and Rita on coastal Louisiana. Technical Report. Geological Survey (US).
- Polina Berezina and Desheng Liu. 2022. Hurricane damage assessment using coupled convolutional neural networks: a case study of hurricane Michael. Geomatics, Natural Hazards and Risk 13, 1 (2022), 414–431.
- Landon Calton and Zhangping Wei. 2022. Using artificial neural network models to assess hurricane damage through transfer learning. Applied Sciences 12, 3 (2022), 1466.
- Deep Residual Learning for Image Recognition. arXiv:1512.03385 [cs.CV]
- Tommi S Jaakkola and Michael I Jordan. 1997. A variational approach to Bayesian logistic regression models and their extensions. In Sixth International Workshop on Artificial Intelligence and Statistics. PMLR, 283–294.
- Eugene Khvedchenya and Tatiana Gabruseva. 2021. Fully convolutional Siamese neural networks for buildings damage assessment from satellite images. arXiv:2111.00508 [cs.CV]
- Field assessment structural team (FAST) Handbook, Version 1.2. Structural Engineering Extreme Events Reconnaissance (2019).
- StEER: Hurricane Ian Early Access Reconnaissance Report (EARR). https://doi.org/10.17603/DS2-3PC2-7P82
- SARO Lee. 2005. Application of logistic regression model and its validation for landslide susceptibility mapping using GIS and remote sensing data. International Journal of remote sensing 26, 7 (2005), 1477–1491.
- Building damage assessment from post-hurricane imageries using unsupervised domain adaptation with enhanced feature discrimination. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), 1–10.
- Combined wind-wave-surge hurricane-induced damage prediction for buildings. Journal of Structural Engineering 145, 1 (2019), 04018227.
- Vulnerability of Florida residential structures to hurricane induced coastal flood. Engineering structures 220 (2020), 111004.
- A sensitivity study of rising compound coastal inundation over large flood plains in a changing climate. Scientific Reports 12, 1 (2022), 3403.
- U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv:1505.04597 [cs.CV]
- Simulation of storm surge, wave, currents, and inundation in the Outer Banks and Chesapeake Bay during Hurricane Isabel in 2003: The importance of waves. Journal of Geophysical Research: Oceans 115, C4 (2010).
- A Smith. 2021. US billion-dollar weather and climate disasters in historical context (NOAA national centers for environmental information). (2021).
- High-Resolution Representations for Labeling Pixels and Regions. arXiv:1904.04514 [cs.CV] Wang et al. (2022) Hao Wang, Chao Tao, Ji Qi, Rong Xiao, and Haifeng Li. 2022. Avoiding Negative Transfer for Semantic Segmentation of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing 60 (2022), 1–15. Wang et al. (2020) Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. 2020. Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Hao Wang, Chao Tao, Ji Qi, Rong Xiao, and Haifeng Li. 2022. Avoiding Negative Transfer for Semantic Segmentation of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing 60 (2022), 1–15. Wang et al. (2020) Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. 2020. Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. 2020. Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.
- Avoiding Negative Transfer for Semantic Segmentation of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing 60 (2022), 1–15. Wang et al. (2020) Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. 2020. Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. 2020. Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.
- Deep High-Resolution Representation Learning for Visual Recognition. arXiv:1908.07919 [cs.CV] Xu et al. (2022) Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Susu Xu, Joshua Dimasaka, David J Wald, and Hae Young Noh. 2022. Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.
- Seismic multi-hazard and impact estimation via causal inference from satellite imagery. Nature Communications 13, 1 (2022), 7793. Zhai and Peng (2020) Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.
- Wei Zhai and Zhong-Ren Peng. 2020. Damage assessment using google street view: Evidence from hurricane Michael in Mexico beach, Florida. Applied geography 123 (2020), 102252. Zhao and Lu (2018) Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279. Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.
- Chaoying Zhao and Zhong Lu. 2018. Remote sensing of landslides—A review. Remote Sensing 10, 2 (2018), 279.