Papers
Topics
Authors
Recent
Search
2000 character limit reached

Efficient Terrain Stochastic Differential Efficient Terrain Stochastic Differential Equations for Multipurpose Digital Elevation Model Restoration

Published 2 Jul 2024 in eess.IV and cs.CV | (2407.01908v2)

Abstract: Digital Elevation Models (DEMs) are indispensable in the fields of remote sensing and photogrammetry, with their refinement and enhancement being critical for a diverse array of applications. Numerous methods have been developed for enhancing DEMs, but most of them concentrate on tackling specific tasks individually. This paper presents a unified generative model for multipurpose DEM restoration, diverging from the conventional approach that typically targets isolated tasks. We modify the mean-reverting stochastic differential equation, to generally refine the DEMs by conditioning on the learned terrain priors. The proposed Efficient Terrain Stochastic Differential Equation (ET-SDE) models DEM degradation through SDE progression and restores it via a simulated reversal process. Leveraging efficient submodules with lightweight channel attention, this adapted SDE boosts DEM quality and streamlines the training process. The experiments show that ET-SDE achieves highly competitive restoration performance on super-resolution, void filling, denoising, and their combinations, compared to the state-of-the-art work. In addition to its restoration capabilities, ET-SDE also demonstrates faster inference speeds and the capacity to generalize across various tasks, particularly for larger patches of DEMs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. L. Polidori and M. El Hage, “Digital elevation model quality assessment methods: A critical review,” Remote sensing, vol. 12, no. 21, p. 3522, 2020.
  2. J. L. Mesa-Mingorance and F. J. Ariza-López, “Accuracy assessment of digital elevation models (dems): A critical review of practices of the past three decades,” Remote Sensing, vol. 12, no. 16, p. 2630, 2020.
  3. M. Roostaee and Z. Deng, “Effects of digital elevation model resolution on watershed-based hydrologic simulation,” Water Resources Management, vol. 34, pp. 2433–2447, 2020.
  4. M. P. Kakavas and K. G. Nikolakopoulos, “Digital elevation models of rockfalls and landslides: a review and meta-analysis,” Geosciences, vol. 11, no. 6, p. 256, 2021.
  5. A. Setianto and T. Triandini, “Comparison of kriging and inverse distance weighted (idw) interpolation methods in lineament extraction and analysis,” Journal of Applied Geology, vol. 5, no. 1, 2013.
  6. A. Beutel, T. Mølhave, and P. K. Agarwal, “Natural neighbor interpolation based grid dem construction using a gpu,” in Proceedings of the 18th SIGSPATIAL International Conference on Advances in geographic information Systems, 2010, pp. 172–181.
  7. A. Pavlova, “Analysis of elevation interpolation methods for creating digital elevation models,” Optoelectronics, Instrumentation and Data Processing, vol. 53, pp. 171–177, 2017.
  8. W. C. Van Beers and J. P. Kleijnen, “Kriging interpolation in simulation: a survey,” in Proceedings of the 2004 Winter Simulation Conference, 2004., vol. 1.   IEEE, 2004.
  9. B. Ajvazi and K. Czimber, “A comparative analysis of different dem interpolation methods in gis: case study of rahovec, kosovo,” Geodesy and cartography, vol. 45, no. 1, pp. 43–48, 2019.
  10. Z. Chen, X. Wang, Z. Xu, and W. Hou, “Convolutional neural network based dem super resolution,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 41, pp. 247–250, 2016.
  11. Z. Xu, X. Wang, Z. Chen, D. Xiong, M. Ding, and W. Hou, “Nonlocal similarity based dem super resolution,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 110, pp. 48–54, 2015.
  12. Z. Xu, Z. Chen, W. Yi, Q. Gui, W. Hou, and M. Ding, “Deep gradient prior network for dem super-resolution: Transfer learning from image to dem,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 150, pp. 80–90, 2019.
  13. B. Lim, S. Son, H. Kim, S. Nah, and K. Mu Lee, “Enhanced deep residual networks for single image super-resolution,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp. 136–144.
  14. L. Jiang, Y. Hu, X. Xia, Q. Liang, A. Soltoggio, and S. R. Kabir, “A multi-scale mapping approach based on a deep learning cnn model for reconstructing high-resolution urban dems,” Water, vol. 12, no. 5, p. 1369, 2020.
  15. R. Zhang, S. Bian, and H. Li, “Rspcn: super-resolution of digital elevation model based on recursive sub-pixel convolutional neural networks,” ISPRS International Journal of Geo-Information, vol. 10, no. 8, p. 501, 2021.
  16. S. Li, G. Hu, X. Cheng, L. Xiong, G. Tang, and J. Strobl, “Integrating topographic knowledge into deep learning for the void-filling of digital elevation models,” Remote Sensing of Environment, vol. 269, p. 112818, 2022.
  17. Y. Zhang, W. Yu, and D. Zhu, “Terrain feature-aware deep learning network for digital elevation model superresolution,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 189, pp. 143–162, 2022.
  18. S. Yao, Y. Cheng, F. Yang, and M. G. Mozerov, “A continuous digital elevation representation model for dem super-resolution,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 208, pp. 1–13, 2024.
  19. Y. Chen, S. Liu, and X. Wang, “Learning continuous image representation with local implicit image function,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 8628–8638.
  20. D. Zhu, X. Cheng, F. Zhang, X. Yao, Y. Gao, and Y. Liu, “Spatial interpolation using conditional generative adversarial neural networks,” International Journal of Geographical Information Science, vol. 34, no. 4, pp. 735–758, 2020.
  21. L. Yan, X. Tang, and Y. Zhang, “High accuracy interpolation of dem using generative adversarial network,” Remote Sensing, vol. 13, no. 4, p. 676, 2021.
  22. K. Gavriil, G. Muntingh, and O. J. Barrowclough, “Void filling of digital elevation models with deep generative models,” IEEE Geoscience and Remote Sensing Letters, vol. 16, no. 10, pp. 1645–1649, 2019.
  23. G. Zhou, B. Song, P. Liang, J. Xu, and T. Yue, “Voids filling of dem with multiattention generative adversarial network model,” Remote Sensing, vol. 14, no. 5, p. 1206, 2022.
  24. D. C. Lepcha, B. Goyal, A. Dogra, and V. Goyal, “Image super-resolution: A comprehensive review, recent trends, challenges and applications,” Information Fusion, vol. 91, pp. 230–260, 2023.
  25. K. Sankaran and S. P. Holmes, “Generative models: An interdisciplinary perspective,” Annual Review of Statistics and Its Application, vol. 10, pp. 325–352, 2023.
  26. F.-A. Croitoru, V. Hondru, R. T. Ionescu, and M. Shah, “Diffusion models in vision: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
  27. X. Li, Y. Ren, X. Jin, C. Lan, X. Wang, W. Zeng, X. Wang, and Z. Chen, “Diffusion models for image restoration and enhancement–a comprehensive survey,” arXiv preprint arXiv:2308.09388, 2023.
  28. C. Ceylan and M. U. Gutmann, “Conditional noise-contrastive estimation of unnormalised models,” in International Conference on Machine Learning.   PMLR, 2018, pp. 726–734.
  29. J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems, vol. 33, pp. 6840–6851, 2020.
  30. Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole, “Score-based generative modeling through stochastic differential equations,” arXiv preprint arXiv:2011.13456, 2020.
  31. C. Saharia, J. Ho, W. Chan, T. Salimans, D. J. Fleet, and M. Norouzi, “Image super-resolution via iterative refinement,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 4713–4726, 2022.
  32. C. Saharia, W. Chan, H. Chang, C. Lee, J. Ho, T. Salimans, D. Fleet, and M. Norouzi, “Palette: Image-to-image diffusion models,” in ACM SIGGRAPH 2022 Conference Proceedings, 2022, pp. 1–10.
  33. Z. Luo, F. K. Gustafsson, Z. Zhao, J. Sjölund, and T. B. Schön, “Image restoration with mean-reverting stochastic differential equations,” arXiv preprint arXiv:2301.11699, 2023.
  34. ——, “Refusion: Enabling large-size realistic image restoration with latent-space diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 1680–1691.
  35. J. Choi, S. Kim, Y. Jeong, Y. Gwon, and S. Yoon, “Ilvr: Conditioning method for denoising diffusion probabilistic models,” arXiv preprint arXiv:2108.02938, 2021.
  36. L. Yang, X. Meng, and X. Zhang, “Srtm dem and its application advances,” International Journal of Remote Sensing, vol. 32, no. 14, pp. 3875–3896, 2011.
  37. T. Toutin, “Aster dems for geomatic and geoscientific applications: a review,” International Journal of Remote Sensing, vol. 29, no. 7, pp. 1855–1875, 2008.
  38. G. Krieger, A. Moreira, H. Fiedler, I. Hajnsek, M. Werner, M. Younis, and M. Zink, “Tandem-x: A satellite formation for high-resolution sar interferometry,” IEEE Transactions on Geoscience and Remote Sensing, vol. 45, no. 11, pp. 3317–3341, 2007.
  39. T. G. Farr, P. A. Rosen, E. Caro, R. Crippen, R. Duren, S. Hensley, M. Kobrick, M. Paller, E. Rodriguez, L. Roth et al., “The shuttle radar topography mission,” Reviews of geophysics, vol. 45, no. 2, 2007.
  40. Y. Xiao, Q. Yuan, K. Jiang, J. He, X. Jin, and L. Zhang, “Ediffsr: An efficient diffusion probabilistic model for remote sensing image super-resolution,” IEEE Transactions on Geoscience and Remote Sensing, 2023.
  41. Y. Zhang, K. Li, K. Li, L. Wang, B. Zhong, and Y. Fu, “Image super-resolution using very deep residual channel attention networks,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 286–301.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.