Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Efficient Large-scale Nonstationary Spatial Covariance Function Estimation Using Convolutional Neural Networks (2306.11487v1)

Published 20 Jun 2023 in stat.ML, cs.LG, and stat.CO

Abstract: Spatial processes observed in various fields, such as climate and environmental science, often occur on a large scale and demonstrate spatial nonstationarity. Fitting a Gaussian process with a nonstationary Mat\'ern covariance is challenging. Previous studies in the literature have tackled this challenge by employing spatial partitioning techniques to estimate the parameters that vary spatially in the covariance function. The selection of partitions is an important consideration, but it is often subjective and lacks a data-driven approach. To address this issue, in this study, we utilize the power of Convolutional Neural Networks (ConvNets) to derive subregions from the nonstationary data. We employ a selection mechanism to identify subregions that exhibit similar behavior to stationary fields. In order to distinguish between stationary and nonstationary random fields, we conducted training on ConvNet using various simulated data. These simulations are generated from Gaussian processes with Mat\'ern covariance models under a wide range of parameter settings, ensuring adequate representation of both stationary and nonstationary spatial data. We assess the performance of the proposed method with synthetic and real datasets at a large scale. The results revealed enhanced accuracy in parameter estimations when relying on ConvNet-based partition compared to traditional user-defined approaches.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. Abdulah, S, Akbudak, K, Boukaram, W, Charara, A, Keyes, D, Ltaief, H, Mikhalev, A, Sukkari, D, and Turkiyyah, G (2019), “Hierarchical computations on manycore architectures (HiCMA),” See http://github. com/ecrc/hicma.
  2. Abdulah, Sameh, Li, Yuxiao, Cao, Jian, Ltaief, Hatem, Keyes, David E., Genton, Marc G., and Sun, Ying (2023), “Large-scale environmental data science with ExaGeoStatR,” Environmetrics, 34, 1, e2770.
  3. Abdulah, Sameh, Ltaief, Hatem, Sun, Ying, Genton, Marc G, and Keyes, David E (2018), “ExaGeoStat: A high performance unified software for geostatistics on manycore systems,” IEEE Transactions on Parallel and Distributed Systems, 29, 12, 2771–2784.
  4. Ajmal, Hina, Rehman, Saad, Farooq, Umar, Ain, Qurrat U, Riaz, Farhan, and Hassan, Ali (2018), “Convolutional neural network based image segmentation: a review,” Pattern Recognition and Tracking XXIX, 10649, 191–203.
  5. Anderes, Ethan B and Stein, Michael L (2008), “Estimating deformations of isotropic Gaussian random fields on the plane,” The Annals of Statistics, 36, 2, 719–741.
  6. — (2011), “Local likelihood estimation for nonstationary random fields,” Journal of Multivariate Analysis, 102, 3, 506–520.
  7. Chaney, Nathaniel W, Metcalfe, Peter, and Wood, Eric F (2016), “HydroBlocks: a field-scale resolving land surface model for application over continental extents,” Hydrological Processes, 30, 20, 3543–3559.
  8. in Proceedings of the 2018 World Wide Web Conference, 1775–1784.
  9. Fouedjio, Francky, Desassis, Nicolas, and Rivoirard, Jacques (2016), “A generalized convolution model and estimation for non-stationary random functions,” Spatial Statistics, 16, 35–52.
  10. Gerber, Florian and Nychka, Douglas (2021), “Fast covariance parameter estimation of spatial Gaussian process models using neural networks,” Stat, 10, 1, e382.
  11. Higdon, David (1998), “A process-convolution approach to modelling temperatures in the North Atlantic Ocean,” Environmental and Ecological Statistics, 5, 2, 173–190.
  12. Huang, Huang and Sun, Ying (2018), “Hierarchical low rank approximation of likelihoods for large spatial datasets,” Journal of Computational and Graphical Statistics, 27, 1, 110–118.
  13. Jun, Mikyoung and Stein, Michael L (2008), “Nonstationary covariance models for global data,” The Annals of Applied Statistics, 2, 4, 1271–1289.
  14. LeCun, Yann, Bengio, Yoshua, and Hinton, Geoffrey (2015), “Deep learning,” Nature, 521, 7553, 436–444.
  15. LeCun, Yann, Boser, Bernhard, Denker, John S, Henderson, Donnie, Howard, Richard E, Hubbard, Wayne, and Jackel, Lawrence D (1989), “Backpropagation applied to handwritten zip code recognition,” Neural Computation, 1, 4, 541–551.
  16. Lenzi, Amanda, Bessac, Julie, Rudi, Johann, and Stein, Michael L (2023), “Neural networks for parameter estimation in intractable models,” Computational Statistics & Data Analysis, 185, 107762.
  17. Lenzi, Amanda and Rue, Haavard (2023), “Towards black-box parameter estimation,” arXiv preprint arXiv:2303.15041.
  18. Li, Yuxiao and Sun, Ying (2019), “Efficient estimation of nonstationary spatial covariance functions with application to high-resolution climate model emulation,” Statistica Sinica, 29, 3, 1209–1231.
  19. Lindgren, Finn, Rue, Håvard, and Lindström, Johan (2011), “An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 73, 4, 423–498.
  20. Monti, Federico, Frasca, Fabrizio, Eynard, Davide, Mannion, Damon, and Bronstein, Michael M (2019), “Fake news detection on social media using geometric deep learning,” arXiv preprint arXiv:1902.06673.
  21. Nabi, Syed Tauhidun, Islam, Md Rashidul, Alam, Md Golam Rabiul, Hassan, Mohammad Mehedi, AlQahtani, Salman A, Aloi, Gianluca, and Fortino, Giancarlo (2023), “Deep learning based fusion model for multivariate LTE traffic forecasting and optimized radio parameter estimation,” IEEE Access, 11, 14533–14549.
  22. in International Conference on Machine Learning, 17117–17137. PMLR.
  23. Paciorek, Christopher and Schervish, Mark (2003), “Nonstationary covariance functions for Gaussian process regression,” Advances in Neural Information Processing Systems, 16.
  24. Paciorek, Christopher J and Schervish, Mark J (2006), “Spatial modelling using a new class of nonstationary covariance functions,” Environmetrics, 17, 5, 483–506.
  25. in Proceeding Eight International Biometric Conference, 1975. Biometric Soc.
  26. Qadir, Ghulam A, Sun, Ying, and Kurtek, Sebastian (2021), “Estimation of spatial deformation for nonstationary processes via variogram alignment,” Technometrics, 63, 4, 548–561.
  27. in 2011 International Conference on Digital Image Computing: Techniques and Applications, 416–421. IEEE.
  28. Rawat, Waseem and Wang, Zenghui (2017), “Deep convolutional neural networks for image classification: A comprehensive review,” Neural Computation, 29, 9, 2352–2449.
  29. Risser, Mark D. (2016), “Review: Nonstationary Spatial Modeling, with Emphasis on Process Convolution and Covariate-Driven Approaches,” arXiv:1610.02447.
  30. Risser, Mark D and Calder, Catherine A (2015), “Local likelihood estimation for covariance functions with spatially-varying parameters: the convoSPAT package for R,” arXiv:1507.08613.
  31. Sampson, Paul D and Guttorp, Peter (1992), “Nonparametric estimation of nonstationary spatial covariance structure,” Journal of the American Statistical Association, 87, 417, 108–119.
  32. in International Conference on Machine Learning, 8459–8468. PMLR.
  33. Scarselli, Franco, Gori, Marco, Tsoi, Ah Chung, Hagenbuchner, Markus, and Monfardini, Gabriele (2008), “The graph neural network model,” IEEE Transactions on Neural Networks, 20, 1, 61–80.
  34. Stein, Michael L (2005), “Nonstationary spatial covariance functions,” Unpublished technical report.
  35. Stokes, Jonathan M, Yang, Kevin, Swanson, Kyle, Jin, Wengong, Cubillos-Ruiz, Andres, Donghia, Nina M, MacNair, Craig R, French, Shawn, Carfrae, Lindsey A, Bloom-Ackermann, Zohar, et al. (2020), “A deep learning approach to antibiotic discovery,” Cell, 180, 4, 688–702.
  36. in International Conference on Machine Learning, 1067–1075. PMLR.
  37. Zhang, Kaipeng, Zhang, Zhanpeng, Li, Zhifeng, and Qiao, Yu (2016), “Joint face detection and alignment using multitask cascaded convolutional networks,” IEEE Signal Processing Letters, 23, 10, 1499–1503.
  38. in 2017 36th Chinese Control Conference (CCC), 11104–11109. IEEE.
  39. Zhou, Jie, Cui, Ganqu, Hu, Shengding, Zhang, Zhengyan, Yang, Cheng, Liu, Zhiyuan, Wang, Lifeng, Li, Changcheng, and Sun, Maosong (2020), “Graph neural networks: A review of methods and applications,” AI Open, 1, 57–81.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now