Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Semiparametric Regression for Spatial Data via Deep Learning (2301.03747v2)

Published 10 Jan 2023 in stat.ML, cs.LG, and stat.ME

Abstract: In this work, we propose a deep learning-based method to perform semiparametric regression analysis for spatially dependent data. To be specific, we use a sparsely connected deep neural network with rectified linear unit (ReLU) activation function to estimate the unknown regression function that describes the relationship between response and covariates in the presence of spatial dependence. Under some mild conditions, the estimator is proven to be consistent, and the rate of convergence is determined by three factors: (1) the architecture of neural network class, (2) the smoothness and (intrinsic) dimension of true mean function, and (3) the magnitude of spatial dependence. Our method can handle well large data set owing to the stochastic gradient descent optimization algorithm. Simulation studies on synthetic data are conducted to assess the finite sample performance, the results of which indicate that the proposed method is capable of picking up the intricate relationship between response and covariates. Finally, a real data analysis is provided to demonstrate the validity and effectiveness of the proposed method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.
  2. On deep learning as a remedy for the curse of dimensionality in nonparametric regression. Ann. Statist., 47(4):2261–2285.
  3. On semiparametric inference of geostatistical models via local karhunen–loève expansion. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76(4):817–832.
  4. Spatial processes: models & applications. Taylor & Francis.
  5. A deep network construction that adapts to intrinsic dimensionality beyond the domain. Neural Networks, 141:404–419.
  6. Fixed rank kriging for very large spatial data sets. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 70(1):209–226.
  7. Statistical estimation in varying coefficient models. The annals of Statistics, 27(5):1491–1518.
  8. Deep neural networks for estimation and inference. Econometrica, 89(1):181–213.
  9. Generalized Additive Models. Statistical Science, 1(3):297 – 310.
  10. Varying-coefficient models. Journal of the Royal Statistical Society: Series B (Methodological), 55(4):757–779.
  11. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778.
  12. Jenish, N. (2012). Nonparametric spatial regression under near-epoch dependence. Journal of Econometrics, 167(1):224–239.
  13. Drug discovery with explainable artificial intelligence. Nature Machine Intelligence, 2(10):573–584.
  14. Generalized spatially varying coefficient models. Journal of Computational and Graphical Statistics, 30(1):1–10.
  15. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
  16. Bayesian deep learning for spatial interpolation in the presence of auxiliary information. Mathematical Geosciences, pages 1–25.
  17. Estimation of a function of low local dimensionality by deep neural networks. IEEE transactions on information theory, 68(6):4032–4042.
  18. On the rate of convergence of fully connected deep neural network regression estimates. The Annals of Statistics, 49(4):2231–2249.
  19. Kurisu, D. (2019). On nonparametric inference for spatial regression models under domain expanding and infill asymptotics. Statistics & Probability Letters, 154:108543.
  20. Kurisu, D. (2022). Nonparametric regression for locally stationary random fields under stochastic sampling design. Bernoulli, 28(2):1250–1275.
  21. Lee, L.-F. (2002). Consistency and efficiency of least squares estimation for mixed regressive, spatial autoregressive models. Econometric theory, 18(2):252–277.
  22. Lee, L.-F. (2004). Asymptotic distributions of quasi-maximum likelihood estimators for spatial autoregressive models. Econometrica, 72(6):1899–1925.
  23. Lassonet: Neural networks with feature sparsity. In International Conference on Artificial Intelligence and Statistics, pages 10–18. PMLR.
  24. Li, K. (2022). Variable selection for nonlinear cox regression model via deep learning. arXiv preprint arXiv:2211.09287.
  25. Calibrating multi-dimensional complex ode from noisy data via deep neural networks. arXiv preprint arXiv:2106.03591.
  26. Deep feature screening: Feature selection for ultra high-dimensional data via deep neural networks. arXiv preprint arXiv:2204.01682.
  27. Li, L. (2016). Nonparametric regression on random fields with random design using wavelet method. Statistical Inference for Stochastic Processes, 19(1):51–69.
  28. Optimal nonparametric inference via deep neural network. Journal of Mathematical Analysis and Applications, 505(2):125561.
  29. On deep instrumental variables estimate.
  30. Online statistical inference for parameters estimation with linear-equality constraints. arXiv preprint arXiv:2105.10315.
  31. Deep network approximation for smooth functions.
  32. Nonparametric estimation of probability density functions for irregularly observed spatial data. Journal of the American Statistical Association, 109(508):1546–1564.
  33. Scalable semiparametric spatio-temporal regression for large data analysis. Journal of Agricultural, Biological and Environmental Statistics, pages 1–20.
  34. Spatial point processes and neural networks: A convenient couple. Spatial Statistics, page 100644.
  35. Estimation and inference in spatially varying coefficient models. Environmetrics, 29(1):e2485.
  36. Adaptive approximation and generalization of deep neural network with intrinsic dimensionality. The Journal of Machine Learning Research, 21(1):7018–7055.
  37. A Stochastic Approximation Method. The Annals of Mathematical Statistics, 22(3):400 – 407.
  38. Robinson, P. M. (2011). Asymptotic theory for nonparametric regression with spatial data. Journal of Econometrics, 165(1):5–19.
  39. Group sparse regularization for deep neural networks. Neurocomputing, 241:81–89.
  40. Schmidt-Hieber, J. (2020). Nonparametric regression using deep neural networks with relu activation function. Ann. Statist., 48(4):1875–1897.
  41. Uncertainty quantification for online learning and stochastic approximation via hierarchical incremental gradient descent. arXiv preprint arXiv:1802.04876.
  42. Geostatistics for large datasets. In Advances and challenges in space-time modelling of natural events, pages 55–77. Springer.
  43. Deep neural network classifier for multi-dimensional functional data. Scandinavian Journal of Statistics.
  44. Spatio-temporal statistics with R. CRC Press.
  45. Yarotsky, D. (2017). Error bounds for approximations with deep relu networks. Neural Networks, 94:103–114.
  46. Deep compositional spatial models. Journal of the American Statistical Association, pages 1–22.
  47. Deep integro-difference equation models for spatio-temporal forecasting. Spatial Statistics, 37:100408.
Citations (6)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now