Papers
Topics
Authors
Recent
Search
2000 character limit reached

On some extensions of shape-constrained generalized additive modelling in R

Published 14 Mar 2024 in stat.CO | (2403.09438v2)

Abstract: Regression models that incorporate smooth functions of predictor variables to explain the relationships with a response variable have gained widespread usage and proved successful in various applications. By incorporating smooth functions of predictor variables, these models can capture complex relationships between the response and predictors while still allowing for interpretation of the results. In situations where the relationships between a response variable and predictors are explored, it is not uncommon to assume that these relationships adhere to certain shape constraints. Examples of such constraints include monotonicity and convexity. The scam package for R has become a popular package to carry out the full fitting of exponential family generalized additive modelling with shape restrictions on smooths. The paper aims to extend the existing framework of shape-constrained generalized additive models (SCAM) to accommodate smooth interactions of covariates, linear functionals of shape-constrained smooths and incorporation of residual autocorrelation. The methods described in this paper are implemented in the recent version of the package scam, available on the Comprehensive R Archive Network (CRAN).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Penalized wavelet monotone regression. Statistics & probability letters, 77(16):1608–1621, 2007.
  2. Simple and multiple P-splines regression with shape constraints. British Journal of Mathematical and Statistical Psychology, 59:451–469, 2006.
  3. A. Brezger and W. J. Steiner. Monotonic regression based on Bayesian P-splines: An application to estimating price response functions from store-level scanner data. Journal of business & economic statistics, 26(1):90–104, 2008.
  4. Y. Chen and R. J. Samworth. Generalized additive and index models with shape constraints. JRSS (B), 78(4):729–754, 2016.
  5. G. Cheng. Semiparametric additive isotonic regression. J Stat Plan Inference, 139(6):1980–1991, 2009.
  6. Empirical likelihood inferences for the semiparametric additive isotonic regression. Journal of Multivariate Analysis, 112:172–182, 2012.
  7. H. Dette and R. Scheder. Strictly monotone and smooth nonparametric regression for two or more variables. Canadian Journal of Statistics, 34(4):535–561, 2006.
  8. Nonparametric kernel regression with multiple predictors and multiple shape constraints. Statistica Sinica, pages 1347–1371, 2013.
  9. D. Dunson. Bayesian semiparametric isotonic regression for count data. JASA, 100(470):618–627, 2005.
  10. D. Dunson and B. Neelon. Bayesian inference on order-constrained parameters in glm. Biometrics, 59:286–295, 2003.
  11. Flexible smoothing with b-splines and penalties. Statistical science, 11(2):89–121, 1996.
  12. Z. Fang and N. Meinshausen. Lasso isotone for high-dimensional additive isotonic regression. J Comput Graph Stat, 21(1):72–91, 2012.
  13. W. H. Fellner. Robust estimation of variance components. Technometrics, 28(1):51–60, 1986.
  14. Estimation of a convex function: characterizations and asymptotic theory. The Annals of Statistics, 29(6):1653–1698, 2001.
  15. The support reduction algorithm for computing non-parametric function estimates in mixture models. Scandinavian Journal of Statistics, 35(3):385–399, 2008.
  16. A. Guntuboyina and B. Sen. Global risk bounds and adaptation in univariate convex regression. Probability Theory and Related Fields, 163(1):379–411, 2015.
  17. P. Hall and L.-S. Huang. Nonparametric kernel regression subject to monotonicity constraints. The Annals of Statistics, 29(3):624–647, 2001.
  18. X. He and P. Shi. Monotone B-spline smoothing. JASA, 93(442):643–650, 1998.
  19. C. Holmes and N. Heard. Generalized monotonic regression using random change points. Statistics in Medicine, 22:623–638, 2003.
  20. C. Kelly and J. Rice. Monotone smoothing with application to dose-response curves and the assessment of synergism. Biometrics, 46:1071–1085, 1990.
  21. S. Lang and A. Brezger. Bayesian P-splines. J Comput Graph Stat, 13(1):183–212, 2004.
  22. L. Lin and D. B. Dunson. Bayesian monotone regression using gaussian process projection. Biometrika, 101(2):303–317, 2014.
  23. E. Mammen. Estimating a smooth monotone regression function. The Annals of Statistics, pages 724–740, 1991.
  24. E. Mammen and K. Yu. Additive isotone regression. In Asymptotics: particles, processes and inverse problems, pages 179–195. Institute of Mathematical Statistics, 2007.
  25. M. C. Meyer. A framework for estimation and inference in generalized additive models with shape and order restrictions. Statistical Science, 33(4):595–614, 2018.
  26. N. Pya. scam: Shape Constrained Additive Models, 2024. URL https://CRAN.R-project.org/package=scam.  R package version 1.2-16.
  27. N. Pya and S. N. Wood. Shape constrained additive models. Statistics and computing, 25:543–559, 2015.
  28. J. Ramsay. Monotone regression splines in action. Stats. Science, 3(4):425–461, 1988.
  29. V. Rousson. Monotone fitting for developmental variables. Journal of Applied Statistics, 35(6):659–670, 2008.
  30. R. Schall. Estimation in generalized linear models with random effects. Biometrika, 78(4):719–727, 1991.
  31. G. Tutz and F. Leitenstorfer. Generalized smooth monotonic regression in additive modeling. J Comput Graph Stat, 16(1):165–188, 2007.
  32. M. Villalobos and G. Wahba. Inequality-constrained multivariate smoothing splines with application to the estimation of posterior probabilities. JASA, 82(397):239–248, 1987.
  33. J. Wang and M. Meyer. Testing the monotonicity or convexity of a function using regression splines. The Canadian Journal of Statistics, 39(1):89–107, 2011.
  34. L. Wang and L. Xue. Constrained polynomial spline estimation of monotone additive models. J Stat Plan Inference, 167:27–40, 2015.
  35. L. Wang and X.-H. Zhou. Estimation of shape constrained additive models with missing response at random. Journal of Nonparametric Statistics, 33(1):118–133, 2021.
  36. S. Wood. mgcv: Mixed GAM Computation Vehicle with Automatic Smoothness Estimation, 2023. URL https://CRAN.R-project.org/package=mgcv. R package version 1.9.1.
  37. S. N. Wood. Generalized Additive Models: An Introduction with R. CRC press, 2017.
  38. S. N. Wood. Inference and computation with generalized additive models and their extensions. Test, 29(2):307–339, 2020.
  39. S. N. Wood and M. Fasiolo. A generalized fellner-schall method for smoothing parameter optimization with application to tweedie location, scale and shape models. Biometrics, 73(4):1071–1081, 2017.
  40. Generalized additive models for large data sets. JRSS (C), 64(1):139–155, 2015.
  41. K. Yu. On partial linear additive isotonic regression. Journal of the Korean Statistical Society, 43(1):11–17, 2014.
  42. J. Zhang. A simple and efficient monotone smoother using smoothing splines. Journal of Nonparametric Statistics, 16(5):779–796, 2004.

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Authors (1)

  1. Natalya Pya Arnqvist 

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free