Papers
Topics
Authors
Recent
2000 character limit reached

Gaussian distributional structural equation models: A framework for modeling latent heteroscedasticity (2404.14124v2)

Published 22 Apr 2024 in stat.ME

Abstract: Accounting for the complexity of psychological theories requires methods that can predict not only changes in the means of latent variables -- such as personality factors, creativity, or intelligence -- but also changes in their variances. Structural equation modeling (SEM) is the framework of choice for analyzing complex relationships among latent variables, but the modeling of latent variances as a function of other latent variables is a task that current methods only support to a limited extent. In this paper, we develop a Bayesian framework for Gaussian distributional SEM which broadens the scope of feasible models for latent heteroscedasticity. We use statistical simulation to validate our framework across four distinct model structures, in which we demonstrate that reliable statistical inferences can be achieved and that computation can be performed with sufficient efficiency for practical everyday use. We illustrate our framework's applicability in a real-world case study that addresses a substantive hypothesis from personality psychology.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Javier Enrique Aguilar and Paul-Christian Bürkner “Intuitive Joint Priors for Bayesian Linear Multilevel Models: The R2D2M2 Prior” In Electronic Journal of Statistics 17.1, 2023 DOI: 10.1214/23-EJS2136
  2. “Routinely Randomize Potential Sources of Measurement Reactivity to Estimate and Adjust for Biases in Subjective Reports.” In Psychological Methods 26.2, 2021, pp. 175–185 DOI: 10.1037/met0000294
  3. Tihomir Asparouhov, Ellen L. Hamaker and Bengt Muthén “Dynamic Structural Equation Models” In Structural Equation Modeling: A Multidisciplinary Journal 25.3, 2018, pp. 359–388 DOI: 10.1080/10705511.2017.1406803
  4. Daniel J. Bauer and Andrea M. Hussong “Psychometric Approaches for Developing Commensurate Measures across Independent Studies: Traditional and New Models.” In Psychological Methods 14.2, 2009, pp. 101–125 DOI: 10.1037/a0015583
  5. Michael Betancourt “A Conceptual Introduction to Hamiltonian Monte Carlo” In arXiv preprint, 2018 DOI: 10.48550/arXiv.1701.02434
  6. Florence Bockting, Stefan T. Radev and Paul-Christian Bürkner “Simulation-Based Prior Knowledge Elicitation for Parametric Bayesian Models” In arXiv preprint, 2023 DOI: 10.48550/arXiv.2308.11672
  7. Kenneth A Bollen “Structural Equations with Latent Variables” John Wiley & Sons, 1989
  8. Paul-Christian Bürkner “Brms : An R Package for Bayesian Multilevel Models Using Stan” In Journal of Statistical Software 80.1, 2017 DOI: 10.18637/jss.v080.i01
  9. Paul-Christian Bürkner “Advanced Bayesian Multilevel Modeling with the R Package Brms” In The R Journal 10.1, 2018, pp. 395 DOI: 10.32614/RJ-2018-017
  10. Paul-Christian Bürkner “Bayesian Item Response Modeling in R with Brms and Stan” In Journal of Statistical Software 100, 2021, pp. 1–54 DOI: 10.18637/jss.v100.i05
  11. “Posterior: Tools for Working with Posterior Distributions”, 2023
  12. Paul-Christian Bürkner, Maximilian Scholz and Stefan T. Radev “Some Models Are Useful, but How Do We Know Which Ones? Towards a Unified Bayesian Model Taxonomy” In Statistics Surveys 17, 2023 DOI: 10.1214/23-SS145
  13. “Fitting Structural Equation Models via Variational Approximations” In Structural Equation Modeling: A Multidisciplinary Journal 29.6, 2022, pp. 839–853 DOI: 10.1080/10705511.2022.2053857
  14. “Regression: Models, Methods and Applications” Berlin, Heidelberg: Springer Berlin Heidelberg, 2021 DOI: 10.1007/978-3-662-63882-8
  15. Jonah Gabry, Rok Češnovar and Andrew Johnson “Cmdstanr: R Interface to ’CmdStan”’, 2023
  16. “Bayesian Data Analysis”, Chapmann & Hall / CRC Texts in Statistical Science Series Boca Raton, Fla.: CRC Press, Taylor & Francis, 2014
  17. Andrew Gelman, Daniel Simpson and Michael Betancourt “The Prior Can Generally Only Be Understood in the Context of the Likelihood” In Entropy 19.10, 2017, pp. 555 DOI: 10.3390/e19100555
  18. “Bayesian Workflow” In arXiv preprint, 2020 DOI: 10.48550/arXiv.2011.01808
  19. Benjamin Graves and Edgar C. Merkle “A Note on Identification Constraints and Information Criteria in Bayesian Latent Variable Models” In Behavior Research Methods 54.2, 2021, pp. 795–804 DOI: 10.3758/s13428-021-01649-8
  20. Andrew C Harvey “Estimating Regression Models with Multiplicative Heteroscedasticity” In Econometrica: journal of the Econometric Society JSTOR, 1976, pp. 461–465 DOI: 10.2307/1913974
  21. David J. Hessen and Conor V. Dolan “Heteroscedastic One-Factor Models and Marginal Maximum Likelihood Estimation” In British Journal of Mathematical and Statistical Psychology 62.1, 2009, pp. 57–77 DOI: 10.1348/000711007X248884
  22. “Exploring Factor Model Parameters across Continuous Variables with Local Structural Equation Models” In Multivariate Behavioral Research 51.2-3, 2016, pp. 257–258 DOI: 10.1080/00273171.2016.1142856
  23. Matthew D Hoffman and Andrew Gelman “The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo.” In Journal of Machine Learning Research 15.1, 2014, pp. 1593–1623
  24. Alicia A. Johnson, Miles Q. Ott and Mine Dogucu “Bayes Rules!: An Introduction to Applied Bayesian Modeling” Boca Raton: Chapman and Hall/CRC, 2022 DOI: 10.1201/9780429288340
  25. K.G. Jöreskog “Simultaneous Factor Analysis in Several Populations” In Psychometrika 36.4, 1971, pp. 409–426 DOI: 10.1007/BF02291366
  26. “SBC: Simulation Based Calibration for Rstan/Cmdstanr Models”, 2023
  27. “Maximum Likelihood Estimation of Latent Interaction Effects with the LMS Method” In Psychometrika 65.4, 2000, pp. 457–474 DOI: 10.1007/BF02296338
  28. Rex B. Kline “Principles and Practice of Structural Equation Modeling”, Methodology in the Social Sciences New York: The Guilford Press, 2016
  29. Tony Lancaster “The Incidental Parameter Problem since 1948” In Journal of Econometrics 95.2, 2000, pp. 391–413 DOI: 10.1016/S0304-4076(99)00044-5
  30. William Michael Landau “The Targets R Package: A Dynamic Make-like Function-Oriented Pipeline Toolkit for Reproducibility and High-Performance Computing” In Journal of Open Source Software 6.57, 2021, pp. 2959
  31. Sik-Yum Lee “Structural Equation Modeling: A Bayesian Approach”, Wiley Series in Probability and Statistics Chichester, England ; Hoboken, NJ: Wiley, 2007
  32. “Measurement Invariance in the Social Sciences: Historical Development, Methodological Challenges, State of the Art, and Future Perspectives” In Social Science Research 110, 2023, pp. 102805 DOI: 10.1016/j.ssresearch.2022.102805
  33. “Emotional (in)Stability: Neuroticism Is Associated with Increased Variability in Negative Emotion after All” In Proceedings of the National Academy of Sciences 120.23, 2023, pp. e2212154120 DOI: 10.1073/pnas.2212154120
  34. Edgar C. Merkle, Daniel Furr and Sophia Rabe-Hesketh “Bayesian Comparison of Latent Variable Models: Conditional Versus Marginal Likelihoods” In Psychometrika 84.3, 2019, pp. 802–829 DOI: 10.1007/s11336-019-09679-0
  35. “Efficient Bayesian Structural Equation Modeling in Stan” In Journal of Statistical Software 100.6, 2021 DOI: 10.18637/jss.v100.i06
  36. “Opaque Prior Distributions in Bayesian Latent Variable Models” In arXiv preprint, 2023
  37. “Simulation-Based Calibration Checking for Bayesian Computation: The Choice of Test Quantities Shapes Sensitivity” In arXiv preprint, 2023
  38. Dylan Molenaar “Heteroscedastic Latent Trait Models for Dichotomous Data” In Psychometrika 80.3, 2015, pp. 625–644 DOI: 10.1007/s11336-014-9406-0
  39. Dylan Molenaar, Conor V. Dolan and Norman D. Verhelst “Testing and Modelling Non-Normality within the One-Factor Model” In British Journal of Mathematical and Statistical Psychology 63.2, 2010, pp. 293–317 DOI: 10.1348/000711009X456935
  40. Dylan Molenaar, Conor V. Dolan and Han L.J. Maas “Modeling Ability Differentiation in the Second-Order Factor Model” In Structural Equation Modeling: A Multidisciplinary Journal 18.4, 2011, pp. 578–594 DOI: 10.1080/10705511.2011.607095
  41. “Detecting Specific Genotype by Environment Interactions Using Marginal Maximum Likelihood Estimation in the Classical Twin Design” In Behavior Genetics 42.3, 2012, pp. 483–499 DOI: 10.1007/s10519-011-9522-x
  42. Amanda K. Montoya “Selecting a Within- or Between-Subject Design for Mediation: Validity, Causality, and Statistical Power” In Multivariate Behavioral Research 58.3, 2023, pp. 616–636 DOI: 10.1080/00273171.2022.2077287
  43. J. Neyman and Elizabeth L. Scott “Consistent Estimates Based on Partially Consistent Observations” In Econometrica 16.1, 1948, pp. 1–32 DOI: 10.2307/1914288
  44. Omiros Papaspiliopoulos, Gareth O. Roberts and Martin Sköld “A General Framework for the Parametrization of Hierarchical Models” In Statistical Science 22.1, 2007 DOI: 10.1214/088342307000000014
  45. R Core Team “R: A Language and Environment for Statistical Computing”, 2023
  46. “Why Full, Partial, or Approximate Measurement Invariance Are Not a Prerequisite for Meaningful and Valid Group Comparisons” In Structural Equation Modeling: A Multidisciplinary Journal 30.6, 2023, pp. 859–870 DOI: 10.1080/10705511.2023.2191292
  47. “That’s a Lot to Process! Pitfalls of Popular Path Models” In Advances in Methods and Practices in Psychological Science 5.2, 2022, pp. 251524592210958 DOI: 10.1177/25152459221095827
  48. Teemu Säilynoja, Paul-Christian Bürkner and Aki Vehtari “Graphical Test for Discrete Uniformity and Its Applications in Goodness-of-Fit Evaluation and Multiple Sample Comparison” In Statistics and Computing 32.2, 2022, pp. 32 DOI: 10.1007/s11222-022-10090-6
  49. Stan Development Team “Stan Modeling Language Users Guide and Reference Manual, 2.33”, 2023
  50. “Validating Bayesian Inference Algorithms with Simulation-Based Calibration” In arXiv preprint, 2020 DOI: 10.48550/arXiv.1804.06788
  51. “The Influence of Multivariate Selection on the Factorial Analysis of Ability.” In British Journal of Psychology 29.3 United Kingdom: British Psychological Society, 1939, pp. 288–306 DOI: 10.1111/j.2044-8295.1939.tb00919.x
  52. S.J. Erp “Bayesian Structural Equation Modeling: The Power of the Prior” In Gildeprint, 2020
  53. “Rank-Normalization, Folding, and Localization: An Improved R^^𝑅\hat{R}over^ start_ARG italic_R end_ARG for Assessing Convergence of MCMC (with Discussion)” In Bayesian Analysis 16.2, 2021 DOI: 10.1214/20-BA1221
  54. “Applied Causal Inference Methods for Sequential Mediators” In BMC Medical Research Methodology 22.1, 2022, pp. 301 DOI: 10.1186/s12874-022-01764-w
Citations (3)

Summary

We haven't generated a summary for this paper yet.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

Github Logo Streamline Icon: https://streamlinehq.com
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.