Gaussian distributional structural equation models: A framework for modeling latent heteroscedasticity (2404.14124v2)
Abstract: Accounting for the complexity of psychological theories requires methods that can predict not only changes in the means of latent variables -- such as personality factors, creativity, or intelligence -- but also changes in their variances. Structural equation modeling (SEM) is the framework of choice for analyzing complex relationships among latent variables, but the modeling of latent variances as a function of other latent variables is a task that current methods only support to a limited extent. In this paper, we develop a Bayesian framework for Gaussian distributional SEM which broadens the scope of feasible models for latent heteroscedasticity. We use statistical simulation to validate our framework across four distinct model structures, in which we demonstrate that reliable statistical inferences can be achieved and that computation can be performed with sufficient efficiency for practical everyday use. We illustrate our framework's applicability in a real-world case study that addresses a substantive hypothesis from personality psychology.
- Javier Enrique Aguilar and Paul-Christian Bürkner “Intuitive Joint Priors for Bayesian Linear Multilevel Models: The R2D2M2 Prior” In Electronic Journal of Statistics 17.1, 2023 DOI: 10.1214/23-EJS2136
- “Routinely Randomize Potential Sources of Measurement Reactivity to Estimate and Adjust for Biases in Subjective Reports.” In Psychological Methods 26.2, 2021, pp. 175–185 DOI: 10.1037/met0000294
- Tihomir Asparouhov, Ellen L. Hamaker and Bengt Muthén “Dynamic Structural Equation Models” In Structural Equation Modeling: A Multidisciplinary Journal 25.3, 2018, pp. 359–388 DOI: 10.1080/10705511.2017.1406803
- Daniel J. Bauer and Andrea M. Hussong “Psychometric Approaches for Developing Commensurate Measures across Independent Studies: Traditional and New Models.” In Psychological Methods 14.2, 2009, pp. 101–125 DOI: 10.1037/a0015583
- Michael Betancourt “A Conceptual Introduction to Hamiltonian Monte Carlo” In arXiv preprint, 2018 DOI: 10.48550/arXiv.1701.02434
- Florence Bockting, Stefan T. Radev and Paul-Christian Bürkner “Simulation-Based Prior Knowledge Elicitation for Parametric Bayesian Models” In arXiv preprint, 2023 DOI: 10.48550/arXiv.2308.11672
- Kenneth A Bollen “Structural Equations with Latent Variables” John Wiley & Sons, 1989
- Paul-Christian Bürkner “Brms : An R Package for Bayesian Multilevel Models Using Stan” In Journal of Statistical Software 80.1, 2017 DOI: 10.18637/jss.v080.i01
- Paul-Christian Bürkner “Advanced Bayesian Multilevel Modeling with the R Package Brms” In The R Journal 10.1, 2018, pp. 395 DOI: 10.32614/RJ-2018-017
- Paul-Christian Bürkner “Bayesian Item Response Modeling in R with Brms and Stan” In Journal of Statistical Software 100, 2021, pp. 1–54 DOI: 10.18637/jss.v100.i05
- “Posterior: Tools for Working with Posterior Distributions”, 2023
- Paul-Christian Bürkner, Maximilian Scholz and Stefan T. Radev “Some Models Are Useful, but How Do We Know Which Ones? Towards a Unified Bayesian Model Taxonomy” In Statistics Surveys 17, 2023 DOI: 10.1214/23-SS145
- “Fitting Structural Equation Models via Variational Approximations” In Structural Equation Modeling: A Multidisciplinary Journal 29.6, 2022, pp. 839–853 DOI: 10.1080/10705511.2022.2053857
- “Regression: Models, Methods and Applications” Berlin, Heidelberg: Springer Berlin Heidelberg, 2021 DOI: 10.1007/978-3-662-63882-8
- Jonah Gabry, Rok Češnovar and Andrew Johnson “Cmdstanr: R Interface to ’CmdStan”’, 2023
- “Bayesian Data Analysis”, Chapmann & Hall / CRC Texts in Statistical Science Series Boca Raton, Fla.: CRC Press, Taylor & Francis, 2014
- Andrew Gelman, Daniel Simpson and Michael Betancourt “The Prior Can Generally Only Be Understood in the Context of the Likelihood” In Entropy 19.10, 2017, pp. 555 DOI: 10.3390/e19100555
- “Bayesian Workflow” In arXiv preprint, 2020 DOI: 10.48550/arXiv.2011.01808
- Benjamin Graves and Edgar C. Merkle “A Note on Identification Constraints and Information Criteria in Bayesian Latent Variable Models” In Behavior Research Methods 54.2, 2021, pp. 795–804 DOI: 10.3758/s13428-021-01649-8
- Andrew C Harvey “Estimating Regression Models with Multiplicative Heteroscedasticity” In Econometrica: journal of the Econometric Society JSTOR, 1976, pp. 461–465 DOI: 10.2307/1913974
- David J. Hessen and Conor V. Dolan “Heteroscedastic One-Factor Models and Marginal Maximum Likelihood Estimation” In British Journal of Mathematical and Statistical Psychology 62.1, 2009, pp. 57–77 DOI: 10.1348/000711007X248884
- “Exploring Factor Model Parameters across Continuous Variables with Local Structural Equation Models” In Multivariate Behavioral Research 51.2-3, 2016, pp. 257–258 DOI: 10.1080/00273171.2016.1142856
- Matthew D Hoffman and Andrew Gelman “The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo.” In Journal of Machine Learning Research 15.1, 2014, pp. 1593–1623
- Alicia A. Johnson, Miles Q. Ott and Mine Dogucu “Bayes Rules!: An Introduction to Applied Bayesian Modeling” Boca Raton: Chapman and Hall/CRC, 2022 DOI: 10.1201/9780429288340
- K.G. Jöreskog “Simultaneous Factor Analysis in Several Populations” In Psychometrika 36.4, 1971, pp. 409–426 DOI: 10.1007/BF02291366
- “SBC: Simulation Based Calibration for Rstan/Cmdstanr Models”, 2023
- “Maximum Likelihood Estimation of Latent Interaction Effects with the LMS Method” In Psychometrika 65.4, 2000, pp. 457–474 DOI: 10.1007/BF02296338
- Rex B. Kline “Principles and Practice of Structural Equation Modeling”, Methodology in the Social Sciences New York: The Guilford Press, 2016
- Tony Lancaster “The Incidental Parameter Problem since 1948” In Journal of Econometrics 95.2, 2000, pp. 391–413 DOI: 10.1016/S0304-4076(99)00044-5
- William Michael Landau “The Targets R Package: A Dynamic Make-like Function-Oriented Pipeline Toolkit for Reproducibility and High-Performance Computing” In Journal of Open Source Software 6.57, 2021, pp. 2959
- Sik-Yum Lee “Structural Equation Modeling: A Bayesian Approach”, Wiley Series in Probability and Statistics Chichester, England ; Hoboken, NJ: Wiley, 2007
- “Measurement Invariance in the Social Sciences: Historical Development, Methodological Challenges, State of the Art, and Future Perspectives” In Social Science Research 110, 2023, pp. 102805 DOI: 10.1016/j.ssresearch.2022.102805
- “Emotional (in)Stability: Neuroticism Is Associated with Increased Variability in Negative Emotion after All” In Proceedings of the National Academy of Sciences 120.23, 2023, pp. e2212154120 DOI: 10.1073/pnas.2212154120
- Edgar C. Merkle, Daniel Furr and Sophia Rabe-Hesketh “Bayesian Comparison of Latent Variable Models: Conditional Versus Marginal Likelihoods” In Psychometrika 84.3, 2019, pp. 802–829 DOI: 10.1007/s11336-019-09679-0
- “Efficient Bayesian Structural Equation Modeling in Stan” In Journal of Statistical Software 100.6, 2021 DOI: 10.18637/jss.v100.i06
- “Opaque Prior Distributions in Bayesian Latent Variable Models” In arXiv preprint, 2023
- “Simulation-Based Calibration Checking for Bayesian Computation: The Choice of Test Quantities Shapes Sensitivity” In arXiv preprint, 2023
- Dylan Molenaar “Heteroscedastic Latent Trait Models for Dichotomous Data” In Psychometrika 80.3, 2015, pp. 625–644 DOI: 10.1007/s11336-014-9406-0
- Dylan Molenaar, Conor V. Dolan and Norman D. Verhelst “Testing and Modelling Non-Normality within the One-Factor Model” In British Journal of Mathematical and Statistical Psychology 63.2, 2010, pp. 293–317 DOI: 10.1348/000711009X456935
- Dylan Molenaar, Conor V. Dolan and Han L.J. Maas “Modeling Ability Differentiation in the Second-Order Factor Model” In Structural Equation Modeling: A Multidisciplinary Journal 18.4, 2011, pp. 578–594 DOI: 10.1080/10705511.2011.607095
- “Detecting Specific Genotype by Environment Interactions Using Marginal Maximum Likelihood Estimation in the Classical Twin Design” In Behavior Genetics 42.3, 2012, pp. 483–499 DOI: 10.1007/s10519-011-9522-x
- Amanda K. Montoya “Selecting a Within- or Between-Subject Design for Mediation: Validity, Causality, and Statistical Power” In Multivariate Behavioral Research 58.3, 2023, pp. 616–636 DOI: 10.1080/00273171.2022.2077287
- J. Neyman and Elizabeth L. Scott “Consistent Estimates Based on Partially Consistent Observations” In Econometrica 16.1, 1948, pp. 1–32 DOI: 10.2307/1914288
- Omiros Papaspiliopoulos, Gareth O. Roberts and Martin Sköld “A General Framework for the Parametrization of Hierarchical Models” In Statistical Science 22.1, 2007 DOI: 10.1214/088342307000000014
- R Core Team “R: A Language and Environment for Statistical Computing”, 2023
- “Why Full, Partial, or Approximate Measurement Invariance Are Not a Prerequisite for Meaningful and Valid Group Comparisons” In Structural Equation Modeling: A Multidisciplinary Journal 30.6, 2023, pp. 859–870 DOI: 10.1080/10705511.2023.2191292
- “That’s a Lot to Process! Pitfalls of Popular Path Models” In Advances in Methods and Practices in Psychological Science 5.2, 2022, pp. 251524592210958 DOI: 10.1177/25152459221095827
- Teemu Säilynoja, Paul-Christian Bürkner and Aki Vehtari “Graphical Test for Discrete Uniformity and Its Applications in Goodness-of-Fit Evaluation and Multiple Sample Comparison” In Statistics and Computing 32.2, 2022, pp. 32 DOI: 10.1007/s11222-022-10090-6
- Stan Development Team “Stan Modeling Language Users Guide and Reference Manual, 2.33”, 2023
- “Validating Bayesian Inference Algorithms with Simulation-Based Calibration” In arXiv preprint, 2020 DOI: 10.48550/arXiv.1804.06788
- “The Influence of Multivariate Selection on the Factorial Analysis of Ability.” In British Journal of Psychology 29.3 United Kingdom: British Psychological Society, 1939, pp. 288–306 DOI: 10.1111/j.2044-8295.1939.tb00919.x
- S.J. Erp “Bayesian Structural Equation Modeling: The Power of the Prior” In Gildeprint, 2020
- “Rank-Normalization, Folding, and Localization: An Improved R^^𝑅\hat{R}over^ start_ARG italic_R end_ARG for Assessing Convergence of MCMC (with Discussion)” In Bayesian Analysis 16.2, 2021 DOI: 10.1214/20-BA1221
- “Applied Causal Inference Methods for Sequential Mediators” In BMC Medical Research Methodology 22.1, 2022, pp. 301 DOI: 10.1186/s12874-022-01764-w
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.