Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 33 tok/s
Gemini 2.5 Pro 51 tok/s Pro
GPT-5 Medium 24 tok/s Pro
GPT-5 High 26 tok/s Pro
GPT-4o 74 tok/s Pro
Kimi K2 188 tok/s Pro
GPT OSS 120B 362 tok/s Pro
Claude Sonnet 4.5 34 tok/s Pro
2000 character limit reached

A General Framework for Random Effects Models for Binary, Ordinal, Count Type and Continuous Dependent Variables Including Variable Selection (2404.17792v1)

Published 27 Apr 2024 in stat.ME

Abstract: A general random effects model is proposed that allows for continuous as well as discrete distributions of the responses. Responses can be unrestricted continuous, bounded continuous, binary, ordered categorical or given in the form of counts. The distribution of the responses is not restricted to exponential families, which is a severe restriction in generalized mixed models. Generalized mixed models use fixed distributions for responses, for example the Poisson distribution in count data, which has the disadvantage of not accounting for overdispersion. By using a response function and a thresholds function the proposed mixed thresholds model can account for a variety of alternative distributions that often show better fits than fixed distributions used within the generalized linear model framework. A particular strength of the model is that it provides a tool for joint modeling, responses may be of different types, some can be discrete, others continuous. In addition to introducing the mixed thresholds model parameter sparsity is addressed. Random effects models can contain a large number of parameters, in particular if effects have to be assumed as measurement-specific. Methods to obtain sparser representations are proposed and illustrated. The methods are shown to work in the thresholds model but could also be adapted to other modeling approaches.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Variance component models with binary response: Interviewer variability. Journal of the Royal Statistical Society Series B 47, 203–210.
  2. Marginal maximum likelihood estimation of item parameters: An application of an EM algorithm. Psychometrika 46, 443–459.
  3. Flexible quasi-beta regression models for continuous bounded data. Statistical Modelling 19(6), 617–633.
  4. Likelihood analysis for a class of beta mixed models. Journal of Applied Statistics 42(2), 252–266.
  5. glmmtmb balances speed and flexibility among packages for zero-inflated generalized linear mixed modeling. The R journal 9(2), 378–400.
  6. Eilers, P. H. and B. D. Marx (2021). Practical Smoothing: The Joys of P-splines. Cambridge University Press.
  7. Regression. Models, Methods and Applications. Berlin: Springer Verlag.
  8. Revisiting dispersion in count data item response theory models: The Conway–Maxwell–Poisson counts model. British Journal of Mathematical and Statistical Psychology 73(1), 32–50.
  9. Regularization and predictor selection for ordinal and categorical data. In Trends and Challenges in Categorical Data Analysis: Statistical Modelling and Interpretation, pp.  199–232. Springer.
  10. Gueorguieva, R. (2001). A multivariate generalized linear mixed model for joint modelling of clustered outcomes in the exponential family. Statistical modelling 1(3), 177–193.
  11. Describing heterogenous effects in stratified ordinal contingency tables, with applications to multi-center clinical trials. Computational Statistics & Data Analysis 35(4), 429–449.
  12. Harville, D. A. and R. W. Mee (1984). A mixed-model procedure for analyzing ordered categorical data. Biometrics 40, 393–408.
  13. The Elements of Statistical Learning (Second Edition). New York: Springer-Verlag.
  14. Hedeker, D. and R. B. Gibbons (1994). A random-effects ordinal regression model for multilevel analysis. Biometrics 50, 933–944.
  15. Hsiao, C. (1986). Analysis of Panel Data. Cambridge: Cambridge University Press.
  16. Joint modeling of survival and longitudinal data: likelihood approach revisited. Biometrics 62(4), 1037–1043.
  17. Mixed models approaches for joint modeling of different types of responses. Journal of Biopharmaceutical Statistics 26(4), 601–618.
  18. Jansen, J. (1990). On the statistical analysis of ordinal data when extravariation is present. Applied Statistics 39, 74–85.
  19. Linear and generalized linear mixed models and their applications, Volume 1. Springer.
  20. Jones, R. H. (1993). Longitudinal Data with Serial Correlation: A State-Space Approach. London: Chapman & Hall.
  21. Kieschnick, R. and B. D. McCullough (2003). Regression analysis of variates observed on (0, 1): percentages, proportions and fractions. Statistical modelling 3(3), 193–213.
  22. Lindsey, J. J. (1993). Models for Repeated Measurements. Oxford: Oxford University Press.
  23. Liu, Q. and D. A. Pierce (1994). A note on Gauss-Hermite quadrature. Biometrika 81, 624–629.
  24. A joint modeling approach for reaction time and accuracy in psycholinguistic experiments. Psychometrika 76, 487–503.
  25. Generalized, Linear, and Mixed Models. New York: Wiley.
  26. The group lasso for logistic regression. Journal of the Royal Statistical Society, Series B 70, 53–71.
  27. An extended random-effects approach to modeling repeated, overdispersed count data. Lifetime data analysis 13, 513–531.
  28. A uniform framework for the combination of penalties in generalized structured models. Advances in Data Analysis and Classification 11, 97–120.
  29. Simplex mixed-effects models for longitudinal proportional data. Scandinavian Journal of Statistics 35(4), 577–596.
  30. Rodríguez, G. (2008). Multilevel generalized linear models. In Handbook of multilevel analysis, pp.  335–376. Springer.
  31. Schauberger, G. (2024). Package multordrs.
  32. A mixed effects model for overdispersed count data in animal breeding. Biometrics, 265–279.
  33. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society B 58, 267–288.
  34. Tutz, G. (2022). Item response thresholds models: A general class of models for varying types of items. Psychometrika (87), 1238–1269.
  35. Regularized regression for categorical data. Statistical Modelling 16, 161–200.
  36. Random effects in ordinal regression models. Computational Statistics and Data Analysis 22, 537–557.
  37. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society B 68, 49–67.
  38. Negative binomial mixed models for analyzing microbiome count data. BMC bioinformatics 18, 1–10.

Summary

We haven't generated a summary for this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (1)

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 post and received 0 likes.