Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Ultra-efficient MCMC for Bayesian longitudinal functional data analysis (2306.07168v2)

Published 12 Jun 2023 in stat.ME and stat.CO

Abstract: Functional mixed models are widely useful for regression analysis with dependent functional data, including longitudinal functional data with scalar predictors. However, existing algorithms for Bayesian inference with these models only provide either scalable computing or accurate approximations to the posterior distribution, but not both. We introduce a new MCMC sampling strategy for highly efficient and fully Bayesian regression with longitudinal functional data. Using a novel blocking structure paired with an orthogonalized basis reparametrization, our algorithm jointly samples the fixed effects regression functions together with all subject- and replicate-specific random effects functions. Crucially, the joint sampler optimizes sampling efficiency for these key parameters while preserving computational scalability. Perhaps surprisingly, our new MCMC sampling algorithm even surpasses state-of-the-art algorithms for frequentist estimation and variational Bayes approximations for functional mixed models -- while also providing accurate posterior uncertainty quantification -- and is orders of magnitude faster than existing Gibbs samplers. Simulation studies show improved point estimation and interval coverage in nearly all simulation settings over competing approaches. We apply our method to a large physical activity dataset to study how various demographic and health factors associate with intraday activity.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Autoregressive Forecasting of Some Functional Climatic Variations. Scandinavian Journal of Statistics 27(4), 673–687.
  2. Fast sampling with Gaussian scale mixture priors in high-dimensional regression. Biometrika 103(4), 985–991.
  3. Functional data analysis characterizes the shapes of the first COVID-19 epidemic wave in Italy. Scientific Reports 11(1), 17054.
  4. Functional linear mixed models for irregularly or sparsely sampled data. Statistical Modelling 16(1), 67–88.
  5. Fast Univariate Inference for Longitudinal Functional Models. Journal of Computational and Graphical Statistics 31(1), 219–230.
  6. Large Scale Population Assessment of Physical Activity Using Wrist Worn Accelerometers: The UK Biobank Study. PLOS ONE 12(2), e0169649.
  7. Expert Panel (2001). Executive Summary of the Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). Journal of the American Medical Association 285(19), 2486–2497.
  8. Gao, Y. and D. R. Kowal (2022). Bayesian adaptive and interpretable functional regression for exposure profiles. arXiv preprint arXiv:2203.00784.
  9. Gelman, A. (2006). Prior distributions for variance parameters in hierarchical models. Bayesian Analysis 1(3).
  10. Bayesian Data Analysis (3rd ed ed.). CRC Press.
  11. Assessing systematic effects of stroke on motor control by using hierarchical function-on-scalar regression. Journal of the Royal Statistical Society: Series C (Applied Statistics) 65(2), 215–236.
  12. refund: Regression with Functional Data. R package version 0.1-24.
  13. Generalized multilevel function-on-scalar regression and principal component analysis. Biometrics 71(2), 344–353.
  14. Guo, W. (2002). Functional Mixed Effects Models. Biometrics 58(1), 121–128.
  15. How many days are needed? Measurement reliability of wearable device data to assess physical activity. PLOS ONE 18(2), e0282162.
  16. Ultra-Fast Approximate Inference Using Variational Functional Mixed Models. Journal of Computational and Graphical Statistics, 1–32.
  17. Kowal, D. R. (2022a). Fast, Optimal, and Targeted Predictions Using Parameterized Decision Analysis. Journal of the American Statistical Association 117(540), 1875–1886.
  18. Kowal, D. R. (2022b). Subset selection for linear mixed models. Biometrics, biom.13707.
  19. Kowal, D. R. and D. C. Bourgeois (2020). Bayesian Function-on-Scalars Regression for High-Dimensional Data. Journal of Computational and Graphical Statistics 29(3), 629–638.
  20. Functional Autoregression for Sparsely Sampled Data. Journal of Business & Economic Statistics 37(1), 97–109.
  21. Bayesian Semiparametric Functional Mixed Models for Serially Correlated Functional Data, With Application to Glaucoma Data. Journal of the American Statistical Association 114(526), 495–513.
  22. Organizing and Analyzing the Activity Data in NHANES. Statistics in Biosciences 11(2), 262–287.
  23. Fixed‐effects inference and tests of correlation for longitudinal functional data. Statistics in Medicine 41(17), 3349–3364.
  24. Liebl, D. (2013). Modeling and forecasting electricity spot prices: A functional data perspective. The Annals of Applied Statistics 7(3).
  25. Morris, J. S. (2017). Comparison and contrast of two general functional regression modelling frameworks. Statistical Modelling 17(1-2), 59–85.
  26. Morris, J. S. and R. J. Carroll (2006). Wavelet-based functional mixed models. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68(2), 179–199.
  27. Nishimura, A. and M. A. Suchard (2022). Prior-Preconditioned Conjugate Gradient Method for Accelerated Gibbs Sampling in “Large n , Large p ” Bayesian Sparse Regression. Journal of the American Statistical Association, 1–14.
  28. Park, S. Y. and A.-M. Staicu (2015). Longitudinal functional data analysis. Stat 4(1), 212–226.
  29. Fast Function-on-Scalar Regression with Penalized Basis Expansions. The International Journal of Biostatistics 6(1).
  30. Rue, H. (2001). Fast Sampling of Gaussian Markov Random Fields. Journal of the Royal Statistical Society Series B: Statistical Methodology 63(2), 325–338.
  31. Spike-and-Slab Priors for Function Selection in Structured Additive Regression Models. Journal of the American Statistical Association 107(500), 1518–1532.
  32. Generalized functional additive mixed models. Electronic Journal of Statistics 10(1).
  33. Functional Additive Mixed Models. Journal of Computational and Graphical Statistics 24(2), 477–501.
  34. Associations of Objectively Assessed Physical Activity and Sedentary Time with All-Cause Mortality in US Adults: The NHANES Study. PLOS ONE 10(3), e0119591.
  35. Using functional data analysis to understand daily activity levels and patterns in primary school-aged children: Cross-sectional analysis of a UK-wide study. PLOS ONE 12(11), e0187677.
  36. A case study of glucose levels during sleep using multilevel fast function on scalar regression inference. Biometrics, biom.13878.
  37. The Predictive Performance of Objective Measures of Physical Activity Derived From Accelerometry Data for 5-Year All-Cause Mortality in Older Adults: National Health and Nutritional Examination Survey 2003–2006. The Journals of Gerontology: Series A 75(9), 1779–1785.
  38. Yu, Y. and X.-L. Meng (2011). To Center or Not to Center: That Is Not the Question—An Ancillarity–Sufficiency Interweaving Strategy (ASIS) for Boosting MCMC Efficiency. Journal of Computational and Graphical Statistics 20(3), 531–570.
  39. Robust, Adaptive Functional Regression in Functional Mixed Model Framework. Journal of the American Statistical Association 106(495), 1167–1179.
  40. FMEM: Functional Mixed Effects Models for Longitudinal Functional Responses. Statistica Sinica 29(4), 2007–2033.
  41. Longitudinal high-dimensional principal components analysis with application to diffusion tensor imaging of multiple sclerosis. The Annals of Applied Statistics 8(4).

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com