Papers
Topics
Authors
Recent
2000 character limit reached

Empirical Bayes for the Reluctant Frequentist (2404.03422v1)

Published 4 Apr 2024 in stat.ME

Abstract: Empirical Bayes methods offer valuable tools for a large class of compound decision problems. In this tutorial we describe some basic principles of the empirical Bayes paradigm stressing their frequentist interpretation. Emphasis is placed on recent developments of nonparametric maximum likelihood methods for estimating mixture models. A more extensive introductory treatment will eventually be available in \citet{kg24}. The methods are illustrated with an extended application to models of heterogeneous income dynamics based on PSID data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (48)
  1. Arellano M (2003) Panel Data Econometrics. Oxford U. Press
  2. Balestra P, Nerlove M (1966) Pooling cross section and time series data in the estimation of a dynamic model: The demand for natural gas. Econometrica 34:585–612
  3. Beckett L, Diaconis P (1994) Spectral analysis for discrete longitudinal data. Advances in Mathematics 103:107–128
  4. Blundell R (2014) Income dynamics and life-cycle inequality: Mechanisms and controversies. The Economic Journal 124:289–318
  5. Bühlmann H, Straub E (1970) Galubwürdigkeit für schadensätze. Bulletin of Swiss Association of Actuaries pp 111–133
  6. Castillo I, van der Vaart A (2012) Needles and straw in a haystack: Posterior concentration for possibly sparse sequences. Annals of Statistics 40:2069–2101
  7. Chamberlain G, Hirano K (1999) Predictive distribution based on longitudinal earnings data. Annales d’ Économie et de Statistique 55/56:211–242
  8. Chamberlain G, Leamer EE (1976) Matrix weighted averages and posterior bounds. Journal of the Royal Statistical Society Series B (Methodological) 38:73–84
  9. Chen X, Liao Z (2014) Sieve m inference on irregular parameters. Journal of Econometrics 182:70–86
  10. Cox DR (1975) A note on partially Bayes inference and the linear model. Biometrika 62:651–654
  11. Deaton A (2018–) Deaton review of inequalities, https://ifs.org.uk/inequality/
  12. Efron B (2014) Two Modeling Strategies for Empirical Bayes Estimation. Statistical Science 29:285 – 301
  13. Efron B (2016) Empirical Bayes deconvolution estimates. Biometrika 103:1–20
  14. Efron B, Morris C (1973) Combining possibly related estimation problems. Journal of the Royal Statistical Society Series B 35:379–421
  15. Friedman M (1957) Theory of the Consumption Function. Princeton University Press
  16. Geweke J, Keane M (2000) An empirical analysis of earnings dynamics among men in the PSID: 1968 - 1989. Journal of Econometrics 96:293–356
  17. Gu J, Koenker R (2017a) Empirical Bayesball remixed: Empirical Bayes methods for longitudinal data. Journal of Applied Econometrics 32:575–599
  18. Gu J, Koenker R (2017b) Unobserved heterogeneity in income dynamics: An empirical Bayes perspective. Journal of Business and Economic Statistics 35:1–16
  19. Gu J, Koenker R (2022) Ranking and selection from pairwise comparisons: Empirical bayes methods for citation analysis. AEA Papers and Proceedings 112:624–629
  20. Gu J, Koenker R (2023) Invidious comparisons: Ranking and selection as compound decisions. Econometrica 91:1–41
  21. Han Q, Wellner JA (2016) Approximation and estimation of s-concave densities via Rényi divergences. The Annals of Statistics 44:1332 – 1359
  22. Harvey AC (1990) Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press
  23. Heckman J, Singer B (1984) A method for minimizing the impact of distributional assumptions in econometric models for duration data. Econometrica 52:63–132
  24. Hirano K (2002) Semiparametric Bayesian inference in autoregressive panel data models. Econometrica 70:781–799
  25. Hospido L (2012) Modelling heterogeneity and dynamics in the volatility of individual wages. Journal of Applied Econometrics 27:386–411
  26. van Houwelingen J, Stijnen T (1983) Monotone Empirical Bayes Estimators for the Continuous One-parameter Exponential Family. Statistica Neerlandica 37:29–43
  27. Ignatiadis N, Sen B (2023) Empirical partially Bayes multiple testing and compound χ2superscript𝜒2\chi^{2}italic_χ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT decisions. Available from: https://arxiv.org/abs/2303.02887
  28. Jiang W, Zhang CH (2009) General maximum likelihood empirical Bayes estimation of normal means. Annals of Statistics 37:1647–1684
  29. Johnstone I, Silverman B (2004) Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Annals of Statistics 32:1594–1649
  30. Kiefer J, Wolfowitz J (1956) Consistency of the maximum likelihood estimator in the presence of infinitely many incidental parameters. The Annals of Mathematical Statistics 27:887–906
  31. Kline PM, Walters CR (2021) Reasonable doubt: Experimental detection of job-level employment discrimination. Econometrica 89:765–792
  32. Koenker R, Mizera I (2010) Quasi-concave density estimation. The Annals of Statistics 38(5):2998–3027
  33. Koenker R, Mizera I (2018) Shape Constrained Density Estimation Via Penalized Rényi Divergence. Statistical Science 33:510 – 526
  34. Laird N (1978) Nonparametric maximum likelihood estimation of a mixing distribution. Journal of the American Statistical Association 73:805–811
  35. Leamer EE, Chamberlain G (1976) A Bayesian interpretation of pretesting. Journal of the Royal Statistical Society Series B (Methodological) 38:85–94
  36. Lindley DV, Smith AF (1972) Bayes estimates for the linear model. Journal of the Royal Statistical Society Series B pp 1–41
  37. Lindsay B (1995) Mixture models: theory, geometry and applications. In: NSF-CBMS regional conference series in probability and statistics
  38. Liu J (1996) Nonparametric hierarchical Bayes via sequential imputations. The Annals of Statistics 24(3):911–930
  39. Meghir C, Pistaferri L (2004) Income variance dynamics and heterogeneity. Econometrica 72:1–32
  40. Murphy SA, van der Vaart AW (2000) On profile likelihood. Journal of the American Statistical Association 95:449–465
  41. Pfanzagl J (1988) Consistency of maximum likelihood estimators for certain nonparametric families, in particular: mixtures. Journal of Statistical Planning and Inference 19:137–158
  42. Robbins H (1950) A generalization of the method of maximum likelihood: Estimating a mixing distribution (abstract). The Annals of Mathematical Statistics 21:314–315
  43. Savage LJ (1954) Foundations of Statistics. Wiley
  44. Stigler SM (1990) A Galtonian Perspective on Shrinkage Estimators. Statistical Science 5:147 – 155
  45. Teicher H (1961) Identifiability of Mixtures. The Annals of Mathematical Statistics 32:244–248
  46. Teicher H (1967) Identifiability of mixtures of product measures. The Annals of Mathematical Statistics 38:1300–1302
  47. Tweedie MCK (1947) Functions of a statistical variate with given means, with special reference to Laplacian distributions. Mathematical Proceedings of the Cambridge Philosophical Society 43:41–49
  48. Wald A (1950) Statistical Decision Functions. Wiley
Citations (1)

Summary

We haven't generated a summary for this paper yet.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.