2000 character limit reached
Empirical Bayes for the Reluctant Frequentist (2404.03422v1)
Published 4 Apr 2024 in stat.ME
Abstract: Empirical Bayes methods offer valuable tools for a large class of compound decision problems. In this tutorial we describe some basic principles of the empirical Bayes paradigm stressing their frequentist interpretation. Emphasis is placed on recent developments of nonparametric maximum likelihood methods for estimating mixture models. A more extensive introductory treatment will eventually be available in \citet{kg24}. The methods are illustrated with an extended application to models of heterogeneous income dynamics based on PSID data.
- Arellano M (2003) Panel Data Econometrics. Oxford U. Press
- Balestra P, Nerlove M (1966) Pooling cross section and time series data in the estimation of a dynamic model: The demand for natural gas. Econometrica 34:585–612
- Beckett L, Diaconis P (1994) Spectral analysis for discrete longitudinal data. Advances in Mathematics 103:107–128
- Blundell R (2014) Income dynamics and life-cycle inequality: Mechanisms and controversies. The Economic Journal 124:289–318
- Bühlmann H, Straub E (1970) Galubwürdigkeit für schadensätze. Bulletin of Swiss Association of Actuaries pp 111–133
- Castillo I, van der Vaart A (2012) Needles and straw in a haystack: Posterior concentration for possibly sparse sequences. Annals of Statistics 40:2069–2101
- Chamberlain G, Hirano K (1999) Predictive distribution based on longitudinal earnings data. Annales d’ Économie et de Statistique 55/56:211–242
- Chamberlain G, Leamer EE (1976) Matrix weighted averages and posterior bounds. Journal of the Royal Statistical Society Series B (Methodological) 38:73–84
- Chen X, Liao Z (2014) Sieve m inference on irregular parameters. Journal of Econometrics 182:70–86
- Cox DR (1975) A note on partially Bayes inference and the linear model. Biometrika 62:651–654
- Deaton A (2018–) Deaton review of inequalities, https://ifs.org.uk/inequality/
- Efron B (2014) Two Modeling Strategies for Empirical Bayes Estimation. Statistical Science 29:285 – 301
- Efron B (2016) Empirical Bayes deconvolution estimates. Biometrika 103:1–20
- Efron B, Morris C (1973) Combining possibly related estimation problems. Journal of the Royal Statistical Society Series B 35:379–421
- Friedman M (1957) Theory of the Consumption Function. Princeton University Press
- Geweke J, Keane M (2000) An empirical analysis of earnings dynamics among men in the PSID: 1968 - 1989. Journal of Econometrics 96:293–356
- Gu J, Koenker R (2017a) Empirical Bayesball remixed: Empirical Bayes methods for longitudinal data. Journal of Applied Econometrics 32:575–599
- Gu J, Koenker R (2017b) Unobserved heterogeneity in income dynamics: An empirical Bayes perspective. Journal of Business and Economic Statistics 35:1–16
- Gu J, Koenker R (2022) Ranking and selection from pairwise comparisons: Empirical bayes methods for citation analysis. AEA Papers and Proceedings 112:624–629
- Gu J, Koenker R (2023) Invidious comparisons: Ranking and selection as compound decisions. Econometrica 91:1–41
- Han Q, Wellner JA (2016) Approximation and estimation of s-concave densities via Rényi divergences. The Annals of Statistics 44:1332 – 1359
- Harvey AC (1990) Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press
- Heckman J, Singer B (1984) A method for minimizing the impact of distributional assumptions in econometric models for duration data. Econometrica 52:63–132
- Hirano K (2002) Semiparametric Bayesian inference in autoregressive panel data models. Econometrica 70:781–799
- Hospido L (2012) Modelling heterogeneity and dynamics in the volatility of individual wages. Journal of Applied Econometrics 27:386–411
- van Houwelingen J, Stijnen T (1983) Monotone Empirical Bayes Estimators for the Continuous One-parameter Exponential Family. Statistica Neerlandica 37:29–43
- Ignatiadis N, Sen B (2023) Empirical partially Bayes multiple testing and compound χ2superscript𝜒2\chi^{2}italic_χ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT decisions. Available from: https://arxiv.org/abs/2303.02887
- Jiang W, Zhang CH (2009) General maximum likelihood empirical Bayes estimation of normal means. Annals of Statistics 37:1647–1684
- Johnstone I, Silverman B (2004) Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Annals of Statistics 32:1594–1649
- Kiefer J, Wolfowitz J (1956) Consistency of the maximum likelihood estimator in the presence of infinitely many incidental parameters. The Annals of Mathematical Statistics 27:887–906
- Kline PM, Walters CR (2021) Reasonable doubt: Experimental detection of job-level employment discrimination. Econometrica 89:765–792
- Koenker R, Mizera I (2010) Quasi-concave density estimation. The Annals of Statistics 38(5):2998–3027
- Koenker R, Mizera I (2018) Shape Constrained Density Estimation Via Penalized Rényi Divergence. Statistical Science 33:510 – 526
- Laird N (1978) Nonparametric maximum likelihood estimation of a mixing distribution. Journal of the American Statistical Association 73:805–811
- Leamer EE, Chamberlain G (1976) A Bayesian interpretation of pretesting. Journal of the Royal Statistical Society Series B (Methodological) 38:85–94
- Lindley DV, Smith AF (1972) Bayes estimates for the linear model. Journal of the Royal Statistical Society Series B pp 1–41
- Lindsay B (1995) Mixture models: theory, geometry and applications. In: NSF-CBMS regional conference series in probability and statistics
- Liu J (1996) Nonparametric hierarchical Bayes via sequential imputations. The Annals of Statistics 24(3):911–930
- Meghir C, Pistaferri L (2004) Income variance dynamics and heterogeneity. Econometrica 72:1–32
- Murphy SA, van der Vaart AW (2000) On profile likelihood. Journal of the American Statistical Association 95:449–465
- Pfanzagl J (1988) Consistency of maximum likelihood estimators for certain nonparametric families, in particular: mixtures. Journal of Statistical Planning and Inference 19:137–158
- Robbins H (1950) A generalization of the method of maximum likelihood: Estimating a mixing distribution (abstract). The Annals of Mathematical Statistics 21:314–315
- Savage LJ (1954) Foundations of Statistics. Wiley
- Stigler SM (1990) A Galtonian Perspective on Shrinkage Estimators. Statistical Science 5:147 – 155
- Teicher H (1961) Identifiability of Mixtures. The Annals of Mathematical Statistics 32:244–248
- Teicher H (1967) Identifiability of mixtures of product measures. The Annals of Mathematical Statistics 38:1300–1302
- Tweedie MCK (1947) Functions of a statistical variate with given means, with special reference to Laplacian distributions. Mathematical Proceedings of the Cambridge Philosophical Society 43:41–49
- Wald A (1950) Statistical Decision Functions. Wiley
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.