Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
120 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Minimax-Regret Sample Selection in Randomized Experiments (2403.01386v2)

Published 3 Mar 2024 in stat.ME and econ.EM

Abstract: Randomized controlled trials are often run in settings with many subpopulations that may have differential benefits from the treatment being evaluated. We consider the problem of sample selection, i.e., whom to enroll in a randomized trial, such as to optimize welfare in a heterogeneous population. We formalize this problem within the minimax-regret framework, and derive optimal sample-selection schemes under a variety of conditions. Using data from a COVID-19 vaccine trial, we also highlight how different objectives and decision rules can lead to meaningfully different guidance regarding optimal sample allocation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Representation and extrapolation: evidence from clinical trials. Technical report, National Bureau of Economic Research, 2022.
  2. Douglas G Altman. Statistics and ethics in medical research: III how large a sample? British Medical Journal, 281(6251):1336, 1980.
  3. Policy learning with observational data. Econometrica, 89(1):133–161, 2021.
  4. A/b testing with fat tails. Journal of Political Economy, 128(12):4614–000, 2020.
  5. The a/b testing problem with gaussian priors. Journal of Economic Theory, 210:105646, 2023.
  6. Efficacy and safety of the mrna-1273 sars-cov-2 vaccine. New England journal of medicine, 384(5):403–416, 2021.
  7. Fair exploration via axiomatic bargaining. Advances in Neural Information Processing Systems, 34:22034–22045, 2021.
  8. Yuehao Bai. Why randomize? minimax optimality under permutation invariance. Journal of Econometrics, 2021.
  9. A theory of experimenters: Robustness, randomization, and balance. American Economic Review, 110(4):1206–1230, 2020.
  10. Centers for Disease Control and Prevention. New hospital admissions of patients with confirmed covid-19, united states. https://thednageek.com/the-limits-of-predicting-relationships-using-dna/, 2020. [Online; Accessed October 18, 2023].
  11. Rebecca Dresser. Wanted single, white male for medical research. The Hastings Center Report, 22(1):24–29, 1992.
  12. Food and Drug Administration and others. Guideline for the format and content of the clinical and statistical sections of new drug applications. FDA, U.S. Department of Health and Human Services, Rockville, MA, U.S.A., 1988.
  13. Miguel A Hernán. The hazards of hazard ratios. Epidemiology (Cambridge, Mass.), 21(1):13, 2010.
  14. Asymptotics for statistical treatment rules. Econometrica, 77(5):1683–1701, 2009.
  15. Causal Inference in Statistics, Social, and Biomedical Sciences. Cambridge University Press, 2015.
  16. An mrna vaccine against sars-cov-2—preliminary report. New England journal of medicine, 383(20):1920–1931, 2020.
  17. Nathan Kallus. On the optimality of randomization in experimental design: How to randomize for minimax variance and design-based inference. Journal of the Royal Statistical Society Series B: Statistical Methodology, 83(2):404–409, 2021.
  18. The nash social welfare function. Econometrica: Journal of the Econometric Society, pages 423–435, 1979.
  19. The theory of decision procedures for distributions with monotone likelihood ratio. The Annals of Mathematical Statistics, pages 272–299, 1956.
  20. Who should be treated? empirical welfare maximization methods for treatment choice. Econometrica, 86(2):591–616, 2018.
  21. Serge-Christophe Kolm. Justice and equity. MIT Press, 1997.
  22. Ker-Chau Li. Minimaxity for randomized designs: some general results. The Annals of Statistics, pages 225–239, 1983.
  23. Charles F Manski. Statistical treatment rules for heterogeneous populations. Econometrica, 72(4):1221–1246, 2004.
  24. Sufficient trial size to inform clinical practice. Proceedings of the National Academy of Sciences, 113(38):10518–10523, 2016.
  25. Trial size for near-optimal choice between surveillance and aggressive treatment: Reconsidering mslt-ii. The American Statistician, 73(sup1):305–311, 2019.
  26. Statistical power, sample size, and their reporting in randomized controlled trials. Journal of the American Medical Association, 272(2):122–124, 1994.
  27. Hervé Moulin. Fair division and collective welfare. MIT press, 2004.
  28. John F Jr Nash. The bargaining problem. Econometrica: Journal of the econometric society, pages 155–162, 1950.
  29. Jerzy Neyman. On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection. Journal of the Royal Statistical Society, 97(4):558–606, 1934.
  30. John Rawls. Atheory of justice. Cambridge (Mass.), 1971.
  31. Estimated average treatment effect of psychiatric hospitalization in patients with suicidal behaviors: A precision treatment analysis. JAMA Psychiatry, 2023. ISSN 2168-622X. doi: 10.1001/jamapsychiatry.2023.3994. URL https://doi.org/10.1001/jamapsychiatry.2023.3994.
  32. Leonard J Savage. The theory of statistical decision. Journal of the American Statistical Association, 46(253):55–67, 1951.
  33. Amartya Sen. Collective choice and social welfare. Harvard University Press, 2018.
  34. Gaganpreet Sharma. Pros and cons of different sampling techniques. International journal of applied research, 3(7):749–752, 2017.
  35. Fundamentals of applied research and sampling techniques. International journal of medical and applied sciences, 2(4):124–132, 2013.
  36. Jörg Stoye. Minimax regret treatment choice with finite samples. Journal of Econometrics, 151(1):70–81, 2009.
  37. Jörg Stoye. Minimax regret treatment choice with covariates or with limited validity of experiments. Journal of Econometrics, 166(1):138–156, 2012.
  38. Batch learning from logged bandit feedback through counterfactual risk minimization. Journal of Machine Learning Research, 16:1731–1755, 2015.
  39. Aleksey Tetenov. Statistical treatment choice based on asymmetric minimax regret criteria. Journal of Econometrics, 166(1):157–165, 2012.
  40. United States Census Bureau. Census bureau releases new 2020 census data on age, sex, race, hispanic origin, households and housing. https://www.census.gov/newsroom/press-releases/2023/2020-census-demographic-profile-and-dhc.html, 2020. [Online; Accessed October 19, 2023].
  41. Chien-Fu Wu. On the robustness and efficiency of some randomized designs. The Annals of Statistics, pages 1168–1177, 1981.
  42. Estimating individualized treatment rules using outcome weighted learning. Journal of the American Statistical Association, 107(499):1106–1118, 2012.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets