Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Generalizing Inferences from Trials to Target Populations (2402.17042v2)

Published 26 Feb 2024 in stat.ME, cs.AI, cs.LG, and econ.EM

Abstract: Randomized Controlled Trials (RCTs) are pivotal in generating internally valid estimates with minimal assumptions, serving as a cornerstone for researchers dedicated to advancing causal inference methods. However, extending these findings beyond the experimental cohort to achieve externally valid estimates is crucial for broader scientific inquiry. This paper delves into the forefront of addressing these external validity challenges, encapsulating the essence of a multidisciplinary workshop held at the Institute for Computational and Experimental Research in Mathematics (ICERM), Brown University, in Fall 2023. The workshop congregated experts from diverse fields including social science, medicine, public health, statistics, computer science, and education, to tackle the unique obstacles each discipline faces in extrapolating experimental findings. Our study presents three key contributions: we integrate ongoing efforts, highlighting methodological synergies across fields; provide an exhaustive review of generalizability and transportability based on the workshop's discourse; and identify persistent hurdles while suggesting avenues for future research. By doing so, this paper aims to enhance the collective understanding of the generalizability and transportability of causal effects, fostering cross-disciplinary collaboration and offering valuable insights for researchers working on refining and applying causal inference methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Building representative matched samples with multi-valued treatments in large observational studies. 29(4):744–757.
  2. Methods for integrating trials and non-experimental data to examine treatment effect heterogeneity. arXiv preprint arXiv:2302.13428.
  3. Generalizing evidence from randomized trials using inverse probability of sampling weights. Journal of the Royal Statistical Society Series A: Statistics in Society, 181(4):1193–1209.
  4. Enhancing treatment effect estimation: A model robust approach integrating randomized experiments and external controls using the double penalty integration estimator. In Uncertainty in Artificial Intelligence, pages 381–390. PMLR.
  5. Double/debiased machine learning for treatment and structural parameters.
  6. Bayesian ensemble learning. In Advances in Neural Information Processing Systems 19 - Proceedings of the 2006 Conference, pages 265–272.
  7. Generalizing evidence from randomized clinical trials to target populations: The actg 320 trial. American Journal of Epidemiology, 172(1):107–115.
  8. Causal inference methods for combining randomized trials and observational studies: a review. arXiv preprint arXiv:2011.08047.
  9. Extending inferences from a randomized trial to a target population. European journal of epidemiology, 34:719–722.
  10. Generalizing and transporting inferences about the effects of treatment assignment subject to non-adherence. arXiv preprint arXiv:2211.04876.
  11. Efficient and robust methods for causally interpretable meta-analysis: Transporting inferences from multiple randomized trials to a target population. Biometrics.
  12. Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals. Biometrics, 75(2):685–694.
  13. A review of generalizability and transportability. Annual Review of Statistics and Its Application, 10:501–524.
  14. Learning models with uniform performance via distributionally robust optimization. arXiv preprint arXiv:1810.08750.
  15. Elements of external validity: Framework, design, and analysis. American Political Science Review, pages 1–19.
  16. Improving transportability of randomized controlled trial inference using robust predictionmethods. Statistical Methods in Medical Research, page 09622802231210944.
  17. Evaluating ex ante counterfactual predictions using ex post causal inference. arXiv preprint arXiv:1806.07016.
  18. Huang, M. (2022). Sensitivity analysis in the generalization of experimental results. arXiv preprint arXiv:2202.03408.
  19. Leveraging population outcomes to improve the generalization of experimental results: Application to the jtpa study. The Annals of Applied Statistics, 17(3):2139–2164.
  20. Huling, J. H. (2023). Transportability of prinicipal causal effects. ICERM.
  21. Misunderstandings between experimentalists and observationalists about causal inference. Journal of the Royal Statistical Society: Series A (Statistics in Society), 171(2):481–502.
  22. Assessing methods for generalizing experimental impact estimates to target populations. Journal of Research on Educational Effectiveness, 9(1):103–127.
  23. Universal adaptability: Target-independent inference that competes with propensity scoring. Proceedings of the National Academy of Sciences, 119(4):e2108097119.
  24. An introduction to domain adaptation and transfer learning. arXiv preprint arXiv:1812.11806.
  25. Generalizing trial evidence to target populations in non-nested designs: Applications to aids clinical trials. Journal of the Royal Statistical Society Series C: Applied Statistics, 71(3):669–697.
  26. Worth weighting? how to think about and use weights in survey experiments. Political Analysis, 26(3):275–291.
  27. A double machine learning approach to combining experimental and observational data. arXiv preprint arXiv:2307.01449.
  28. Sensitivity analysis for an unobserved moderator in rct-to-target-population generalization of treatment effects. The Annals of Applied Statistics, 11(1):225–247.
  29. External validity in policy evaluations that choose sites purposively. Journal of Policy Analysis and Management, 32(1):107–121.
  30. A survey on transfer learning. IEEE Transactions on knowledge and data engineering, 22(10):1345–1359.
  31. Who are we missing? a principled approach to characterizing the underrepresented population. arXiv preprint arXiv:2401.14512.
  32. Distributionally robust optimization: A review. arXiv preprint arXiv:1908.05659.
  33. Advances in domain adaptation theory. Elsevier.
  34. Regression-based estimation of heterogeneous treatment effects when extending inferences from a randomized trial to a target population. European Journal of Epidemiology, 38(2):123–133.
  35. Robust estimation of encouragement design intervention effects transported across sites. Journal of the Royal Statistical Society Series B: Statistical Methodology, 79(5):1509–1525.
  36. Efficiently transporting average treatment effects using a sufficient subset of effect modifiers. arXiv preprint arXiv:2304.00117.
  37. Robust estimation of encouragement design intervention effects transported across sites. Journal Of The Royal Statistical Society Series B-Statistical Methodology, 79(5):1509–1525.
  38. Beyond randomized clinical trials: use of external controls. Clinical Pharmacology & Therapeutics, 107(4):806–816.
  39. A two-stage method for extending inferences from a collection of trials. arXiv preprint arXiv:2309.03693.
  40. Distributionally robust optimization and generalization in kernel methods. Advances in Neural Information Processing Systems, 32.
  41. Assessing the generalizability of randomized trial results to target populations. Prevention Science, 16:475–485.
  42. The use of propensity scores to assess the generalizability of results from randomized trials: Use of propensity scores to assess generalizability. Journal of the Royal Statistical Society: Series A (Statistics in Society), 174(2):369–386.
  43. Designing randomized experiments to predict unit-specific treatment effects. arXiv preprint arXiv:2310.18500.
  44. Heterogeneity assessment in causal data fusion problems. arXiv preprint arXiv:2208.05543.
  45. A comprehensive survey on transfer learning. Proceedings of the IEEE, 109(1):43–76.
  46. Synthesis estimators for positivity violations with a continuous covariate. arXiv preprint arXiv:2311.09388.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now