Papers
Topics
Authors
Recent
2000 character limit reached

Three-way Cross-Fitting and Pseudo-Outcome Regression for Estimation of Conditional Effects and other Linear Functionals (2306.07230v1)

Published 12 Jun 2023 in stat.ME, math.ST, and stat.TH

Abstract: We propose an approach to better inform treatment decisions at an individual level by adapting recent advances in average treatment effect estimation to conditional average treatment effect estimation. Our work is based on doubly robust estimation methods, which combine flexible machine learning tools to produce efficient effect estimates while relaxing parametric assumptions about the data generating process. Refinements to doubly robust methods have achieved faster convergence by incorporating 3-way cross-fitting, which entails dividing the sample into three partitions, using the first to estimate the conditional probability of treatment, the second to estimate the conditional expectation of the outcome, and the third to perform a first order bias correction step. Here, we combine the approaches of 3-way cross-fitting and pseudo-outcome regression to produce personalized effect estimates. We show that this approach yields fast convergence rates under a smoothness condition on the conditional expectation of the outcome.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. Recursive partitioning for heterogeneous causal effects. Proc. Natl. Acad. Sci. U. S. A., 113(27):7353–7360.
  2. Doubly robust estimation in missing data and causal inference models. Biometrics, 61(4):962–973.
  3. Some new asymptotic theory for least squares series: Pointwise and uniform results. J. Econom., 186(2):345–366.
  4. Bickel, P. J. (1982). On adaptive estimation. Ann. Stat., 10(3):647–671.
  5. Estimating integrated squared density derivatives: Sharp best order of convergence estimates. Sankhyā: The Indian Journal of Statistics, Series A (1961-2002), 50(3):381–393.
  6. Linear regression with censored data. Biometrika, 66(3):429–436.
  7. A general statistical framework for subgroup identification and comparative treatment scoring. Biometrics, 73(4):1199–1209.
  8. Double/debiased machine learning for treatment and structural parameters. Econom. J., 21(1):C1–C68.
  9. Locally robust semiparametric estimation. Econometrica, 90(4):1501–1535.
  10. Automatic debiased machine learning of causal and structural effects. Econometrica, 90(3):967–1027.
  11. Targeted learning ensembles for optimal individualized treatment rules with time-to-event outcomes. Biometrika, 105(3):723–738.
  12. Censored regression: Local linear approximations and their applications. J. Am. Stat. Assoc., 89(426):560–570.
  13. Orthogonal statistical learning.
  14. A note on the expected value of an inverse matrix. Biometrika, 56(3):690–691.
  15. Hill, J. L. (2011). Bayesian nonparametric modeling for causal inference. J. Comput. Graph. Stat., 20(1):217–240.
  16. Estimating treatment effect heterogeneity in randomized program evaluation. aoas, 7(1):443–470.
  17. Kennedy, E. H. (2022a). Semiparametric doubly robust targeted double machine learning: a review.
  18. Kennedy, E. H. (2022b). Towards optimal doubly robust estimation of heterogeneous causal effects.
  19. Sharp instruments for classifying compliers and generalizing causal effects. Ann. Stat.
  20. Minimax rates for heterogeneous causal effect estimation.
  21. Metalearners for estimating heterogeneous treatment effects using machine learning. Proc. Natl. Acad. Sci. U. S. A., 116(10):4156–4165.
  22. Dynamic treatment regimes: technical challenges and applications. Electron. J. Stat., 8(1):1225–1272.
  23. Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy. Ann. Stat., 44(2):713–742.
  24. Super-Learning of an optimal dynamic treatment rule. Int. J. Biostat., 12(1):305–332.
  25. Cross-Fitting and fast remainder rates for semiparametric estimation.
  26. Quasi-oracle estimation of heterogeneous treatment effects. Biometrika.
  27. Some methods for heterogeneous treatment effect estimation in high dimensions. Stat. Med., 37(11):1767–1787.
  28. Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects.
  29. Comment: Performance of double-robust estimators when“ inverse probability” weights are highly variable. Stat. Sci., 22(4):544–559.
  30. Semiparametric efficiency in multivariate regression models with missing data. J. Am. Stat. Assoc., 90(429):122–129.
  31. On profile likelihood: Comment. J. Am. Stat. Assoc., 95(450):477–482.
  32. A general imputation methodology for nonparametric regression with censored data.
  33. A doubly robust censoring unbiased transformation. Int. J. Biostat., 3(1).
  34. Rudelson, M. (1999). Random vectors in the isotropic position. J. Funct. Anal., 164(1):60–72.
  35. Adjusting for nonignorable Drop-Out using semiparametric nonresponse models. J. Am. Stat. Assoc., 94(448):1096–1120.
  36. Schick, A. (1986). On asymptotically efficient estimation in semiparametric models. Ann. Stat., 14(3):1139–1151.
  37. Debiased machine learning of conditional average treatment effects and other causal functions. Econom. J., 24(2):264–289.
  38. A simple method for estimating interactions between a treatment and a large number of covariates. J. Am. Stat. Assoc., 109(508):1517–1532.
  39. Tropp, J. A. (2015). An introduction to matrix concentration inequalities. Foundations and Trends® in Machine Learning, 8(1-2):1–230.
  40. Tsybakov, A. B. (2009). Introduction to nonparametric estimation. Springer Series in Statistics.
  41. van der Laan, M. J. (2006). Statistical inference for variable importance. Int. J. Biostat., 2(1).
  42. Estimating optimal treatment regimes from a classification perspective. Stat, 1(1):103–114.
  43. Estimating individualized treatment rules using outcome weighted learning. J. Am. Stat. Assoc., 107(449):1106–1118.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.