Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Conditional Instrumental Variable Regression with Representation Learning for Causal Inference (2310.01865v1)

Published 3 Oct 2023 in cs.LG and cs.AI

Abstract: This paper studies the challenging problem of estimating causal effects from observational data, in the presence of unobserved confounders. The two-stage least square (TSLS) method and its variants with a standard instrumental variable (IV) are commonly used to eliminate confounding bias, including the bias caused by unobserved confounders, but they rely on the linearity assumption. Besides, the strict condition of unconfounded instruments posed on a standard IV is too strong to be practical. To address these challenging and practical problems of the standard IV method (linearity assumption and the strict condition), in this paper, we use a conditional IV (CIV) to relax the unconfounded instrument condition of standard IV and propose a non-linear CIV regression with Confounding Balancing Representation Learning, CBRL.CIV, for jointly eliminating the confounding bias from unobserved confounders and balancing the observed confounders, without the linearity assumption. We theoretically demonstrate the soundness of CBRL.CIV. Extensive experiments on synthetic and two real-world datasets show the competitive performance of CBRL.CIV against state-of-the-art IV-based estimators and superiority in dealing with the non-linear situation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Alberto Abadie. Semiparametric instrumental variable estimation of treatment response models. Journal of Econometrics, 113(2):231–263, 2003.
  2. The costs of low birth weight. The Quarterly Journal of Economics, 120(3):1031–1083, 2005.
  3. Estimation of the parameters of a single equation in a complete system of stochastic equations. The Annals of Mathematical Statistics, 20(1):46–63, 1949.
  4. Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90(430):431–442, 1995.
  5. On making causal claims: A review and recommendations. The leadership quarterly, 21(6):1086–1120, 2010.
  6. Deep generalized method of moments for instrumental variable analysis. In Advances in Neural Information Processing Systems 32, NeurIPS, pp.  3559–3569, 2019.
  7. Generalized instrumental variables. In UAI ’02, Proceedings of the 18th Conference in Uncertainty in Artificial Intelligence, pp.  85–93, 2002.
  8. David Card. Using geographic variation in college proximity to estimate the return to schooling. NBER Working Papers 4483, National Bureau of Economic Research, Inc, 1993.
  9. Estimation of nonparametric conditional moment models with possibly nonsmooth generalized residuals. Econometrica, 80(1):277–321, 2012.
  10. Data-driven causal effect estimation based on graphical causal modelling: A survey. CoRR, abs/2208.09590, 2022a.
  11. Ancestral instrument method for causal inference without complete knowledge. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI, pp.  4843–4849, 2022b.
  12. Causal inference with conditional instruments using deep generative models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pp.  7122–7130, 2023.
  13. Double/debiased machine learning for treatment and structural parameters. The Econometrics Journal, 21(1):C1–C68, 2018.
  14. A semiparametric instrumental variable approach to optimal treatment regimes under endogeneity. Journal of the American Statistical Association, 116(533):162–173, 2021.
  15. Hal Daumé III. Frustratingly easy domain adaptation. In Proc. of the 45th Annual Meeting of the Association of Computational Linguistics, 2007, pp.  256–263, 2007.
  16. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research, 12:2121–2159, 2011.
  17. Sander Greenland. An introduction to instrumental variables for epidemiologists. International Journal of Epidemiology, 29(4):722–729, 2000.
  18. Sander Greenland. Quantifying biases in causal models: classical confounding vs collider-stratification bias. Epidemiology, pp.  300–306, 2003.
  19. A survey of learning causality with data: Problems and methods. ACM Computing Surveys (CSUR), 53(4):1–37, 2020.
  20. Deep IV: A flexible approach for counterfactual prediction. In Proceedings of the 34th International Conference on Machine Learning, pp.  1414–1423, 2017.
  21. Learning disentangled representations for counterfactual regression. In 8th International Conference on Learning Representations, ICLR, pp.  1–11, 2020.
  22. Instruments for causal inference: an epidemiologist’s dream? Epidemiology, pp.  360–372, 2006.
  23. Causal Inference. CRC Boca Raton, FL, 2010.
  24. Jennifer L Hill. Bayesian nonparametric modeling for causal inference. Journal of Computational and Graphical Statistics, 20(1):217–240, 2011.
  25. Guido W Imbens. Instrumental variables: An Econometrician’s Perspective. Statistical Science, 29(3):323–358, 2014.
  26. Causal Inference in Statistics, Social, and Biomedical Sciences. Cambridge University Press, 2015.
  27. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  28. Deep learning. Nature, 521(7553):436–444, 2015.
  29. One-stage deep instrumental variable method for causal inference from observational data. In 2019 IEEE International Conference on Data Mining (ICDM), pp.  419–428, 2019.
  30. Instrumental variable estimation of nonparametric models. Econometrica, 71(5):1565–1578, 2003.
  31. Judea Pearl. Causality. Cambridge University Press, 2009.
  32. The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1):41–55, 1983.
  33. Estimating individual treatment effect: generalization bounds and algorithms. In International Conference on Machine Learning, pp. 3076–3085. PMLR, 2017.
  34. Identification of joint interventional distributions in recursive semi-markovian causal models. In Proceedings, The Twenty-First National Conference on Artificial Intelligence and the Eighteenth Innovative Applications of Artificial Intelligence Conference, pp.  1219–1226, 2006.
  35. Kernel instrumental variable regression. In Proceedings of the 33rd International Conference on Neural Information Processing Systems, pp.  4593–4605, 2019.
  36. Instrumental variable estimation with the R package ivtools. Epidemiologic Methods, 8(1), 2019.
  37. Causation, Prediction, and Search. MIT Press, 2000.
  38. Machine learning estimation of heterogeneous treatment effects with instruments. In Advances in Neural Information Processing Systems 32, NeurIPS, pp.  15167–15176, 2019.
  39. Efficiently finding conditional instruments for causal inference. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI, pp.  3243–3249, 2015.
  40. Estimating individualized causal effect with confounded instruments. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp.  1857–1867, 2022.
  41. Instrumental variable regression with confounder balancing. In International Conference on Machine Learning, pp. 24056–24075. PMLR, 2022.
  42. Learning deep features in instrumental variable regression. In International Conference on Learning Representations, pp. 1–28, 2021.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now