Papers
Topics
Authors
Recent
2000 character limit reached

Causal Structure Learning by Using Intersection of Markov Blankets (2307.00227v1)

Published 1 Jul 2023 in stat.ML and cs.LG

Abstract: In this paper, we introduce a novel causal structure learning algorithm called Endogenous and Exogenous Markov Blankets Intersection (EEMBI), which combines the properties of Bayesian networks and Structural Causal Models (SCM). Furthermore, we propose an extended version of EEMBI, namely EEMBI-PC, which integrates the last step of the PC algorithm into EEMBI.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. Latent dirichlet allocation. Journal of Machine Learning Research, 3(1):993–1022, 2003.
  2. Kenneth A Bollen. Structural equations with latent variables, volume 210. John Wiley & Sons, 1989.
  3. Cam: Causal additive models, high-dimensional order search and penalized regression. The Annals of Statistics, pages 2526–2556, 2014.
  4. David Maxwell Chickering. Optimal structure identification with greedy search. Journal of Machine Learning Research, 3(11):507–554, 2002.
  5. Order-independent constraint-based causal structure learning. Journal of Machine Learning Research, 15(1):3741–3782, 2014.
  6. David F Crouse. On implementing 2d rectangular assignment algorithms. IEEE Transactions on Aerospace and Electronic Systems, 52(4):1679–1696, 2016.
  7. Interventions and causal inference. Philosophy of Science, 74(5):981–995, 2007.
  8. Causal inference in statistics: A primer. John Wiley & Sons, 2016.
  9. Characterization and greedy learning of interventional markov equivalence classes of directed acyclic graphs. Journal of Machine Learning Research, 13(1):2409–2464, 2012.
  10. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840–6851, 2020.
  11. Stochastic variational inference. Journal of Machine Learning Research, 2013.
  12. Causal discovery from heterogeneous/nonstationary data. Journal of Machine Learning Research, 21(1):3482–3534, 2020.
  13. Aapo Hyvarinen. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3):626–634, 1999.
  14. Independent component analysis: algorithms and applications. Neural Networks, 13(4-5):411–430, 2000.
  15. Diviyan Kalainathan. causal discovery box, 2018. URL https://fentechsolutions.github.io/CausalDiscoveryToolbox/html/index.html.
  16. Structural agnostic modeling: Adversarial learning of causal graphs. Journal of Machine Learning Research, 23(219):1–62, 2022.
  17. Functional analysis. Elsevier, 2016.
  18. Auto-encoding variational bayes. International Conference on Learning Representations, 2013.
  19. An introduction to variational autoencoders. Foundations and Trends® in Machine Learning, 12(4):307–392, 2019.
  20. Probabilistic graphical models: principles and techniques. MIT press, 2009.
  21. Greedy relaxations of the sparsest permutation algorithm. In Uncertainty in Artificial Intelligence, pages 1052–1062, 2022.
  22. Feature selection: A data perspective. ACM computing surveys (CSUR), 50(6):1–45, 2017.
  23. Autocross: Automatic feature crossing for tabular data in real-world applications. page 1936–1945. Association for Computing Machinery, 2019. ISBN 9781450362016. doi: 10.1145/3292500.3330679.
  24. Daniel Marbach. Dream 3, 2008. URL https://www.synapse.org/#!Synapse:syn2853594/wiki/71567.
  25. Dimitris Margaritis. Learning bayesian network model structure from data. Technical report, Carnegie-Mellon Univ Pittsburgh Pa School of Computer Science, 2003.
  26. Christopher Meek. Causal inference and causal explanation with background knowledge. arXiv preprint arXiv:1302.4972, 2013.
  27. Conditional mutual information estimation for mixed, discrete and continuous data. IEEE Transactions on Information Theory, 67(1):464–484, 2020.
  28. Foundations of structural causal models with cycles and latent variables by stephan bongers, patrick forre, jonas peters 2, bernhard. arXiv preprint arXiv:1611.06221, 2016.
  29. Judea Pearl. Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan kaufmann, 1988.
  30. Using markov blankets for causal structure learning. Journal of Machine Learning Research, 9(7), 2008.
  31. Causal protein-signaling networks derived from multiparameter single-cell data. Science, 308(5721):523–529, 2005.
  32. The graph neural network model. IEEE Transactions on Neural Networks, 20(1):61–80, 2008.
  33. Marco Scutari. bnlearn, 2023. URL https://www.bnlearn.com/.
  34. Who learns better bayesian network structures: Constraint-based, score-based or hybrid algorithms? In International Conference on Probabilistic Graphical Models, pages 416–427. Proceedings of Machine Learning Research, 2018.
  35. A linear non-gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7(10), 2006.
  36. Directlingam: A direct method for learning a linear non-gaussian structural equation model. Journal of Machine Learning Research, 12(4):1225–1248, 2011.
  37. Deep unsupervised learning using nonequilibrium thermodynamics. In International Conference on Machine Learning, pages 2256–2265. Proceedings of Machine Learning Research, 2015.
  38. Causal inference in the presence of latent variables and selection bias. UAI’95, page 499–506, San Francisco, CA, USA, 1995. Morgan Kaufmann Publishers Inc. ISBN 1558603859.
  39. An algorithm for causal inference in the presence of latent variables and selection bias in computation, causation and discovery, 1999.
  40. M.Ide T.Ikeuchi, G.Haraoka. Lingam, 2023. URL https://lingam.readthedocs.io/en/latest/index.html.
  41. Algorithms for large scale markov blanket discovery. In FLAIRS conference, volume 2, pages 376–380. St. Augustine, FL, 2003.
  42. The max-min hill-climbing bayesian network structure learning algorithm. Machine Learning, 65:31–78, 2006.
  43. Dags with no tears: Continuous optimization for structure learning. Advances in Neural Information Processing Systems, 31, 2018.
  44. Yujia Zheng. causal-learn, 2021. URL https://causal-learn.readthedocs.io/en/latest/index.html.
  45. Graph neural networks: A review of methods and applications. AI open, 1:57–81, 2020.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Authors (2)

  1. Yiran Dong
  2. Chuanhou Gao

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up