Comparative Study of Causal Discovery Methods for Cyclic Models with Hidden Confounders (2401.13009v2)
Abstract: Nowadays, the need for causal discovery is ubiquitous. A better understanding of not just the stochastic dependencies between parts of a system, but also the actual cause-effect relations, is essential for all parts of science. Thus, the need for reliable methods to detect causal directions is growing constantly. In the last 50 years, many causal discovery algorithms have emerged, but most of them are applicable only under the assumption that the systems have no feedback loops and that they are causally sufficient, i.e. that there are no unmeasured subsystems that can affect multiple measured variables. This is unfortunate since those restrictions can often not be presumed in practice. Feedback is an integral feature of many processes, and real-world systems are rarely completely isolated and fully measured. Fortunately, in recent years, several techniques, that can cope with cyclic, causally insufficient systems, have been developed. And with multiple methods available, a practical application of those algorithms now requires knowledge of the respective strengths and weaknesses. Here, we focus on the problem of causal discovery for sparse linear models which are allowed to have cycles and hidden confounders. We have prepared a comprehensive and thorough comparative study of four causal discovery techniques: two versions of the LLC method [10] and two variants of the ASP-based algorithm [11]. The evaluation investigates the performance of those techniques for various experiments with multiple interventional setups and different dataset sizes.
- “Optuna: A Next-generation Hyperparameter Optimization Framework” In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2019
- “Foundations of structural causal models with cycles and latent variables” In The Annals of Statistics 49.5 Institute of Mathematical Statistics, 2021, pp. 2885–2915
- Frederick Eberhardt, Patrik Hoyer and Richard Scheines “Combining experiments to discover linear cyclic models with latent variables” In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 2010, pp. 185–192 JMLR WorkshopConference Proceedings
- Patrick Forré and Joris M Mooij “Constraint-based causal discovery for non-linear structural causal models with cycles and latent confounders” In arXiv preprint arXiv:1807.03024, 2018
- Patrick Forré and Joris M Mooij “Markov properties for graphical models with cycles and latent variables” In arXiv preprint arXiv:1710.08775, 2017
- “Potassco: The Potsdam answer set solving collection” In Ai Communications 24.2 Citeseer, 2011, pp. 107–124
- “The stable model semantics for logic programming.” In ICLP/SLP 88, 1988, pp. 1070–1080 Cambridge, MA
- “Nonlinear causal discovery with additive noise models” In Advances in neural information processing systems 21, 2008
- Antti Hyttinen, Frederick Eberhardt and Patrik O Hoyer “Causal discovery for linear cyclic models with latent variables” In Proceedings of the Fifth European Workshop on Probabilistic Graphical Models (PGM 2010), 2010, pp. 153–160 Citeseer
- Antti Hyttinen, Frederick Eberhardt and Patrik O Hoyer “Learning linear cyclic causal models with latent variables” In The Journal of Machine Learning Research 13.1 JMLR. org, 2012, pp. 3387–3439
- Antti Hyttinen, Frederick Eberhardt and Matti Järvisalo “Constraint-based Causal Discovery: Conflict Resolution with Answer Set Programming.” In UAI, 2014, pp. 340–349
- “Discovering cyclic causal models by independent components analysis” In arXiv preprint arXiv:1206.3273, 2012
- Sara Magliacane, Tom Claassen and Joris M Mooij “Ancestral causal inference” In Advances in Neural Information Processing Systems 29, 2016
- “Distinguishing cause from effect using observational data: methods and benchmarks” In The Journal of Machine Learning Research 17.1 JMLR. org, 2016, pp. 1103–1204
- Judea Pearl “Causality” Cambridge university press, 2009
- Jonas Peters, Dominik Janzing and Bernhard Schölkopf “Elements of causal inference: foundations and learning algorithms” The MIT Press, 2017
- Kari Rantanen, Antti Hyttinen and Matti Järvisalo “Discovering causal graphs with cycles and latent confounders: An exact branch-and-bound approach” In International Journal of Approximate Reasoning 117 Elsevier, 2020, pp. 29–49
- Kari Rantanen, Antti Hyttinen and Matti Järvisalo “Learning optimal cyclic causal graphs from interventional data” In International Conference on Probabilistic Graphical Models, 2020, pp. 365–376 PMLR
- Thomas S Richardson “A discovery algorithm for directed cyclic graphs” In arXiv preprint arXiv:1302.3599, 2013
- “BACKSHIFT: Learning causal cyclic graphs from unknown shift interventions” In Advances in Neural Information Processing Systems 28, 2015
- “Causal discovery of feedback networks with functional magnetic resonance imaging” In bioRxiv Cold Spring Harbor Laboratory, 2018, pp. 245936
- “A linear non-Gaussian acyclic model for causal discovery.” In Journal of Machine Learning Research 7.10, 2006
- Eric V Strobl “A constraint-based algorithm for causal discovery with cycles, latent variables and selection bias” In International Journal of Data Science and Analytics 8 Springer, 2019, pp. 33–56