Identification of Causal Structure with Latent Variables Based on Higher Order Cumulants (2312.11934v1)
Abstract: Causal discovery with latent variables is a crucial but challenging task. Despite the emergence of numerous methods aimed at addressing this challenge, they are not fully identified to the structure that two observed variables are influenced by one latent variable and there might be a directed edge in between. Interestingly, we notice that this structure can be identified through the utilization of higher-order cumulants. By leveraging the higher-order cumulants of non-Gaussian data, we provide an analytical solution for estimating the causal coefficients or their ratios. With the estimated (ratios of) causal coefficients, we propose a novel approach to identify the existence of a causal edge between two observed variables subject to latent variable influence. In case when such a causal edge exits, we introduce an asymmetry criterion to determine the causal direction. The experimental results demonstrate the effectiveness of our proposed method.
- Bekker, P. A.; and ten Josephus Berge. 1997. Generic global indentification in factor analysis. Linear Algebra and its Applications, 264: 255–263.
- Brillinger, D. R. 2001. Time series: data analysis and theory. Society for Industrial and Applied Mathematics.
- Causal Discovery with Latent Confounders Based on Higher-Order Cumulants. International conference on machine learning.
- Causal Discovery in Linear Non-Gaussian Acyclic Model With Multiple Latent Confounders. IEEE Transactions on Neural Networks and Learning Systems.
- Learning high-dimensional directed acyclic graphs with latent and selection variables. The Annals of Statistics, 40(1): 294 – 321.
- The statistical sign test. Journal of the American Statistical Association, 41(236): 557–566.
- Discovering unconfounded causal relationships using linear non-gaussian models. In New Frontiers in Artificial Intelligence: JSAI-isAI 2010 Workshops, LENLS, JURISIN, AMBN, ISS, Tokyo, Japan, November 18-19, 2010, Revised Selected Papers 2, 181–195. Springer.
- Identifiability, separability, and uniqueness of linear ICA models. IEEE Signal Processing Letters, 11(7): 601–604.
- Nonlinear causal discovery with additive noise models. Advances in neural information processing systems, 21.
- Estimation of causal effects using linear non-Gaussian causal models with hidden variables. International Journal of Approximate Reasoning, 49(2): 362–378.
- Latent hierarchical causal structure discovery with rank constraints. Advances in Neural Information Processing Systems, 35: 5549–5561.
- Independent Component Analysis. Wiley.
- Causal clustering for 1-factor measurement models. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 1655–1664.
- Ledermann, W. 1937. On the rank of the reduced correlational matrix in multiple-factor analysis. Psychometrika, 2: 85–93.
- Learning overcomplete representations. Neural Computation, 12(2): 337–365.
- RCD: Repetitive causal discovery of linear non-Gaussian acyclic models with latent confounders. In International Conference on Artificial Intelligence and Statistics, 735–745. PMLR.
- Connectivity-contrastive learning: Combining causal discovery and representation learning for multimodal data. In International Conference on Artificial Intelligence and Statistics, 3399–3426. PMLR.
- Causal protein-signaling networks derived from multiparameter single-cell data. Science, 308(5721): 523–529.
- A linear non-Gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7(10).
- Learning the Structure of Linear Latent Variable Models. Journal of Machine Learning Research, 7(2).
- Causal inference in the presence of latent variables and selection bias. In Conference on Uncertainty in artificial intelligence, 499–506.
- ParceLiNGAM: A causal ordering method robust against latent confounders. Neural computation, 26(1): 57–83.
- Learning linear non-Gaussian polytree models. In Uncertainty in Artificial Intelligence, 1960–1969. PMLR.
- High-dimensional causal discovery under non-Gaussianity. Biometrika, 107(1): 41–59.
- Generalized independent noise condition for estimating latent variable causal graphs. Advances in neural information processing systems, 33: 14891–14902.
- Identification of linear non-gaussian latent hierarchical structure. In International Conference on Machine Learning, 24370–24387. PMLR.