Network Learning with Directional Sign Patterns (2403.14915v2)
Abstract: Complex systems can be effectively modeled via graphs that encode networked interactions, where relations between entities or nodes are often quantified by signed edge weights, e.g., promotion/inhibition in gene regulatory networks, or encoding political of friendship differences in social networks. However, it is often the case that only an aggregate consequence of such edge weights that characterize relations may be directly observable, as in protein expression of in gene regulatory networks. Thus, learning edge weights poses a significant challenge that is further exacerbated for intricate and large-scale networks. In this article, we address a model problem to determine the strength of sign-indefinite relations that explain marginal distributions that constitute our data. To this end, we develop a paradigm akin to that of the Schr\"odinger bridge problem and an efficient Sinkhorn type algorithm (more properly, Schr\"odinger-Fortet-Sinkhorn algorithm) that allows fast convergence to parameters that minimize a relative entropy/likelihood criterion between the sought signed adjacency matrix and a prior. The formalism that we present represents a novel generalization of the earlier Schr\"odinger formalism in that marginal computations may incorporate weights that model directionality in underlying relations, and further, that it can be extended to high-order networks -- the Schr\"odinger-Fortet-Sinkhorn algorithm that we derive is applicable all the same and allows geometric convergence to a sought sign-indefinite adjacency matrix or tensor, for high-order networks. We demonstrate our framework with synthetic and real-world examples.
- The architecture of mutualistic networks minimizes competition and increases biodiversity. Nature, 458(7241):1018–1020, 2009.
- Network granger causality with inherent grouping structure. The Journal of Machine Learning Research, 16(1):417–453, 2015.
- Claude Berge. Hypergraphs: combinatorics of finite sets, volume 45. Elsevier, 1984.
- Teasing out missing reactions in genome-scale metabolic networks through hypergraph learning. Nature Communications, 14(1):2375, 2023.
- A survey on hyperlink prediction. IEEE Transactions on Neural Networks and Learning Systems, 2023.
- Tensor entropy for uniform hypergraphs. IEEE Transactions on Network Science and Engineering, 7(4):2889–2900, 2020.
- Controllability of hypergraphs. IEEE Transactions on Network Science and Engineering, 8(2):1646–1657, 2021.
- Optimal steering of a linear stochastic system to a final probability distribution, Part I. IEEE Transactions on Automatic Control, 61(5):1158–1169, 2015.
- On the relation between optimal transport and Schrödinger bridges: A stochastic control viewpoint. Journal of Optimization Theory and Applications, 169:671–691, 2016.
- Optimal transport in systems and control. Annual Review of Control, Robotics, and Autonomous Systems, 4:89–113, 2021.
- Stochastic control liaisons: Richard Sinkhorn meets Gaspard Monge on a Schrödinger bridge. SIAM Review, 63(2):249–313, 2021.
- System identification: A machine learning perspective. Annual Review of Control, Robotics, and Autonomous Systems, 2:281–304, 2019.
- Quantitative analysis of ecological networks. Cambridge University Press, 2021.
- Signal processing on signed graphs: Fundamentals and potentials. IEEE Signal Processing Magazine, 37(6):86–98, 2020.
- Data assimilation for sign-indefinite priors: A generalization of Sinkhorn’s algorithm. arXiv preprint: 2308.11791, 2023.
- Promotion/inhibition effects in networks: A model with negative probabilities. arXiv preprint: 2307.07738, 2023.
- Traversing the schrödinger bridge strait: Robert fortet’s marvelous proof redux. Journal of Optimization Theory and Applications, 181(1):23–60, 2019.
- Evaluation of the performance of information theory-based methods and cross-correlation to estimate the functional connectivity in cortical networks. PloS one, 4(8):e6482, 2009.
- Tryphon T Georgiou. Relative entropy and the multivariable multidimensional moment problem. IEEE Transactions on Information Theory, 52(3):1052–1066, 2006.
- Positive contraction mappings for classical and quantum Schrödinger systems. Journal of Mathematical Physics, 56(3), 2015.
- Clark Jeffries. Qualitative stability and digraphs in model ecosystems. Ecology, 55(6):1415–1419, 1974.
- DO Logofet and NB Ulianov. Sign stability in model ecosystems: a complete class of sign-stable patterns. Ecological modelling, 16(2-4):173–189, 1982.
- On the convergence of the coordinate descent method for convex differentiable minimization. Journal of Optimization Theory and Applications, 72(1):7–35, 1992.
- Mehran Mesbahi. Graph theoretic methods in multiagent networks. Princeton University Press, 2010.
- Mark Newman. Networks. Oxford university press, 2018.
- Computational optimal transport: With applications to data science. Foundations and Trends® in Machine Learning, 11(5-6):355–607, 2019.
- Compartmentalization increases food-web persistence. Proceedings of the National Academy of Sciences, 108(9):3648–3652, 2011.
- Hypergraph similarity measures. IEEE Transactions on Network Science and Engineering, 10(2):658–674, 2022.
- Solution of the quasispecies model for an arbitrary gene network. Physical Review E, 70(2):021903, 2004.
- Mider: network inference with mutual information distance and entropy reduction. PloS one, 9(5):e96732, 2014.
- Advantages to modeling relational data using hypergraphs versus graphs. In 2016 IEEE High Performance Extreme Computing Conference (HPEC), pages 1–7. IEEE, 2016.
- Edge-dual graph preserving sign prediction for signed social networks. IEEE Access, 5:19383–19392, 2017.
- Graph transformer networks. Advances in neural information processing systems, 32, 2019.
- Thomas Zaslavsky. Signed graphs. Discrete Applied Mathematics, 4(1):47–74, 1982.
- Anqi Dong (14 papers)
- Can Chen (64 papers)
- Tryphon T. Georgiou (89 papers)