Dice Question Streamline Icon: https://streamlinehq.com

Fast algorithms for approximate stochastic p-th roots of large transition matrices

Develop a fast-converging algorithm to compute, for a given stochastic transition matrix M and integer p > 1, a stochastic matrix H that approximates a stochastic p-th root of M by minimizing a matrix divergence K(M, H^p) (for example, Kullback–Leibler divergence or Frobenius norm), with scalability to matrices of the sizes encountered in large origin–destination mobility networks.

Information Square Streamline Icon: https://streamlinehq.com

Background

To mitigate mobility-aliasing arising from coarse temporal aggregation, the paper proposes reconstructing finer time-scale dynamics by inserting p shorter-step transition matrices whose product approximates the observed coarse-grained transition matrix. Exact stochastic p-th roots may not exist, so the authors formulate an optimization to find an approximate root by minimizing a divergence K(M, Bp) over stochastic matrices B.

They note that for the large transition matrices arising in their application (e.g., GH5 geohash OD networks at 3-hour resolution), they could not find fast-converging algorithms to compute such approximate roots, identifying a pressing algorithmic gap for scalable solutions.

References

The authors have not been able to find fast converging algorithms for the approximation for the size of stochastic matrices in this paper.

A Pseudo Markov-Chain Model and Time-Elapsed Measures of Mobility from Collective Data (2502.04162 - Foster et al., 6 Feb 2025) in Appendix A: Proposed data collection method and algorithmic Markov matrix resampling to compensate for mobility aliasing