Structure from Voltage (2203.00063v2)
Abstract: Effective resistance (ER) is an attractive way to interrogate the structure of graphs. It is an alternative to computing the eigen-vectors of the graph Laplacian. Graph laplacians are used to find low dimensional structures in high dimensional data. Here too, ER based analysis has advantages over eign-vector based methods. Unfortunately Von Luxburg et al. (2010) show that, when vertices correspond to a sample from a distribution over a metric space, the limit of the ER between distant points converges to a trivial quantity that holds no information about the structure of the graph. We show that by using scaling resistances in a graph with $n$ vertices by $n2$, one gets a meaningful limit of the voltages and of effective resistances. We also show that by adding a "ground" node to a metric graph one gets a simple and natural way to compute all of the distances from a chosen point to all other points.
- Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6):1373–1396, 2003.
- Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps. In Proceedings of the National Academy of Sciences, volume 102, pages 7426–7431, 2005.
- Random walks and electric networks, volume 22. American Mathematical Soc., 1984.
- Getting lost in space: Large sample analysis of the resistance distance. In Advances in Neural Information Processing Systems, volume 23. Curran Associates, Inc., 2010.
- Dimensionality reduction: a comparative review. Journal of machine learning research, 10(66-71):13, 2009.
- Kernel PCA and de-noising in feature spaces. In M. Kearns, S. Solla, and D. Cohn, editors, Advances in Neural Information Processing Systems, volume 11. MIT Press, 1998.
- A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2323, 2000.
- Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323–2326, 2000.
- Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-SNE. Journal of machine learning research, 9(11):2579–2605, 2008.
- UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426, 2018.
- t-SNE, forceful colorings, and mean field limits. Research in the Mathematical Sciences, 9(3):42, 2022.
- LDLE: Low distortion local eigenmaps. Journal of machine learning research, 22:282–1, 2021.
- Towards a theoretical foundation for laplacian-based manifold methods. Journal of Computer and System Sciences, 74(8):1289–1308, 2008.
- A kernel view of the dimensionality reduction of manifolds. In Proceedings of the 21st international conference on Machine learning, page 47, 2004.
- Initialization is critical for preserving global data structure in both t-SNE and UMAP. Nature biotechnology, 39(2):156–157, 2021.
- Resistance distance. Journal of mathematical chemistry, 12(1):81–95, 1993.
- Phylogenetic networks as circuits with resistance distance. Frontiers in Genetics, 11:1177, 2020.
- Detecting community structure in complex networks via resistance distance. Physica A: Statistical Mechanics and its Applications, 526:120782, 2019.
- Graph effective resistance and distributed control: Spectral properties and applications. In Proceedings of the 45th IEEE Conference on Decision and Control, pages 3479–3485, 2006.
- Graph sparsification by effective resistances. SIAM Journal on Computing, 40(6):1913–1926, 2011.
- Measuring cascade effects in interdependent networks by using effective graph resistance. In 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pages 683–688, 2015.
- The impact of the topology on cascading failures in a power grid model. Physica A: Statistical Mechanics and its Applications, 402:169–179, 2014.
- A network approach for power grid robustness against cascading failures. In 2015 7th International Workshop on Reliable Networks Design and Modeling (RNDM), pages 208–214, 2015.
- Graph algorithms for topology identification using power grid probing. IEEE Control Systems Letters, 2(4):689–694, 2018.
- Minimizing effective resistance of a graph. SIAM Review, 50(1):37–66, 2008.
- A queueing network-based distributed laplacian solver for directed graphs. Information Processing Letters, 166:106040, 2021.
- Efficient manifold and subspace approximations with spherelets. arXiv preprint arXiv:1706.08263, 2017.
- Internet. Sam Roweis. https://cs.nyu.edu/~roweis/data.html, 2022. Accessed: 2022-09-30.
- Li Deng. The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6):141–142, 2012.
- Euclidean distance matrices: Essential theory, algorithms, and applications. IEEE Signal Processing Magazine, 32(6):12–30, 2015.