Document

# A Combinatorial Cut-Toggling Algorithm for Solving Laplacian Linear Systems

## File

LIPIcs.ITCS.2023.69.pdf
• Filesize: 1 MB
• 22 pages

## Cite As

Monika Henzinger, Billy Jin, Richard Peng, and David P. Williamson. A Combinatorial Cut-Toggling Algorithm for Solving Laplacian Linear Systems. In 14th Innovations in Theoretical Computer Science Conference (ITCS 2023). Leibniz International Proceedings in Informatics (LIPIcs), Volume 251, pp. 69:1-69:22, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
https://doi.org/10.4230/LIPIcs.ITCS.2023.69

## Abstract

Over the last two decades, a significant line of work in theoretical algorithms has made progress in solving linear systems of the form 𝐋𝐱 = 𝐛, where 𝐋 is the Laplacian matrix of a weighted graph with weights w(i,j) > 0 on the edges. The solution 𝐱 of the linear system can be interpreted as the potentials of an electrical flow in which the resistance on edge (i,j) is 1/w(i,j). Kelner, Orrechia, Sidford, and Zhu [Kelner et al., 2013] give a combinatorial, near-linear time algorithm that maintains the Kirchoff Current Law, and gradually enforces the Kirchoff Potential Law by updating flows around cycles (cycle toggling). In this paper, we consider a dual version of the algorithm that maintains the Kirchoff Potential Law, and gradually enforces the Kirchoff Current Law by cut toggling: each iteration updates all potentials on one side of a fundamental cut of a spanning tree by the same amount. We prove that this dual algorithm also runs in a near-linear number of iterations. We show, however, that if we abstract cut toggling as a natural data structure problem, this problem can be reduced to the online vector-matrix-vector problem (OMv), which has been conjectured to be difficult for dynamic algorithms [Henzinger et al., 2015]. The conjecture implies that the data structure does not have an O(n^{1-ε}) time algorithm for any ε > 0, and thus a straightforward implementation of the cut-toggling algorithm requires essentially linear time per iteration. To circumvent the lower bound, we batch update steps, and perform them simultaneously instead of sequentially. An appropriate choice of batching leads to an Õ(m^{1.5}) time cut-toggling algorithm for solving Laplacian systems. Furthermore, we show that if we sparsify the graph and call our algorithm recursively on the Laplacian system implied by batching and sparsifying, we can reduce the running time to O(m^{1 + ε}) for any ε > 0. Thus, the dual cut-toggling algorithm can achieve (almost) the same running time as its primal cycle-toggling counterpart.

## Subject Classification

##### ACM Subject Classification
• Theory of computation → Network flows
##### Keywords
• Laplacian solver
• electrical flow
• data structure

## Metrics

• Access Statistics
• Total Accesses (updated on a weekly basis)
0

## References

1. Ittai Abraham and Ofer Neiman. Using petal-decompositions to build a low stretch spanning tree. Proceedings of the 44th Symposium on the Theory of Computing, pages 395-406, 2012. URL: https://doi.org/10.1145/2213977.2214015.
2. Joshua D. Batson, Daniel A. Spielman, Nikhil Srivastava, and Shang-Hua Teng. Spectral sparsification of graphs: theory and algorithms. Commun. ACM, 56(8):87-94, 2013. Available at: URL: http://cs-www.cs.yale.edu/homes/spielman/PAPERS/CACMsparse.pdf.
3. Erik G. Boman, Kevin Deweese, and John R. Gilbert. An empirical comparison of graph Laplacian solvers. In Proceedings of the 18th Workshop on Algorithm Engineering and Experiments, pages 174-188, 2016.
4. Erik G. Boman, Kevin Deweese, and John R. Gilbert. Evaluating the potential of a dual randomized Kaczmarz Laplacian linear solver. Informatica, 40:95-107, 2016.
5. Li Chen, Rasmus Kyng, Yang P. Liu, Richard Peng, Maximilian Probst Gutenberg, and Sushant Sachdeva. Maximum flow and minimum-cost flow in almost-linear time, 2022. URL: https://doi.org/10.48550/arXiv.2203.00671.
6. Paul Christiano, Jonathan A. Kelner, Aleksander Mądry, Daniel Spielman, and Shang-Hua Teng. Electrical flows, Laplacian systems, and faster approximation of maximum flow in undirected graphs. In Proceedings of the 42nd Annual ACM Symposium on the Theory of Computing, pages 273-282, 2011.
7. Kevin Deweese, John R. Gilbert, Gary Miller, Richard Peng, Hao Ran Xu, and Shen Chen Xu. An empirical study of cycle toggling based Laplacian solvers. In Proceedings of the 7th SIAM Workshop on Combinatorial Scientific Computing, pages 33-41, 2016.
8. Thomas R. Ervolina and S. Thomas McCormick. Two strongly polynomial cut cancelling algorithms for minimum cost network flow. Discrete Applied Mathematics, 46:133-165, 1993.
9. Yu Gao, Yang P. Liu, and Richard Peng. Fully dynamic electrical flows: Sparse maxflow faster than Goldberg-Rao. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 516-527, 2022. URL: https://doi.org/10.1109/FOCS52979.2021.00058.
10. Andrew V. Goldberg and Robert E. Tarjan. Finding minimum-cost circulations by canceling negative cycles. Journal of the ACM, 36:873-886, 1989.
11. Monika Henzinger, Sebastian Krinninger, Danupon Nanongkai, and Thatchaphol Saranurak. Unifying and strengthening hardness for dynamic problems via the online matrix-vector multiplication conjecture. Proceedings of the 47th Annual ACM Symposium on the Theory of Computing, pages 21-30, 2015. URL: https://doi.org/10.1145/2746539.2746609.
12. Daniel Hoske, Dimitar Lukarski, Henning Meyerhenke, and Michael Wegner. Engineering a combinatorial Laplacian solver: Lessons learned. Algorithms, 9, 2016. Article 72.
13. David R. Karger. Minimum cuts in near-linear time. J. ACM, 47(1):46-76, January 2000. URL: https://doi.org/10.1145/331605.331608.
14. Tarun Kathuria, Yang P. Liu, and Aaron Sidford. Unit capacity maxflow in almost m^4/3 time. SIAM Journal on Computing, 2022. To appear. URL: https://doi.org/10.1137/20M1383525.
15. Jonathan A. Kelner, Lorenzo Orecchia, Aaron Sidford, and Zeyuan Allen Zhu. A simple, combinatorial algorithm for solving SDD systems in nearly-linear time. Proceedings of the 45th Annual ACM Symposium on the Theory of Computing, pages 911-920, 2013. URL: https://doi.org/10.1145/2488608.2488724.
16. Aleksander Mądry. Computing maximum flow with augmenting electrical flows. In Proceedings of the 57th IEEE Symposium on the Foundations of Computer Science, pages 593-602, 2016.
17. Richard Peng and Daniel A. Spielman. An efficient parallel solver for SDD linear systems, 2013. URL: http://arxiv.org/abs/1311.3286.
18. Jonah Sherman, October 2017. Personal communication.
19. Daniel A. Spielman and Shang-Hua Teng. Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In Proceedings of the 36th Annual ACM Symposium on the Theory of Computing, pages 81-90, 2004.
20. Daniel A. Spielman and Shang-Hua Teng. Spectral sparsification of graphs. SIAM J. Comput., 40(4):981-1025, 2011. Available at: URL: https://arxiv.org/abs/0808.4134.
21. David P. Williamson. Network Flow Algorithms. Cambridge University Press, 2019.