Fully Dynamic Spectral and Cut Sparsifiers for Directed Graphs
Abstract
Recent years have seen extensive research on directed graph sparsification. In this work, we initiate the study of fast fully dynamic spectral and cut sparsification algorithms for directed graphs.
We introduce a new notion of spectral sparsification called degree-balance preserving spectral approximation, which maintains the difference between the in-degree and out-degree of each vertex. The approximation error is measured with respect to the corresponding undirected Laplacian. This notion is equivalent to direct Eulerian spectral approximation when the input graph is Eulerian. Our algorithm achieves an amortized update time of and produces a sparsifier of size . Additionally, we present an algorithm that maintains a constant-factor approximation sparsifier of size against an adaptive adversary for -partially symmetrized graphs, a notion introduced in [Kyng-Meierhans-Probst Gutenberg ’22]. A -partial symmetrization of a directed graph is the union of and , where is the corresponding undirected graph of . This algorithm also achieves a polylogarithmic amortized update time.
Moreover, we develop a fully dynamic algorithm for maintaining a cut sparsifier for -balanced directed graphs, where the ratio between weighted incoming and outgoing edges of any cut is at most . This algorithm explicitly maintains a cut sparsifier of size in worst-case update time .
Keywords and phrases:
Dynamic graph algorithm, Spectral graph theory, SparsifierCategory:
Track A: Algorithms, Complexity and Games2012 ACM Subject Classification:
Theory of computation Dynamic graph algorithms ; Theory of computation Sparsification and spannersAcknowledgements:
The author would like to thank Sushant Sachdeva and Richard Peng for helpful discussions.Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele PuppisSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Designing spectral algorithms for directed graphs is a major frontier in algorithmic spectral graph theory. These algorithms have found numerous applications, ranging from fast algorithms for processing Markov chains [21, 3] to deterministic low-space computation [4]. Spectral sparsification of directed (Eulerian) graphs has emerged as a central topic in this area, with considerable recent advances [20, 16, 5, 44, 32, 38]. In particular, faster spectral sparsification algorithms that produce sparser directed Eulerian sparsifiers directly lead to faster computation of approximate Personalized PageRank vectors [21], stationary distributions, hitting times, escape probabilities of random walks [21], and approximate Perron vectors [3] through efficient directed Eulerian Laplacian solvers [20, 42].
In this work, we initiate the study of spectral and cut sparsification for dynamically changing directed graphs. We believe that our dynamic algorithms will serve as the foundation for efficient dynamic computations of the aforementioned problems.
Unlike undirected spectral sparsification, developing a useful notion of directed spectral or cut sparsification has been particularly challenging. Consider the complete directed bipartite graph where every node on one side of the bipartition has a directed edge to every node on the other side. Any sparsifier that approximately preserves all directed cuts in such a graph cannot delete any edges. For cut sparsification, Cen, Cheng, Panigrahi, and Sun [13] restricted the sparsification guarantees to only apply to cuts with values close to their corresponding cuts in the reverse direction.
Definition 1 (-balanced directed cut approximation).
is a -balanced directed cut approximation of if for all non-trivial cuts satisfying , satisfies that
This notion of -balanced cut sparsification is motivated by applications in solving flows and cuts problems [24, 34], as the residual graphs that appear in the intermediate steps of the maxflow algorithms are naturally balanced. These sparsifiers have found further application in recent work by Goranci, Henzinger, Räcke, and Sricharan [29], who used them to achieve the first dynamic incremental maxflow algorithm with polylogarithmic amortized update time for dense graphs ().
Cohen, Kelner, Peebles, Peng, Rao, Sidford, and Vladu [20] addressed the directed spectral sparsification problem by focusing on directed Eulerian graphs (where every vertex has equal weighted in-degree and out-degree). This requirement might seem overly restrictive, since all directed cuts of an Eulerian graph must have a balance factor . However, Cohen et al. demonstrated that their sparsification approach suffices for developing fast solvers for all directed Laplacian linear systems (even those not corresponding to an Eulerian graph). In this paper, we propose a relaxed notion of directed spectral approximation closely related to that of [20], where the sparsifier only needs to maintain the degree balances.
Definition 2 (Degree balance preserving directed spectral approximation).
is a -degree balance preserving directed spectral approximation of if for the corresponding undirected ,
| (1) |
This definition of directed spectral approximation has been implicitly used in almost all previous works in the directed Laplacian literature (e.g. [20, 19, 16, 37, 44, 32]). We note that the degree balance preserving requirement is implicitly ensured by (1): if the degree balance is not preserved, then there are some vectors such that the left hand side of (1) is non-zero while the right hand side is zero (see Lemma 10). The relaxation to any directed graph is necessary for dynamically changing graphs, as modifying from one directed Eulerian graph to another requires at least 3 individual edge updates. Whenever a dynamic directed graph becomes Eulerian, our degree balance preservation requirement naturally ensures that the dynamically maintained sparsifier is also Eulerian.
For both directed balanced cut sparsification and degree balance preserving spectral sparsification, we ask the natural question of whether a fully dynamic algorithm with polylogarithmic update time exists for maintaining a nearly-linear size sparsifier (i.e., the number of edges in the sparsifier is at most ) for directed graphs. Previous work by Abraham, Durfee, Koutis, Krinninger, and Peng [1] established the existence of such dynamic algorithms for undirected graphs. In this work, we answer this question affirmatively for the directed case.
1.1 Our results
Our first result is a fully dynamic algorithm for degree balance preserving directed spectral sparsification with polylogarithmic amortized update time.
Theorem 3 (Explicit dynamic directed spectral sparsifier).
Given a directed graph on vertices and with polynomially bounded edge weights, we can maintain explicitly a graph on vertices such that the Schur complement onto the original vertices is a -degree balance preserving directed sparsifier. has size 111We use to hide polylogarithmic factors in . and satisfies . The algorithm has amortized recourse and update time per edge insertion or deletion and works against an oblivious adversary.
Our algorithm explicitly maintains a sparsifier at the expense of extra vertices. We demonstrate in Lemma 13 (Section 3) that these extra vertices do not affect the usefulness of our theorem. Crucially, having an explicit sparsifier with low recourse enables further dynamic algorithms using our algorithm as a dynamic subroutine. A version of this theorem that exactly preserves both in-degrees and out-degrees is presented in Theorem 24. We also present two different algorithms that maintain implicit sparsifiers on the original set of vertices in the full version.
As observed by [11] for dynamic undirected spectral sparsifiers, dynamic algorithms that maintain implicit sparsifiers already support important applications. For example, one can maintain a dynamic row and column diagonally dominant (RCDD) Z-matrix222A RCDD matrix is a real M-matrix with non-negative row and column sums. solver through a reduction to directed Eulerian spectral sparsifier by [21] and by running a non-iterative static directed Eulerian Laplacian solver (e.g., [42]) on top of the sparsifier.
Corollary 4 (Dynamic RCDD Z-matrix solver).
Given a dynamic RCDD Z-matrix of dimension and , we can maintain a data structure in amortized update time which supports solving the linear system for any to -approximation in time .
Our next result, parallel to spectral sparsification, is a simple fully dynamic balanced directed cut sparsification algorithm with polylogarithmic worst-case update time.
Theorem 5 (Dynamic -balanced cut sparsifier).
Given a directed graph with polynomially bounded edge weights, we can maintain explicitly a -balanced directed cut sparsifier of size with worst-case update time per edge insertion or deletion against an oblivious adversary.
Unlike spectral sparsification, cut sparsification does not require degree fixing. As a result, our data structure can maintain a cut sparsifier explicitly without extra vertices. Additionally, we present an algorithm with improved amortized recourse and update time (see Theorem 27 in Section 4). In achieving Theorem 5, we also prove that independent edge sampling based on inverse undirected edge connectivity is sufficient for balanced directed cut approximation.
Theorem 6 (Improved static -balanced cut sparsifier).
There is a sparsification algorithm that, given a weighted directed graph and the edge connectivities of its corresponding undirected graph, computes a -balanced directed cut sparsifier with edges in linear time.
Finally, we present a fully dynamic directed spectral sparsification algorithm that works against an adaptive adversary. This result requires more detailed explanation, which we provide below.
We first remind readers that our degree balance preserving sparsifier requires the approximation factor . This requirement is necessary and warranted – for any directed Eulerian graph, an empty graph on the same set of vertices can serve as a constant good approximation. To the best of our knowledge, there exists no notion of directed spectral approximation that extends beyond constant approximation. This limitation is particularly problematic since the state-of-the-art adaptive undirected cut and spectral sparsifier from [11] require the multiplicative approximation factor to be at least .
Kyng, Meierhans, and Probst Gutenberg [37] circumvented this issue by considering the sparsification problem on a related graph called a partial symmetrization. Specifically, a -partial symmetrization of a directed graph is defined by , which combines the directed graph with a copy of its corresponding undirected graph scaled by a factor of . They showed that a partially symmetrized Eulerian graph serves as a good approximate pseudoinverse of the original directed graph (see Lemma 37).
Definition 7 (Approximate pseudoinverse, [21]).
For , a square matrix is an -approximate pseudoinverse of square matrix with respect to a Hermitian PSD matrix if , and
where is the identity matrix on the image of .
Moreover, when is large, the directed portion of can be sparsified much more aggressively under the notion of degree balance preserving spectral approximation, since
Further sparsification can also be performed on the undirected portion of the graph to ultimately produce a sparse approximation. These layers of approximation allow them to build a sparse preconditioner chain, which can be applied to solve directed Eulerian Laplacian systems using iterative solvers. See Section 5 for more details. Our dynamic algorithm efficiently maintains these sparsification layers under adaptive edge insertions and deletions.
Theorem 8 (Adaptive directed spectral sparsification quadruple).
Given a directed graph on vertices and with polynomially bounded edge weights, we can maintain explicitly a set of 3 directed graphs with and and . For and , they satisfy that
-
1.
when is Eulerian is a -approximate pseudoinverse of for all and degree balance preserving with respect to ,
-
2.
has size and has size .
The algorithm works against an adaptive adversary, has preprocessing time and amortized update time .
In this paper, we provide an overview of our algorithms and techniques. We refer readers to the full version of our paper for formal statements and detailed proofs.
1.2 Related works
Static directed graph sparsification
The notion of Eulerian Laplacian spectral sparsification was introduced by [20] to construct fast directed Eulerian Laplacian linear system solvers. These solvers have applications in various computational problems related to random walks on general directed graphs, through reductions given in [21, 3]. Cohen et al. [20] gave the first time algorithm for constructing Eulerian sparsifiers with edges, based on expander decompositions.
As an alternative approach, Chu et al. [16] introduced the short cycle decomposition technique and used it to give a polynomial-time algorithm for computing sparsifiers with significantly improved sparsity. This approach was subsequently improved by the work of [40, 41, 44]. Notably, [44] also demonstrated an improved existential result on the sparsity of Eulerian sparsifiers by leveraging techniques from matrix discrepancy theory [7]. This discrepancy approach was earlier introduced by Jambulapti, Reis, and Tian [31] for constructing undirected degree preserving spectral sparsifiers with optimal sparsity in almost linear time.
Recently, Jambulapati et al. [32] achieved state-of-the-art Eulerian sparsification results for both efficient sparsification and existential sparsity using a combination of techniques: effective resistance decomposition and sampling by electrical circulations. When combined with the reduction by Peng and Song [42], they provided the state-of-the-art Eulerian Laplacian solver that runs in time 333We use to hide polyloglog factors in .. Lau, Wang, and Zhou [38] gave a derandomized Eulerian sparsification algorithm using the “deterministic discrepancy walk” approach from [43]. They extended their sparsification result to satisfy a stronger notion of directed spectral approximation known as “singular value (SV) approximation” [5].
For directed cut sparsification, the notion of balanced cut approximation was introduced by Cen et al. [13] for sparsification of directed graphs where each cut has approximately the same weight as the cut in the reverse direction. Efficient cut sparsification algorithms have applications in minimum cut approximations for such balanced graphs [24]. Cen et al. designed an algorithm for constructing cut sparsifiers with edges for balance factor by sampling using the inverse undirected edge strength, introduced in [9] for undirected cut sparsification. This upper bound was later proven to be nearly tight by Chen et al. [15], who gave a bit complexity lower bound of . Theorem 6 complements the results of [13] by showing that sampling with probability inversely proportional to undirected edge connectivities, similar to [27] for undirected cut sparsification, achieves the same sparsity guarantee.
Recently, Goranci, Henzinger, Räcke, and Sricharan [29] independently discovered a similar generalization to balanced cut approximation using the framework of [27]. They proved a stronger result showing that any undirected edge connectivity measure is suitable for sparsification of balanced directed cuts. One key difference is that their general result has a slightly worse sparsity guarantee compared to ours that specifically uses undirected edge connectivity. Their sparsification algorithm works in conjunction with a dynamic NI index algorithm to dynamically sparsify residual networks in incremental maxflow problems.
Dynamic graph sparsification
Dynamic graph sparsification problems have been studied extensively for undirected graphs. There is a long line of work [6, 23, 8, 25, 10, 11, 14, 47, 18] on maintaining spanners – graph sparsifiers that approximately preserve distances – with various assumptions about updates (amortized or worst-case) and adversaries (oblivious or adaptive).
Abraham, Durfee, Koutis, Krinninger, and Peng [1] initiated the study of dynamic undirected spectral and cut sparsifications. They developed fully dynamic spectral sparsifiers with edges and amortized update time against oblivious adversaries by adapting the static spectral sparsification algorithm of Koutis and Xu [36]. Their algorithm maintains a bundle of dynamic spanners [8] that can certify edges with small effective resistances, the central value for undirected spectral sparsification. By swapping spanners with a bundle of dynamic (approximate) maximum spanning forests [30, 33, 28] that could certify edge connectivities, they also showed fully dynamic algorithms for cut sparsification with worst-case update time of against an oblivious adversary.
These results were subsequently strengthened by Bernstein, van den Brand, Probst Gutenberg, Nanongkai, Saranurak, Sidford, and Sun [11] to either work against adaptive adversaries or have worst-case update time guarantees. At the core of these results is a black-box reduction that reduces fully dynamic sparsification problems to decremental sparsification problems on almost uniform degree expanders. A version of their framework serves as the basis of our dynamic algorithms. To handle probabilistic dependencies introduced by adaptive adversaries, Bernstein et al. developed a technique called proactive sampling, where an edge update incurs multiple re-samplings with increasing intervals. One downside is that their adaptive algorithms have a significant trade-off between update time and approximation factor, leading to at least polylogarithmic approximations for any subpolynomial update time.
2 Preliminaries
All are base unless otherwise specified. We denote by . When discussing a graph clear from context with vertices and edge weight ratio bounded by . We use the notation to hide factors for brevity (in runtimes only). We let .
Vectors and Matrices
Vectors are denoted in lower-case boldface. and are the all-zeroes and all-ones vector respectively of dimension . denotes the basis vector. denotes the entrywise product of of equal dimension.
Matrices are denoted in upper-case boldface. We refer to the row and column of matrix by and respectively. We use to index into the coordinate of vector , and let , , and in contexts where , have subscripts.
is the identity matrix. For , denotes the associated diagonal matrix. For linear subspace of , is its dimension and is the orthogonal projection matrix onto . We let , , and denote the kernel, image and pseudoinverse of . We denote the operator norm (largest singular value) of matrix by . The number of nonzero entries of a matrix (resp. vector ) is denoted (resp. ), and the subset of indices with nonzero entries is (resp. ).
We use to denote the Loewner partial order on , the symmetric matrices. For and , we let denote the smallest eigenvalue of , so . For positive semidefinite , we define the seminorm induced by by .
Graphs
All graphs throughout this paper are assumed to be simple without loss of generality, as collapsing parallel multi-edges does not affect (undirected or directed) graph Laplacians. Moreover, a dynamic update of adding a parallel edge can be simulated by one edge deletion and one edge insertion with combined weight. We denote undirected weighted graphs without an arrow and directed weighted graphs with an arrow, i.e., is an undirected graph with vertices , edges , and weights , and is a directed graph. A directed Eulerian graph is a directed graph where weighted in-degree equals weighted out-degree for every vertex. We refer to the vertex set and edge set of a graph (resp. ) by and (resp. and ). We associate a directed edge from to with the tuple , and an undirected edge with and interchangeably. We define and to be the head and tail of a directed edge . We let denote the directed graph with all edge orientations reversed from , and denote the undirected graph which removes orientations (both keeping the same weights).
We say is a subgraph of if the edges and vertices of are subsets of the edges and vertices of (with the same weights), denoting if , and defining the same notion for directed graphs. For , we let denote the induced subgraph of on (i.e., keeping all of the edges within ). When is a set of vertices, we say is a partition of if , and all are disjoint. We say are a family of edge-disjoint subgraphs of if all are disjoint, and for all , , , and every edge weight in is the same as its weight in .
Graph matrices
For a graph with edges and vertices , we let be its edge-vertex transfer matrix, so that when is directed and , is -sparse with , (for undirected graphs, we fix an arbitrary consistent orientation). For , we define . When is the transfer matrix associated with graph (resp. ), we say is a circulation in (resp. ) if ; when (resp. ) is clear we simply say is a circulation. We let indicate the heads and tails of each edge, i.e., have one nonzero entry per row indicating the relevant head or tail vertex for each edge, respectively, so that . When clear from context that are edge weights, we let . For undirected with transfer matrix , the Laplacian matrix of is . For directed , the directed Laplacian matrix of is . To disambiguate, we use , , , , etc. to denote matrices associated with a graph when convenient.
Note that for any directed Laplacian . If is Eulerian, then its directed Laplacian also satisfies and is a circulation in (i.e., ). Note that for a directed graph and its corresponding undirected graph , the undirected Laplacian is , and the reversed directed Laplacian is .
We let denote the Laplacian of the unweighted complete graph on , i.e., . Note that is the orthogonal projection on the the subspace spanned by the vector that is in the coordinates of and elsewhere.
For a subset of vertices and , the Schur complement of a directed Laplacian onto is defined by , which satisfies the block LU factorization
| (2) |
A Schur complement of a directed graph Laplacian remains a directed graph Laplacian. We say that a directed graph is the Schur complement of onto a subset , denoted by , if . The Schur complement of an Eulerian graph is Eulerian.
Cut, Conductance and Expanders
Given a directed graph , for a subset of vertices, the volume of is the same as the volume of in the corresponding undirected graph . For another subset , we let be the set of edges satisfying that for it has and and denote by the total weight of these edges. We say that a subgraph , often referred to as a subset of edges, is a directed cut (di-cut) of if there exists some subset satisfying such that . The corresponding (undirected) cut of is defined by the set of cut edges in .
We say that the undirected conductance of subset is
where we note that . The conductance of an undirected graph , denoted by , is the minimum conductance of any cut .
Definition 9.
For any , we say that an undirected graph is a -expander if .
3 A Fully Dynamic Directed Spectral Sparsifier
In this section, we give an overview of our main result, Theorem 3 for dynamically maintaining directed spectral sparsifiers under the notion of degree balance preserving directed spectral approximation (Definition 2).
For directed spectral sparsification, a major challenge compared to undirected spectral sparsification is the degree balance preservation requirement. Sampling edges independently, as in undirected spectral sparsification algorithms [46], may create degree imbalances. Recent approaches in the static setting instead use independent sampling of graph structures that inherently preserve degree balances. Chu et al. [16] used short-cycle sampling while Jambulapati et al. [32] employed electrical circulation sampling. These structures are particularly difficult to maintain in a dynamic setting and the recourse could grow quickly over levels of half-sparsifications.
To avoid these issues, we instead adopt the approach of Cohen et al. [20], where the sparsification algorithm performs independent edge sampling on expanders and computes a “patching” graph to fix degree imbalances caused by the sampling. Cohen et al. made the key observation that sampling a directed edge with probability inversely proportional to both the in-degree of its tail and the out-degree of its head in an “expander” (i.e., a directed graph whose corresponding undirected graph is an expander) effectively controls spectral error and degree imbalance. They then showed that a small patching of size can be computed for such an expander by greedily matching remaining imbalanced degrees.
We show in the full version that a patching similar to the greedy patching of [20] can be implicitly maintained by a tree data structure that allows time querying of any edge. We call this an external patching since it introduces directed edges not originally present in the graph. To avoid having extra edges in a sparsifier, we introduce another patching algorithm that slightly adjusts the edge weights of the sampled subgraph using electrical flow. We call this an internal patching algorithm. For our dynamic algorithm, we only update the demand vector associated with the degree imbalance and compute an electric flow when querying the entire graph. We refer readers to the full version for more details.
A significant problem with both patching approaches is that the patching edges cannot be maintained explicitly. For external patching, modifying the degree of a vertex whose interval appears early in the ordering changes almost all edge weights in the patching. It can be worse for internal patching: the entire electrical flow is changed by a single update. To solve this problem, we observe that by adding auxiliary vertices, we can effectively patch degree imbalance using just a single directed star graph with one extra vertex. This approach allows us to maintain the spectral sparsifier explicitly and efficiently, as a single degree change only requires adjusting one edge on the degree imbalance. We remark that there is no tangible drawback for having a few auxiliary vertices in a sparsifier. For Eulerian graphs specifically, sparsifiers constructed this way still serve as effective preconditioners for solving Eulerian systems (see Lemma 13 in Section 3.1). There are also applications of undirected sparsifiers with auxiliary vertices [39, 26].
3.1 Properties of degree balance preserving directed spectral sparsifiers
In this section, we provide some useful properties of our degree balance preserving directed spectral sparsification. Some of these properties are crucial for applying the dynamic sparsification framework of [11]. Proofs of these statements can be found in the full version.
We state first the following equivalent definition of Definition 2 using the degree preserving condition, justifying our naming for Definition 2.
Lemma 10.
is an -degree balance preserving directed spectral approximation of (i.e., satisfying (1)) if and only if is degree balance preserving w.r.t. and
| (3) |
Recall the union property of graph sparsification problems. Let be the set of -approximations of under some definition of approximation for weighted directed (or undirected) graph. Then, we say that satisfies union property if for any with it satisfies that for any , we have
Our notion of directed spectral sparsification Definition 2 naturally satisfies the union property.
Lemma 11 (Union property).
Suppose directed graph for some and that . Then, suppose is an -degree balance preserving directed spectral approximation to for every , it follows that is an -degree balance preserving directed spectral approximation to .
We state also the contraction property where contraction of vertices does not affect the quality of our degree-balance preserving approximation.
Lemma 12 (Contraction property).
For a directed graph , suppose is an -degree balance preserving directed spectral approximation to . Then, for any subset , let , be the respective directed graphs resulting from contracting , then is an -degree balance preserving directed spectral approximation to .
We also demonstrate that having extra vertices in a degree balance preserving sparsifier does not affect most potential applications of it. In particular, Lemma 13 states that as long as the Schur complement of a graph is a good degree balance preserving sparsifier of an Eulerian graph , then serves as a good preconditioner of .
Lemma 13.
Let and be directed graphs such that the Schur complement is a -degree balance preserving approximation of for . If is Eulerian, then
3.2 Bipartitle lifts
We invoke a helper result which we use to ensure degree preserving properties, a strictly stronger property of degree balance preserving properties, of our algorithms by working with bipartite lifts. This primitive is from Section 9.1 of [32]. Given a directed graph , we let the directed graph be its bipartite lift, which is defined so that where is a copy of , and with . Notice that our definition gives a canonical bijection between and .
Lemma 14.
Let be a directed graph and let its bipartite lift be , with and . Suppose that for some , satisfies
Then, letting apply the absolute value entry-wise,
For the rest of this section, we almost exclusively considers such directed bipartite graphs.
Lemma 15 states that adding extra vertices and taking the Schur complement onto the original vertices under bipartite lift does not affect approximation guarantees on the unlifted graph.
Lemma 15.
Let be a directed graph and let its bipartite lift be , with and . Suppose is a directed graph such that is an -degree preserving spectral approximation of . Let be the resulting directed graph of with each pair of corresponding vertices contracted. Then, is an -degree preserving spectral approximation of .
3.3 Reduction to decremental sparsifier on expanders
In this section, we recall a fully dynamic expander decomposition algorithm by [11] using expander pruning from [45].
We first state the definition of expander decompositions. Note that for the purpose of this paper, we assume that the subgraphs in the decomposition contain the entire set of edges.
Definition 16 (Expander decomposition).
We call a -expander decomposition if are edge-disjoint subgraphs of satisfying , and the following hold.
-
1.
Bounded weight ratio: For all , .
-
2.
Conductance: For all , .
-
3.
Vertex coverage: There is a -partition such that every vertex appears at most once in the subgraphs of each .
When stating our results, we replace the use of the static expander decomposition algorithm from [45] by the state-of-the-art algorithm in [2].
Lemma 17 (Expander pruning).
Let be a -expander with . There is a deterministic algorithm with access to adjacency lists of such that given an online sequence of edges deletions in , can maintain a pruned set satisfing the following properties. Let be the graph and set after edge deletions. We have for all
-
1.
, ,
-
2.
,
-
3.
is a -expander,
-
4.
.
The amortized update time is .
Proposition 18 (Dynamic expander decomposition).
Given a weighted undirected dynamic graph with edge bounded edge weights ratio at all time, there exists a dynamic algorithm against an adaptive adversary that preprocess in time, maintains with high probability a -expander decomposition over all polynomially bounded number of updates of with high probability for some constant . The algorithm supports both edge deletions and insertions with amortized recourse and amortized time.
After each update, the output consists of a list of potential changes to the decomposition: (i) edge deletions to some subgraph in the decomposition, (ii) removing some subgraph from the decomposition, and (iii) new subgraph added to the decomposition.
Crucially, the types of updates in Proposition 18 entails that any expander in the dynamic decomposition only receives decremental update before it becomes obsolete.
We now recall the reduction to decremental algorithm on expanders by [11] using dynamic expander decomposition algorithm from above. The version we present here is an informal statement with a slight generalization: we remove the perturbation requirement and allows for directed graphs. See full version for more details.
Lemma 19 (Informal blackbox reduction with dynamic expander decomposition).
Assume is a graph sparsification problem that satisfies the union property, and there is a decremental algorithm for on (directed) graphs with edge weights ratio at most and satisfying that their corresponding undirected graph is an expander.
Then, there exists a fully dynamic algorithm for on weighted (directed) graphs such that given a dynamic weighted simple directed graph maintains an -approximate sparsifier of essentially the same size with essentially the same amortized update time as .
3.4 Patching by directed star graphs
To fix the degree imbalance, we consider patching using directed star graphs. The static algorithm PatchingStar (Algorithm 1) can be trivially made dynamic with deterministic updates in worst-case update time and recourse. This dynamic algorithm can also maintain the guarantees in Lemma 20.
Lemma 20 (Star patching).
Given , as in the input conditions and satisfying that and for the in and out degrees of , PatchingStar (Algorithm 1) returns in time a simple weighted directed graph such that
-
1.
, , and for the Schur complement , , ,
-
2.
-
3.
and .
3.5 A simple decremental algorithm on expanders
Finally, we present our main ingredient for a fully dynamic spectral sparsifier: a decremental algorithm for maintaining a degree preserving directed spectral sparsifier for an expander.
Lemma 21.
Suppose is a weighted directed bipartite graph with edges and weight ratio undergoing edge deletions only. There is a dynamic algorithm that preprocesses in time , maintains explicitly a directed graph on vertices and , where is the number of non-trivial vertices currently. The algorithm has worst-case recourse and update time . Furthermore, with high probability whenever becomes a -expander, is an -degree preserving directed spectral sparsifier of .
The following Lemma 22 is the key lemma from [20] that enables our results. In light of our static algorithm, our dynamic algorithm maintains a reweighted subgraph satisfying the approximation guarantees in (4) for its weighted adjacency matrix with and . For brevity we say that is an -degree approximation of .
Lemma 22.
Let be a matrix with and parameters . Let the row and column sums be and with and . Consider a random matrix that independently for each nonzero
where . Then, it satisfies that with probability , the following holds
| (4) |
Similar to the algorithm in [11], Algorithms 2, 3 sample for each vertex a subset of its incident edges using a fast uniform subset sampling algorithm [35, 22, 12]. An edge is present in the sparsifier as long as one of has it sampled.
Lemma 23.
Under the same assumptions on as in Lemma 21, there is an algorithm that given an oblivious online sequence of edge deletions, preprocesses in time , maintains explicitly a reweighted directed subgraph that is an -degree approximation of with where is the number of non-trivial vertices currently. The algorithm has worst-case recourse and worst-case update time .
3.6 Degree preserving directed spectral sparsification
In this section, we show to extend the degree-balance preserving guarantee from the algorithms above to exact degree preserving, i.e., the algorithm maintains a sparsifier with exact same weighted in and out degrees as the input directed graph. Even though our algorithms are degree preserving on bipartite lifted graphs, the patching schemes, except internal patching, may introduce self-loops when “unlifting” the sparsifier back to the original set of vertices. Eliminating the center of a star creates a biclique on all of its adjacent vertices. If there was an edge and for center , then the biclique contains the degenerative edge of , making it not degree preserving.
To avoid self-loops, we instead consider using multiple stars. We ensure for each star that the incident edges of the center do not contain any pair of edges of the form , . For vertex sets , and the complete set of bipartite edges , we devise a decomposition. Firstly, we label the vertices of by where and denote by its labeling. For each that corresponds to , we assign it the same label. Then, we defined for each integer the edge set by
We then get the following disjoint decomposition of ,
To produce a degree preserving directed spectral sparsifier, we first decompose the bipartite lift into edges disjoint subgraphs where each only contains the edges . Our dynamic algorithm then proceeds the same as before, with one copy of the algorithm on each . Now, suppose the algorithm receives an update (insertion or deletion) with edge , we first check for which the edge belongs to. The update is then propagated to the copy on and processed. Our final sparsifier is a union of our degree preserving sparsifiers of each unlifted back to the original set of vertices. The correctness of these operations are guaranteed by Lemmas 11 and 15. We summarize our conclusion above into the following informal statement.
Theorem 24 (Theorem 3, degree preserving).
Given a directed graph on vertices and with polynomially bounded edge weights, we can maintain explicitly a graph on vertices such that the Schur complement onto the original vertices is a -degree preserving directed spectral sparsifier of . has size and satisfies . The algorithm has amortized recourse and update time per edge insertion or deletion and works against an oblivious adversary.
4 A Fully Dynamic Balanced Directed Cut Sparsifier
In this section we give an overview of our fully dynamic algorithms for maintaining a -balanced directed cut sparsifier under edges updates.
In the static setting, Cen, Cheng, Panigrahi, and Sun [13] initiated the study of -balanced directed cut sparsification. Cen et al. [13] achieved sparsity by independent edge sampling with probability proportional to inverses of undirected edge strength defined originally by Benczúr and Karger [9] for undirected cut sparsification. As it stands, there is currently no known algorithm for fast maintenance of edge strength or fast certification of large edge strength under edge updates. We instead turn our attention to undirected edge connectivity that is proven to be useful for undirected cut sparsification in the work of [27]. We show statically that a -balanced dicut sparsifier can also be obtained by sampling using undirected edge connectivity in Theorem 6.
Definition 25 (Edge connectivity).
For any pair of vertices in a weighted undirected graph , the edge connectivity between is defined as the minimum value of a cut that separates them. The connectivity of an edge is defined by .
If an undirected graph is an expander, its edge connectivities can be certified by the degrees.
Lemma 26.
For -expander it satisfies that for ever edge , the edge connectivity .
One can then leverage expander decompositions to devise a fast algorithm for directed cut sparsifications. Such an algorithm lends itself nicely to the dynamic setting by utilizing the dynamic expander decomposition framework presented in Section 3.3.
Theorem 27.
Given a directed graph with polynomially bounded edge weights, we can maintain explicitly a -balanced directed cut sparsifier of size with amortized update time per edge insertion or deletion against an oblivious adversary.
Our de-amortized result in Theorem 5 uses instead the dynamic framework developed by [1]. While it is possible to directly apply the black-box reduction developed in [11] for this task, their framework introduces significant runtime overhead since it is geared towards reduction of dynamic algorithms for adaptive adversary. The algorithm by [1] dynamically maintains bundles of approximate maximum spanning forests (called -MSFs), that can certify edges with small undirected edge connectivities. We refer readers to the full version for more details on this approach.
Before we present our sparsification algorithms, we state a useful property of -balanced dicut approximations. In the full version, we give these properties for a more general notion of cut approximation on digraphs.
Lemma 28 (Union property).
Suppose directed graph for some and that . Then, suppose is a -balanced dicut approximation to for every , it follows that is a -balanced dicut approximation to .
4.1 Balanced directed cut sparsifiers via edge connectivity
Our static algorithm samples directed edges based on the reciprocals of their undirected edge connectivity measures. Proposition 29 quantifies the number of edges in a sparsifier.
Proposition 29.
For a connected undirected graph with edge connectivity ,
| (5) |
We say that is a -stretch edge connectivity estimation of if for all and
Definition 30.
An edge is -heavy if its connectivity is at least ; otherwise, it is said to be -light. The -projection of a cut is the set of -heavy edges in it.
The key to our analysis is the following cut counting statement in Theorem 31 that is a generalization of Theorem 2.3 of [27] to weighted graphs. Crucially, Theorem 31 allows us to bound the number of distinct -projections polynomially, allowing us to obtain high probability concentration.
Theorem 31 (Generalized cut projection counts, [27]).
For a weighted undirected graph , any and any , the number of distinct -projections in cuts of value at most in is at most , where is the minimum value of a cut in and is a constant.
Similar to [27], we partition the edges in according to their edge connectivities in into sets , where where is the min-cut value of and
| (6) |
For a dicut in induced by a partition of the vertices , we let be the cut induced by on . Let and let . We also let and let . Lemma 32 shows that for each , Algorithm 4 achieves -balanced dicut approximation on subset .
Lemma 32.
For any fixed , with probability at least , every cut in satisfies
| (7) |
where .
Our proof of Lemma 32 follows by showing using concentration bounds that for each , the probability of (7) fails is at most . Combining this observation with Theorem 31 allows us to obtain the desired probability via a union bound. Then, Theorem 6 follows by applying Cauchy-Schwarz with Lemma 32. See full version for more details.
4.2 Dynamic directed cut sparsification
Since -balanced dicut approximation satisfies union property (Lemma 28), the reductions presented in Section 3.3 can, again, be applied for dynamic balanced dicut sparsification. This allows us to focus on deriving a decremental algorithm on expanders for this task. Specifically, we observe that Algorithms 2, 3 for dynamically maintaining -degree approximations applies here as well.
Lemma 33.
Suppose is a weighted directed graph with weight ratio undergoing edge deletions only. There is an algorithm that given , and an oblivious online sequence of edge deletions, preprocesses in time , maintains explicitly a reweighted directed subgraph of with where is the number of non-trivial vertices currently. The algorithm has worst-case recourse and worst-case update time . Furthermore, with high probability, whenever becomes a -expander, is a -dicut sparsifier of .
Theorem 27 follows by applying the dynamic expander decomposition framework in Lemma 19.
5 Directed Spectral Sparsification Against an Adaptive Adversary via Partial Symmetrization
In this section, we consider the problem of fully dynamic degree balance preserving directed spectral sparsification against an adaptive adversary. This is a particularly difficult question, as the state-of-the-art adaptive undirect spectral sparsifier requires multiplicative approximation [11], while any current notions of directed spectral sparsification do not permit approximation factor . As was observed by Kyng, Meierhans, and Probst Gutenberg [37], a weaker notion of approximation, i.e., approximate pseudoinverse (Definition 7), suffices for solving directed Eulerian Laplacian systems.
The key observation in [37] is that a -partial symmetrization of a Eulerian directed graph is a good approximate pseudoinverse of .
Definition 34 (Generalized partial symmetrization, [37]).
For a directed graph with and , we let be the -partial symmetrization of .
We remark that and where . Subsequently, one can sparsify the directed portion of much more aggressively under the notion of degree balance preserving spectral approximation, since
Moreover, the graph is also a good approximate pseudoinverse of . One can further reduce the size of the graph by performing an undirected spectral sparsification of the undirected portion . These layers of sparsification allows them to build sparse preconditioner chain which can be used in solving directed Eulerian Laplacian systems by applying an iterative solver, such as Preconditioned Richardson (see Lemma 35). We refer readers to [37] and [20] for further expositions of this idea.
Lemma 35 (Preconditioned Iterations, Lemma 4.4 in [20]).
If is a -approximate pseudoinverse of with respect to for , and , then computes for some matrix only depending on and , such that is a -approximate pseudoinverse of with respect to .
Following [37], we consider for , three graphs , such that each spectrally approximates . Specifically,
-
1.
is the -partial symmetrization of ,
-
2.
is a sparsification of the directed portion of ,
-
3.
, the final sparsifier, further sparsifies the undirected portion of of .
We now recall the definition of a sparsification quadruple.
Definition 36 (Sparsification quadruple, [37]).
We call strongly connected Eulerian graphs a -quadruple if
-
1.
is a -approximate pseudoinverse of with respect to for ,
-
2.
for ,
-
3.
for , and ,
-
4.
is nearly-linear in and for .
Our adaptive degree (balance) preserving directed spectral sparsification algorithm maintains explicitly a sparsification quadruple. Similar to Theorem 3, our sparsifiers in Theorem 8 contain a few extra vertices and the approximation guarantees are given for the Schur complements with those vertices removed. Having such extra vertices does not affect preconditioning, as we observed in Lemma 13. When the input graph becomes Eulerian, for a constant approximate pseudoinverse of , we can solve the system of linear equation using at most applications of the pseudoinverse and each matrix for using Lemma 35.
5.1 Sparsification quadruples
In this section, we consider the approximation factors between each and under the notion of approximate pseudoinverse.
Lemma 37 (Lemma 4.6, [37]).
For Eulerian , the matrix is an -approximate pseudoinverse of with respect to for .
Lemma 38 states that if is a good degree balance preserving spectral approximate to , then it is also a good approximate pseudoinverse.
Lemma 38.
For , and Eulerian , if is a -degree balance preserving directed spectral approximation of and is Eulerian, then is a -approximate pseudoinverse of with respect to and .
Similarly, Lemma 40 states that using a good multiplicative undirected spectral approximation to , one can generate that is also a good approximate pseudoinverse of . Here, we recall the definition of multiplicative undirected spectral approximation.
Definition 39 (Undirected spectral approximation, multiplicative).
is a -spectral approximation of if it satisfies for some scaler that
Lemma 40.
For and Eulerian , if the graph satisfies , then satisfies that is a -approximate pseudoinverse of with respect to and .
5.2 Dynamic reductions to pruned almost uniform degree expanders
We will consider a variant of expanders where the minimum degree is guaranteed to be close to the average degree. We say that an graph is ()-uniform degree expander if is a -expander and and that , where we denote as the weighted degree of . Recall that we assume the subgraphs in a decomposition contain the entire set of edges.
An uniform degree expander decomposition of a graph is defined similarly to Definition 16 but with a few additional requirments on the degrees. For each subgraph , it is associated with a graph supported on the vertices of and extra sets of vertices for . The graph is required to be a -uniform degree expander satisfing that contracting each in gives .
Informally speaking, Theorem 5.8 in [11] provide a similar algorithm to Proposition 18 where an uniform degree expander decomposition of a weighted dynamic graph can be maintained efficiently where each expander undergoes only decremental updates. In the full version, we provide a slight modification for directed graphs and with edge weight bucketing.
We now recall the reduction to decremental algorithm on uniform degree expanders by [11] using this dynamic uniform degree expander decomposition algorithm from above. The version we present here is an informal version of Theorem 5.2 in [11] with a slight generalization: we remove the perturbation condition and allows for directed graphs.
Lemma 41 (Informal blackbox adaptive reduction with uniform degree promise).
Assume is a graph sparsification problem that satisfies the union and contraction property, and there is a decremental algorithm for on (directed) graphs with edge weights ratio at most and satisfying that their corresponding undirected graph is a uniform degree expander.
Then, there exists a fully dynamic algorithm for on weighted (directed) graphs such that given a dynamic weighted simple directed graph maintains an -approximate sparsifier of essentially the same size with essentially the same amortized update time as . Moreover, works against an adaptive adversary if supports adaptive edge updates.
5.3 Adaptive degree preserving sparsifications
In this section, we provide our guarantees for dynamic sparsification from to .
Theorem 42 gives dynamic sparsification from to , which, by Lemma 40, reduces to the sparsification of the undirected graph against an adaptive adversary.
Theorem 42.
There is a fully dynamic algorithm that given as input a weighted undirected graph with bounded weight ratio at all time undergoing adaptive edge insertions and deletions, maintain explicitly a graph on vertices with disjoint from . The Schur complement is an undirected graph and satisfies with high probability that is -degree preserving spectral approximation of . The graph has size and extra number of vertices . The algorithm has preprocessing time and amortized update time .
For sparsification from to , by Lemma 38, it suffices to produce a -degree preserving spectral sparsification of with respect to . The exact statement of our guarantees is presented in Lemma 43.
Lemma 43.
Let be a dynamic weighted directed graph undergoing adaptive edge updates. There is a deterministic dynamic algorithm that for , if , it maintains explicitly a weighted directed graph satisfying that for Schur complement is a -degree preserving directed spectral sparsifier of , where . The graph has size and extra number of vertices . The algorithm has preprocessing time and amortized update time .
Our algorithm in Theorem 8 maintains (a) a copy of the algorithm from Lemma 43 for sparsification from to , and (b) a copy of the algorithm from Theorem 42 for sparsification from to with the sparsifier scaled appropriately. Note that (a) maintains a graph on and (b) maintain a graph on for some subset disjoint from . By the disjointness, we have the following equivalence in the Schur complement,
Then, the union property (Lemma 11) then ensures the Schur complement is a degree preserving spectral approximation to . Theorem 8 follows by picking appropriate parameters in Theorem 42 and Lemma 43.
To prove Theorem 42, we use the observation that a degree preserving undirected cut sparsifier of an expander is a good spectral to the expander as well (Lemma 45). This observation allows to utilize an adaptive algorithm for cut sparsification from [11] on decremental uniform degree expanders.
Definition 44 (Undirected cut approximation, multiplicative).
is a -cut approximation of if for all non-trivial ut , it satisfies that
Lemma 45 ([17, 11]).
Let be weighted undirected graphs with the same set of vertices and satisfying . If both are -expanders for , then
We observe that a degree preserving spectral sparsifier of an almost uniform degree expander is easy to compute using cut sparsifiers and our patching scheme in Lemma 46. Note that our returned graph on vertices is instead directed. This is not a problem: (1) our overall sparsifier is ultimately a directed graph, and (2) the Schur complement back onto the original set of vertices is an undirected graph. We further notice that Lemma 46 require specifically for the graph to be a bipartite graph. This is an important assumption to ensure our star patching does not generate self-loops after “unlifting” the graph. See Section 3.6 for the exact reduction.
Lemma 46.
Let weighted bipartite undirected graph be a -expander. If is a -cut approximation of , then there is a deterministic algorithm that computes in time a directed graph on vertices for such that the Schur complement is an undirected graph that satisfies , and is a -spectral approximation of . The graph has size ,
We can now apply a decremental cut sparsification algorithm from [11] for spectral sparsification. Remark that the following Lemma 47 has a slight modification to allow for edge weights to be within a factor of 2, instead of uniform. Theorem 42 is then a direct consequence when combined with Lemma 46.
Lemma 47 (Decremental adaptive cut sparsifier, Theorem 9.5 [11]).
Let be a decremental weighted graph undergoing adaptive edge deletions that satisfies for all and for some fixed , where is the maximum weighted degree in the initial graph and is a degree lowerbound. Then, there is an algorithm that maintains a reweighted subgraph of such that and at any stage where has and on non-trivial vertices, is a -approximate cut sparsifier of with high probability. The algorithm has preprocessing time and worst-case update time .
Consider sparsification from to . Similar to the undirected sparsification, a directed graph can be computed using a star patching for expanders. We again considers a bipartite graph with “disjoint” vertices to avoid self-loops when eliminating the extra vertices. Lemma 43 can then be proven straightforwardly using Lemma 48.
Lemma 48.
Let be a weighted bipartite directed graph with so that is a -expander. There is a deterministic algorithm that given , and satisfying , returns in time a graph on vertices of size such that for is a -degree preserving directed spectral sparsifier of .
References
- [1] Ittai Abraham, David Durfee, Ioannis Koutis, Sebastian Krinninger, and Richard Peng. On fully dynamic graph sparsifiers. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pages 335–344, 2016. doi:10.1109/FOCS.2016.44.
- [2] Daniel Agassy, Dani Dorfman, and Haim Kaplan. Expander decomposition with fewer inter-cluster edges using a spectral cut player. In 50th International Colloquium on Automata, Languages, and Programming, ICALP 2023, July 10-14, 2023, Paderborn, Germany, volume 261 of LIPIcs, pages 9:1–9:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2023. doi:10.4230/LIPIcs.ICALP.2023.9.
- [3] AmirMahdi Ahmadinejad, Arun Jambulapati, Amin Saberi, and Aaron Sidford. Perron-Frobenius Theory in Nearly Linear Time: Positive Eigenvectors, M-matrices, Graph Kernels, and Other Applications, pages 1387–1404. SIAM, 2019. doi:10.1137/1.9781611975482.85.
- [4] AmirMahdi Ahmadinejad, Jonathan A. Kelner, Jack Murtagh, John Peebles, Aaron Sidford, and Salil P. Vadhan. High-precision estimation of random walks in small space. In 61st IEEE Annual Symposium on Foundations of Computer Science, FOCS, pages 1295–1306. IEEE, 2020. doi:10.1109/FOCS46700.2020.00123.
- [5] AmirMahdi Ahmadinejad, John Peebles, Edward Pyne, Aaron Sidford, and Salil P. Vadhan. Singular value approximation and sparsifying random walks on directed graphs. In 64th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2023, pages 846–854. IEEE, 2023. doi:10.1109/FOCS57990.2023.00054.
- [6] Giorgio Ausiello, Paolo Franciosa, and Giuseppe Italiano. Small stretch spanners on dynamic graphs. Journal of Graph Algorithms and Applications, 10(2):365–385, 2006. doi:10.7155/JGAA.00133.
- [7] Nikhil Bansal, Haotian Jiang, and Raghu Meka. Resolving matrix spencer conjecture up to poly-logarithmic rank. In Proceedings of the 55th Annual ACM Symposium on Theory of Computing, STOC 2023, pages 1814–1819. ACM, 2023. doi:10.1145/3564246.3585103.
- [8] Surender Baswana, Sumeet Khurana, and Soumojit Sarkar. Fully dynamic randomized algorithms for graph spanners. ACM Trans. Algorithms, 8(4), October 2012. doi:10.1145/2344422.2344425.
- [9] András A. Benczúr and David R. Karger. Approximating s-t minimum cuts in Õ(n2) time. In Proceedings of the Twenty-Eighth Annual ACM Symposium on Theory of Computing, STOC ’96, pages 47–55. Association for Computing Machinery, 1996. doi:10.1145/237814.237827.
- [10] Aaron Bernstein, Sebastian Forster, and Monika Henzinger. A deamortization approach for dynamic spanner and dynamic maximal matching. ACM Trans. Algorithms, 17(4), October 2021. doi:10.1145/3469833.
- [11] Aaron Bernstein, Jan van den Brand, Maximilian Probst Gutenberg, Danupon Nanongkai, Thatchaphol Saranurak, Aaron Sidford, and He Sun. Fully-Dynamic Graph Sparsifiers Against an Adaptive Adversary. In Mikołaj Bojańczyk, Emanuela Merelli, and David P. Woodruff, editors, 49th International Colloquium on Automata, Languages, and Programming (ICALP 2022), volume 229 of Leibniz International Proceedings in Informatics (LIPIcs), pages 20:1–20:20, Dagstuhl, Germany, 2022. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.ICALP.2022.20.
- [12] Karl Bringmann and Konstantinos Panagiotou. Efficient sampling methods for discrete distributions. In Artur Czumaj, Kurt Mehlhorn, Andrew Pitts, and Roger Wattenhofer, editors, Automata, Languages, and Programming, pages 133–144, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg. doi:10.1007/978-3-642-31594-7_12.
- [13] Ruoxu Cen, Yu Cheng, Debmalya Panigrahi, and Kevin Sun. Sparsification of Directed Graphs via Cut Balance. In Nikhil Bansal, Emanuela Merelli, and James Worrell, editors, 48th International Colloquium on Automata, Languages, and Programming (ICALP 2021), volume 198 of Leibniz International Proceedings in Informatics (LIPIcs), pages 45:1–45:21, Dagstuhl, Germany, 2021. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.ICALP.2021.45.
- [14] Li Chen, Rasmus Kyng, Yang P. Liu, Richard Peng, Maximilian Probst Gutenberg, and Sushant Sachdeva. Maximum flow and minimum-cost flow in almost-linear time. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 612–623, 2022. doi:10.1109/FOCS54457.2022.00064.
- [15] Yu Cheng, Max Li, Honghao Lin, Zi-Yi Tai, David P. Woodruff, and Jason Zhang. Tight lower bounds for directed cut sparsification and distributed min-cut. Proc. ACM Manag. Data, 2(2), May 2024. doi:10.1145/3651148.
- [16] Timothy Chu, Yu Gao, Richard Peng, Sushant Sachdeva, Saurabh Sawlani, and Junxing Wang. Graph sparsification, spectral sketches, and faster resistance computation, via short cycle decompositions. In 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS), pages 361–372, 2018. doi:10.1109/FOCS.2018.00042.
- [17] Julia Chuzhoy, Yu Gao, Jason Li, Danupon Nanongkai, Richard Peng, and Thatchaphol Saranurak. A deterministic algorithm for balanced cut with applications to dynamic connectivity, flows, and beyond. In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), pages 1158–1167, 2020. doi:10.1109/FOCS46700.2020.00111.
- [18] Julia Chuzhoy and Merav Parter. Fully Dynamic Algorithms for Graph Spanners via Low-Diameter Router Decomposition, pages 785–823. SIAM, 2025. doi:10.1137/1.9781611978322.23.
- [19] Michael B Cohen, Jonathan Kelner, Rasmus Kyng, John Peebles, Richard Peng, Anup B Rao, and Aaron Sidford. Solving directed laplacian systems in nearly-linear time through sparse lu factorizations. In 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS), pages 898–909. IEEE, 2018. doi:10.1109/FOCS.2018.00089.
- [20] Michael B Cohen, Jonathan Kelner, John Peebles, Richard Peng, Anup B Rao, Aaron Sidford, and Adrian Vladu. Almost-linear-time algorithms for markov chains and new spectral primitives for directed graphs. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pages 410–419, 2017. doi:10.1145/3055399.3055463.
- [21] Michael B Cohen, Jonathan Kelner, John Peebles, Richard Peng, Aaron Sidford, and Adrian Vladu. Faster algorithms for computing the stationary distribution, simulating random walks, and more. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pages 583–592. IEEE, 2016. doi:10.1109/FOCS.2016.69.
- [22] Luc Devroye. Chapter 4 nonuniform random variate generation. In Shane G. Henderson and Barry L. Nelson, editors, Simulation, volume 13 of Handbooks in Operations Research and Management Science, pages 83–121. Elsevier, 2006. doi:10.1016/S0927-0507(06)13004-2.
- [23] Michael Elkin. Streaming and fully dynamic centralized algorithms for constructing and maintaining sparse spanners. ACM Trans. Algorithms, 7(2), March 2011. doi:10.1145/1921659.1921666.
- [24] Alina Ene, Gary Miller, Jakub Pachocki, and Aaron Sidford. Routing under balance. In Proceedings of the Forty-Eighth Annual ACM Symposium on Theory of Computing, STOC ’16, pages 598–611, New York, NY, USA, 2016. Association for Computing Machinery. doi:10.1145/2897518.2897654.
- [25] Sebastian Forster and Gramoz Goranci. Dynamic low-stretch trees via dynamic low-diameter decompositions. In Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing, STOC 2019, pages 377–388, New York, NY, USA, 2019. Association for Computing Machinery. doi:10.1145/3313276.3316381.
- [26] Sebastian Forster, Gramoz Goranci, Yang P Liu, Richard Peng, Xiaorui Sun, and Mingquan Ye. Minor sparsifiers and the distributed laplacian paradigm. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 989–999. IEEE, 2021. doi:10.1109/FOCS52979.2021.00099.
- [27] Wai Shing Fung, Ramesh Hariharan, Nicholas J.A. Harvey, and Debmalya Panigrahi. A general framework for graph sparsification. In Proceedings of the Forty-Third Annual ACM Symposium on Theory of Computing, STOC ’11, pages 71–80, New York, NY, USA, 2011. Association for Computing Machinery. doi:10.1145/1993636.1993647.
- [28] David Gibb, Bruce Kapron, Valerie King, and Nolan Thorn. Dynamic graph connectivity with improved worst case update time and sublinear space, 2015. arXiv:1509.06464.
- [29] Gramoz Goranci, Monika Henzinger, Harald Räcke, and A. R. Sricharan. Incremental Approximate Maximum Flow via Residual Graph Sparsification. In Keren Censor-Hillel, Fabrizio Grandoni, Joël Ouaknine, and Gabriele Puppis, editors, 52nd International Colloquium on Automata, Languages, and Programming (ICALP 2025), volume 334 of Leibniz International Proceedings in Informatics (LIPIcs), pages 91:1–91:20, Dagstuhl, Germany, 2025. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.ICALP.2025.91.
- [30] Jacob Holm, Eva Rotenberg, and Christian Wulff-Nilsen. Faster fully-dynamic minimum spanning forest. In Nikhil Bansal and Irene Finocchi, editors, Algorithms - ESA 2015, pages 742–753, Berlin, Heidelberg, 2015. Springer Berlin Heidelberg. doi:10.1007/978-3-662-48350-3_62.
- [31] Arun Jambulapati, Victor Reis, and Kevin Tian. Linear-Sized Sparsifiers via Near-Linear Time Discrepancy Theory, pages 5169–5208. SIAM, 2024. doi:10.1137/1.9781611977912.186.
- [32] Arun Jambulapati, Sushant Sachdeva, Aaron Sidford, Kevin Tian, and Yibin Zhao. Eulerian Graph Sparsification by Effective Resistance Decomposition, pages 1607–1650. SIAM, 2025. doi:10.1137/1.9781611978322.50.
- [33] Bruce M. Kapron, Valerie King, and Ben Mountjoy. Dynamic graph connectivity in polylogarithmic worst case time, pages 1131–1142. SIAM, 2013. doi:10.1137/1.9781611973105.81.
- [34] David R. Karger and Matthew S. Levine. Fast augmenting paths by random sampling from residual graphs. SIAM Journal on Computing, 44(2):320–339, 2015. doi:10.1137/070705994.
- [35] Donald E. Knuth. The art of computer programming, volume 2 (3rd ed.): seminumerical algorithms. Addison-Wesley Longman Publishing Co., Inc., USA, 1997.
- [36] Ioannis Koutis and Shen Chen Xu. Simple parallel and distributed algorithms for spectral graph sparsification. ACM Trans. Parallel Comput., 3(2), 2016. doi:10.1145/2948062.
- [37] Rasmus Kyng, Simon Meierhans, and Maximilian Probst Gutenberg. Derandomizing directed random walks in almost-linear time. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 407–418, 2022. doi:10.1109/FOCS54457.2022.00046.
- [38] Lap Chi Lau, Robert Wang, and Hong Zhou. Spectral Sparsification by Deterministic Discrepancy Walk, pages 315–340. SIAM, 2025. doi:10.1137/1.9781611978315.24.
- [39] Huan Li and Aaron Schild. Spectral subspace sparsification. In 59th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2018, pages 385–396. IEEE Computer Society, 2018. doi:10.1109/FOCS.2018.00044.
- [40] Yang P Liu, Sushant Sachdeva, and Zejun Yu. Short cycles via low-diameter decompositions. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2602–2615. SIAM, 2019. doi:10.1137/1.9781611975482.161.
- [41] Merav Parter and Eylon Yogev. Optimal Short Cycle Decomposition in Almost Linear Time. In 46th International Colloquium on Automata, Languages, and Programming (ICALP 2019), volume 132 of Leibniz International Proceedings in Informatics (LIPIcs), pages 89:1–89:14. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2019. doi:10.4230/LIPIcs.ICALP.2019.89.
- [42] Richard Peng and Zhuoqing Song. Sparsified block elimination for directed laplacians. In STOC ’22: 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 557–567. ACM, 2022. doi:10.1145/3519935.3520053.
- [43] Lucas Pesenti and Adrian Vladu. Discrepancy Minimization via Regularization, pages 1734–1758. SIAM, 2023. doi:10.1137/1.9781611977554.ch66.
- [44] Sushant Sachdeva, Anvith Thudi, and Yibin Zhao. Better Sparsifiers for Directed Eulerian Graphs. In Karl Bringmann, Martin Grohe, Gabriele Puppis, and Ola Svensson, editors, 51st International Colloquium on Automata, Languages, and Programming (ICALP 2024), volume 297 of Leibniz International Proceedings in Informatics (LIPIcs), pages 119:1–119:20, Dagstuhl, Germany, 2024. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.ICALP.2024.119.
- [45] Thatchaphol Saranurak and Di Wang. Expander decomposition and pruning: Faster, stronger, and simpler. In Timothy M. Chan, editor, Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2019, pages 2616–2635. SIAM, 2019. doi:10.1137/1.9781611975482.162.
- [46] Daniel Spielman and Nikhil Srivastava. Graph sparsification by effective resistances. SIAM Journal on Computing, 40(6):1913–1926, 2011. doi:10.1137/080734029.
- [47] Jan van den Brand, Li Chen, Rasmus Kyng, Yang P. Liu, Richard Peng, Maximilian Probst Gutenberg, Sushant Sachdeva, and Aaron Sidford. A deterministic almost-linear time algorithm for minimum-cost flow. In 2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS), pages 503–514, 2023. doi:10.1109/FOCS57990.2023.00037.
- [48] Yibin Zhao. Fully dynamic spectral and cut sparsifiers for directed graphs, 2025. doi:10.48550/arXiv.2507.19632.
