Brief Announcement: Faster CONGEST Approximation Algorithms for Maximum Weighted Independent Set in Sparse Graphs
Abstract
The maximum independent set problem is a classic optimization problem in graph theory that has also been studied quite intensively in the distributed setting. Although the problem is hard to approximate within reasonable factors in general, there are good approximation algorithms known for several sparse graph families. In the present paper, we consider deterministic distributed algorithms for the weighted version of the problem in trees and graphs of bounded arboricity (i.e., hereditary sparse graphs).
For trees, we prove that the task of deterministically computing a -approximate solution to the maximum weight independent set (MWIS) problem has a tight complexity. The lower bound already holds on unweighted oriented paths. On the upper bound side, we show that the bound can be achieved even in unrooted trees.
For graphs of arboricity , we give two algorithms. If the sum of all node weights is , we show that for any , an independent set of weight at least can be computed in rounds. This result is obtained by a direct application of the local rounding framework of Faour, Ghaffari, Grunau, Kuhn, and Rozhoň [SODA ‘23]. We further show that for any , an independent set of weight at least can be computed in rounds. For , this significantly improves on a recent result of Gil [OPODIS ‘23], who showed that a -approximation to the MWIS problem can be computed in rounds. As an intermediate step to our result, we design an algorithm to compute an independent set of total weight at least in time , where is the maximum degree of the graph.
Keywords and phrases:
CONGEST model, weighted independent set, approximation, trees, arboricityCopyright and License:
2012 ACM Subject Classification:
Theory of computation Distributed algorithmsEditor:
Dariusz R. KowalskiSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction and Related Work
Given a graph with node weights , the maximum weight independent set (MWIS) problem asks for an independent set (i.e., a set of pairwise non-adjacent nodes) such that the total weight is maximized. The MWIS problem is a classic optimization problem on graphs, which has also been studied quite extensively in the distributed setting. In the present paper, we focus on sparse families of graphs for which good MWIS approximations are known in the centralized and also in the distributed setting. We start by briefly summarizing the most relevant existing literature.
In the standard setting, the graph on which we intend to solve some given graph problem (e.g., MWIS) is also the communication graph. There are nodes and each node is equipped with an -bit unique identifier. The nodes communicate over the edges in synchronous rounds. In the model [18], the nodes can exchange arbitrarily large messages. In the more restricted model, in each round, each node can send a (possibly different) message of bits to each neighbor. When considering algorithms for the MWIS problem, we further assume that a single node weight can be communicated with a single message. The internal computation at the nodes is not restricted. Initially, the nodes do not know anything about the topology of the graph . For simplicity, we however assume that the nodes do know the values of the relevant parameters of . At the end of an independent set algorithm, each node must know if it is in the independent set or not.
1.1 Distributed MWIS Algorithms in General Graphs
The most widely studied distributed independent set problem is the problem of computing a maximal independent set (MIS), i.e., an independent set that cannot be extended. The distributed complexity of computing an MIS has been studied intensively since the 1980s, e.g., [1, 5, 10, 9, 17, 11, 15]. The current best randomized algorithms have complexity in and in [10, 9, 11].111The notation hides polylogarithmic factors in the argument, i.e., . The best known deterministic MIS algorithms require rounds in and rounds in [9, 11]. For the maximum cardinality independent set (MCIS) problem, i.e., for the unweighted version of the MWIS problem, an MIS directly gives a -approximation (where denotes the maximum degree of the graph). In [3], it is shown that in , a -approximation for MWIS can be computed in time , where denotes the ratio between the largest and smallest node weight and is the time to compute an MIS. Subsequently, Kawarabayashi, Khoury, Schild, and Schwartzman [14] give an algorithm to compute an independent set of weight at least in time times the time to compute an independent set of weight at least for some constant . For the latter problem, they give two algorithms. One of them uses the local-ratio technique [2] to reduce the problem to computing a single MIS of a (locally computable) subgraph of the input graph. The other one is a randomized algorithm that requires rounds. In [9], it is shown that it suffices to run instances of computing an independent set of weight . Further, the paper gives a deterministic -time algorithm to compute an independent set of total weight at least .
1.2 Distributed MWIS Algorithms for Sparse Graphs
We now get to the case of sparse graphs, which are the focus of this paper. It has been shown by Turán [19] that every graph of average degree has an independent set of size at least . A natural generalization of this is the so-called Caro-Wei bound [7, 20], which states that every graph has an independent set of size
| (1) |
The second inequality follows from an application of the Cauchy-Schwarz inequality. As observed by Boppana, the Caro-Wei bound can be obtained in expectation by a simple random process that can be implemented in a single round in the model [6, 13]. Every node picks an independent random number from a sufficiently large domain and a node joins the independent set if and only if it picked a smaller number than all its neighbors. This algorithm is equivalent to running a single phase of Luby’s classic MIS algorithm [17]. In [6], it is shown that the Caro-Wei bound (1) is a -approximation of the MCIS problem. For sparse graphs, we often want to express the approximation factor as a function of the arboricity of the graph. The arboricity of a graph is defined as the number of forests into which the edges of a graph can be partitioned. Since we always have , the result of [6] implies that (1) is a -approximation of the MCIS problem. In [9], it is shown that there is a deterministic algorithm with round complexity that comes within a factor of the bound of (1), as well as of a natural generalization of (1) in the weighted case. As one of the technical results of the present paper, we show that one can improve the factor to a factor at the cost of an additional factor in the round complexity (cf. Theorem 4).
The first paper that achieves an efficient -approximation for the MWIS problem in the model is [14]. They achieve a -approximation by first decomposing the graph into layers of degree at most and by running an algorithm to obtain an independent set of weight within each layer (and where is an appropriate weight function that is used in layer ). The overall round complexity is times the time for computing the independent set of weight in each layer. By using the randomized algorithm of [14], the overall complexity of the resulting randomized -approximation for the MWIS problem is and by using the deterministic algorithm of [9], the overall complexity of the resulting deterministic -approximation for the MWIS problem is . In fact, at the cost of an additional -factor in the round complexity, the approximation quality of the algorithm of [14] can be improved to . Those results were then improved by Gil in [12], who in particular provides a deterministic algorithm to compute a -approximation in time .
More special classes of sparse graphs are trees and more generally minor-closes families of graphs (e.g., planar graphs). In [16, 8], it was shown that on cycles (and paths), deterministically computing a constant approximation for the maximum cardinality independent set problem requires rounds. Note that in all graphs of arboricity , computing a constant MCIS approximation is trivial. Half the nodes have degree at most and an independent set of size among the nodes of degree at most can be computed by computing an MIS in time [5]. For planar graphs (and thus also for trees), it is shown in [8] that in the model, even for the MWIS problem, a -approximation can be computed in time .
1.3 Our Contributions
In our paper, we focus on deterministic approximation algorithms for the MWIS problem in the model in sparse families of graphs. In the following, we list our technical contributions in detail and we also give an overview over the most important ideas that are needed to prove the stated theorems.
1.3.1 Approximating Maximum Weight Independent Set in Trees
We start by establishing a tight bound for computing a -approximation in trees.
Theorem 1.
Let be a parameter. The deterministic model complexity of computing a -approximate solution for MWIS in tree networks is . The upper bound holds in general unrooted trees. The lower bound even holds for the unweighted version of the problem in oriented paths and in the model.
The lower bound is based on a relatively simple reduction from the MCIS problem in paths [8, 16]. The condition is a technical condition because for arbitrary , the lower bound becomes .
The upper bound is based on ideas that were developed for planar graphs in [8] and which are based the following core idea. First, one defines a weight function on edges, where for , we set . The algorithm of [8] then computes a clustering of the nodes of such that the total weight of the edges connecting nodes in different clusters is at most an -fraction of the total weight of all the edges. By computing an optimal weighted independent set within each cluster, one can then obtain a -approximate MWIS solution of the given instance. The independent sets of the clusters are combined by taking the union and removing the smaller weight node of every intercluster edge. The clustering algorithm of [8] obtains clusters of diameter in time in the model. In trees, the clustering algorithm of [8] can be implemented in the model. Further, in trees, an optimal MWIS solution inside each cluster can be computed in time linear in cluster diameter by using a straightforward dynamic programming algorithm. The core challenge for proving the upper bound of Theorem 1 is to obtain a clustering algorithm in which the maximum cluster diameter is only . The algorithm of [8] consists of basic steps in which the cluster diameter grows by constant factor and the total weight of the intercluster edges shrinks by a constant factor. The cluster diameter however grows by a factor that is larger than the factor by which the total weight of the intercluster edges decreases. In our algorithm, we show that in trees, one can interleave those basic steps of [8] with steps in which the clusters are split into clusters of smaller diameter, without increasing the overall weight of the intercluster edges by too much.
1.3.2 Approximation of MWIS as a Function of the Arboricity
For the remainder of this section, we assume that we are given a graph of arboricity . In [14], it is shown that there is a deterministic algorithm to compute an independent set of weight at least in randomized time and in combination with an algorithm from [9] in deterministic time . In the following, we show that for moderately small both those bounds can be improved significantly.
Theorem 2.
For any , there is a -round deterministic algorithm to compute an independent set of weight in any graph of arboricity and with node weights .
The theorem can be proven by a relatively straightforward blackbox application of the local rounding framework of [9]. More concretely, we can show that Theorem 2 follows almost directly from Lemma 4.2 in [9]. Theorem 2 implies a -approximation of MWIS. In [12], it is shown that a -approximation can be computed deterministically in rounds. For , we significantly improve on this bound as stated by the following theorem.
Theorem 3.
For any , there is a -round deterministic algorithm to compute an independent set of weight in any graph of arboricity and with node weights .
A major step towards proving Theorem 3 is an efficient algorithm to compute an independent set of weight arbitrarily close to a natural weighted generalization of the Caro-Wei bound (1). Specifically, we prove the following theorem.
Theorem 4.
For any , there is a -round deterministic algorithm to compute an independent set of weight in any graph of maximum degree and with node weights .
Before discussing the main ideas needed to prove, Theorem 4, we discuss its direct application to approximating the maximum cardinality independent set problem in graphs of arboricity . As proven in [6] and discussed in Section 1.2, the Caro-Wei bound (1) provides a -approximation to the maximum cardinality independent set problem in graphs of arboricity . Theorem 4 thus implies that such an approximation can be computed in rounds in the model. This can be further improved slightly. Because in a graph of arboricity , the average degree is at most , the number of nodes of degree is at most , which can be shown to be at most , where denotes the independence number of . It therefore suffices to apply Theorem 4 to the subgraph induced by the nodes of degree at most for a sufficiently large constant . We thus obtain the following corollary.
Corollary 5.
For any , there is a -round deterministic algorithm to compute a -approximation to the maximum cardinality independent set problem in graphs of arboricity .
We next sketch how Theorem 4 is proven and how it is used to prove Theorem 3. The starting point to proving Theorem 4 is an -round algorithm from [9] to compute an independent set of weight at least in a graph of maximum degree . The idea now is to divide the nodes of into degree classes so that the degrees within one class differ by at most a factor . We then want to essentially apply the algorithm from [9] separately for each degree class, starting from the small degrees. This would work almost directly for unweighted graphs. To make it work, one just has to include all the still available nodes from the lower degree classes when computing the independent set of some degree class.
For weighted graphs, sequential composition of independent set is a bit more tricky. We can however utilize a technique developed in the context of the local-ratio method [2] and used in the context of distributed MWIS approximation in [3, 14, 9]. Given a graph with node weights and an independent set , one can define a new weight function , where denotes the inclusive neigborhood of . If one then computes a second independent set consisting only of nodes for which , the combined independent set is guaranteed to have a total weight of at least (w.r.t. to the original weight function ). In this way, we can iterate through the degree classes in a similar way as in the unweighted case to obtain an independent set satisfying the requirements for Theorem 4.
We next discuss our algorithm to obtain the bound claimed by Theorem 3. Note that since the average degree of a graph of arboricity can be almost , we might have to compute an independent set of weight close to divided by the average degree. There are graphs of arboricity for which this is best possible (e.g., unweighted cliques) and we therefore in some cases cannot afford to allow too much “slack” when iteratively computing an independent set. A standard tool to algorithmically deal with graphs of bounded arboricity is the so-called -decomposition as introduced in [4]. Because the average degree of a graph with arboricity is at most , the number of nodes of degree more than is at most . When peeling off all nodes of degree at most , we therefore get rid of a -fraction of all the nodes. Repeating this idea gives a decomposition of the graph into layers so that the nodes in each layer have at most neighbors in the same layer and higher layers. We are not aware of an algorithm to compute an independent set of weight close to that does not at least implicitly use an -decomposition (which in most cases leads to a time complexity that is at least linear in the number of layers ).
The highlevel idea of our approach is the following. We again use the framework of [2, 3, 14] to iteratively construct an independent set in the weighted setting. Because the nodes in the lowest layer are always the ones of bounded degree, we start our iterative construction at the lowest layer and work our way up the decomposition. Some of the main challenges with this approach already appear for the unweighted case and in the following highlevel discussion, we therefore focus on this case. Let be the nodes of the lowest layer of our decomposition. All nodes in have degree at most and we can therefore compute an independent set of size close to (or even close to the Caro-Wei bound (1) within ). However, even if the independent set is relatively large, it could consist of nodes that mostly have neighbors in so that a lot of nodes in have no neighbor in . When moving to the next layer, we can however not include any remaining nodes in because this might create some high degree nodes in the layer, we are considering. Our goal therefore should be to select an independent set in such that it removes most of the nodes in . As an estimate of the number of removed nodes in , we use , where is the degree of within . If this sum is close to , we are guaranteed to make sufficient progress (even if many nodes of remain because other nodes in have multiple neighbors in ). We can compute such an independent set as follows. We define a weight for each node . Note that for an independent set , we have . By using Theorem 4, we can compute an independent set of total weight , which is exactly what we need.
References
- [1] N. Alon, L. Babai, and A. Itai. A fast and simple randomized parallel algorithm for the maximal independent set problem. Journal of Algorithms, 7(4):567–583, 1986. doi:10.1016/0196-6774(86)90019-2.
- [2] A. Bar-Noy, R. Bar-Yehuda, A. Freund, J. Naor, and B. Schieber. A unified approach to approximating resource allocation and scheduling. J. of the ACM (JACM), 48:1069–1090, 2001. doi:10.1145/502102.502107.
- [3] Reuven Bar-Yehuda, Keren Censor-Hillel, Mohsen Ghaffari, and Gregory Schwartzman. Distributed approximation of maximum independent set and maximum matching. In Proc. of 36th ACM Symp. on Principles of Distributed Computing (PODC), pages 165–174, 2017. doi:10.1145/3087801.3087806.
- [4] L. Barenboim and M. Elkin. Sublogarithmic distributed mis algorithm for sparse graphs using Nash-Williams decomposition. In Proc. 27th ACM Symp. on Principles of Distributed Computing (PODC), pages 25–34, 2008.
- [5] L. Barenboim, M. Elkin, and F. Kuhn. Distributed -coloring in linear (in ) time. SIAM J. Computing, 43(1):72–95, 2015.
- [6] Ravi B. Boppana, Magnús M. Halldórsson, and Dror Rawitz. Simple and local independent set approximation. In Proc. 25th Int. Coll. on Structural Information and Communication Complexity (SIROCCO), pages 88–101, 2018. doi:10.1007/978-3-030-01325-7_12.
- [7] Y. Caro. New results on the independence number. Technical report, Tel Aviv University, 1979.
- [8] A. Czygrinow, M. Hańćkowiak, and W. Wawrzyniak. Fast distributed approximations in planar graphs. In DISC, volume 5218 of Lecture Notes in Computer Science, pages 78–92. Springer, 2008. doi:10.1007/978-3-540-87779-0_6.
- [9] S. Faour, M. Ghaffari, C. Grunau, F. Kuhn, and V. Rozhon. Local distributed rounding: Generalized to mis, matching, set cover, and beyond. In Proc. of the 2023 ACM-SIAM Symposium on Discrete Algorithms, (SODA 2023), Florence, Italy, January 22-25, 2023, pages 4409–4447, SIAM, 2023.
- [10] M. Ghaffari. An improved distributed algorithm for maximal independent set. In Proc. 27th ACM-SIAM Symp. on Discrete Algorithms (SODA), pages 270–277, 2016.
- [11] Mohsen Ghaffari and Christoph Grunau. Near-optimal deterministic network decomposition and ruling set, and improved MIS. In Proc. 65th IEEE Symp. on Foundations of Computer Science (FOCS), pages 2148–2179, 2024. doi:10.1109/FOCS61266.2024.00007.
- [12] Y. Gil. Improved Deterministic Distributed Maximum Weight Independent Set Approximation in Sparse Graphs. In 27th International Conference on Principles of Distributed Systems (OPODIS 2023), pages 16:1–16:20, 2024.
- [13] Magnús M. Halldórsson and Christian Konrad. Computing large independent sets in a single round. Distributed Computing, 31:69–82, 2018. doi:10.1007/S00446-017-0298-Y.
- [14] K. Kawarabayashi, S. Khoury, A. Schild, and G. Schwartzman. Improved distributed approximations for maximum independent set. In Proc. 34th Symp. on Distributed Computing (DISC), pages 35:1–35:16, 2020.
- [15] F. Kuhn, T. Moscibroda, and R. Wattenhofer. Local computation: Lower and upper bounds. J. of the ACM, 63(2), 2016. doi:10.1145/2742012.
- [16] C. Lenzen and R. Wattenhofer. Leveraging linial’s locality limit. In Proceedings of 22nd Symp. on Distributed Computing (DISC), pages 394–407, 2008.
- [17] M. Luby. A simple parallel algorithm for the maximal independent set problem. SIAM Journal on Computing, 15:1036–1053, 1986. doi:10.1137/0215074.
- [18] D. Peleg. Distributed Computing: A Locality-Sensitive Approach. SIAM, 2000.
- [19] P. Turán. On an extremal problem in graph theory (in Hungarian). Mat. Fiz. Lapok, 48:436–452, 1941.
- [20] V. K. Wei. A lower bound on the stability number of a simple graph. Technical Report No. 81-11217-9, Bell Laboratories Technical Memorandum, 1981.
