On the Average-Case Performance of Greedy for Maximum Coverage
Abstract
For the classical maximum coverage problem, the greedy algorithm achieves a worst-case approximation, which is optimal unless . The notion of coverage appears in a wide range of optimization tasks, where empirical evaluations indicate approximation ratios close to for the greedy algorithm on real data. Random models have provided average-case justifications for the empirical performance of many well-known algorithms, but little is known about the average-case performance of greedy for maximum coverage.
We analyze the expected approximation ratio of the greedy algorithm in a random model, which we call the left-regular random model. We first show that, for all parameter settings of this model, the expected approximation ratio of the greedy algorithm improves by a constant over its worst-case guarantee. We then identify two simple conditions, either of which ensures that the expected approximation ratio is close to for sufficiently large graphs. Finally, we show that there is a regime where greedy does not achieve an expected approximation better than . To obtain these results, we develop analytical tools, including a novel application of the differential equation method and a connection to maximum matching in Erdős-Rényi graphs, which may be of independent interest for other random models.
Keywords and phrases:
Maximum Coverage, Greedy Algorithm, Average-Case Analysis, Differential Equation Method, Random GraphsCategory:
Track A: Algorithms, Complexity and GamesCopyright and License:
2012 ACM Subject Classification:
Theory of computation Approximation algorithms analysisFunding:
Eric Balkanski and Jason Chatzitheodorou were supported in part by NSF grants CCF-2210501 and IIS-2147361.Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele PuppisSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Maximizing coverage is a fundamental problem in computer science and operations research, as the notion of coverage arises across a wide range of optimization tasks. Influence maximization in social networks [17], facility and sensor placement [18], information retrieval [1], content recommendation [25], and finding essential webpages [4] are examples of problems that have been formulated as maximum coverage problems. Maximum coverage is also closely related to set cover, one of Karp’s original 21 NP-complete problems [16].
Maximum coverage can be defined as follows. Given a bipartite graph with left nodes and right nodes , the goal is to find the nodes in that cover the largest number of nodes in , i.e., . The greedy algorithm, which iteratively selects the node in that covers the largest number of nodes in not yet covered, achieves a worst-case approximation ratio guarantee [21], which is optimal unless [10]. However, worst-case guarantees are often driven by pathological instances, leading to pessimistic bounds that can be uninformative in practice. There have been numerous approaches to bridging this gap between theory and practice for various problems through beyond–worst-case analyses of algorithms. A canonical example is the smoothed analysis of the simplex method [26].
For maximum coverage, the greedy algorithm empirically performs significantly better than its approximation ratio guarantee [4, 5]. There have been numerous attempts going beyond worst-case to explain this strong performance in practice for the broader problem of monotone submodular maximization under a cardinality constraint. These include the parameterized properties of curvature [8], stability [7], and sharpness [23]. More recently, [24] considered a budget-smoothed model where the cardinality constraint is stochastic.
However, except for a few notable exceptions discussed in Section 1.1, little is known about the average-case performance of greedy for maximum coverage on random graphs. In contrast, random models have provided average-case justifications for the performance of classical algorithms such as quicksort [14], first-fit decreasing for bin packing [12], local search for the traveling salesman problem [9], and the greedy algorithm for both max-value [19, 2] and min-cost matching [13]. Motivated by the strong empirical performance of greedy for maximum coverage, we explore the following question.
What is the average-case performance of the greedy algorithm for maximum coverage?
We study the approximation ratio of greedy under a model that we call the left-regular random model . This model generates a bipartite graph with left nodes and right nodes , where each node independently selects neighbors uniformly at random from . We also consider extensions in which and the nodes in have non-uniform degrees. Our motivation for the -regularity assumption for left nodes in the base model is that it is a challenging regime for greedy. In particular, there are simple bad instances for greedy in which the left nodes have equal degree (see Section A.1 for an example). Moreover, in empirical evaluations of extensions of this model, greedy’s approximation ratio was lowest when the nodes in had equal degree (see Section A.2 for an example).
Our results
Our first main result is an unconditional bound on the expected approximation ratio of greedy in the left-regular random model. We show that for all values of and , there is a constant improvement for the approximation ratio of greedy in this random model compared to its worst-case approximation ratio of . For all results, we assume that greedy breaks ties according to an arbitrary but consistent ordering of the nodes in .
Theorem 1.
There exists a constant such that for all , the greedy algorithm achieves, in expectation, a -approximation under the left-regular random model.
The second main result provides two alternative sufficient conditions, either of which ensures a near-optimal approximation ratio for greedy for sufficiently large graphs.
Theorem 2.
For any , , the greedy algorithm achieves, in expectation, a approximation under the left-regular random model if either or .
This result implies that, for any constant , the degree of nodes in being super-constant or the cardinality constraint lying outside of a constant factor neighborhood of are sufficient conditions for a approximation. We note that when , then the sum of the degrees of left nodes is equal to the number of right nodes. The only regime for which Theorem 2 does not give near-optimality is where is constant and . The third main result shows that for and some such that , the approximation ratio of greedy is not near-optimal as grows large: it is upper bounded by .
Theorem 3.
For , there exists a sequence of cardinality constraints such that the expected approximation ratio of the greedy algorithm is at most in the limit as under the left-regular random model.
These results indicate that the left-regular random model is sufficient to always get a constant improvement in the approximation ratio of greedy, but that it requires additional assumptions for near-optimality; Theorem 2 gives two such assumptions.
Extensions
In the full version of our paper, we consider two extensions of the left-regular random model.
-
Unbalanced bipartite graphs. We consider an extension of the base model where the number of right nodes is denoted by and is potentially different from the number of left nodes . We show that for all such that for some constant and for all and , there exists a constant such that greedy achieves a approximation in expectation.
-
Non-regular unbalanced bipartite graphs. We consider an extension of the base model where the left nodes have degree and the bipartite graph is unbalanced. We show that if either (1) the sum of the largest degrees is bounded away from : , (2) the average degree of the largest degrees is sufficiently large: , or (3) are drawn from a power law distribution and is sufficiently small, then the expected approximation ratio of greedy is at least .
Our techniques
The positive results rely on two main analytical tools, which may also be of interest for analyzing greedy in other random bipartite graph models.
First, we develop a framework using the differential equation method to analyze an AcceptReject algorithm that is equivalent to greedy. AcceptReject proceeds in phases; in each phase, it iterates through every node to either add it to the solution or reject it. We show that the evolution of the value of the current solution of AcceptReject during the first phase can be approximated by a function that is the unique solution to a differential equation. This differential equation is obtained by approximating the expected per-iteration increase in the solution size as a function of the current solution size.
Second, we show that greedy’s expected value is at least the expected value of a fixed set of left nodes, chosen independently of the random graph’s realization. Although this claim may seem intuitive, it requires a careful argument because there are iterations in which the marginal gain of the fixed set is larger than that of greedy, where these marginal gains are measured with respect to their respective current solutions. We circumvent that obstacle by analyzing a hybrid algorithm that runs greedy for iterations and then completes the solution by selecting the nodes with the largest residual degrees at iteration .
The negative result is established by relating maximum coverage in -left regular graphs and maximum matching in Erdős-Rényi random graphs. This connection yields a lower bound on the coverage of the optimal solution via known results on maximum matching. At the same time, we tightly control the performance of greedy through our differential equation analysis.
Open questions
An alternative random model in which it would be natural to study the approximation ratio of greedy is the Erdős–Rényi random bipartite graph model with left nodes, right nodes, and an edge between each left and right node independently with probability . To the best of our knowledge, there is no known result for the maximum coverage problem under Erdős–Rényi random bipartite graphs and analyzing greedy in that model seems non-trivial.
Obtaining stronger unconditional bounds on the approximation ratio of greedy in the left-regular random model is a natural direction for future work. In particular, using the differential equation method to analyze additional phases of AcceptReject is a promising direction for establishing stronger approximation guarantees for greedy in the regime where it is not near-optimal.
Paper organization
We discuss additional related work in Section 1.1 and introduce preliminary definitions and notation in Section 2. In Section 3, we show the approximation guarantees achieved by greedy in the left-regular random model. In Section 4, we show the negative result for greedy.
1.1 Related Work
[4] use the dual of the maximum coverage LP to provide bounds on the approximation ratio of greedy that are in practice much stronger than its worst-case approximation. In particular, for , they obtain bounds on real data that are always at least . They also show that in the random model, where left nodes and right nodes both have degrees that follow a power law distribution and edges are added randomly according to these degree distributions, greedy achieves a approximation if it has a marginal contribution of at least at every iteration. In [27], three algorithms for maximum coverage, including greedy, are analyzed heuristically using the differential equation method on sparse biregular random bipartite graphs. In particular, they use a differential equation to predict a threshold for the cardinality constraint below which greedy achieves exact optimality with high probability and above which it is no longer optimal with high probability.
For the closely related set cover problem where the goal is to cover all the nodes in with a subset of of minimum size, [11] and [6] also study a random model with fixed degrees and also use the differential equation method. However, their primary focus is on methods that, given parameter values for the random model, yield numerical estimates of the approximation ratio of greedy on random instances for these specific parameters, but not closed-form approximation ratios. In addition to these numerical estimates, [11] shows that for a fixed ratio , greedy is asymptotically optimal as the degree of right nodes tends to infinity. When each edge is included with constant probability, [28] shows that there is an algorithm, distinct from greedy, that is asymptotically optimal for set cover.
2 Preliminaries
In the maximum coverage problem, there is a bipartite graph with left nodes , right nodes , and edges . The goal is to find the nodes in that cover the largest number of nodes in , i.e., where are the neighbors of in . We abuse notation and write when is clear from context. The greedy algorithm (Greedy) iteratively adds to the current solution the left node that covers the most right nodes not yet covered. We refer to and as the marginal contribution of to and the value of , respectively.
The random graph model
We consider instances of the maximum coverage problem with random bipartite graphs drawn from the following random graph model that we call the left-regular random model. Throughout the paper, uppercase letters represent fixed sets/graphs, while calligraphic letters denote random sets/graphs.
Definition 4.
The model generates a bipartite graph by setting and, independently for each , selecting neighbors in uniformly at random without replacement.
We note that a left-regular random graph satisfies for all and . When analyzing Greedy under the left-regular random model, we assume it breaks ties according to an arbitrary, but consistent, ordering of the nodes in , and that the left nodes are indexed in the order in which greedy breaks ties.
We let and denote the greedy solution and the optimal solution, respectively, for the maximum coverage problem with cardinality constraint over a bipartite graph . Throughout the paper, approximation guarantees in expectation are defined as ratios of expected values. For fixed and , the greedy algorithm achieves, in expectation, an -approximation if
We abuse notation and write and when is clear from context. It will be useful in our analysis to compare to the expected value of a fixed set of size . For that purpose, we denote the first left nodes as We also use the notation .
3 Approximation Guarantees
In this section, we show that greedy achieves an approximation ratio that is, for all parameters , and , a constant improvement over its worst-case guarantee and, in a wide range of regimes, asymptotically optimal. We first discuss two central technical tools that we use for these two results in Section 3.1, then partition the space of all parameters in three regions and analyze greedy in each of them in Section 3.2, and finally combine the analyses of these regions to obtain the desired results in Section 3.3. Missing proofs can be found in the full version of our paper.
3.1 Technical Tools
The near-linear, saturated, and critical regions
We distinguish three parameter regimes that we analyze separately. First, for small values of , we have the near-linear region, where Greedy selects nodes that have neighborhoods with almost no overlap. Therefore, their value increases almost linearly with . Second, for large values of , we have the saturated region, where Greedy covers almost all the right nodes. Between these two regions lies the critical region, which is the most challenging to analyze.
The differential equation method
The first technical tool is a novel application of the differential equation method. We use it to estimate the number of iterations
in which Greedy, over a left-regular random graph , selects a node with marginal contribution to the current solution that is equal to , i.e., all neighbors of the selected node are disjoint from the neighbors of . The main lemma for this estimate of is a bound on its error that, for any , has an dependence on with high probability.
Lemma 5.
Let , and . With probability at least , estimate is such that .
This estimate plays a key role in the proof showing that greedy achieves a constant improvement over in the critical region when is small. To prove Lemma 5, we employ the differential equation method, formalized by [29]. Under appropriate regularity conditions, including bounded increments and Lipschitz continuity, this method yields a high-probability bound on the discrepancy between a discrete stochastic process and the deterministic solution of an associated differential equation. It has found great use in the field of random graphs [11, 22, 29, 30, 19, 3].
We do not apply the method directly to the standard description of Greedy because its evolution is difficult to express through a low-dimensional Markovian state, which is crucial for tractability. Instead, we analyze AcceptReject, an equivalent reformulation of Greedy. AcceptReject, which is formally defined in Algorithm 2, proceeds in phases from to . In phase , it iterates over the left nodes of the bipartite graph in the order in which greedy breaks ties and either accepts (meaning a node gets added to the solution) or rejects each of them based on whether their marginal contribution to the current solution is at least . This iterative exploration of the graph in each phase implies that its randomness is revealed sequentially, allowing low-dimensional Markovian states to describe the evolution of the current solution size .
We denote by the set of accepted nodes at iteration of phase of AcceptReject. For the proof of Lemma 5, we focus on analyzing the first phase of AcceptReject on a graph .
Proof sketch of Lemma 5 (proof can be found in the full version).
The solution returned by Greedy and AcceptReject is not only the same, but the ordering in which nodes are added to this solution is also identical since the nodes are indexed in the order in which Greedy breaks ties. Thus, the number of iterations where Greedy adds nodes with marginal contribution is equal to the number of nodes accepted during the first phase of AcceptReject, i.e., . We define the function for all .
The central part of the proof consists of showing that where is the unique solution to the following differential equation:
This approximation is obtained by using the differential equation method, which requires the following four conditions.
-
The expected one-step change is tightly approximated by . For this condition, we show the following:
-
The function is Lipschitz.
-
A deterministic bound for the one-step change . In our case, .
-
. In our case, .
We show that and satisfy these four conditions with parameters such that the resulting approximation is sufficiently tight to imply the desired bound. A promising direction for future work is to leverage estimates of the number of accepts across all phases, rather than only the first, as this could yield a tighter lower bound on the coverage of Greedy. The main challenge is that the solution of the differential equations in each phase depends on the solutions from the preceding phases, making closed-form expressions analogous to those obtained for unlikely. This interdependence substantially complicates the derivation of the approximation ratio. Nevertheless, we believe that a sufficiently careful analysis could overcome these technical obstacles and uncover the true extent of the improvement that Greedy achieves over .
The fixed-set lower bound
The second technical tool provides a seemingly simple lower bound on the expected value of the greedy solution. The lower bound is the expected value of a fixed set of left nodes chosen independently of the realization of the random graph. For this fixed set of nodes, we consider the nodes with lowest indices .
Lemma 6.
Let , , and , then .
In Section 3.2, we use this bound to show that greedy is near-optimal in the near-linear, the saturated, and the critical region when is large. The only region where it does not provide a constant improvement is in the critical region when is small, where we use Lemma 5 instead.
It may seem natural that Greedy performs better than over left-regular random graphs. However, a difficulty that arises in proving Lemma 6, is that the expected marginal improvement of Greedy is not always larger than the expected marginal improvement of at all iterations , which we illustrate in the full version of our paper. Nevertheless, in the early iterations, where a small number of right nodes have been covered, it does hold that . The challenge is thus to show that the expected value of Greedy remains larger in later iterations.
Proof sketch of Lemma 6 (proof can be found in the full version).
We define a hybrid algorithm that runs in two phases. First, it runs iterations of Greedy, after which its current solution is . In the second phase, it adds to the solution the nodes with largest marginal contribution to .
The main part of the proof consists in showing that trading one iteration of Greedy in the first phase for one more node in the second phase reduces the expected value, i.e.,
To show that inequality, we first note that , which implies that it suffices to compare the marginal contribution of the other nodes in the two solutions to . The crucial difference that we leverage is that the other nodes in are selected to be the nodes with largest marginal contribution to , whereas for they are the nodes with largest marginal contribution to . With the lemma then follows since and
3.2 Analysis For The Different Regions
Near-linear and saturated regions
In both regions, we show that Greedy achieves a ratio close to in Lemma 7. Intuitively, in the near-linear region (i.e., ), even the nodes of share very few neighbors; therefore, the expected value of Greedy is close to . On the other hand, in the saturated region (i.e., ), covers most of the right nodes, even if the nodes of share many neighbors.
Lemma 7.
Let and . Then we have .
The proof uses the fixed set lower bound from Lemma 6, whose value is lower bounded by the following lemma (proof can be found in the full version).
Lemma 8.
Let , , and . Then .
The proof also uses the following inequality, whose proof can be found in the full version.
Claim 9.
For all , .
We are now ready to prove Lemma 7.
Proof of Lemma 7.
For :
where the first inequality is because is lower bounded by by Lemma 6, the second inequality is due to Lemma 8, the third inequality is because by assumption, the fourth inequality is due to and is upper bounded by . For :
where the first inequality is because is lower bounded by by Lemma 6, the second inequality is due to Lemma 8, the third inequality is because by assumption, the fourth inequality is due to Claim 9 and is upper bounded by .
Critical region: large degrees
We use Lemma 6 and Chernoff bounds over negatively correlated variables to show a ratio in the critical region (i.e. ) when the degrees are large. Intuitively, it is possible to upper bound the optimal solution, since any nodes suffer from sharing too many neighbors.
Lemma 10.
Let and . Then we have .
Proof sketch (proof can be found in the full version).
We show that the values of all sets concentrate with high probability. To this end, we express the value of a set as the sum over of the indicator variables for whether is covered by . We first show that these indicator variables are negatively correlated.
We then use a generalization of the Chernoff bound for negatively correlated variables and a union bound to show that for an appropriate choice of . It then follows that , where the first inequality is by Lemma 6 and the second inequality by the choice of and the assumption on .
Critical region: small degrees
We use Lemma 5 to lower bound the ratio in the critical region, when the degrees are small. The main challenge in this case is that the optimal solution can achieve a high value close to , so Lemmas 6 and 8 only retrieve worst-case ratio . Therefore, we need a tighter lower bound for Greedy. This is the most challenging case and the only one in which we do not show a ratio. Nevertheless, we still improve over the ratio by a constant, albeit small.
Lemma 11.
There exists a function such that for and , we have .
The proof uses worst-case analysis after iteration , to obtain a result for . Specifically, we show that as long as is on the order of , Greedy is bounded a constant away from , which we formalize in the following lemma.
Lemma 12.
Let be a -left-regular bipartite graph with . For all we have .
We are now ready to give a proof sketch of Lemma 11.
Proof sketch of Lemma 11 (proof can be found in the full version).
Let be an appropriately chosen error term. For , Greedy gains on each iteration with high probability by Lemma 5, so For , Greedy gains on each iteration until with high probability by Lemma 5, and for later iterations we use Lemma 12:
We choose large enough to make terms and . The statement follows by lower bounding .
3.3 Putting Everything Together
By combining Lemma 7 and Lemma 10, we immediately get the near-optimality of greedy in the near-linear region, saturated region, and critical region with large degrees. See 2
The second main result regarding the approximation guarantee of greedy requires the following inequality (proof can be found in full version).
Claim 13.
For all , .
By combining Lemma 11, which is for the critical region with small degrees, and Theorem 2, which is for all other regions, we get the constant improvement over for all regions.
Theorem 1. [Restated, see original statement.]
There exists a constant such that for all , the greedy algorithm achieves, in expectation, a -approximation under the left-regular random model.
Proof.
Let and be the function from the statement of Lemma 11. For , the statement is implied by Theorems 2 and 11. For , the worst-case approximation ratio of greedy is , so we get
where the first inequality is by Claim 13 and the second since .
4 Limitation of Greedy
In the previous section, Theorem 2 does not guarantee an approximation ratio close to for all parameter values. The remaining difficult regime is when the degree is small and lies in a critical window around . In this section, we establish Theorem 3, which demonstrates that this gap is due to a fundamental limitation of Greedy rather than a proof artifact. Specifically, we identify a counterexample with , where the ratio is bounded away from as goes to infinity. The main results are Lemmas 15 and 17, which lower bound Opt and upper bound Greedy respectively. We defer the complete proofs to Appendix B.
4.1 Lower Bound for Opt
The first challenge is to lower-bound the value of the optimal solution. We resolve this difficulty by relating the value of the optimal solution in -left-regular random graphs to the size of a maximum matching in Erdős-Renyi random graphs. This process takes two steps.
First, the value of the optimal solution in any -left-regular bipartite graph is at least twice the minimum between and the size of the largest set of left nodes with no common neighbors, i.e.
| (1) |
with
| (2) |
The following lemma reduces the computation of to finding the size of a maximum matching in a specific graph , defined as follows: the vertex set of is the set of right nodes of , and for each left node , we add an edge in between the two neighbors of . If two nodes on the left side share the same neighbor set, the parallel edges are merged; in other words, is a simple graph.
Lemma 14.
Let be a -left-regular bipartite graph. Also let be a graph such that where for all . Then , where is the size of the maximum matching in .
Proof.
Consider a set attaining the maximum in Equation (2), i.e., and for all distinct . We construct
which is a valid matching in by definition of , and clearly . We now show that is a maximum matching in . Towards a contradiction, assume there exists a matching in such that . Then we can define:
where for all since is a matching. Then , which contradicts optimality of . The statement follows as .
Now suppose that is sampled from . Then is distributed as a graph on vertices obtained by sampling edges independently and uniformly at random with replacement from the possible edges, merging parallel edges. This distribution is closely related to the classical Erdős–Rényi model , in which edges are sampled uniformly at random without replacement. Sharp estimates for the maximum matching size in Erdős–Rényi graphs are known; see, e.g., [15]. As we show in the following lemma, these results yield a bound on , which can be translated into a lower bound on the expected value of the optimal solution. Before we proceed, we define constants , where is the smallest root of and since we use them extensively in our proofs.
Lemma 15.
Let and . Then for any , we have
The proof leverages the following lemma, which provides a probabilistic lower bound on the size of the maximum matching in .
Lemma 16.
Let and , then
The proof, deferred to Appendix B, bounds how much the maximum matching size can change due to the discrepancy between the generation process of and the seminal Erdős-Renyi model, and leverages what is known about the size of maximum matchings in Erdős-Renyi. We are now ready to prove Lemma 15.
Proof of Lemma 15.
Consider any , then:
where the inequality is due to Equation 1 and the equality is due to by Lemma 14. We now lower bound :
where the first inequality is due to the assumption on and the second due to Lemma 16. Chaining with the previous inequality establishes the lemma.
4.2 Upper Bound for Greedy
The second challenge is to upper bound the value of Greedy. We do so through the machinery of Lemma 5 in the following lemma.
Lemma 17.
Let and . Then we have that, for any , .
Proof.
By definition of , up to iteration , Greedy will gain per iteration, and thereafter it gains at most per iteration. Consequently, for any , the following holds
As always holds, we have:
We upper bound the probability using Lemma 5:
Chaining those three inequalities yields:
The statement then follows, since by definition.
4.3 Putting Everything Together
Proof.
References
- [1] Aris Anagnostopoulos, Luca Becchetti, Ilaria Bordino, Stefano Leonardi, Ida Mele, and Piotr Sankowski. Stochastic query covering for fast approximate document retrieval. ACM Trans. Inf. Syst., 33(3), 2015. doi:10.1145/2699671.
- [2] Nick Arnosti. Greedy matching in bipartite random graphs. Stochastic Systems, 12(2):133–150, 2022.
- [3] Jonathan Aronson, Alan Frieze, and Boris G Pittel. Maximum matchings in sparse random graphs: Karp–sipser revisited. Random Structures & Algorithms, 12(2):111–177, 1998. doi:10.1002/(SICI)1098-2418(199803)12:2\%3C111::AID-RSA1\%3E3.0.CO;2-\%23.
- [4] Ricardo Baeza-Yates, Paolo Boldi, and Flavio Chierichetti. Essential web pages are easy to find. In Proceedings of the 24th International Conference on World Wide Web, WWW ’15, pages 97–107, 2015. doi:10.1145/2736277.2741100.
- [5] Eric Balkanski, Sharon Qian, and Yaron Singer. Instance specific approximations for submodular maximization. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 609–618. PMLR, July 2021. URL: http://proceedings.mlr.press/v139/balkanski21a.html.
- [6] Joël Blot, Wenceslas Fernande de la Vega, Vangelis Th Paschos, and Rachid Saad. Average case analysis of greedy algorithms for optimisation problems on set systems. Theoretical computer science, 147(1-2):267–298, 1995. doi:10.1016/0304-3975(95)00242-O.
- [7] Vaggos Chatziafratis, Tim Roughgarden, and Jan Vondrak. Stability and Recovery for Independence Systems. In 25th Annual European Symposium on Algorithms (ESA 2017), volume 87 of Leibniz International Proceedings in Informatics (LIPIcs), pages 26:1–26:15. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2017. doi:10.4230/LIPIcs.ESA.2017.26.
- [8] Michele Conforti and Gérard Cornuéjols. Submodular set functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the rado-edmonds theorem. Discrete applied mathematics, 7(3):251–274, 1984. doi:10.1016/0166-218X(84)90003-9.
- [9] Matthias Englert, Heiko Röglin, and Berthold Vöcking. Worst case and probabilistic analysis of the 2-opt algorithm for the tsp. Algorithmica, 68(1):190–264, 2014. doi:10.1007/S00453-013-9801-4.
- [10] Uriel Feige. A threshold of ln n for approximating set cover. J. ACM, 45(4):634–652, July 1998. doi:10.1145/285055.285059.
- [11] W. Fernandez de la Vega, V. Th. Paschos, and R. Saad. Average case analysis of a greedy algorithm for the minimum hitting set problem. In Imre Simon, editor, LATIN ’92, pages 130–138, Berlin, Heidelberg, 1992. Springer Berlin Heidelberg.
- [12] Greg N Frederickson. Probabilistic analysis for simple one-and two-dimensional bin packing algorithms. Information Processing Letters, 11(4-5):156–161, 1980. doi:10.1016/0020-0190(80)90041-1.
- [13] Alan Frieze, Colin McDiarmid, and Bruce Reed. Greedy matching on the line. SIAM Journal on Computing, 19(4):666–672, 1990. doi:10.1137/0219045.
- [14] Charles AR Hoare. Quicksort. The computer journal, 5(1):10–16, 1962. doi:10.1093/COMJNL/5.1.10.
- [15] R. M. Karp and M. Sipser. Maximum matching in sparse random graphs. In 22nd Annual Symposium on Foundations of Computer Science (sfcs 1981), pages 364–375, 1981.
- [16] Richard M Karp. Reducibility among combinatorial problems. Complexity of Computer Computations, pages 85–103, 1972. doi:10.1007/978-1-4684-2001-2_9.
- [17] David Kempe, Jon Kleinberg, and Éva Tardos. Maximizing the spread of influence through a social network. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2003.
- [18] Andreas Krause and Carlos Guestrin. Near-optimal observation selection using submodular functions. In Proceedings of the 22nd National Conference on Artificial Intelligence - Volume 2, 2007.
- [19] Andrew Mastin and Patrick Jaillet. Greedy online bipartite matching on random graphs. arXiv preprint arXiv:1307.2536, 2013. arXiv:1307.2536.
- [20] G. L. Nemhauser and L. A. Wolsey. Best algorithms for approximating the maximum of a submodular set function. Mathematics of Operations Research, 3(3):177–188, 1978. doi:10.1287/MOOR.3.3.177.
- [21] G. L. Nemhauser, L. A. Wolsey, and M. L. Fisher. An analysis of approximations for maximizing submodular set functions – I. Mathematical Programming, 14:265–294, December 1978. doi:10.1007/BF01588971.
- [22] Boris Pittel, Joel Spencer, and Nicholas Wormald. Sudden emergence of a giantk-core in a random graph. Journal of Combinatorial Theory, Series B, 67(1):111–151, 1996. doi:10.1006/JCTB.1996.0036.
- [23] Sebastian Pokutta, Mohit Singh, and Alfredo Torrico. On the unreasonable effectiveness of the greedy algorithm: Greedy adapts to sharpness. In International Conference on Machine Learning, pages 7772–7782. PMLR, 2020. URL: http://proceedings.mlr.press/v119/pokutta20a.html.
- [24] Aviad Rubinstein and Junyao Zhao. Budget-Smoothed Analysis for Submodular Maximization. In 13th Innovations in Theoretical Computer Science Conference (ITCS 2022), volume 215 of Leibniz International Proceedings in Informatics (LIPIcs), pages 113:1–113:23. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2022. doi:10.4230/LIPIcs.ITCS.2022.113.
- [25] Barna Saha and Lise Getoor. On maximum coverage in the streaming model & application to multi-topic blog-watch. In Proceedings of the SIAM International Conference on Data Mining, SDM 2009, April 30 - May 2, 2009, Sparks, Nevada, USA, pages 697–708. SIAM, 2009. doi:10.1137/1.9781611972795.60.
- [26] Daniel A Spielman and Shang-Hua Teng. Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time. Journal of the ACM (JACM), 51(3):385–463, 2004. doi:10.1145/990308.990310.
- [27] Satoshi Takabe, Takanori Maehara, and Koji Hukushima. Typical approximation performance for maximum coverage problem. Physical Review E, 97(2), February 2018.
- [28] Orestis A Telelis and Vassilis Zissimopoulos. Absolute o(logm) error in approximating random set covering: an average case analysis. Information Processing Letters, 94(4):171–177, 2005. doi:10.1016/J.IPL.2005.02.009.
- [29] Nicholas C. Wormald. Differential Equations for Random Processes and Random Graphs. The Annals of Applied Probability, 5(4):1217–1235, 1995.
- [30] Nicholas C Wormald et al. The differential equation method for random graph processes and greedy algorithms. Lectures on approximation and randomized algorithms, 73(155):0943–05073, 1999.
Appendix A Additional Discussion about the Left-Regular Random Model
A.1 A Simple Bad Instance for Greedy over a Left-Regular Graph
The following instance corresponds to the classical bad instance for greedy originally provided in [20] to show that greedy achieves at best a approximation, as described using the notation from [23]. We highlight that this simple and original instance from [20] is left-regular with all the left nodes having equal degree. The instance is the following
-
cardinality constraint ,
-
right nodes with ,
-
left nodes with
-
–
for , and
-
–
for
-
–
We note that this graph is left-regular with all the nodes in having degree . The optimal solution is , which covers all the right nodes and thus has value . Note that for any , the marginal contribution of each node to is identical and equal to , i.e., a fraction of the right nodes not covered by . If greedy breaks ties according to order , it returns solution , which has value
whose limit approaches as grows large. This bipartite graph can of course be made balanced with by adding a sufficient number of copies of an arbitrary left node.
A.2 Empirical Performance of Greedy over Random Graphs with Uneven Left-Node Degrees
We evaluate Greedy over random graphs with left nodes whose degrees are either equal or have different level of unevenness. We use this family of instances as an example to illustrate that, for random graphs and at least experimentally, greedy seems to perform worse when the degrees of the left nodes are all equal.
To make the comparison clear, we use parameter to interpolate between equal degrees () and unequal degrees (), while keeping the average degree fixed. The instances we create for our experiments have left degrees randomly chosen from with probabilities , so that the average degree is always . For each value of , we estimate:
As we can see in Figure 1, the lowest ratio is achieved for equal degrees ().
Appendix B Omitted Proofs Of Section 4
Definition 18 (Erdos-Renyi random graph).
samples graphs , with and chosen uniformly, such that .
Definition 19 (Random graph with replacement).
samples graphs , with . Also let be independent uniform random samples (with replacement), then .
Definition 20 (Maximum matching).
Let and let be a maximum matching on . We denote the size of this matching as .
Definition 21 (Maximum matching on random graphs).
Let and . Then denotes the size of the maximum matching on and denotes the size of the maximum matching on .
We state a classic result for the size of maximum matchings in random graphs by [15], but we use the statement of [3]. The difference in some constants is because we assume , while in the original matching setting it was .
Lemma 22.
[Theorem 4 in [3]] Let for some constant and sample graph from . Then for any constant we have that:
where is the smallest root of and .
The following lemma shows that with high probability there is a sublinear number of pairs of duplicated edges in graphs drawn from model .
Lemma 23.
Draw . Then .
Proof.
Let , then , since the right-hand side counts more collisions when the same edge is sampled multiple times. Let arbitrary and we have that:
| (1) |
where the first line is by law of total probability, the second line is due to independent choice of edges and the third line is because edges are chosen uniformly at random with replacement. For the expectation of we have that:
| (2) |
where the second equality is by (1). Finally we show the statement:
where the first inequality is by Markov and the second is due to (2).
Now we show that the maximum matching size in both random graph models is close.
Lemma 24.
for all .
Proof.
We construct a coupling between and by first sampling and then sampling an additional edges from without replacement to obtain . Then we have that:
where the first line is by definition of , the second line is by law of total probability, the third line is by Lemma 23 since , the fourth line is because conditional on we have , so implies , the fifth line is due to the condition being independent of matching size and the sixth line by definition of .
Proof.
Then we have that:
the first line is by definition of , the second line is due to Lemma 24, the fourth line is due to by the assumption for large , the fifth line is because this event is a subset, the sixth line is by taking the complement and the seventh line is due to Lemma 22 for .
