Abstract 1 Introduction 2 Preliminaries 3 Approximation Guarantees 4 Limitation of Greedy References Appendix A Additional Discussion about the Left-Regular Random Model Appendix B Omitted Proofs Of Section 4

On the Average-Case Performance of Greedy for Maximum Coverage

Eric Balkanski ORCID Columbia IEOR, New York, NY, USA    Jason Chatzitheodorou ORCID Columbia IEOR, New York, NY, USA    Flore Sentenac ORCID HEC, Paris, France
Abstract

For the classical maximum coverage problem, the greedy algorithm achieves a worst-case 11/e approximation, which is optimal unless P=NP. The notion of coverage appears in a wide range of optimization tasks, where empirical evaluations indicate approximation ratios close to 1 for the greedy algorithm on real data. Random models have provided average-case justifications for the empirical performance of many well-known algorithms, but little is known about the average-case performance of greedy for maximum coverage.

We analyze the expected approximation ratio of the greedy algorithm in a random model, which we call the left-regular random model. We first show that, for all parameter settings of this model, the expected approximation ratio of the greedy algorithm improves by a constant over its worst-case 11/e guarantee. We then identify two simple conditions, either of which ensures that the expected approximation ratio is close to 1 for sufficiently large graphs. Finally, we show that there is a regime where greedy does not achieve an expected approximation better than 0.94. To obtain these results, we develop analytical tools, including a novel application of the differential equation method and a connection to maximum matching in Erdős-Rényi graphs, which may be of independent interest for other random models.

Keywords and phrases:
Maximum Coverage, Greedy Algorithm, Average-Case Analysis, Differential Equation Method, Random Graphs
Category:
Track A: Algorithms, Complexity and Games
Copyright and License:
[Uncaptioned image] © Eric Balkanski, Jason Chatzitheodorou, and Flore Sentenac; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Approximation algorithms analysis
Related Version:
Full Version: https://arxiv.org/abs/2604.24884
Funding:
Eric Balkanski and Jason Chatzitheodorou were supported in part by NSF grants CCF-2210501 and IIS-2147361.
Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele Puppis

1 Introduction

Maximizing coverage is a fundamental problem in computer science and operations research, as the notion of coverage arises across a wide range of optimization tasks. Influence maximization in social networks [17], facility and sensor placement [18], information retrieval [1], content recommendation [25], and finding essential webpages [4] are examples of problems that have been formulated as maximum coverage problems. Maximum coverage is also closely related to set cover, one of Karp’s original 21 NP-complete problems [16].

Maximum coverage can be defined as follows. Given a bipartite graph with left nodes L and right nodes R, the goal is to find the k nodes in L that cover the largest number of nodes in R, i.e., maxSL:|S|k|N(S)|. The greedy algorithm, which iteratively selects the node in L that covers the largest number of nodes in R not yet covered, achieves a 11/e worst-case approximation ratio guarantee [21], which is optimal unless P=NP [10]. However, worst-case guarantees are often driven by pathological instances, leading to pessimistic bounds that can be uninformative in practice. There have been numerous approaches to bridging this gap between theory and practice for various problems through beyond–worst-case analyses of algorithms. A canonical example is the smoothed analysis of the simplex method [26].

For maximum coverage, the greedy algorithm empirically performs significantly better than its 11/e approximation ratio guarantee [4, 5]. There have been numerous attempts going beyond worst-case to explain this strong performance in practice for the broader problem of monotone submodular maximization under a cardinality constraint. These include the parameterized properties of curvature [8], stability [7], and sharpness [23]. More recently, [24] considered a budget-smoothed model where the cardinality constraint k is stochastic.

However, except for a few notable exceptions discussed in Section 1.1, little is known about the average-case performance of greedy for maximum coverage on random graphs. In contrast, random models have provided average-case justifications for the performance of classical algorithms such as quicksort [14], first-fit decreasing for bin packing [12], local search for the traveling salesman problem [9], and the greedy algorithm for both max-value [19, 2] and min-cost matching [13]. Motivated by the strong empirical performance of greedy for maximum coverage, we explore the following question.

What is the average-case performance of the greedy algorithm for maximum coverage?

We study the approximation ratio of greedy under a model that we call the left-regular random model LRR(n,d). This model generates a bipartite graph with n left nodes L and n right nodes R, where each node uL independently selects d neighbors uniformly at random from R. We also consider extensions in which |L||R| and the nodes in L have non-uniform degrees. Our motivation for the d-regularity assumption for left nodes L in the base model is that it is a challenging regime for greedy. In particular, there are simple bad instances for greedy in which the left nodes have equal degree (see Section A.1 for an example). Moreover, in empirical evaluations of extensions of this model, greedy’s approximation ratio was lowest when the nodes in L had equal degree (see Section A.2 for an example).

Our results

Our first main result is an unconditional bound on the expected approximation ratio of greedy in the left-regular random model. We show that for all values of n,d, and k, there is a constant improvement for the approximation ratio of greedy in this random model compared to its worst-case approximation ratio of 11/e. For all results, we assume that greedy breaks ties according to an arbitrary but consistent ordering of the nodes in L.

Theorem 1.

There exists a constant c>0 such that for all n,d[n],k[n], the greedy algorithm achieves, in expectation, a (11/e+c)-approximation under the left-regular random model.

The second main result provides two alternative sufficient conditions, either of which ensures a near-optimal approximation ratio for greedy for sufficiently large graphs.

Theorem 2.

For any ϵ(0,1), n=Ω(ϵ8), the greedy algorithm achieves, in expectation, a 1ϵ approximation under the left-regular random model if either d=Ω(ϵ8) or k[0,ϵn2d][2nϵd,n].

This result implies that, for any constant ϵ, the degree d of nodes in L being super-constant or the cardinality constraint k lying outside of a constant factor neighborhood of n/d are sufficient conditions for a 1ϵ approximation. We note that when k=n/d, then the sum of the degrees of k left nodes is equal to the number of right nodes. The only regime for which Theorem 2 does not give near-optimality is where d is constant and k=Θ(n/d). The third main result shows that for d=2 and some k such that k=Θ(n/d), the approximation ratio of greedy is not near-optimal as n grows large: it is upper bounded by 0.94.

Theorem 3.

For d=2, there exists a sequence k(n) of cardinality constraints such that the expected approximation ratio of the greedy algorithm is at most 0.94 in the limit as n under the left-regular random model.

These results indicate that the left-regular random model is sufficient to always get a constant improvement in the approximation ratio of greedy, but that it requires additional assumptions for near-optimality; Theorem 2 gives two such assumptions.

Extensions

In the full version of our paper, we consider two extensions of the left-regular random model.

  • Unbalanced bipartite graphs. We consider an extension ULRR(n,m,d) of the base model LRR(n,d) where the number of right nodes is denoted by m and is potentially different from the number of left nodes n. We show that for all n,m such that n=cm for some constant c>0 and for all d[m] and k[n], there exists a constant ϵc>0 such that greedy achieves a 11/e+ϵc approximation in expectation.

  • Non-regular unbalanced bipartite graphs. We consider an extension GenR(n,m,{di}i[n]) of the base model where the left nodes have degree d1dn and the bipartite graph is unbalanced. We show that if either (1) the sum of the k largest degrees is bounded away from m: i=1kdi[(ϵ/2)m,(ϵ/2)1m], (2) the average degree of the k largest degrees is sufficiently large: 1ki=1kdi=Ω(max(1,(n/m)2)ϵ8), or (3) d1,,dn are drawn from a power law distribution and k is sufficiently small, then the expected approximation ratio of greedy is at least 1ϵ.

Our techniques

The positive results rely on two main analytical tools, which may also be of interest for analyzing greedy in other random bipartite graph models.

First, we develop a framework using the differential equation method to analyze an AcceptReject algorithm that is equivalent to greedy. AcceptReject proceeds in phases; in each phase, it iterates through every node to either add it to the solution or reject it. We show that the evolution of the value of the current solution of AcceptReject during the first phase can be approximated by a function that is the unique solution to a differential equation. This differential equation is obtained by approximating the expected per-iteration increase in the solution size as a function of the current solution size.

Second, we show that greedy’s expected value is at least the expected value of a fixed set of k left nodes, chosen independently of the random graph’s realization. Although this claim may seem intuitive, it requires a careful argument because there are iterations in which the marginal gain of the fixed set is larger than that of greedy, where these marginal gains are measured with respect to their respective current solutions. We circumvent that obstacle by analyzing a hybrid algorithm that runs greedy for t iterations and then completes the solution by selecting the kt nodes with the largest residual degrees at iteration t.

The negative result is established by relating maximum coverage in 2-left regular graphs and maximum matching in Erdős-Rényi random graphs. This connection yields a lower bound on the coverage of the optimal solution via known results on maximum matching. At the same time, we tightly control the performance of greedy through our differential equation analysis.

Open questions

An alternative random model in which it would be natural to study the approximation ratio of greedy is the Erdős–Rényi random bipartite graph model Gn,n,p with n left nodes, n right nodes, and an edge between each left and right node independently with probability p. To the best of our knowledge, there is no known result for the maximum coverage problem under Erdős–Rényi random bipartite graphs and analyzing greedy in that model seems non-trivial.

Obtaining stronger unconditional bounds on the approximation ratio of greedy in the left-regular random model is a natural direction for future work. In particular, using the differential equation method to analyze additional phases of AcceptReject is a promising direction for establishing stronger approximation guarantees for greedy in the regime where it is not near-optimal.

Paper organization

We discuss additional related work in Section 1.1 and introduce preliminary definitions and notation in Section 2. In Section 3, we show the approximation guarantees achieved by greedy in the left-regular random model. In Section 4, we show the negative result for greedy.

1.1 Related Work

[4] use the dual of the maximum coverage LP to provide bounds on the approximation ratio of greedy that are in practice much stronger than its worst-case 11/e approximation. In particular, for k50, they obtain bounds on real data that are always at least 0.95. They also show that in the random model, where left nodes and right nodes both have degrees that follow a power law distribution and edges are added randomly according to these degree distributions, greedy achieves a 1ϵ approximation if it has a marginal contribution of at least O(ϵ2logn) at every iteration. In [27], three algorithms for maximum coverage, including greedy, are analyzed heuristically using the differential equation method on sparse biregular random bipartite graphs. In particular, they use a differential equation to predict a threshold for the cardinality constraint k below which greedy achieves exact optimality with high probability and above which it is no longer optimal with high probability.

For the closely related set cover problem where the goal is to cover all the nodes in R with a subset of L of minimum size, [11] and [6] also study a random model with fixed degrees and also use the differential equation method. However, their primary focus is on methods that, given parameter values for the random model, yield numerical estimates of the approximation ratio of greedy on random instances for these specific parameters, but not closed-form approximation ratios. In addition to these numerical estimates, [11] shows that for a fixed ratio |R|/|L|, greedy is asymptotically optimal as the degree of right nodes tends to infinity. When each edge is included with constant probability, [28] shows that there is an algorithm, distinct from greedy, that is asymptotically optimal for set cover.

2 Preliminaries

In the maximum coverage problem, there is a bipartite graph B=(L,R,E) with n left nodes L={u1,,un}, m right nodes R={v1,,vm}, and edges EL×R. The goal is to find the k nodes in L that cover the largest number of nodes in R, i.e., maxSL:|S|k|NB(S)| where NB(S) are the neighbors of S in B. We abuse notation and write N(S) when B is clear from context. The greedy algorithm (Greedy) iteratively adds to the current solution S the left node that covers the most right nodes not yet covered. We refer to |N(u)N(S)| and |N(S)| as the marginal contribution of u to S and the value of S, respectively.

Algorithm 1 Greedy(B,k).

The random graph model

We consider instances of the maximum coverage problem with random bipartite graphs drawn from the following random graph model that we call the left-regular random model. Throughout the paper, uppercase letters represent fixed sets/graphs, while calligraphic letters denote random sets/graphs.

Definition 4.

The LRR(n,d) model generates a bipartite graph =(L,R,) by setting |L|=|R|=n and, independently for each uL, selecting d neighbors in R uniformly at random without replacement.

We note that a left-regular random graph satisfies Pr[vjN(ui)]=dn for all vjR and uiL. When analyzing Greedy under the left-regular random model, we assume it breaks ties according to an arbitrary, but consistent, ordering of the nodes in L, and that the left nodes ui are indexed in the order in which greedy breaks ties.

We let 𝒢k() and 𝒪k() denote the greedy solution and the optimal solution, respectively, for the maximum coverage problem with cardinality constraint k over a bipartite graph LRR(n,d). Throughout the paper, approximation guarantees in expectation are defined as ratios of expected values. For fixed n,d, and k, the greedy algorithm achieves, in expectation, an α-approximation if

𝔼LRR(n,d)[|N(𝒢k())|]α𝔼LRR(n,d)[|N(𝒪k())|].

We abuse notation and write 𝒢k and 𝒪k when is clear from context. It will be useful in our analysis to compare 𝔼[|N(𝒢k)|] to the expected value of a fixed set of size k. For that purpose, we denote the first k left nodes as Hk={u1,u2,,uk}. We also use the notation [n]={1,,n}.

3 Approximation Guarantees

In this section, we show that greedy achieves an approximation ratio that is, for all parameters n,d, and k, a constant improvement over its worst-case 11/e guarantee and, in a wide range of regimes, asymptotically optimal. We first discuss two central technical tools that we use for these two results in Section 3.1, then partition the space of all parameters in three regions and analyze greedy in each of them in Section 3.2, and finally combine the analyses of these regions to obtain the desired results in Section 3.3. Missing proofs can be found in the full version of our paper.

3.1 Technical Tools

The near-linear, saturated, and critical regions

We distinguish three parameter regimes that we analyze separately. First, for small values of k, we have the near-linear region, where Greedy selects nodes that have neighborhoods with almost no overlap. Therefore, their value increases almost linearly with k. Second, for large values of k, we have the saturated region, where Greedy covers almost all the right nodes. Between these two regions lies the critical region, which is the most challenging to analyze.

The differential equation method

The first technical tool is a novel application of the differential equation method. We use it to estimate the number of iterations

td=max{t1:|N(𝒢t())N(𝒢t1())|=d}

in which Greedy, over a left-regular random graph LRR(n,d), selects a node with marginal contribution to the current solution 𝒢t1 that is equal to d, i.e., all d neighbors of the selected node are disjoint from the neighbors of 𝒢t1. The main lemma for this estimate td of td is a bound on its error |tdtd| that, for any dn/2, has an O~(n) dependence on n with high probability.

Lemma 5.

Let n, dn/2,k[n] and LRR(n,d). With probability at least 11n, estimate td=(1(1+d(d1))1d1)nd is such that |tdtd|3ed28nlog2n.

This estimate plays a key role in the proof showing that greedy achieves a constant improvement over 11/e in the critical region when d is small. To prove Lemma 5, we employ the differential equation method, formalized by [29]. Under appropriate regularity conditions, including bounded increments and Lipschitz continuity, this method yields a high-probability bound on the discrepancy between a discrete stochastic process and the deterministic solution of an associated differential equation. It has found great use in the field of random graphs [11, 22, 29, 30, 19, 3].

We do not apply the method directly to the standard description of Greedy because its evolution is difficult to express through a low-dimensional Markovian state, which is crucial for tractability. Instead, we analyze AcceptReject, an equivalent reformulation of Greedy. AcceptReject, which is formally defined in Algorithm 2, proceeds in phases from p=maxuL|N(u)| to 1. In phase p, it iterates over the left nodes ui of the bipartite graph in the order in which greedy breaks ties and either accepts (meaning a node gets added to the solution) or rejects each of them based on whether their marginal contribution to the current solution A is at least p. This iterative exploration of the graph in each phase implies that its randomness is revealed sequentially, allowing low-dimensional Markovian states to describe the evolution of the current solution size |A|.

Algorithm 2 AcceptReject(B,k).

We denote by 𝒜ip the set A of accepted nodes at iteration i of phase p of AcceptReject. For the proof of Lemma 5, we focus on analyzing the first phase p=maxuL|N(u)|=d of AcceptReject on a graph LRR(n,d).

Proof sketch of Lemma 5 (proof can be found in the full version).

The solution returned by Greedy and AcceptReject is not only the same, but the ordering in which nodes are added to this solution is also identical since the nodes ui are indexed in the order in which Greedy breaks ties. Thus, the number of iterations td where Greedy adds nodes with marginal contribution d is equal to the number of nodes accepted during the first phase p=d of AcceptReject, i.e., td=|𝒜nd|. We define the function F(y)=(1dy)d for all y.

The central part of the proof consists of showing that |𝒜id|ny(i/n) where y() is the unique solution to the following differential equation:

y(t)=F(y(t))=(1dy(t))d,y(0)=0.

This approximation is obtained by using the differential equation method, which requires the following four conditions.

  • The expected one-step change 𝔼[|𝒜i+1d||𝒜id|||𝒜id|] is tightly approximated by F(|𝒜id|/n). For this condition, we show the following:

    𝔼[|𝒜i+1d||𝒜id|||𝒜id|] =Pr[|N(ui+1)N(𝒜id)|=d||𝒜id|]
    =(n|𝒜id|dd)(nd)
    (1d|𝒜id|n)d
    =F(|𝒜id|n).
  • The function F is Lipschitz.

  • A deterministic bound for the one-step change |𝒜i+1d||𝒜id|. In our case, |𝒜i+1d||𝒜id|1.

  • |𝒜0d|y(0). In our case, |𝒜0d|=y(0)=0.

We show that 𝒜id and F satisfy these four conditions with parameters such that the resulting approximation td=|𝒜nd|ny(1) is sufficiently tight to imply the desired bound. A promising direction for future work is to leverage estimates of the number of accepts across all phases, rather than only the first, as this could yield a tighter lower bound on the coverage of Greedy. The main challenge is that the solution of the differential equations in each phase depends on the solutions from the preceding phases, making closed-form expressions analogous to those obtained for td unlikely. This interdependence substantially complicates the derivation of the approximation ratio. Nevertheless, we believe that a sufficiently careful analysis could overcome these technical obstacles and uncover the true extent of the improvement that Greedy achieves over 11/e.

The fixed-set lower bound

The second technical tool provides a seemingly simple lower bound on the expected value of the greedy solution. The lower bound is the expected value of a fixed set of left nodes chosen independently of the realization of the random graph. For this fixed set of nodes, we consider the k nodes with lowest indices Hk={u1,,uk}.

Lemma 6.

Let n, d[n],k[n], and LRR(n,d), then 𝔼[|N(𝒢k)|]𝔼[|N(Hk)|].

In Section 3.2, we use this bound to show that greedy is near-optimal in the near-linear, the saturated, and the critical region when d is large. The only region where it does not provide a constant improvement is in the critical region when d is small, where we use Lemma 5 instead.

It may seem natural that Greedy performs better than Hk over left-regular random graphs. However, a difficulty that arises in proving Lemma 6, is that the expected marginal improvement 𝔼[|N(𝒢t)N(𝒢t1)|] of Greedy is not always larger than the expected marginal improvement 𝔼[|N(Ht)N(Ht1)|] of Hk at all iterations t, which we illustrate in the full version of our paper. Nevertheless, in the early iterations, where a small number of right nodes have been covered, it does hold that 𝔼[|N(𝒢t)N(𝒢t1)|]𝔼[|N(Ht)N(Ht1)|]. The challenge is thus to show that the expected value of Greedy remains larger in later iterations.

Proof sketch of Lemma 6 (proof can be found in the full version).

We define a hybrid algorithm 𝒴t that runs in two phases. First, it runs t iterations of Greedy, after which its current solution is 𝒢t. In the second phase, it adds to the solution the kt nodes with largest marginal contribution to 𝒢t.

The main part of the proof consists in showing that trading one iteration of Greedy in the first phase for one more node in the second phase reduces the expected value, i.e.,

𝔼[|N(𝒴t)|]𝔼[|N(𝒴t1)|].

To show that inequality, we first note that 𝒢t𝒴t𝒴t1, which implies that it suffices to compare the marginal contribution of the kt other nodes in the two solutions to 𝒢t. The crucial difference that we leverage is that the kt other nodes in 𝒴t are selected to be the nodes with largest marginal contribution to 𝒢t, whereas for 𝒴t1 they are the nodes with largest marginal contribution to 𝒢t1. With 𝔼[|N(𝒴t)|]𝔼[|N(𝒴t1)|], the lemma then follows since 𝔼[|N(𝒢k)|]=𝔼[|N(𝒴k)|] and 𝔼[|N(𝒴0)|]=𝔼[|N(Hk)|].

3.2 Analysis For The Different Regions

Near-linear and saturated regions

In both regions, we show that Greedy achieves a ratio close to 1 in Lemma 7. Intuitively, in the near-linear region (i.e., k<<n/d), even the nodes of Hk share very few neighbors; therefore, the expected value of Greedy is close to kd. On the other hand, in the saturated region (i.e., k>>n/d), Hk covers most of the right nodes, even if the nodes of Hk share many neighbors.

Lemma 7.

Let ϵ(0,1),n,d[n],k[0,ϵn2d][2nϵd,n] and LRR(n,d). Then we have 𝔼[|N(𝒢k)|](1ϵ)𝔼[|N(𝒪k)|].

The proof uses the fixed set lower bound from Lemma 6, whose value is lower bounded by the following lemma (proof can be found in the full version).

Lemma 8.

Let n, d[n],k[n], and LRR(n,d). Then 𝔼[|N(Hk)|](1ekdn)n.

The proof also uses the following inequality, whose proof can be found in the full version.

Claim 9.

For all ϵ(0,1), 1eϵϵ1ϵ.

We are now ready to prove Lemma 7.

Proof of Lemma 7.

For k2nϵd:

𝔼[|N(𝒢k)|]𝔼[|N(Hk)|](1ekd/n)n(1e1/ϵ)n(1ϵ)𝔼[|N(𝒪k)|],

where the first inequality is because 𝔼[|N(𝒢k)|] is lower bounded by 𝔼[|N(Hk)|] by Lemma 6, the second inequality is due to Lemma 8, the third inequality is because kd/n2/ϵ1/ϵ by assumption, the fourth inequality is due to e1/ϵϵ and |N(𝒪k)| is upper bounded by n. For kϵn2d:

𝔼[|N(𝒢k)|]𝔼[|N(Hk)|](1ekd/n)n=1ekd/nkd/nkd 1eϵϵkd
(1ϵ)𝔼[|N(𝒪k)|],

where the first inequality is because 𝔼[|N(𝒢k)|] is lower bounded by 𝔼[|N(Hk)|] by Lemma 6, the second inequality is due to Lemma 8, the third inequality is because kd/nϵ/2ϵ by assumption, the fourth inequality is due to Claim 9 and |N(𝒪k)| is upper bounded by kd.

Critical region: large degrees

We use Lemma 6 and Chernoff bounds over negatively correlated variables to show a 1ϵ ratio in the critical region (i.e. kn/d) when the degrees are large. Intuitively, it is possible to upper bound the optimal solution, since any k nodes suffer from sharing too many neighbors.

Lemma 10.

Let ϵ(0,1),d204ϵ8,nd,k[ϵn2d,2nϵd], and LRR(n,d). Then we have 𝔼[|N(𝒢k)|](1ϵ)𝔼[|N(𝒪k)|].

Proof sketch (proof can be found in the full version).

We show that the values of all sets concentrate with high probability. To this end, we express the value |N(S)|=vR𝟙{vN(S)} of a set S as the sum over vR of the indicator variables for whether v is covered by S. We first show that these indicator variables are negatively correlated.

We then use a generalization of the Chernoff bound for negatively correlated variables and a union bound to show that Pr[|N(𝒪k)|(1+δ)𝔼[|N(Hk)|]]1n for an appropriate choice of δ. It then follows that 𝔼[|N(𝒢k)|]𝔼[|N(Hk)|]11+ϵ𝔼[|N(𝒪k)], where the first inequality is by Lemma 6 and the second inequality by the choice of δ and the assumption on n.

Critical region: small degrees

We use Lemma 5 to lower bound the ratio in the critical region, when the degrees are small. The main challenge in this case is that the optimal solution can achieve a high value close to n, so Lemmas 6 and 8 only retrieve worst-case ratio 11e. Therefore, we need a tighter lower bound for Greedy. This is the most challenging case and the only one in which we do not show a 1ϵ ratio. Nevertheless, we still improve over the 11e ratio by a constant, albeit small.

Lemma 11.

There exists a function n0(x):(0,1) such that for ϵ(0,1),nn0(ϵ),d204ϵ8,k[ϵn2d,2nϵd], and LRR(n,d), we have 𝔼[|N(𝒢k)|](11e+Ω(ϵ24))𝔼[|N(𝒪k)|].

The proof uses worst-case analysis after iteration td, to obtain a result for ktd. Specifically, we show that as long as td is on the order of n/d, Greedy is bounded a constant away from 11e, which we formalize in the following lemma.

Lemma 12.

Let B=(L,R,E) be a d-left-regular bipartite graph with |L|=|R|=n. For all ktd we have |N(Gk)|(11e+1e(tdn/d)3)|N(Ok)|.

We are now ready to give a proof sketch of Lemma 11.

Proof sketch of Lemma 11 (proof can be found in the full version).

Let δ be an appropriately chosen error term. For ktdδ, Greedy gains d on each iteration with high probability by Lemma 5, so 𝔼[|N(𝒢k)|](11n)𝔼[|N(𝒪k)|]. For ktdδ, Greedy gains d on each iteration until tdδ with high probability by Lemma 5, and for later iterations we use Lemma 12:

𝔼[|N(𝒢k)|](11e+1e(tdδn/d)38ϵn)𝔼[|N(𝒪k)|].

We choose n0(ϵ) large enough to make terms δn/d=O(ϵ8) and 8ϵn=O(ϵ25). The statement follows by lower bounding tdδn/d=Ω(ϵ8).

3.3 Putting Everything Together

By combining Lemma 7 and Lemma 10, we immediately get the near-optimality of greedy in the near-linear region, saturated region, and critical region with large degrees. See 2

The second main result regarding the approximation guarantee of greedy requires the following inequality (proof can be found in full version).

Claim 13.

For all k1, (11k)k1e14ek.

By combining Lemma 11, which is for the critical region with small degrees, and Theorem 2, which is for all other regions, we get the constant improvement over 11/e for all regions.

Theorem 1. [Restated, see original statement.]

There exists a constant c>0 such that for all n,d[n],k[n], the greedy algorithm achieves, in expectation, a (11/e+c)-approximation under the left-regular random model.

Proof.

Let ϵ=0.3 and n0(x) be the function from the statement of Lemma 11. For nn0(ϵ), the statement is implied by Theorems 2 and 11. For n<n0(ϵ), the worst-case approximation ratio of greedy is 1(11k)k, so we get

1(11k)k11e+14ek11e+14en0(ϵ),

where the first inequality is by Claim 13 and the second since kn<n0(ϵ).

4 Limitation of Greedy

In the previous section, Theorem 2 does not guarantee an approximation ratio close to 1 for all parameter values. The remaining difficult regime is when the degree d is small and k lies in a critical window around n/d. In this section, we establish Theorem 3, which demonstrates that this gap is due to a fundamental limitation of Greedy rather than a proof artifact. Specifically, we identify a counterexample with d=2, where the ratio is bounded away from 1 as n goes to infinity. The main results are Lemmas 15 and 17, which lower bound Opt and upper bound Greedy respectively. We defer the complete proofs to Appendix B.

4.1 Lower Bound for Opt

The first challenge is to lower-bound the value of the optimal solution. We resolve this difficulty by relating the value of the optimal solution in 2-left-regular random graphs to the size of a maximum matching in Erdős-Renyi random graphs. This process takes two steps.

First, the value of the optimal solution in any 2-left-regular bipartite graph B=(L,R,E) is at least twice the minimum between k and the size of the largest set of left nodes with no common neighbors, i.e.

|N(𝒪k(B))|2min(k,λ(B)), (1)

with

λ(B)=max{|S|:SL s.t. N(u)N(u)=uuS}. (2)

The following lemma reduces the computation of λ(B) to finding the size of a maximum matching in a specific graph IB, defined as follows: the vertex set of IB is the set of right nodes of B, and for each left node uL, we add an edge in IB between the two neighbors of u. If two nodes on the left side share the same neighbor set, the parallel edges are merged; in other words, IB is a simple graph.

Lemma 14.

Let B=(L,R,E) be a 2-left-regular bipartite graph. Also let IB=(R,EB) be a graph such that EB={e1,,en} where ei=N(ui) for all i[n]. Then λ(B)=μ(IB), where μ(IB) is the size of the maximum matching in IB.

Proof.

Consider a set SL attaining the maximum in Equation (2), i.e., |S|=λ(B) and N(u)N(u)= for all distinct u,uS. We construct

M={ei:uiS},

which is a valid matching in IB by definition of S, and clearly |M|=|S|. We now show that M is a maximum matching in IB. Towards a contradiction, assume there exists a matching M in IB such that |M|>|M|. Then we can define:

S={ui:eiM},

where N(ui)N(uj)= for all ui,ujS since M is a matching. Then |S|=|M|>|M|=|S|=λ(B), which contradicts optimality of S. The statement follows as λ(B)=|S|=|M|=μ(IB).

Now suppose that is sampled from LRR(n,2). Then is distributed as a graph on n vertices obtained by sampling n edges independently and uniformly at random with replacement from the (n2) possible edges, merging parallel edges. This distribution is closely related to the classical Erdős–Rényi model 𝔾n,m, in which m edges are sampled uniformly at random without replacement. Sharp estimates for the maximum matching size in Erdős–Rényi graphs are known; see, e.g., [15]. As we show in the following lemma, these results yield a bound on μ(), which can be translated into a lower bound on the expected value of the optimal solution. Before we proceed, we define constants γ,γ, where γ is the smallest root of x=2e2ex and γ=2eγ since we use them extensively in our proofs.

Lemma 15.

Let n and LRR(n,2). Then for any k(1γ+γ+γγ4n19)n, we have 𝔼[|N(𝒪k)|](1o(1))2k.

The proof leverages the following lemma, which provides a probabilistic lower bound on the size of the maximum matching in .

Lemma 16.

Let n and LRR(n,2), then

Pr[μ()(1γ+γ+γγ4n19)n]1o(1).

The proof, deferred to Appendix B, bounds how much the maximum matching size can change due to the discrepancy between the generation process of and the seminal Erdős-Renyi model, and leverages what is known about the size of maximum matchings in Erdős-Renyi. We are now ready to prove Lemma 15.

Proof of Lemma 15.

Consider any k(1γ+γ+γγ4n19)n, then:

𝔼[|N(𝒪k)|]2kPr[λ()k]=2kPr[μ()k],

where the inequality is due to Equation 1 and the equality is due to λ()=μ() by Lemma 14. We now lower bound μ():

Pr[μ()k]Pr[μ()(1γ+γ+γγ4n19)n]1o(1),

where the first inequality is due to the assumption on k and the second due to Lemma 16. Chaining with the previous inequality establishes the lemma.

4.2 Upper Bound for Greedy

The second challenge is to upper bound the value of Greedy. We do so through the machinery of Lemma 5 in the following lemma.

Lemma 17.

Let n and LRR(n,2). Then we have that, for any k>13n, 𝔼[|N(𝒢k)|](1+o(1))(13n+k).

Proof.

By definition of t2, up to iteration t2, Greedy will gain 2 per iteration, and thereafter it gains at most 1 per iteration. Consequently, for any k, the following holds

𝔼[|N(𝒢k)|]𝔼[2t2+(kt2)]=𝔼[t2]+k.

As t2n always holds, we have:

𝔼[t2]t2+3e48nlog2n+nPr[t2t2+3e48nlog2n].

We upper bound the probability using Lemma 5:

Pr[t2t2+3e48nlog2n]1n.

Chaining those three inequalities yields:

𝔼[|N(𝒢k)|]t2+3e48nlog2n+1+k=(1+3e48nlog2n+1t2+k)(t2+k).

The statement then follows, since t2=n/3 by definition.

4.3 Putting Everything Together

We proceed to show Theorem 3 by combining Lemmas 15 and 17. See 3

Proof.

Let k(n)=(1γ+γ+γγ4n19)n, then we have:

k(n)(1γ+γ+γγ4n19)n1=(1γ+γ+γγ4n19n1)n. (1)

We upper bound the ratio:

𝔼[|N(𝒢k(n))|]𝔼[|N(𝒪k(n))|] 𝔼[|N(𝒢k(n))|](1o(1))2k(n)
(1+o(1))(13n+k(n))(1o(1))2k(n)
n12+132γ+γ+γγ2
0.94,

where the first inequality is due to Lemma 15, the second inequality is due to Lemma 17 which applies since k(n)t2=13n for large enough n, the limit is due to Equation (1) and because all o(1) terms vanish, and the third inequality is because both γ,γ0.853.

References

  • [1] Aris Anagnostopoulos, Luca Becchetti, Ilaria Bordino, Stefano Leonardi, Ida Mele, and Piotr Sankowski. Stochastic query covering for fast approximate document retrieval. ACM Trans. Inf. Syst., 33(3), 2015. doi:10.1145/2699671.
  • [2] Nick Arnosti. Greedy matching in bipartite random graphs. Stochastic Systems, 12(2):133–150, 2022.
  • [3] Jonathan Aronson, Alan Frieze, and Boris G Pittel. Maximum matchings in sparse random graphs: Karp–sipser revisited. Random Structures & Algorithms, 12(2):111–177, 1998. doi:10.1002/(SICI)1098-2418(199803)12:2\%3C111::AID-RSA1\%3E3.0.CO;2-\%23.
  • [4] Ricardo Baeza-Yates, Paolo Boldi, and Flavio Chierichetti. Essential web pages are easy to find. In Proceedings of the 24th International Conference on World Wide Web, WWW ’15, pages 97–107, 2015. doi:10.1145/2736277.2741100.
  • [5] Eric Balkanski, Sharon Qian, and Yaron Singer. Instance specific approximations for submodular maximization. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 609–618. PMLR, July 2021. URL: http://proceedings.mlr.press/v139/balkanski21a.html.
  • [6] Joël Blot, Wenceslas Fernande de la Vega, Vangelis Th Paschos, and Rachid Saad. Average case analysis of greedy algorithms for optimisation problems on set systems. Theoretical computer science, 147(1-2):267–298, 1995. doi:10.1016/0304-3975(95)00242-O.
  • [7] Vaggos Chatziafratis, Tim Roughgarden, and Jan Vondrak. Stability and Recovery for Independence Systems. In 25th Annual European Symposium on Algorithms (ESA 2017), volume 87 of Leibniz International Proceedings in Informatics (LIPIcs), pages 26:1–26:15. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2017. doi:10.4230/LIPIcs.ESA.2017.26.
  • [8] Michele Conforti and Gérard Cornuéjols. Submodular set functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the rado-edmonds theorem. Discrete applied mathematics, 7(3):251–274, 1984. doi:10.1016/0166-218X(84)90003-9.
  • [9] Matthias Englert, Heiko Röglin, and Berthold Vöcking. Worst case and probabilistic analysis of the 2-opt algorithm for the tsp. Algorithmica, 68(1):190–264, 2014. doi:10.1007/S00453-013-9801-4.
  • [10] Uriel Feige. A threshold of ln n for approximating set cover. J. ACM, 45(4):634–652, July 1998. doi:10.1145/285055.285059.
  • [11] W. Fernandez de la Vega, V. Th. Paschos, and R. Saad. Average case analysis of a greedy algorithm for the minimum hitting set problem. In Imre Simon, editor, LATIN ’92, pages 130–138, Berlin, Heidelberg, 1992. Springer Berlin Heidelberg.
  • [12] Greg N Frederickson. Probabilistic analysis for simple one-and two-dimensional bin packing algorithms. Information Processing Letters, 11(4-5):156–161, 1980. doi:10.1016/0020-0190(80)90041-1.
  • [13] Alan Frieze, Colin McDiarmid, and Bruce Reed. Greedy matching on the line. SIAM Journal on Computing, 19(4):666–672, 1990. doi:10.1137/0219045.
  • [14] Charles AR Hoare. Quicksort. The computer journal, 5(1):10–16, 1962. doi:10.1093/COMJNL/5.1.10.
  • [15] R. M. Karp and M. Sipser. Maximum matching in sparse random graphs. In 22nd Annual Symposium on Foundations of Computer Science (sfcs 1981), pages 364–375, 1981.
  • [16] Richard M Karp. Reducibility among combinatorial problems. Complexity of Computer Computations, pages 85–103, 1972. doi:10.1007/978-1-4684-2001-2_9.
  • [17] David Kempe, Jon Kleinberg, and Éva Tardos. Maximizing the spread of influence through a social network. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2003.
  • [18] Andreas Krause and Carlos Guestrin. Near-optimal observation selection using submodular functions. In Proceedings of the 22nd National Conference on Artificial Intelligence - Volume 2, 2007.
  • [19] Andrew Mastin and Patrick Jaillet. Greedy online bipartite matching on random graphs. arXiv preprint arXiv:1307.2536, 2013. arXiv:1307.2536.
  • [20] G. L. Nemhauser and L. A. Wolsey. Best algorithms for approximating the maximum of a submodular set function. Mathematics of Operations Research, 3(3):177–188, 1978. doi:10.1287/MOOR.3.3.177.
  • [21] G. L. Nemhauser, L. A. Wolsey, and M. L. Fisher. An analysis of approximations for maximizing submodular set functions – I. Mathematical Programming, 14:265–294, December 1978. doi:10.1007/BF01588971.
  • [22] Boris Pittel, Joel Spencer, and Nicholas Wormald. Sudden emergence of a giantk-core in a random graph. Journal of Combinatorial Theory, Series B, 67(1):111–151, 1996. doi:10.1006/JCTB.1996.0036.
  • [23] Sebastian Pokutta, Mohit Singh, and Alfredo Torrico. On the unreasonable effectiveness of the greedy algorithm: Greedy adapts to sharpness. In International Conference on Machine Learning, pages 7772–7782. PMLR, 2020. URL: http://proceedings.mlr.press/v119/pokutta20a.html.
  • [24] Aviad Rubinstein and Junyao Zhao. Budget-Smoothed Analysis for Submodular Maximization. In 13th Innovations in Theoretical Computer Science Conference (ITCS 2022), volume 215 of Leibniz International Proceedings in Informatics (LIPIcs), pages 113:1–113:23. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2022. doi:10.4230/LIPIcs.ITCS.2022.113.
  • [25] Barna Saha and Lise Getoor. On maximum coverage in the streaming model & application to multi-topic blog-watch. In Proceedings of the SIAM International Conference on Data Mining, SDM 2009, April 30 - May 2, 2009, Sparks, Nevada, USA, pages 697–708. SIAM, 2009. doi:10.1137/1.9781611972795.60.
  • [26] Daniel A Spielman and Shang-Hua Teng. Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time. Journal of the ACM (JACM), 51(3):385–463, 2004. doi:10.1145/990308.990310.
  • [27] Satoshi Takabe, Takanori Maehara, and Koji Hukushima. Typical approximation performance for maximum coverage problem. Physical Review E, 97(2), February 2018.
  • [28] Orestis A Telelis and Vassilis Zissimopoulos. Absolute o(logm) error in approximating random set covering: an average case analysis. Information Processing Letters, 94(4):171–177, 2005. doi:10.1016/J.IPL.2005.02.009.
  • [29] Nicholas C. Wormald. Differential Equations for Random Processes and Random Graphs. The Annals of Applied Probability, 5(4):1217–1235, 1995.
  • [30] Nicholas C Wormald et al. The differential equation method for random graph processes and greedy algorithms. Lectures on approximation and randomized algorithms, 73(155):0943–05073, 1999.

Appendix A Additional Discussion about the Left-Regular Random Model

A.1 A Simple Bad Instance for Greedy over a Left-Regular Graph

The following instance corresponds to the classical bad instance for greedy originally provided in [20] to show that greedy achieves at best a 11/e approximation, as described using the notation from [23]. We highlight that this simple and original instance from [20] is left-regular with all the left nodes having equal degree. The instance is the following

  • cardinality constraint k,

  • right nodes R={1,,k}k with |R|=kk,

  • left nodes L={a1,,ak1}{b1,,bk} with

    • N(ai)={xR:xi=1} for i[k1], and

    • N(bi)={xR:xk=i} for i[k]

We note that this graph is left-regular with all the nodes in L having degree kk1. The optimal solution is {b1,,bk}, which covers all the right nodes and thus has value kk. Note that for any S{a1,,ak1}, the marginal contribution of each node uLS to S is identical and equal to 1k|RN(S)|, i.e., a 1/k fraction of the right nodes not covered by S. If greedy breaks ties according to order (a1,,ak1,b1,,bk), it returns solution {a1,,ak1,b1}, which has value

(1(11k)k)|R|,

whose limit approaches 11/e as k grows large. This bipartite graph can of course be made balanced with |L|=|R| by adding a sufficient number of copies of an arbitrary left node.

A.2 Empirical Performance of Greedy over Random Graphs with Uneven Left-Node Degrees

We evaluate Greedy over random graphs with left nodes whose degrees are either equal or have different level of unevenness. We use this family of instances as an example to illustrate that, for random graphs and at least experimentally, greedy seems to perform worse when the degrees of the left nodes are all equal.

To make the comparison clear, we use parameter a[0,1] to interpolate between equal degrees (a=0) and unequal degrees (a=1), while keeping the average degree fixed. The instances we create for our experiments have left degrees randomly chosen from 1,4,7 with probabilities a2,1a,a2, so that the average degree is always 4. For each value of a, we estimate:

mink[n]𝔼[|N(𝒢k)|]𝔼[|N(𝒪k)|].

As we can see in Figure 1, the lowest ratio is achieved for equal degrees (a=0).

Refer to caption
Figure 1: The computation is carried out for n=m=100 and the ratio between the value of Greedy and Opt is calculated by averaging over 50 runs. Opt was implemented in Python using Gurobi to solve the integer program. The shaded region depicts the standard error for our estimation.

Appendix B Omitted Proofs Of Section 4

Definition 18 (Erdos-Renyi random graph).

𝔾n,m samples graphs 𝒢=(V,), with |V|=n and (V2) chosen uniformly, such that ||=m.

Definition 19 (Random graph with replacement).

𝔾n,mr samples graphs 𝒢r=(V,r), with |V|=n. Also let e1,e2,,em(V2) be independent uniform random samples (with replacement), then r={e1,,em}.

Definition 20 (Maximum matching).

Let G=(V,E) and let M be a maximum matching on G. We denote the size of this matching as μ(G)=|M| .

Definition 21 (Maximum matching on random graphs).

Let 𝒢𝔾n,m and 𝒢r𝔾n,mr. Then μ(n,m)=μ(𝒢) denotes the size of the maximum matching on 𝒢 and μr(n,m)=μ(𝒢r) denotes the size of the maximum matching on 𝒢r.

We state a classic result for the size of maximum matchings in random graphs by [15], but we use the statement of [3]. The difference in some constants is because we assume n=cm, while in the original matching setting it was n=cm/2.

Lemma 22.

[Theorem 4 in [3]] Let n=cm for some constant c>0 and sample graph 𝒢 from 𝔾m,n. Then for any constant ϵ>0 we have that:

Pr[|μ(m,n)m(1γ+γ+γγ4c)|m17+ϵ]=o(1),

where γ is the smallest root of x=2ce2cex and γ=2ceγ.

The following lemma shows that with high probability there is a sublinear number of pairs of duplicated edges in graphs drawn from model 𝔾n,nr.

Lemma 23.

Draw 𝒢r(V,r)𝔾n,nr. Then Pr[n|r|logn]1logn.

Proof.

Let X=n|r|, then X1i<jn𝟙{ei=ej}, since the right-hand side counts more collisions when the same edge is sampled multiple times. Let ij arbitrary and we have that:

Pr[ei=ej] ={v,v}(V2)Pr[ei={v,v},ej={v,v}]
={v,v}(V2)Pr[ei={v,v}]Pr[ej={v,v}]
=(n2)(1(n2))2
=1(n2), (1)

where the first line is by law of total probability, the second line is due to independent choice of edges and the third line is because edges are chosen uniformly at random with replacement. For the expectation of X we have that:

𝔼[X]1i<jnPr[ei=ej]=1i<jn1(n2)=(n2)(n2)=1 (2)

where the second equality is by (1). Finally we show the statement:

Pr[Xlogn]𝔼[X]logn1logn,

where the first inequality is by Markov and the second is due to (2).

Now we show that the maximum matching size in both random graph models is close.

Lemma 24.

Pr[μr(n,n)x]Pr[μ(n,n)x+logn](11logn) for all x.

Proof.

We construct a coupling between 𝔾n,nr and 𝔾n,n by first sampling 𝒢^r=(V,^r)𝔾n,nr and then sampling an additional n|^r| edges from (V2)^r without replacement to obtain 𝒢^n,n=(V,^)𝔾n,n. Then we have that:

Pr[μr(n,n)x] =Pr[μ(𝒢r^)x]
Pr[μ(𝒢r^)x||^^r|logn]Pr[|^^r|logn]
Pr[μ(𝒢r^)x||^^r|logn](11logn)
Pr[μ(𝒢^)x+logn||^^r|logn](11logn)
=Pr[μ(𝒢^)x+logn](11logn)
=Pr[μ(n,n)x+logn](11logn),

where the first line is by definition of 𝒢^r, the second line is by law of total probability, the third line is by Lemma 23 since |^^r|=n|^r|, the fourth line is because conditional on |^^r|logn we have μ(𝒢^r)μ(𝒢^)logn, so μ(𝒢^)x+logn implies μ(𝒢r^)x, the fifth line is due to the condition being independent of matching size μ(𝒢^) and the sixth line by definition of 𝒢^.

The following lemma gives a bound for the size of the maximum matching in graphs sampled from 𝔾n,nr, with high probability. It is only slightly weaker than Lemma 22, which is the corresponding result for Erdős-Renyi 𝔾n,n. See 16

Proof.

Then we have that:

Pr [μ()(1γ+γ+γγ4n19)n]=
=Pr[μr(n,n)(1γ+γ+γγ4n19)n]
Pr[μ(n,n)(1γ+γ+γγ4n19)n+logn](11logn)
=Pr[μ(n,n)(1γ+γ+γγ4)nlognn119](11logn)
Pr[μ(n,n)(1γ+γ+γγ4)nn118](11logn)
Pr[|μ(n,n)(1γ+γ+γγ4)n|n118](11logn)
=1Pr[|μ(n,n)n(1γ+γ+γγ4)|n18](11logn)
=1o(1),

the first line is by definition of μr(n,n), the second line is due to Lemma 24, the fourth line is due to lognn11/9=lognn8/9n7/8=n11/8 by the assumption for large n, the fifth line is because this event is a subset, the sixth line is by taking the complement and the seventh line is due to Lemma 22 for ϵ=1718>0.