Abstract 1 Introduction 2 Proof of Theorem 1 3 Proof of Theorem 4 References

Recovering Communities in Structured Random Graphs

Michael Kapralov ORCID EPFL, Lausanne, Switzerland Luca Trevisan Bocconi University, Milan, Italy Weronika Wrzos-Kaminska ORCID EPFL, Lausanne, Switzerland
Abstract

The problem of recovering planted community structure in random graphs has received a lot of attention in the literature on the stochastic block model, where the input is a random graph in which edges crossing between different communities appear with smaller probability than edges induced by communities. The communities themselves form a collection of vertex-disjoint sparse cuts in the expected graph, and can be recovered, often exactly, from a sample as long as a separation condition on the intra- and inter-community edge probabilities is satisfied.

In this paper, we ask whether the presence of a large number of overlapping sparsest cuts in the expected graph still allows recovery. For example, the d-dimensional hypercube graph admits d distinct (balanced) sparsest cuts, one for every coordinate. Can these cuts be identified given a random sample of the edges of the hypercube where each edge is present independently with some probability p(0,1)? We show that this is the case, in a very strong sense: the sparsest balanced cut in a sample of the hypercube at rate p=Clogd/d for a sufficiently large constant C is 1/poly(d)-close to a coordinate cut with high probability. This is asymptotically optimal and allows approximate recovery of all d cuts simultaneously. Furthermore, for an appropriate sample of hypercube-like graphs recovery can be made exact. The proof is essentially a strong hypercube cut sparsification bound that combines a theorem of Friedgut, Kalai and Naor on boolean functions whose Fourier transform concentrates on the first level of the Fourier spectrum with Karger’s cut counting argument.

Keywords and phrases:
Hypercube graphs, Community detection, Fourier analysis of Boolean functions
Copyright and License:
[Uncaptioned image] © Michael Kapralov, Luca Trevisan, and Weronika Wrzos-Kaminska; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Graph algorithms analysis
; Mathematics of computing Random graphs
Editor:
Shubhangi Saraf

1 Introduction

Graph clustering, or community detection, is a fundamental problem in data analysis. The input is a graph G=(V,E), where a subset CV of vertices is considered a “community” if it is sparsely connected to the rest of the graph and is reasonably well-connected as an induced subgraph. The task is to recover the communities.

Graph clustering with a planted solution has received a lot of attention in the literature. In this setting the vertex set V of the graph G is assumed to be partitioned into vertex disjoint clusters C1,C2,,Ck such that the clusters induce well-connected subgraphs and are sparsely connected to the rest of the graph[24, 15, 13, 23, 16, 29, 31, 32, 3, 10]. For example, in the stochastic block model (SBM; [1]) edges of G are generated independently, where an edge {u,v} is included in the graph with higher probability if u and v belong to the same cluster, and lower probability otherwise. A large body of work on the stochastic block model shows that, if the edge probabilities satisfy a separation condition, the communities C1,C2,,Ck can be recovered from a sample graph with high probability. Determining the exact recovery threshold is a fascinating information theoretic problem for which tight bounds have been obtained over the past two decades [14, 30, 35, 12, 32, 3, 5]. Most of the work on SBM has focused on the case of non-overlapping communities, with only a few works allowing for some overlap. At the same time, in the practice of graph clustering one typically does not expects to have very pronounced cluster. Instead, several clusterings of the vertex set may be consistent with the edge set of the graph. Our central question in this paper is:

Can highly overlapping clusterings be recovered from a sample of the underlying graph?

Perhaps the most basic example of a graph with a large number of overlapping communities is the hypercube graph on n=2d vertices, where each of d coordinate cuts is a sparsest cut, and defines a partition of the vertex set into two “communities”, namely the two corresponding coordinate halfspaces. This setting is very different from the SBM with two communities, where the expected graph is a union of two cliques on the two clusters and a clique on the entire vertex set, and therefore the two communities are uniquely defined. Formally, the main question we ask in this paper is a structured version of the stochastic block model that allows for many communities with large overlaps:

Can coordinate cuts be recovered from the edge set of a subsampled hypercube?

A priori it would seem plausible that cuts of sparsity comparable to the coordinate cuts may emerge in a subsampled hypercube. Intuitively, this could be a mixture of several coordinate cuts in the original cube (a similar effect is seen in rounding the SDP solution to the sparsest cut problem on the hypercube). However, we show that this is not the case:

Theorem 1.

Let Qd be the d-dimensional hypercube, and let Qd be obtained by including each edge with probability pClogd/d, where C is a sufficiently large constant. There exists an algorithm with running time 2O(nlogn) that, given Qd, recovers d orthogonal balanced cuts, each with Hamming distance O(2d/poly(d)) to a coordinate cut, with probability at least 1d100 over the subsampling.

We say that a cut AV is balanced if |A|=|V|/2. The Hamming distance between two sets A,BV is given by |AB|, and we say A and B are orthogonal cuts if |AB|=|V|/2. We also remind the reader of the definition of the d-dimensional hypercube graph:

Definition 2 (Hypercube).

Define the d-dimensional hypercube to be the graph Qd=(V,E) with vertex set V={0,1}d, and any two vertices are connected by an edge if their Hamming distance is exactly 1. We let n|V|=2d denote the number of vertices.

We note that the subsampling rate in Theorem 1 is such that the expected degree of a vertex is at least Clogd=Cloglogn, i.e. Theorem 1 allows for an exponential reduction of the average degree after sampling. The guarantee in Theorem 1 is tight up to poly(d) factors, since the expected number of isolated vertices in Qd is at least 2d/poly(d). To see this, note that the degree of each vertex in Qd is distributed as Bin(d,p). For p=Clogdd, the probability that a given vertex is isolated is

(1p)d=(1Clogdd)deClogd(1(Clogd)2d)=1poly(d).

So in expectation, at least 2d/poly(d) vertices are isolated, and we cannot hope to classify those vertices.

Exact recovery

Furthermore, we show that, similarly to SBM, exact recovery is possible for a sufficiently high degree sample, specifically, a sample where every vertex has expected degree at least Clogn,n=2d, for a sufficiently large constant C>0. The hypercube itself is not a good model to study this setting, as the degree in the hypercube itself is d=log2n. We therefore study the k-distance hypercube, defined below:

Definition 3 (k-distance hypercube).

Define the k-distance hypercube to be the graph Qd,k=(V,E) with vertex set V={0,1}d, and any two vertices are connected by an edge if their Hamming distance is exactly k.

When k is odd, the graph Qd,k is connected. When k is even, Qd,k splits into two connected components, corresponding to the vertices of even and odd Hamming weight, respectively:

QdE{x{0,1}d:|x|0(mod2)},QdO{x{0,1}d:|x|1(mod2)},

where |x| denotes the Hamming weight of x.

We show that if the sampling rate is such that a given vertex has at least logarithmic expected degree, exact recovery is possible:

Theorem 4.

Let G=(V,E) be a connected component of the d-dimensional k-distance hypercube Qd,k. Let G=(V,E) be obtained by including each edge with probability pClogd/dk1, where C is a sufficiently large constant. There exists an algorithm with running time 2O(nlogn) that, given G, exactly recovers the d coordinate cuts, with probability 1d100 over the subsampling.

Related work on community detection on graphs with overlapping communities

A small number of works allow for overlapping communities. [5] considers SBM with overlapping communities, and observes that this can be reduced to a standard SBM where each “community membership profile” is considered as a separate community. The number of profiles would be too large for our setting, making every vertex in the hypercube have a profile of its own. The work of [37] considers a variant of the SBM with fractional community memberships and proves asymptotic consistency under strong assumptions, such as the existence of “pure” nodes that only belong to one community. Another line of work considers dense graphs [7], but requires much higher densities than in our setting.

Related work on community detection in geometric random graphs

The geometric block model, introduced in [34], generalizes random geometric graphs in the same way that SBMs generalize Erdős–Rényi graphs: In this model, vertices are partitioned into communities, randomly embedded in a metric space, and edges are formed as a function of distances and community memberships. A number of variants and extensions have since been studied [19, 20, 21, 26, 4, 2, 22, 8, 6]. These works, however, focus on detecting (non-overlapping) communities and do not provide guarantees for recovering underlying geometric structure.

Another related direction considers testing whether an observed graph is a realization of an Erdős-Rényi random graph or a random geometric graph [11, 27, 9].

Open problem

Our work leaves open a very exciting open problem of recovering coordinate cuts with the same precision as our results, but in polynomial time. The SoS hierarchy seems to be a promising direction.

2 Proof of Theorem 1

In this section we prove Theorem 1. The proof is algorithmic. We state the (simple) algorithm below, and then proceed to analyze it.

The algorithm

Our algorithm finds d orthogonal sparse cuts in the subsampled hypercube by solving the optimization problem (solved by direct enumeration in time 2O(nlogn)):

min i=1d|E(Ai,VAi)|subject to (1)
|Ai|=2d1 i,
|AiAj|=2d1 ij.

Known results from Fourier analysis show that before subsampling, every sparse cut in the hypercube is close (in Hamming distance) to a coordinate cut. Using this, we will prove that after subsampling, all cuts that are far from coordinate cuts remain large, and will therefore not be a part of the optimal solution to (1).

We will need tools from Fourier analysis of boolean functions, and start by setting up the necessary preliminaries.

Preliminaries

Let Qd=(V,E) denote the d-dimensional hypercube with vertex set V={0,1}d and edges connecting pairs of vertices that differ in exactly one coordinate. We write E for the set of edges obtained from E after subsampling. For a subset AV, we sometimes write 𝟙A{0,1}V for its indicator function, and (A)=E(A,VA) for its edge boundary. We say that a cut AV is balanced if |A|=|V|2, and we say that cuts A,BV are orthogonal if |AB|=|V|2. For j[d], b{0,1}, we use the notation Sj,b for the coordinate cut {x{0,1}d:xj=b}.

For a function f:{0,1}d, we define its Fourier transform f^:𝒫([d]) by

f^(S)𝔼x{0,1}d[f(x)χS(x)]=2df,χS,

where χS is the the Fourier character χS(x)=(1)iSxi. We call f^(S) the Fourier coefficient of f at S.

The Fourier characters form an orthogonal basis for functions on {0,1}d, which gives the inverse formula

f(x)=S[d]f^(S)χS

and Parseval’s identity

S[d]f^(S)2=2dx{0,1}df(x)2.

Furthermore, for every S[d], the Fourier character χS is an eigenvector with eigenvalue 2|S| of the unnormalized Laplacian matrix =dIA of the hypercube.

Finally, we need the fact that the singleton cuts are the minimum cuts in a hypercube.

Lemma 5 (Folklore, see e.g., Example 4.1.3 in [36]).

The min cut of the d-dimensional hypercube Qd=(V,E) has size d, that is

minAV:1|A||V|/2|E(A,VA)|=d.

Every sparse cut is close to a coordinate cut

We begin by showing that every cut that is sparse in the original hypercube is indeed close to a coordinate cut. For this, we use the following standard Fourier–analytic identity, which expresses the size of a cut in terms of the Fourier coefficients of its indicator function (see e.g. Theorem 2.38 in [33]). We include a proof for completeness.

Lemma 6.

Let Qd=(V,E) be the d-dimensional hypercube, and let AV. Let f:V{0,1} denote the indicator function on A. Then

|E(A,VA)|=2d+1S[d]|S|f^(S)2.

Proof.

Let be the unnormalized Laplacian of Qd. The cut size of A is given by

|E(A,VA)|={x,y}E(f(x)f(y))2=ff. (2)

Expanding f in the Fourier basis, we have f=S[d]f^(S)χS. Since the Fourier characters are eigenvectors of with eigenvalues 2|S|, we obtain

ff=(Sdf^(S)χS)(Sdf^(S)χS)=S[d]2|S|f^(S)2χS22=2d+1S[d]|S|f^(S)2. (3)

Combining Equations (2) and (3) gives the lemma. From the above lemma, we will show that every sparse cut must place most of its Fourier mass on the first two levels. This is because the contribution of each Fourier coefficient to the cut size is weighted by |S|, so the mass on higher levels contributes to the cut size proportionally.

This will allow us to apply the Friedgut–Kalai–Naor (FKN) theorem, which states that any boolean function with nearly all of its Fourier mass on the first two levels, has to be close to the indicator function of a coordinate cut.

Theorem 7 (FKN Theorem, Theorem 1.1 in [18]).

If f:{0,1}d{0,1} is a boolean function, f22=p and if |S|>1f^(S)2δ then either p<Kδ or p>1Kδ or f(x1,x2,,xd)xiKδ for some i or f(x1,x2,,xd)(1xi)Kδ for some i. Here, K and K are absolute constants.

We remark that the conclusion of the FKN theorem is far from obvious. In particular, the assumption that f is a boolean function is essential. For example, consider a convex combination of coordinate cuts f(x)=iλiχi(x). This places all of its Fourier mass on the first two levels, but is in general not close to any coordinate cut.

A corollary of the FKN Theorem (Theorem 7) is that every sparse cut in the hypercube must be close to a coordinate cut. For completeness, we include a proof of this known fact.

Lemma 8 (Sparse cuts are close to coordinate cuts, Corollary 1.2 in [18]).

Suppose AQd with |A|2d1. If |E(A,VA)|(1+ϵ)|A|, then there exists a coordinate cut Sj,b such that

|ASj,b|2dKϵ.

Here K is an absolute constant.

Proof.

We start by bounding the Fourier mass above the first two levels in order to apply the FKN theorem (Theorem 7). Suppose |E(A,VA)|(1+ϵ)|A|. From Lemma 6, we have

(1+ϵ)|A||E(A,VA)|=2d+1S[d]|S|f^(S)2. (4)

On the other hand, we have

|A|=xVf(x)2=2dS[d]f^(S)2 (5)

and, since f^()=2dxVf(x)=2d|A|, we have

f^()2=22d|A|2. (6)

Combining Equations (4), (5) and (6) gives

ϵ|A| 2d+1S[d]|S|f^(S)22dS[d]f^(S)2 by (4) and (5)
=2d+1|S|1(|S|1)f^(S)22d+1f^()2+2dS[d]f^(S)2
2d+1|S|2f^(S)2+2|A|(12|A|2d) by (5) and (6).

The second summand is non-negative by the assumption that |A|2d1, which gives |S|2f^(S)2ϵ2(d+1)|A|ϵ/4. Therefore, by Theorem 7 we have |ASj,b|2dKϵ or |A|Kϵ. Finally, to rule out the second possibility, note that the above equation gives 2|A|(1/2|A|/2d)ϵ|A|, which rearranges to |A|2d1(1ϵ).

Cut counting on the difference from a coordinate cut

Next, we want to show that a cut that is far (in Hamming distance) from every coordinate cut, cannot become the sparsest cut after subsampling. Let A be a cut with E(A,VA)=(1+ϵ)2d1 and ϵ>1/poly(d). Then |AS|O(ϵ)2d1 for some coordinate cut S. We want to show that with a high probability, |E(A,VA)|>E|(S,VS)|, i.e. that the coordinate cut S is still sparser than A after subsamling. To show this, we want to apply the Chernoff bound to show concentration for each cut, and Karger’s cut-counting theorem to union bound over all possible choices of the cut A.

Theorem 9 (Karger’s cut counting theorem [25]).

Let α1. Then for all graphs G, the number of α-approximate minimum cuts in G is at most 22α(n2α) .

We start by noting that a direct cut counting plus Chernoff bound argument does not work. Indeed, a direct Chernoff bound applied to E(A,VA) and E(S,VS) would require concentration within a (1±ϵ) factor for all ϵ>1/poly(d) simultaneously, which is too strong. Instead, we use the fact that A is close to S, and show that the differences E(A,VA)E(S,VS) and E(S,VS)E(A,VA) concentrate well. In essence, we apply a Karger-style cut counting argument on the difference between AS, thereby only requiring the Chernoff bound to handle a constant factor deviation.

Applying a Chernoff bound, using the trivial upper-bound

|E(A,VA)E(S,VS)|d|AS|dO(ϵ)2d1,

we can show that E(A,VA) and E(S,VS) concentrate within a O(1/d)-factor with probability at least 1eΩ(pϵ2d1/d).

To union bound, we must enumerate over all cuts A with |E(A,VA)|=(1+ϵ)2d1. A naive application of Karger’s theorem (using mincut(Qd)=d, by Lemma 5) shows that there are at most 2O(2d1/d)(2dO(2d1/d)) such cuts, which is too weak of a bound.

Instead, we observe that for a fixed coordinate cut S, the set A is uniquely determined by AS, so it suffices to enumerate the possible choices for AS. Applying Karger’s cut-counting theorem with the trivial bound (AS)d|AS|dO(ϵ)2d1 gives that there are at most 2O(ϵ)2d1(2dO(ϵ)2d1)2O(ϵ)log1/ϵ2d possible choices for the set AS. However, this bound is still too weak. We will therefore derive a stronger bound on (A)(S) and (AS).

Lemma 10.

Let AV be a set with |A|2d1 and |(A)|(1+ϵ)|A| and let S be the coordinate cut such that |AS|Kϵ2d (exists by Lemma 8). Then there exists a universal constant C such that

|(A)(S)||(AS)|Cϵ2d1.

Proof.

It is straightforward to verify that for every pair of sets T1,T2, it holds that (T1)(T2)(T1T2), which gives the first inequality. We now prove the second inequality.

Let A+AS and ASA. Furthermore, write S¯=VS. Then V is partitioned into the four sets AS, A, A+ and S¯A (see Figure 1).

Refer to caption
Figure 1: Illustration of the sets A (red), S, A+ and A, and the edges incident on A+ and A (blue).

The high-level idea is that the edge boundaries of A+ and A consist of E(A,S¯) and E(A+,S), which cross the cut S, and E(A,AS) and E(A+,S¯A), which cross the cut A. Since the former two sets cross the coordinate cut, they have size at most |A+|+|A|=O(ϵ)2d1. Since the latter two sets contribute to the cut A, they cannot be too large, as otherwise the edge-boundary of A would have size significantly larger than (1+ϵ)2d1. We now prove this more formally.

Claim 11.
|(A+)|+|(A)||(A)||(S)|+2|E(A+,S)|+2|E(A,S¯)|.

Proof.

Since A is partitioned into AS and A+, and VA is partitioned into A and S¯A, we have

|(A)|=|E(AS,S¯A)|+|E(A+,A)|+|E(AS,A)|+|E(A+,S¯A)|.

Similarly, since S is partitioned into AS and A, and S¯ is partitioned into A+ and S¯A, we have

|(S)|=|E(AS,S¯A)|+|E(A,A+)|+|E(AS,A+)|+|E(A,S¯A)|.

Combining, we get

|(A)||(S)| =|E(A,AS)|+|E(A+,S¯A)||E(AS,A+)||E(A,S¯A)|
|E(A,AS)|+|E(A+,S¯A)||E(A+,S)||E(A,S¯)|.

On the other hand, we have

|(A)|+|(A+)|=|E(A,SA)|+|E(A,S¯)|+|E(A+,S)|+|E(A+,S¯A)|.

Combining the above two equations yields the claim.

To continue, note that the edges in E(A+,S) and in E(A,S¯) are crossing the coordinate cut S. Since S is a coordinate cut, every vertex can have at most one edge crossing S incident on it. This gives

|E(A+,S)|+|E(A,S¯)||A+|+|A|=|AS|Kϵ2d1, (7)

where the last inequality follows by the lemma assumption. Combining with Claim 11, and recalling from the lemma assumption that |(A)|(1+ϵ)|A|(1+ϵ)2d1, we obtain

|(AS)| |(A)|+|(A+)|
|(A)||(S)|+2|E(A+,S)|+2|E(A,S¯)| by Claim (11)
|(A)||(S)|+2Kϵ2d1 by Equation (7)
(1+ϵ)2d12d1+2Kϵ2d1 by the lemma assumption
=Cϵ2d1, for C=2K+1

which completes the proof. With this stronger bound on (AS), we can now bound the number of cuts A of size (A)(1+ϵ)2d1.

Lemma 12.

Let S be a coordinate cut. The number of sets AQk of size |A|=2d1 such that |(A)|(1+2ϵ)2d1 and |AS|Kϵ2d is at most exp(2dO(ϵ/d)log(d/ϵ)).

Proof.

Let AQk be of size |A|=2d1 such that |(A)|(1+2ϵ)(d1k1)2d1 and |AS|Kϵ2d. Given S, the set A is uniquely determined by the choice of AS, so we just need to count the number of possible choices for AS. Letting C denote the universal constant in Lemma 10, we have

|(AS)|Cϵ2d1.

On the other hand, by Lemma 5, the minimum cut has size d, so (AS) is an α-approximate minimum cut with α=Cϵd2d1. Therefore, by Karger’s cut counting theorem (Theorem 9), the number of choices for |AS| is at most

2Cϵ/d2d1(2dCϵ/d2d1)2Cϵ/d2d12H2(Cϵ/d)2dexp(2dO(ϵ/d)log(d/ϵ)).

Here H2(x) denotes the binary entropy function H2(x)=xlogx(1x)log(1x).

To bound the deviation of the cut sizes after subsampling, we use the additive Chernoff bound (see e.g., Theorems 1.10.10 and 1.10.11 in [17]).

Theorem 13.

Let X1,,Xn be independent random variables taking values in [0,1]. Let X=i=1nXi. Let λ0. Then

Pr[|X𝔼[X]|λ]2exp(13min{λ2/𝔼[X],λ}).

Applying the Chernoff bound, we show that with high probability, every cut A remains larger than its closest coordinate cut after subsampling.

Lemma 14.

Let ϵ>0 and let AV be a set of size A=2d1 such that (1+ϵ)|A|E(A,VA)(1+2ϵ)|A|. Let S be the coordinate cut such that |AS|O(ϵ)2d (exists by Lemma 8). Then

Pr[|E(A,VA)||E(S,VS)|+pϵ22d1.]14eΩ(ϵp2d1).

Proof.

Let E+(A)(S) and let E(S)(A). We have

|E(A,VA)||E(S,VS)| =|((A)(S))E||((S)(A))E|
=|E+E||EE|.

So we need to bound the probability of the event |E+E||EE|pϵ22d1. From the lemma assumption, we have

|E+||E|=|E(A,VA)||E(S,VS)|(1+ϵ)|A||S|=ϵ2d1. (8)

By Lemma 10, we have

𝔼[|E+E|]=p|E+|pO(ϵ)2dand𝔼[|EE|]=p|E|pO(ϵ)2d.

Let λ=pϵ42d1. Then min{λ,λ2/p|E|},min{λ,λ2/p|E+|}Ω(ϵp2d1), so applying the Chernoff bound (Lemma 13), we get

Pr[EE|p|Epϵ42d1]2eΩ(ϵp2d1)

and

Pr[E+E|p|E+pϵ42d1]2eΩ(ϵp2d1).

By a union bound, with probability at least 14eΩ(ϵp2d1), it holds that

|E+E||EE| p|E+|p|E|pϵ22d1pϵ2d1pϵ22d1=pϵ22d1,

where the second inequality follows from Equation (8). We can now show that every sufficiently large cut remains larger than a coordinate cut after subsampling.

Lemma 15.

Let pκlogdd for a sufficiently large constant κ, and let ϵ0=d100. Then with probability at least 1d100/2, the following holds: For every ϵϵ0 and every balanced cut A of size |E(A,VA)|=(1+ϵ)2d1, it holds that

|E(A,VA)||E(S,VS)|+pϵ22d1,

where S is the coordinate cut such that |AS|Kϵ2d (exists by Lemma 8).

Proof.

Suppose κ204C/D, where C denotes the hidden constant in the O-notation in Lemma 12 and D denotes the hidden constant in the Ω-notation in Lemma 14. Let ϵi=2iϵ0 for i=1,log(2dd/ϵ0). For every coordinate cut S=Sj,b with j[d] and b{0,1}, and for every ϵi, let (S,ϵi) be the event that there exists a cut A of size (1+ϵi)2d1|E(A,VA)|(1+2ϵi)2d1 with |AS|Kϵi2d such that

|E(A,VA)|<|E(S,VS)|+pϵ22d1.

We now show that Pr[(S,ϵi)]d102/8. For every cut A of size |E(A,VA)|(1+2ϵi)2d1 with |AS|Kϵi2d, by Lemma 14, we have

Pr[|E(A,VA)|<|E(S,VS)|+pϵi22d1]4exp(Dϵip2d1).

By Lemma 12, the number of such cuts is at most exp(2dCϵidlog(d/ϵi)). Therefore, by a union bound, we have
Pr[(S,ϵi)] 4exp(Dϵip2d1)exp(2dCϵidlog(d/ϵi)) =4exp(2dϵi(Clog(d/ϵi)dDp2)) 4exp(2dϵi(101ClogddκDlogd2d)) since 1ϵi1ϵ0d100 and pκlogdd 4exp(2dϵiClogdd) since κ204C/D =4exp(2d/poly(d)) since ϵiϵ0=d100 <18d102 for d sufficiently large.

Finally, taking a union bound over the 2d possible choices of S and the log(2d/ϵ0)2d possible choices for i, gives the lemma. Lemma 15 implies that the sparsest cut after sampling is close in Hamming distance to a coordinate cut. However, since the objective value of (1) is a sum i|E(Ai,VAi)|, we need to exclude the possibility that the optimal solution includes a large cut |E(Ai,VAi)| due to the other cuts being surprisingly sparse. Corollary 16 handles this.

Corollary 16.

Conditioned on the success of the event in Lemma 15, for every balanced cut AV, it holds that

|E(A,VA)||E(S,VS)|Cϵ02d1,

where S is the coordinate with the smallest hamming distance to A, C is a universal constant, and ϵ0=d100.

Proof.

Let C be he universal constant from Lemma 10. Let AV be a cut of size |E(A,VA)|=(1+ϵ)2d1, and let S be the coordinate cut with the smallest Hamming distance to A. By Lemma 8, we have |AS|Kϵ2d1. Consider two cases depending on ϵ.

Suppose ϵϵ0. Then by Lemma 15, we have |E(A,VA)||E(S,VS)|, so we are done.

Suppose instead that ϵ<ϵ0. Then by Lemma 10, we have |(A)(S)|Cϵ02d1, which gives

|E(A,VA)||E(S,VS)||(A)(S)||E(S,VS)|Cϵ02d1.

We also need to bound the optimal value of (1).

Lemma 17.

Let K be the universal constant from Lemma 8. With probability at least 1d100/2, all coordinate cuts Sj,b satisfy

||E(Sj,b,VSj,b)|p2d1|p100Kd2d1,

and in particular, the optimal value of (1) is at most (d+1100K)2d1p.

Proof.

Fix a coordinate cut Sj,b. Then 𝔼[|E(Sj,b,VSj,b)|]=2d1p, so applying the Chernoff bound (Lemma 13) with λ=1100Kd2d1p, we obtain

Pr[||E(Sj,b,VSj,b)|p2d1|p100Kd2d1] exp(1311002K2d2p2d1)
=exp(2d/poly(d))
d101/2.

By a union bound over the d coordinate cuts, the above equation holds simultaneously for all Sj,b with probability at least 1d100/2. If this holds, then, since {Sj,b:j[d],b=0} is a feasible solution to (1), the optimal value of (1) is at most

j|E(Sj,0,VSj,0)|d(1+1100Kd)2d1p=(d+1100K)2d1p.

Finally, we put everything together to prove Theorem 1.

Proof of Theorem 1.

The algorithm solves the optimization problem

min i=1d|E(Ai,VAi)|subject to (1)
|Ai|=2d1 i,
|AiAj|=2d1 ij

and outputs the optimal solution A1,,Ad.

Running time.

We can solve this program by enumerating all feasible families of cuts, of which there are at most ((2d2d1))d=2O(2dd)=2O(nlogn) and computing the corresponding edge counts, so the running time is 2O(nlogn).

Correctness.

Condition on the success of the events in Lemma 15 and Lemma 17. By a union bound, this occurs with probability at least 1d100.

Let {Ai}i[d] be the optimal solution to (1). For every i[d], let Si denote the coordinate cut with the smallest Hamming distance to Ai. We start by proving that this is a matching, i.e., that the set {Si}[d] consists of d different coordinate cuts. Suppose not. Then Si=Sj or Si=S¯j for some ij. If Si=Sj=S, then by triangle inequality,

|AiS|+|AjS||AiAj|= 2d1,

so either |AiSi|2d2 or |AjSj|2d2. If instead Si=S¯j=S, then again by triangle inequality,

|AiS|+|AjS¯|=|AiS|+2d|AjS|2d|AiAj|=2d1,

so again either |AiSi|2d2 or |AjSj|2d2.

Let i be the index such that |AiSi|2d2. Applying Lemma 8 with ϵ=1/4 gives |E(Ai,VAi)|(1+14K)2d1, where K is the universal constant from Lemma 8. Therefore, by Lemma 15 and Lemma 17, we have

|E(Ai,VAi)| |E(Si,VSi)|+p8K2d1 by Lemma 15
(11100K)p2d1+p8K2d1 by Lemma 17
(1+110K)p2d1.

Furthermore, letting C be the universal constant from Corollary 16, for every ji, we have

|E(Aj,VAj)| |E(Sj,VSj)|Cϵ02d1 by Corollary 16
(11100Kd)p2d1Cϵ02d1 by Lemma 17
>(1150Kd)p2d1 since ϵ0=d100pKd.

But then summing over all j[d] gives

j[d]|E(Aj,VAj)| (1+110K)p2d1+(d1)(1150Kd)p2d1
>(d+1100K)p2d1,

which is a contradiction, since objective value of (1) is at most (d+1100K)p2d, by Lemma 17. Thus, the set {Si}i[d] must contain d distinct coordinate cuts.

So now suppose that we have a matching, i.e. that the set {Si}i[d] contains d distinct coordinate cuts. Then {Si}i[d] is a feasible solution to (1). Recall that K is the universal constant from Lemma 8 and C is the universal constant from Corollary 16. Let L2KC, and suppose for contradiction that

|AiSi|Lϵ0d2d1/p

for some i[d]. Applying Lemma 8 with ϵ=LKϵ0d/p, gives

|E(Ai,VAi)|(1+LKϵ0d/p)2d1(1+2Cϵ0d/p)2d1,

where the last inequality follows by choice of L. So by Lemma 15, we have

|E(Ai,VAi)||E(Si,VSi)|+Cϵ0d2d1.

But then, by Corollary 16, we have
j[d]|E(Aj,VAj)| |E(Si,VSi)|+Cϵ0d2d1+ji|E(Aj,VAj)| |E(Si,VSi)|+Cdϵ02d1+ji|E(Sj,VSj)|(d1)Cϵ02d1 >j=1d|E(Sj,VSj)|,

which contradicts the optimality of {Ai}i[d], since {Si}i[d] is a feasible solution. Therefore, we conclude that with probability at least 1d100, it holds that |AiSi|Lϵ0d2d1/p2d1/poly(d) for all i.

3 Proof of Theorem 4

In this section, we prove Theorem 4, restated below for the convenience of the reader. See 4

The proof follows the same overall strategy as Theorem 1. The algorithm solves to following optimization problem and outputs the optimal solution.

min i=1d|E(Ai,VAi)|subject to (9)
|Ai|=|V|2 i,
|AiAj|=|V|2 ij.

We want to use the FKN Theorem (Theorem 7) to show that every sparse cut is close to a coordinate cut, and then use Karger’s cut-counting theorem (Theorem 9) to union bound over all cuts. In the k-distance cube, every vertex has degree (dk), and for every coordinate cut Sj,b and every vertex vV, exactly (d1k1) of the edges incident on v cross the cut Sj,b. These higher degrees allow for better concentration bounds, which is why we can achieve exact recovery. It is important to note that when k is even, the k-distance cube Qd,k has at least two components, corresponding to the vertices with odd Hamming weight, and the vertices with even Hamming weight.

Definition 18 (Component of Qd,k).

Let Qd,kE, Qd,kOQd,k be the subgraphs induced by

{x{0,1}d:|x|0(mod2)},and{x{0,1}d:|x|1(mod2)},

respectively. We say that QQd,k is an component of Qd,k if

  • Q=Qd,k and k is odd, or

  • Q{Qd,kE,Qd,kO} and k is even.

We say that a cut S is a coordinate cut in Q if S=Sj,bQ for some coordinate cut Sj,b.

Later, in Remark 23, we will see that when d is sufficiently large, the components of Qd,k are exactly the connected components.

We start by analyzing the spectrum of the k-distance cube Qd,k. Known results for the Hamming association scheme (see e.g. Theorem 5, Chapter 21 in [28]) show that the eigenvalues {μS}S[d] of the adjacency matrix of Qd,k are given by binary Krawtchouk polynomials

μS=𝒦k(|S|;d)j=0k(1)j(|S|j)(d|S|kj).

Therefore, the eigenvalues {λS}S[d] of the Laplacian satisfy

λS=(dk)μS=2j[k]:j odd(|S|j)(d|S|kj).

We include a direct calculation of the eigenvalues λS in the full version for completeness.

Lemma 19 (Eigenvalues of Qd,k).

Let k be an integer, and let be the unnormalized Laplacian of Qd,k. Then the Fourier characters χS form an eigenbasis of , with corresponding eigenvalues

λS=2j[k]:j odd(|S|j)(d|S|kj). (10)

Using the above lemma, we can write the size of any cut in Qd,k in terms of the Fourier coefficients of its indicator function.

Lemma 20.

Let Qd,k be the d-dimensional k-distance hypercube, and let Q=(V,E) be component of Q (as per Definition 18). Let AV, and let f:V{0,1} denote the indicator function on A. Then

|E(A,VA)|=2dS[d]λSf^(S)2.

Proof.

Since there are no edges between Qd,kE and Qd,kO, we can use the unnormalized Lapacian of the entire graph Qd,k to express the cut size of A as

|E(A,VA)|={x,y}E(f(x)f(y))2=ff, (11)

On the other hand, expanding f in the Fourier basis, we have f=S[d]f^(S)χS. By Lemma 19, every Fourier character χS is an eigenvector of with eigenvalue λS, which gives

ff=(Sdf^(S)χS)(Sdf^(S)χS)=S[d]λSf^(S)2χS22=2dS[d]λSf^(S)2. (12)

Combining Equations (11) and (12) gives the lemma.

To argue that every sparse cut places most of its Fourier mass on the first two levels, we first need to argue that the eigenvalues λS with |S|>1 are large compared to those with |S|=1.

Lemma 21.

Let k be a positive integer, and let d=d(k) be sufficiently large. Denote by λ1 the eigenvalue corresponding to sets S[d] of size |S|=1. Then:

  • If k is odd, then for every S[d] with |S|2, it holds that λS32λ1.

  • If k is even, then for every S[d] with 2|S|d2, it holds that λS32λ1, and for every S[d] with |S|=d1, it holds that λS=λ1.

The proof of Lemma 21 is included in the full version. Using the spectral gap established in Lemma 21, we will show that every sparse cut places most of its Fourier mass on the first two levels. As a first step, we derive a lower bound on the expansion of a cut in terms of the higher-level Fourier coefficients.

Lemma 22.

Let k be an integer, let d be sufficiently large, and let Q=(V,E) be a component of Qd,k (as per Definition 18). Let AQ with |A||V|2, and let f:{0,1}d{0,1} be the indicator function on A.

  • If k is odd, then

    |E(A,VA)|(d1k1)(|A|+2dS[d]:|S|2f^(S)2).
  • If k is even, then

    |E(A,VA)|(d1k1)(|A|+2dS[d]:2|S|d2f^(S)2).
 Remark 23 (Coordinate cuts are sparsest cuts).

Recall that the coordinate cuts have expansion (d1k1). Lemma 22 shows that every cut in the component Q has expansion at least this large, and hence the coordinate cuts are the sparsest cuts. This also implies that the components of Qd,k (as per Definition 18) are exactly the connected components of Qd,k.

Proof.

We prove the lemma for the case when k is odd. The case when k is even is similar and is included in the full version. We have

|A|=xVf(x)2=2dS[d]f^(S)2 (13)

and, since f^()=2dxVf(x)=2d|A|, we have

f^()2=22d|A|. (14)

Denote by λ1=2(d1k1) the eigenvalue corresponding to sets S[d] of size |S|=1. Also note from (10), that λ=0. Combining Lemma 20, together with Equations (13) and (14) gives
|E(A,VA)| =2dS[d]λSf^(S)2 by Lemma 20 =2d|S|2(λSλ1)f^(S)2+2dλ1S[d]f^(S)22dλ1f^()2 2dλ12|S|2f^(S)2+2dλ1S[d]f^(S)22dλ1f^()2 by Lemma 21 =λ12(2d|S|2f^(S)2+|A|+2|A|(12|A|2d)) by (13) and (14) (d1k1)(2d|S|2f^(S)2+|A|).

Here the last inequality uses that 1/22d|A|0, by the assumption.

As a corollary of Lemma 22, we get that sparse cuts place almost all of their Fourier mass on the first two levels (and, in the even-k case, also on the top two levels).

Corollary 24.

Let k be an integer, let d be sufficiently large and let Q=(V,E) be a component of Qd,k (as per Definition 18). Let A be a subset Q with |A||V|2 and suppose that |E(A,VA)|(1+ϵ)(d1k1)|A|. Let f denote the indicator function of A. Then

  • If k is odd, then |S|2f^(S)2ϵ2.

  • If k is even, then 2|S|d2f^(S)2ϵ2.

Proof.

We prove the lemma for the case when k is odd. The case when k is even is similar and is included in the full version. By Lemma 22, we have

(1+ϵ)(d1k1)|A||E(A,V\A)|(d1k1)(|A|+2dS[d]:|S|2f^(S)2),

which gives

ϵ2d1ϵ|A|2dS[d]:|S|2f^(S)2.

We now wish to apply the FKN theorem (Theorem 7) to argue that every sparse cut must be close to a coordinate cut. We can do that in the case when k is odd. However, when k is even, we are in a slightly different setting: First, the function f is only supported on one of the connected components, and second, f puts most of its Fourier mass on both the bottom two and the top two levels. Therefore, we need to extend the FKN theorem to the case of even k.

Lemma 25 (FKN theorem for even k).

Let 𝟙E denote the indicator function of the even component QdE{x{0,1}d:|x|0(mod2)}. Suppose that f:{0,1}d{0,1} is a boolean function supported on QdE such that f22=14 and 2|S|d2f^(S)2δ. Then there exists an index i[d] such that 𝟙E(f(x1,x2,,xd)xi)Kδ or 𝟙E(f(x1,x2,,xd)(1xi))Kδ. Here K is an absolute constant.

The proof is included in the full version. We can now argue that sparse cuts are close to coordinate cuts.

Lemma 26 (Sparse cuts are close to coordinate cuts).

Let k be an integer and let d=d(k) be sufficiently large. Let Q=(V,E) be a component of Qd,k (as per Definition 18). Suppose AQ with |A|=|V|2. If |E(A,VA)|(1+ϵ)(d1k1)|A|, then there exists a coordinate cut S in Q (as per Definition 18) such that

|AS|Kϵ2d.

Here K is an absolute constant.

Proof.

If k is odd, then the lemma follows from Corollary 24 and the FKN Theorem (Theorem 7).

If k is even, then we can without loss of generality assume that f is supported on the even component, and the lemma follows from Corollary 24 and Lemma 25.

Next, we want to apply Karger’s cut-counting theorem (Theorem 9) and a Chernoff bound (Lemma 13). Similarly to the proof of Theorem 1, we need to establish a strong bound on the size of (A)(S) and (AS).

Lemma 27.

Let Q=(V,E) be component of Qd,k (as per Definition 18) and let AQ be a set with |A||V|2 and |(A)|(1+ϵ)(d1k1)|A|. Let S be a coordinate cut in Q with |AS|O(ϵ)2d (exists by Lemma 26). Then

|(A)(S)||(AS)|O(ϵ)(d1k1)|A|.

The proof is almost identical to the proof of Lemma 10, and is included in the full version. In order to apply Karger’s cut-counting theorem, we also need to establish the size of the minimum cuts.

Lemma 28 (The singleton cuts are min-cuts).

Let k be an integer, and let d be sufficiently large. Let Q=(V,E) be a component of Qd,k (as per Definition 18). Then

minAV:1|A||V|/2|E(A,VA)|=(dk).

Proof.

If |A|=1, then |E(A,VA)|=(dk). For the rest of the proof, we consider 2|A||V|/2 and split into two cases according to |A|.

Case 1: |𝑨|(𝒅𝒌)/(𝒅𝟏𝒌𝟏).

By Lemma 22, we have

|E(A,VA)|(d1k1)|A|(dk).

Case 2: 𝟐|𝑨|<(𝒅𝒌)/(𝒅𝟏𝒌𝟏).

Every vertex in Q has degree (dk). A vertex in A can have at most |A|1 neighbors in |A|, so it must have at least (dk)|A|+1 edges to VA. Summing over all vertices in A, we obtain

|E(A,VA)||A|((dk)|A|+1)=((dk)|A|)(|A|1)+(dk)>(dk),

where the last inequality follows from 2|A|(dk)/(d1k1)<(dk). We can now apply Karger’s cut-counting theorem to count the number of cuts of size (1+ϵ)(d1k1)2d1.

Lemma 29.

Let Q=(V,E) be a component of Qd,k (as per Definition 18), and let S be a coordinate in Q. The number of sets AQ of size |A||V|2 such that |E(A,VA)|(1+2ϵ)(d1k1)|A| and |AS|O(ϵ)2d is at most exp(2dO(ϵ/d)log(d/ϵ)).

Proof.

Given S, the set A is uniquely determined by the choice of AS, so we just need to count the number of possible choices for AS. Let C denote the hidden constant in the big O-notation in Lemma 27. By Lemma 27, we have

|(AS)|Cϵ(d1k1)2d1.

By Lemma 28, the minimum cut has size (dk), so (AS) is an α-approximate minimum cut with α=Cϵ(d1k1)2d1/(dk)=Cϵ2d1/d. Therefore, by Karger’s cut counting theorem (Theorem 9), the number of choices for |AS| is at most

2Cϵ/d2d1(2dCϵ/2d1)2Cϵ/d2d12H2(Cϵ/d)2dexp(2dO(ϵ/d)log(d/ϵ)).

Here H2(x) denotes the binary entropy function H2(x)=xlogx(1x)log(1x).

Lemma 30.

Let Q=(V,E) be a component of Qd,k (as per Definition 18), and let AQ be a set with |A|=|V|2 and (1+ϵ)(d1k1)|A|E(A,VA)(1+2ϵ)(d1k1)|A|. Let S be the coordinate cut in Q such that |AS|O(ϵ)2d (exists by Lemma 26). Then

Pr[|E(A,VA)||E(S,VS)|+pϵ2(d1k1)|V|2]14exp(Ω(ϵpdk12d1)).

The proof is similar to Lemma 14, and is included in the full version.

Lemma 31.

Let Q=(V,E) be a component of Qd,k (as per Definition 18). Suppose p=κlogddk1 for a sufficiently large constant κ, and let ϵ0=2d/K, where K is the universal constant from Lemma 26. Then with probability at least 1d100/2, the following holds: For every ϵϵ0, and every balanced cut AQ of size |E(A,VA)|=(1+ϵ)(d1k1)|V|2, it holds that

|E(A,VA)||E(S,VS)|+pϵ2(d1k1)|V|2,

where S is the coordinate cut in Q such that |AS|Kϵ2d (exists by Lemma 26).

Proof.

Let C be the hidden constant in the O-notation in Lemma 29 and let D be the hidden constant in the Ω-notation in Lemma 30. Suppose that κ is a sufficiently large constant. Let ϵi=2iϵ0 for i=1,log(2d/ϵ0). For every coordinate cut S=Sj,bQ with j[d] and b{0,1}, and for every ϵi, let (S,ϵi) be the event that there exists a balanced cut AQ of size (1+ϵi)|A||E(A,VA)|(1+2ϵi)(d1k1)|A| with |AS|Kϵ2d such that

|E(A,VA)|<|E(S,VS)|+pϵi2(d1k1)|V|2.

We now show that Pr[(Q,ϵi)]d102/8. For every balanced cut A of size |E(A,VA)|(1+2ϵi)(d1k1)|A| with |AS|O(ϵi)2d, by Lemma 30, we have

Pr[|E(A,VA)|<|E(S,VS)|+pϵi2(d1k1)|V|2]4exp(Dϵipdk12d).

By Lemma 29, the number of such cuts is at most exp(2dCϵi/dlog(d/ϵi)). Therefore, by a union bound, we have
Pr[(S,ϵi)] 4exp(Dϵipdk12d)exp(2dCϵi/dlog(d/ϵi)) =4exp(2dϵi(Clog(d/ϵi)/dDpdk1/2)) 4exp(2dϵi(ClogdlogKDκlogd/2)), since log(1/ϵi)log(1/ϵ0)=dlogK 4exp(103logd),for κ sufficiently large, since ϵ0=2d/K d102/8.

Taking a union bound over the 2d possible choices of S and the log(2d/ϵ0)2d possible choices for i, we get the claim for ϵϵ0.

Corollary 32.

Conditioned on the success of the event in Lemma 31, for every balanced cut AQ it holds that

|E(A,VA)||E(S,VS)|.

Proof.

Let A be a balanced cut of size |E(A,VA)|=(1+ϵ)(d1k1)|V|. If ϵϵ0, then we are done by Lemma 31. If instead ϵ<ϵ0, then |E(A,VA)|<(1+ϵ0)(d1k1)|A|, so by Lemma 26, there exists a coordinate cut S such that

|AS|<Kϵ02d11,

where the last inequality follows by the setting ϵ0=2d/K. But then A is equal to S, so we are done.

Lemma 33.

Let K be the universal constant from Lemma 26. With probability at least 1d100/2, all coordinate cuts S in Q satisfy

||E(S,VS)|p(d1k1)2d1|p100Kd(d1k1)|V|2,

and in particular, the optimal value of (9) is at most (d+1100K)(d1k1)2d1p.

The proof of Lemma 33 is almost identical to the proof of Lemma 17, and is included in the full version.

Proof of Theorem 4.

The algorithm solves the following optimization problem:

min i=1d|E(Ai,VAi)subject to (9)
|Ai|=|V|2 i,
|AiAj|=|V|2 ij,

and outputs the optimal solution A1,,Ad.

Running time.

We can solve (9) by enumerating over all feasible families of cuts, of which there are at most ((2d2d1))d=2O(2dd)=2O(nlogn) and computing the corresponding edge counts, so the running time is 2O(nlogn).

Correctness.

Condition on the success of the events in Lemma 31 and Lemma 33. By a union bound, this occurs with probability at least 1d100. Let {Ai}i[d] be the optimal solution to (9). For every i[d], let Si denote the coordinate cut in Q with the smallest Hamming distance to Ai.

We start by proving that this is a matching, i.e., that the set {Si}[d] consists of d different coordinate cuts. Suppose not. Then Si=Sj or Si=S¯j for some ij. If Si=Sj=S, then by triangle inequality,

|AiS|+|AjS||AiAj|=|V|2,

so either |AiSi||V|4 or |AjSj||V|4. If instead Si=S¯j=S, then by triangle inequality,

|AiS|+|AjS¯|=|AiS|+V|AjS|2d|AiAj|=|V|2,

so again either |AiSi||V|4 or |AjSj||V|4.

Let i be the index such that |AiSi||V|4. Applying Lemma 26 with ϵ=1/4 gives |E(Ai,VAi)|(1+14K)|V|2. From Lemma 31 and Lemma 33, we have

|E(Ai,VAi)| |E(Si,VSi)|+p8K(d1k1)|V|2 by Lemma 31
(11100K)(d1k1)p|V|2+p8K(d1k1)|V|2 by Lemma 33
(1+110K)(d1k1)p|V|2.

Furthermore, from Lemma 31 and Lemma 33, we have that for every ji,

|E(Aj,VAj)| |E(Sj,VSj)|(1p100Kd)(d1k1)|V|2.

But then summing over all j[d] gives

j[d]|E(Aj,VAj)|(1+110K)p|V|2+d(11100Kd)p|V|2>(d+1100K)p|V|2, (15)

which is a contradiction, since objective value of (9) is at most (d+1100K)p|V|2, by Lemma 33. Thus, the set {Si}i[d] must contain d distinct coordinate cuts.

So now suppose that we have a matching, i.e. that the set {Si}i[d] contains d distinct coordinate cuts. Then {Si}i[d] is a feasible solution to (9). Suppose for contradiction that |AiSi|1 for some i. Then by Lemma 31 applied to Ai, we have

|E(Ai,VAi)|>|E(Si,VSi)|,

and for every ji, by Lemma 32 applied to Aj, we have

|E(Aj,VAj)||E(Sj,VSj)|.

But this gives j[d]|E(Aj,VAj)|>j=1d|E(Sj,VSj)|, contradicting the optimality of {Ai}i[d].

References

  • [1] Emmanuel Abbe. Community detection and stochastic block models: recent developments. J. Mach. Learn. Res., 18(1):6446–6531, January 2017.
  • [2] Emmanuel Abbe, François Baccelli, and Abishek Sankararaman. Community detection on euclidean random graphs. Information and Inference: A Journal of the IMA, 10(1):109–160, May 2020.
  • [3] Emmanuel Abbe, Afonso S. Bandeira, and Georgina Hall. Exact recovery in the stochastic block model. IEEE Transactions on Information Theory, 62(1):471–487, 2016. doi:10.1109/TIT.2015.2490670.
  • [4] Emmanuel Abbe, Enric Boix-Adserà, Peter Ralli, and Colin Sandon. Graph powering and spectral robustness. SIAM Journal on Mathematics of Data Science, 2(1):132–157, 2020. doi:10.1137/19M1257135.
  • [5] Emmanuel Abbe and Colin Sandon. Community detection in general stochastic block models: Fundamental limits and efficient algorithms for recovery. In Proceedings of the 2015 IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS), FOCS ’15, pages 670–688, USA, 2015. IEEE Computer Society. doi:10.1109/FOCS.2015.47.
  • [6] Luiz Emilio Allem, K. Avrachenkov, Carlos Hoppen, Hariprasad Manjunath, and Lucas Sibemberg. Multi-community spectral clustering for geometric graphs, 2025. doi:10.48550/arXiv.2508.00893.
  • [7] Sanjeev Arora, Rong Ge, Sushant Sachdeva, and Grant Schoenebeck. Finding overlapping communities in social networks: toward a rigorous approach. In Proceedings of the 13th ACM Conference on Electronic Commerce, EC ’12, pages 37–54, New York, NY, USA, 2012. Association for Computing Machinery. doi:10.1145/2229012.2229020.
  • [8] Konstantin Avrachenkov, Andrei Bobu, and Maximilien Dreveton. Higher-order spectral clustering for geometric graphs. Journal of Fourier Analysis and Applications, 27(2):22, 2021.
  • [9] Kiril Bangachev and Guy Bresler. Sandwiching random geometric graphs and erdos-renyi with applications: Sharp thresholds, robust testing, and enumeration. In Proceedings of the 57th Annual ACM Symposium on Theory of Computing, pages 310–321, June 2025. doi:10.1145/3717823.3718125.
  • [10] Charles Bordenave, Marc Lelarge, and Laurent Massoulié. Non-backtracking spectrum of random graphs: Community detection and non-regular ramanujan graphs. In Venkatesan Guruswami, editor, IEEE 56th Annual Symposium on Foundations of Computer Science, FOCS 2015, Berkeley, CA, USA, 17-20 October, 2015, pages 1347–1357. IEEE Computer Society, 2015. doi:10.1109/FOCS.2015.86.
  • [11] Sébastien Bubeck, Jian Ding, Ronen Eldan, and Miklós Z. Rácz. Testing for high-dimensional geometry in random graphs. Random Structures & Algorithms, 49, 2014. URL: https://api.semanticscholar.org/CorpusID:15367951.
  • [12] Yudong Chen and Jiaming Xu. Statistical-computational tradeoffs in planted problems and submatrix localization with a growing number of clusters and submatrices. J. Mach. Learn. Res., 17(1):882–938, January 2016.
  • [13] Ashish Chiplunkar, Michael Kapralov, Sanjeev Khanna, Aida Mousavifar, and Yuval Peres. Testing graph clusterability: Algorithms and lower bounds. In 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS), pages 497–508. IEEE, 2018. doi:10.1109/FOCS.2018.00054.
  • [14] Anne Condon and Richard M. Karp. Algorithms for graph partitioning on the planted partition model. Random Structures & Algorithms, 18(2):116–140, 2001. doi:10.1002/1098-2418(200103)18:2<116::AID-RSA1001>3.0.CO;2-2.
  • [15] Artur Czumaj, Pan Peng, and Christian Sohler. Testing cluster structure of graphs. In Proceedings of the Forty-Seventh Annual ACM Symposium on Theory of Computing, STOC ’15, pages 723–732, New York, NY, USA, 2015. Association for Computing Machinery. doi:10.1145/2746539.2746618.
  • [16] Aurelien Decelle, Florent Krzakala, Cristopher Moore, and Lenka Zdeborová. Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications. Phys. Rev. E, 84:066106, December 2011. doi:10.1103/PhysRevE.84.066106.
  • [17] Benjamin Doerr. Probabilistic Tools for the Analysis of Randomized Optimization Heuristics, pages 1–87. Springer International Publishing, January 2020. doi:10.1007/978-3-030-29414-4_1.
  • [18] Ehud Friedgut, Gil Kalai, and Assaf Naor. Boolean functions whose fourier transform is concentrated on the first two levels. Advances in Applied Mathematics, 29(3):427–437, 2002. doi:10.1016/S0196-8858(02)00024-6.
  • [19] Sainyam Galhotra, Arya Mazumdar, Soumyabrata Pal, and Barna Saha. The geometric block model. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), April 2018. doi:10.1609/aaai.v32i1.11905.
  • [20] Sainyam Galhotra, Arya Mazumdar, Soumyabrata Pal, and Barna Saha. Connectivity of Random Annulus Graphs and the Geometric Block Model. In Dimitris Achlioptas and László A. Végh, editors, Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2019), volume 145 of Leibniz International Proceedings in Informatics (LIPIcs), pages 53:1–53:23, Dagstuhl, Germany, 2019. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.APPROX-RANDOM.2019.53.
  • [21] Sainyam Galhotra, Arya Mazumdar, Soumyabrata Pal, and Barna Saha. Community recovery in the geometric block model. J. Mach. Learn. Res., 24(1), January 2023. URL: http://jmlr.org/papers/v24/22-0572.html.
  • [22] Julia Gaudio, Xiaochun Niu, and Ermin Wei. Exact community recovery in the geometric sbm. In Proceedings of the 2024 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 2158–2184, 2024. doi:10.1137/1.9781611977912.78.
  • [23] Grzegorz Gluch, Michael Kapralov, Silvio Lattanzi, Aida Mousavifar, and Christian Sohler. Spectral clustering oracles in sublinear time. In Proceedings of the 2021 ACM-SIAM Symposium on Discrete Algorithms, SODA 2021, Virtual Conference, January 10 - 13, 2021, pages 1598–1617. SIAM, 2021. doi:10.1137/1.9781611976465.97.
  • [24] Paul Holland, Kathryn B. Laskey, and Samuel Leinhardt. Stochastic blockmodels: First steps. Social Networks, 5:109–137, 1983. URL: https://api.semanticscholar.org/CorpusID:34098453.
  • [25] David R Karger. Global min-cuts in RNC, and other ramifications of a simple min-cut algorithm. In ACM-SIAM Symposium on Discrete Algorithms, 1993. URL: https://api.semanticscholar.org/CorpusID:10445344.
  • [26] Shuangping Li and Tselil Schramm. Spectral clustering in the gaussian mixture block model, 2023. doi:10.48550/arXiv.2305.00979.
  • [27] Siqi Liu, Sidhanth Mohanty, Tselil Schramm, and Elizabeth Yang. Testing thresholds for high-dimensional sparse random geometric graphs. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, STOC 2022, pages 672–677, New York, NY, USA, 2022. Association for Computing Machinery. doi:10.1145/3519935.3519989.
  • [28] Florence Jessie MacWilliams and Neil James Alexander Sloane. The theory of error-correcting codes, volume 16. Elsevier, 1977.
  • [29] Laurent Massoulié. Community detection thresholds and the weak ramanujan property. In Proceedings of the Forty-Sixth Annual ACM Symposium on Theory of Computing, STOC ’14, pages 694–703, New York, NY, USA, 2014. Association for Computing Machinery. doi:10.1145/2591796.2591857.
  • [30] F. McSherry. Spectral partitioning of random graphs. In Proceedings 42nd IEEE Symposium on Foundations of Computer Science, pages 529–537, 2001. doi:10.1109/SFCS.2001.959929.
  • [31] Elchanan Mossel, Joe Neeman, and Allan Sly. Reconstruction and estimation in the planted partition model. Probability Theory and Related Fields, 162, July 2014. doi:10.1007/s00440-014-0576-6.
  • [32] Elchanan Mossel, Joe Neeman, and Allan Sly. Consistency thresholds for the planted bisection model. In Proceedings of the Forty-Seventh Annual ACM Symposium on Theory of Computing, STOC ’15, pages 69–75, New York, NY, USA, 2015. Association for Computing Machinery. doi:10.1145/2746539.2746603.
  • [33] Ryan O’Donnell. Analysis of Boolean Functions. Cambridge University Press, 2014.
  • [34] Abishek Sankararaman and François Baccelli. Community detection on euclidean random graphs. In Proceedings of the 2018 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), 2018. arXiv:https://epubs.siam.org/doi/pdf/10.1137/1.9781611975031.142.
  • [35] van Vu. A simple svd algorithm for finding hidden partitions. Combinatorics, Probability and Computing, 27:124–140, 2014. URL: https://api.semanticscholar.org/CorpusID:8561244.
  • [36] Douglas Brent West et al. Introduction to graph theory, volume 2. Prentice hall Upper Saddle River, 2001.
  • [37] Yuan Zhang, Elizaveta Levina, and Ji Zhu. Detecting overlapping communities in networks using spectral methods. SIAM Journal on Mathematics of Data Science, 2(2):265–283, 2020. doi:10.1137/19M1272238.