Abstract 1 Introduction 2 Sharp Phase Transition for the 𝒎-OGP: Ising 𝒑-Spin Glass Model 3 Sharp Phase Transition for the 𝒎-OGP: Random 𝒌-SAT Model 4 Future Directions & Further Background on OGP References

Sharp Thresholds for the Overlap Gap Property: Ising p-Spin Glass and Random k-SAT

Eren C. Kızıldağ ORCID Department of Statistics, University of Illinois Urbana-Champaign, IL, USA
Abstract

The Ising p-spin glass and random k-SAT are two canonical examples of disordered systems that play a central role in understanding the link between geometric features of optimization landscapes and computational tractability. Both models exhibit hard regimes where all known polynomial-time algorithms fail and possess the multi Overlap Gap Property (m-OGP), an intricate geometrical property that rigorously rules out a broad class of algorithms exhibiting input stability.

We establish that, in both models, the symmetric m-OGP undergoes a sharp phase transition, and we pinpoint its exact threshold. For the Ising p-spin glass, our results hold for all sufficiently large p; for the random k-SAT, they apply to all k growing mildly with the number of Boolean variables. Notably, our findings yield qualitative insights into the power of OGP-based arguments. A particular consequence for the Ising p-spin glass is that the strength of the m-OGP in establishing algorithmic hardness grows without bound as m increases.

These are the first sharp threshold results for the m-OGP. Our analysis hinges on a judicious application of the second moment method, enhanced by concentration. While a direct second moment calculation fails, we overcome this via a refined approach that leverages an argument of Frieze [33] and exploiting concentration properties of carefully constructed random variables.

Keywords and phrases:
spin glasses, p-spin model, random constraint satisfaction problems, overlap gap property, phase transitions, computational complexity
Category:
RANDOM
Copyright and License:
[Uncaptioned image] © Eren C. Kızıldağ; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Randomness, geometry and discrete structures
; Mathematics of computing Combinatorial optimization
Related Version:
Full Version: https://arxiv.org/abs/2309.09913 [54]
Acknowledgements:
I am grateful to David Gamarnik for his guidance and many helpful discussions during the early stages of this work. I would like to thank Brice Huang for carefully proofreading the draft and offering insightful comments, Aukosh Jagannath for numerous valuable discussions regarding spin glasses, Lutz Warnke for a helpful discussion on the bounded differences inequality, and anonymous referees for their valuable feedback.
Editors:
Alina Ene and Eshan Chattopadhyay

1 Introduction

In this paper, we focus on two fundamental models in the statistical mechanics of disordered systems: Ising p-spin glass and random k-SAT. Both models have been extensively studied across probability, theoretical computer science, and physics; see [58, 71] and references therein. Sharing profound structural similarities, including rich phase transitions and rugged landscapes, they are central to understanding the interplay between the geometrical properties of optimization landscapes and computational phase transitions in average-case settings. Our particular focus is on their inherent algorithmic barriers.

Both models exhibit regimes where no polynomial-time algorithms are known to succeed. For the Ising p-spin glass, which involves optimizing random polynomials, existing algorithms find strictly suboptimal solutions. For the random k-SAT, a random constraint satisfaction problem (CSP), known algorithms operate only at constraint densities far below the satisfiability threshold. Due to their average-case nature, classical complexity theory offers little insight into these barriers. An extensive body of work has instead sought unconditional lower bounds, showing that both models exhibit the multi Overlap Gap Property (m-OGP) – an intricate geometrical feature of the optimization landscape that rigorously rules out a broad class of algorithms [41, 17, 37, 15, 46, 36, 34]. These works have focused almost exclusively on establishing such lower bounds via the OGP and exploring their tightness – i.e., whether they match known algorithmic guarantees – often by analyzing increasingly refined versions of the OGP as m grows. For fixed m, a canonical result asserts that there exists a threshold γ(m) such that when γ>γ(m), the corresponding model exhibits m-OGP and certain algorithms necessarily fail; here, γ denotes a natural model parameter. However, a finer, two-sided understanding of the link between OGP and hardness remains elusive. In some models, OGP-based lower bounds match provable average-case hardness [79]. At the same time, certain optimization problems exhibit the OGP, yet still admit efficient algorithms [55]. These examples collectively highlight the need for a more nuanced understanding of OGP-based methods – one that addresses not only how OGP rules out algorithms, but also how its power evolves with m and what its absence implies.

To this end, a natural question arises: does the OGP indeed become more powerful as m increases? This is directly tied to understanding the regime where m-OGP is absent, as elaborated below. Typically, the presence of OGP is established via the first moment method, with the threshold γ(m) often improving with m. Consequently, a common rule of thumb in the field is that increasing m leads to stronger algorithmic lower bounds.111A similar monotonicity in m has also been conjectured in the context of spherical spin glasses [14]. However, this approach offers no insight into the regime γ<γ(m). To truly establish that the power of m-OGP grows with m, one must precisely locate its threshold – by showing that m-OGP is present for γ>γ(m) and absent for γ<γ(m). Without this, the observed improvement in γ(m) could be spurious, merely an artifact of the first moment method. Such a sharp analysis would also rigorously justify the prevailing practice of increasing m to tighten lower bounds. This issue is particularly stark in the binary perceptron, where the first moment method fails: in certain regimes, the predicted m-OGP threshold actually worsens with m, and the very presence of OGP remains unknown for m4 [39, Section II.B]. Moreover, the absence of OGP is not merely of theoretical interest: for the Sherrington-Kirkpatrick (SK) model, algorithms are known to succeed under the widely believed assumption that OGP is absent [61]. These examples underscore that understanding both the presence and absence of OGP – especially in the regime γ<γ(m) – is essential to fully grasp its power and limitations.

In this paper, we pinpoint the precise threshold for the symmetric m-OGP – a widely used variant of the OGP (see below) – for both models, thereby demonstrating a sharp phase transition. These thresholds are particularly transparent and strictly monotonic in m, in the large-p and large-k regimes. Our results yield qualitative insights into the power of OGP-based arguments. Notably, for the p-spin model, we establish that the power of m-OGP in proving algorithmic hardness increases indefinitely with m. In the context of spin glasses and shattering, our results also explain why a certain soft-OGP argument by El Alaoui [26] is necessary; see Section 1.3.

For an overview of our results, see Section 1.3. We next formally introduce the two models we study.

1.1 Ising Pure 𝒑-Spin Glass Model

For a fixed integer p2, an order-p tensor 𝑱=(Ji1,,ip:1i1,,ipn) with i.i.d. standard normal entries, Ji1,,ip𝒩(0,1), and 𝝈n, the p-spin Hamiltonian is:

Hn,p(𝝈)=np+12𝑱,𝝈p=np+121i1,,ipnJi1,,ip𝝈i1𝝈ip. (1)

Introduced by Derrida [24], the p-spin model generalizes the SK model (p=2) [70] by incorporating p-body interactions. Our particular focus is on the Ising case, where the configuration space is the discrete hypercube, 𝝈Σn:={1,1}n.222The spherical case where 𝝈 lies in the hypersphere of radius n, 𝝈2=n, is also studied extensively. A key quantity regarding spin glass models is the limiting free energy F(β):=limnlnZβ/n, where Zβ=𝝈Σnexp(βnHn,p(𝝈)) at inverse temperature β>0. The limiting free energy for the SK model was predicted in a celebrated work of Parisi [67] using the non-rigorous replica method. Following the work of Guerra [42], Talagrand [75] rigorously verified Parisi’s prediction in a breakthrough paper; his proof in fact extends to all even p. For general p, Parisi formula was verified by Panchenko [65], following the work Aizenman, Sims, and Starr [9]. The existence of the free energy limit was shown earlier by Guerra and Toninelli [43] using the so-called interpolation method. Far more is known rigorously regarding the p-spin glass models, including the ultrametricity of the asymptotic Gibbs measure [63, 48, 16], the TAP equations [12] and the TAP free energy [72, 18], a certain phase diagram [78, 10, 49], shattering [14, 29, 36], and algorithmic results (see below). Furthermore, more general spin glass models have also been studied in the literature. A particularly relevant case is the vector spin models where the states are tuples of points in n (as opposed to points in n) with a prescribed overlap, see [66, 52]. For further pointers to relevant literature, see the textbooks [76, 77, 64].

Finding a Near-Ground State in Polynomial-Time.

Define the ground-state energy by 𝖧:=limnmax𝝈ΣnHn,p(𝝈), which can be recovered as the zero temperature limit of the Parisi formula, 𝖧=limβF(β)/β.333See also [11] for a generalized Parisi formula for 𝖧 that does not require β limit. Given 𝖧, an algorithmic question is to find a near ground-state efficiently. That is, given 𝑱(n)p and ϵ>0, find in polynomial time a 𝝈ALGΣn such that Hn,p(𝝈ALG)(1ϵ)𝖧, ideally with high probability (w.h.p.). For the SK model, this problem was solved by Montanari [61], who developed an Approximate Message Passing (AMP) type algorithm. Montanari’s algorithm was inspired by an algorithm of Subag [73] for spherical mixed p-spin model; it is contingent on a widely believed conjecture that the SK model does not exhibit the OGP. More recently, [27, 69] extended Montanari’s algorithm to Ising mixed p-spin models. For any ϵ>0, these algorithms also return a 𝝈ALG for which Hn,p(𝝈ALG)(1ϵ)𝖧 w.h.p., provided the underlying mixed p-spin model does not exhibit the OGP. It is known, however, that the Ising p-spin glass model exhibits the OGP for p4 [17, Theorem 3], and that the OGP serves a rigorous barrier to AMP type algorithms [35]. Specifically, for any even p4, there exists a value μ¯ such that no AMP type algorithm can find a 𝝈ALG with Hn,p(𝝈ALG)𝖧μ¯ [35]. This algorithmic lower bound was later extended to low-degree polynomials [37] and low-depth Boolean circuits [38]. However, classical OGP [17] and the aforementioned lower bounds do not match the best known algorithmic threshold. More recently, Huang and Sellke [46, 47] introduced a very elegant branching OGP consisting of an ultrametric tree of solutions and subsequently obtained tight bounds for Lipschitz algorithms.

1.2 Random 𝒌-SAT Model

Given Boolean variables x1,,xn, a k-clause 𝒞 is defined as a disjunction of k literals {y1,,yk} chosen from {x1,,xn,x¯1,,x¯n}, i.e., 𝒞=y1yk. A random k-SAT formula Φ is a conjunction of M k-clauses 𝒞1,,𝒞M, with each of its kM literals sampled independently and uniformly from {x1,,xn,x¯1,,x¯n}: Φ=𝒞1𝒞M.444This model allows clauses to contain repeated literals, or both a variable xi and its negation x¯i. However, we focus on the regime k=Ω(lnn), where such occurrences are rare as n. This is standard in the literature [32, 21, 15]. Throughout, M=Θ(n) and n, where we refer to α:=M/n as the clause density.

Arguably the most fundamental question about random k-SAT is satisfiability: when does a satisfying assignment, i.e., a 𝝈{0,1}n with Φ(𝝈)=1, exist? For fixed k, Franco and Paull [31] showed, using a simple first moment argument, that a random k-SAT formula is w.h.p. unsatisfiable if α2kln2. This was later refined by Kirousis et al. [51], who established a sharper bound α2kln212(ln2+1)+ok(1), where the ok(1)0 as k. On the algorithmic side, Chvátal and Reed [19] showed that a simple algorithm known as unit clause w.h.p. finds a satisfying assignment if α<2k/k; see also [60], who showed that the same algorithm succeeds with constant probability. The asymptotic gap between 2k/k and Ωk(2k) was substantially narrowed by Achlioptas and Moore [6]. Using a non-constructive second moment argument, they showed that a random k-SAT formula is w.h.p. satisfiable if α2k1ln2Ok(1). Coja-Oghlan and and Panagiotou [23] later refined this bound to α2kln212(ln2+1)+ok(1), nearly matching the lower bound of [51] up to ok(1) terms. A major breakthrough by Ding, Sly, and Sun [25] confirmed, for large k, that the satisfiability threshold is the value predicted by Mézard, Parisi and Zecchina [59]: for any large k, there exists a threshold α(k) such that a random k-SAT formula is satisfiable for α<α(k) and unsatisfiable for α>α(k), both w.h.p. as n. For a detailed discussion on the random k-SAT, see the introduction of [15] and the survey by [3].

Finding a Satisfying Assignment Efficiently.

Given the existence of satisfying assignments for α=Ok(2k), a natural algorithmic question arises: can we find such an assignment efficiently? As mentioned earlier, the simple unit clause algorithm finds a satisfying assignment in polynomial time for α2k/k. Later, Coja-Oghlan [20] devised a polynomial-time algorithm that succeeds for α(1+ok(1))2klnk/k, beyond which no efficient algorithm is known. Interestingly, the threshold (1+ok(1))2klnk/k also marks the onset of clustering in the solution space of random k-SAT, as predicted by Krzakala et al. [53] and rigorously verified by Achlioptas and Coja-Oghlan [4]. Beyond this threshold, the solution space of random k-SAT fragments into exponentially many well-separated sub-dominant clusters, which are Ω(n) apart, each containing only an exponentially small fraction of solutions. This phenomenon led to the conjecture that (1+ok(1))2klnk/k is the algorithmic threshold for the random k-SAT.555It is worth noting that clustering alone does not necessarily imply algorithmic hardness. For instance, the binary perceptron model exhibits an extreme form of clustering at all densities, including the “easy” regime where polynomial-time algorithms exist; see [68, 1, 2, 39, 40]. Specifically, it is conjectured that no polynomial-time algorithm can find (w.h.p.) a satisfying assignment above this threshold. While this conjecture remains open, lower bounds against particular classes of algorithms have been obtained. Using the symmetric m-OGP, Gamarnik and Sudan [41] showed that sequential local algorithms with a moderately growing number of message passing iterations fail to find a satisfying assignment for a variant of the random k-SAT model known as the random Not-All-Equal-k-SAT (NAE-k-SAT) for α2k1log2k/k. Hetterich [45] proved that Survey Propagation Guided Decimation algorithm fails for α(1+ok(1))2klogk/k even with an unbounded number of iterations. Coja-Oglan, Haqshenas, and Hetterich [22] showed that Walksat stalls for αC2klog2k/k, for some absolute constant C>0. More recently, Bresler and Huang [15] demonstrated that low-degree polynomials fail to find a satisfying assignment for the random k-SAT when ακ(1+ok(1))2klnk/k, where κ4.911. Their approach leverages a novel asymmetric variant of the m-OGP.

Significance of Symmetric 𝒎-OGP.

Our focus is on the symmetric m-OGP, which plays a central role in establishing unconditional algorithmic lower bounds. It yields the sharpest known bounds in central models such as the binary perceptron [39, 56] and discrepancy minimization [40], as well as nearly sharp bounds for NAE-k-SAT, a closely related variant of random k-SAT [41]. In Ising p-spin glasses, symmetric m-OGP is asymptotically tight as p grows: its onset matches the algorithmic threshold of the Random Energy Model, the formal p limit of the Ising p-spin glasses [24, 74, 8, 36]. For fixed p, the sharpest lower bounds follow from a very elegant branching OGP argument [46]; however, this applies only to overlap-concentrated algorithms – a strict subclass of stable algorithms that excludes, for example, low-degree polynomials. In contrast, symmetric m-OGP applies to this broader class, albeit yielding weaker bounds. Moreover, branching OGP yields lower bounds only for even p, whereas symmetric m-OGP applies to both even and odd p. In fact, for odd p, it provides the only known algorithmic lower bounds for Ising p-spin glasses [36]. Further underscoring its relevance, the case m=2, or pairwise OGP, is directly linked to the shattering phenomenon – a notion from spin glass theory that has shaped our understanding of algorithmic phase transitions in random CSPs [7, 4, 5], see below. By contrast, such a connection is less clear for more sophisticated OGP variants. Taken together, these observations underscore the significance of symmetric m-OGP and highlight the need to fully understand its power.

For m, γ>γpspin(m):=1/m, and sufficiently large p, Ising p-spin glasses exhibit symmetric m-OGP above the threshold γ2ln2 [36, Theorem 2.11].666The value 2ln2 corresponds to the ground-state energy of the Random Energy Model [74, 36].: no tuples of equidistant solutions at a prescribed distance exist beyond this threshold (see Definition 6). Likewise, for m, γ>γkSAT(m):=1/m, and sufficiently large k, the random k-SAT model exhibits symmetric m-OGP above the constraint density γ2kln2; see [41] or Theorem 13 below. That is, no tuples of nearly equidistant satisfying assignments at a prescribed distance exist beyond the density γ2kln2 (see Definition 12).

1.3 Overview of Our Results

As noted, studying the absence of OGP is essential for a deeper understanding of OGP-based methods and for developing a more complete average-case theory, yet this question has not been rigorously addressed. We initiate this direction by investigating the absence of symmetric m-OGP for Ising p-spin glass and random k-SAT for large p and k – two fundamental average-case models. This is a natural starting point: extending such investigations to other variants of OGP (e.g., asymmetric OGP [15] or branching OGP [46]) appears far more challenging, and symmetric OGP provides a natural foundation for these extensions. Moreover, both Ising p-spin and random k-SAT are more tractable for large p and k. Rigorous results for small, fixed k remain elusive for random k-SAT, and results for fixed p are extremely challenging for spin glasses. This reflects a broad trend in random structures; see Remark 5.

Prior work, focusing exclusively on leveraging symmetric m-OGP to establish algorithmic hardness, overlooked the case γ<γ(m), where γpspin(m)=1/m or γkSAT(m)=1/m. Our first contribution is to precisely determine the thresholds for both models, providing deeper insights into the power of symmetric m-OGP. All statements below hold w.h.p. as n. We begin with the Ising spin glasses.

Theorem 1 (Informal, see Theorem 8).

For any m, γ<γpspin(m)=1/m and sufficiently large p, the symmetric m-OGP is absent in the Ising p-spin glass below the value γ2ln2.

Namely, for any m and sufficiently large p, nearly equidistant m-tuples of solutions exist at all pairwise distances below the value (2ln2)/m. Theorem 1 offers a qualitative insight into the OGP-based arguments. Specifically, in the limit of large p, it reveals that the power of OGP in establishing algorithmic hardness indeed strictly improves with m. We next address the random k-SAT.

Theorem 2 (Informal, see Theorem 14).

For any m, γ<γkSAT(m)=1/m and k=Ω(lnn), the symmetric m-OGP is absent in the random k-SAT below the density γ2kln2.

Theorem 2 asserts that for any m and mildy growing k, k=Ω(lnn), nearly equidistant m-tuples of satisfying assignments exist at all pairwise distances below the constraint density (2kln2)/m. Recall that the algorithmic threshold for the random k-SAT is asymptotic to 2kln2/k as k. Consequently, Theorem 3 implies that achieving matching algorithmic lower bounds via the symmetric m-OGP requires m to be superconstant. Indeed, sharp lower bounds for this model were obtained instead through an asymmetric variant of OGP [15].

Theorem 2 holds under the assumption that k grows mildly in n. For constant k, we establish:

Theorem 3 (Informal, see Theorem 18).

For any m, γ<1/m and sufficiently large k, the symmetric m-OGP is absent below the density γ2kln2 for the set of assignments that satisfy a 1exp(Θk(k)) fraction of clauses.

Namely, the m-OGP is absent for the set of assignments violating a small fraction of clauses.

Combined with prior results on the m-OGP, Theorems 1-2 establish a sharp phase transition.

Theorem 4 (Informal, see Theorems 11 and 16).

For any m, the symmetric m-OGP undergoes a sharp phase transition in the Ising p-spin glass and the random k-SAT.

Phase transition points are γpspin=1/m and γkSAT=1/m, both of which are strictly monotonic in m. While the first moment calculations had suggested that the OGP thresholds improve with m – as expected, since m-OGP structure becomes increasingly nested as m increases – a rigorous confirmation had been lacking. Theorem 4 establishes this structural fact for the models we study, thereby justifying the aforementioned common practice of increasing m when applying OGP-based methods.

 Remark 5.

Notice that Theorems 1-4 hold for large p and k. This mirrors a rich body of work in random structures – e.g., random k-SAT, spin glasses, and random graphs – where rigorous results for fixed parameters are notoriously challenging and foundational progress has largely occurred in the large parameter regime. For random k-SAT, both the satisfiability threshold [25] and algorithmic lower bounds [15] are known only for sufficiently large k. Earlier developments [32, 21, 57] focused on the same regime k=Ω(lnn) considered here. For Ising p-spin glasses, rigorous results for large p [74] preceded technically far more delicate breakthroughs for fixed p [75, 63]. For sparse random graphs, most rigorous results pertain to large average degree d [33, 13, 81]. The large p regime has also proven useful in high-dimensional statistics; for instance, a recent work rigorously analyzes the large average subtensor problem in a challenging regime for p large [44]. Our work, which initiates a new direction into the absence of OGP, also focuses on large parameter regime; extending beyond this, particularly to fixed p or k, is a central open challenge for future work.

Shattering in Spin Glasses.

The celebrated work by Kirkpatrick and Thirumalai [50] predicted a shattering phase in the Gibbs measure of the Ising p-spin glass, in which exponentially many well-separated clusters, each with exponentially small mass, collectively contain almost all of the Gibbs mass. Subsequent work [62, 30] refined this conjecture, postulating shattering over a range of inverse temperatures β(βd(p),βc(p)), where βd(p)=(1+op(1))(2lnp)/p as shown in [30, 28] and βc(p)=(1op(1))2ln2 as established in [74], both asymptotically as p. Shattering at zero temperature (i.e., shattering of the solution space) has played a key role since then in the study of algorithmic hardness in random CSPs [7, 4, 5].

Despite major advances in spin glass theory, shattering phenomena have only recently begun to be rigorously understood. [36] established shattering in the Ising p-spin glass model for β(ln2,2ln2) and all sufficiently large p. Their argument, based on the pairwise OGP (2-OGP), falls short of establishing shattering when βd(p)<β<ln2. In light of Theorems 1 and 8, the 2-OGP is absent when β<ln2, which accounts for the fact that the techniques of [36] apply only to the range ln2<β<2ln2. Very recently, El Alaoui [26] introduced a “soft” version of the 2-OGP, which led to a near-optimal shattering result extending down to the conjectured βd(p) threshold. Our results confirm that the bounds in [36] are tight. This highlights the necessity of the soft-OGP approach developed in [26] to obtain optimal shattering results.

Notation.

For any event E, 𝟙{E} denotes its indicator. For r, exp(r):=er. For n, Σn:={1,1}n. For any 𝝈,𝝈Σn or 𝝈,𝝈{0,1}n, dH(𝝈,𝝈):=1in𝟙{𝝈(i)𝝈(i)}. For 𝝈,𝝈Σn, 𝝈,𝝈:=1in𝝈(i)𝝈(i)=n2dH(𝝈,𝝈). We employ standard asymptotic notation: Θ(),O(),o(),Ω(), and ω(); the underlying asymptotics is often w.r.t. n. Asymptotics other than n are reflected with a subscript, e.g. Ωk().

2 Sharp Phase Transition for the 𝒎-OGP: Ising 𝒑-Spin Glass Model

In this section, we establish a sharp phase transition for the multi Overlap Gap Property (m-OGP) in the Ising p-spin model. We first formalize the set of m-tuples under consideration.

Definition 6.

Let m, 0<γ<1, and 0<η<ξ<1. Denote by 𝒮pspin(γ,m,ξ,η) the set of all m-tuples 𝛔(t)Σn:={1,1}n, 1tm, that satisfy the following:

  • 𝜸-Optimality: For any 1tm, H(𝝈(t))γ2ln2.

  • Overlap Constraint: For any 1t<m, n1𝝈(t),𝝈()[ξη,ξ].

Definition 6 regards m-tuples of near-optimal solutions whose (pairwise) overlaps are constrained; parameter γ quantifies the near-optimality and ξ,η control the region of overlaps. The model exhibits symmetric m-OGP at threshold γ2ln2 if 𝒮pspin is w.h.p. empty for suitable m,ξ and η.

Gamarnik, Jagannath, and Kızıldağ establish the following result.

Proposition 7 ([36, Theorem 2.11]).

For any m and any γ>1/m, there exists 0<η<ξ<1 and a P such that the following holds. Fix any pP. Then, as n

[𝒮pspin(γ,m,ξ,η)]eΘ(n).

That is, for any m and γ>1/m, Ising pure p-spin model exhibits the symmetric m-OGP above γ2ln2 for all large enough p.777We emphasize that [36, Theorem 2.11] is, in fact, stronger. It establishes the ensemble m-OGP, concerning tuples of near-optima w.r.t. correlated Hamiltonians, which is necessary for proving algorithmic hardness.

Proposition 7 focuses on γ>1m. Our first main result addresses the regime γ<1/m.

Theorem 8.

For any m, γ<1/m, and any 0<η<ξ<1, there exists a P such that the following holds. Fix any pP. Then, as n

[𝒮pspin(γ,m,ξ,η)]1eΘ(n).

The proof of Theorem 8 relies on multiple techniques, which we overview in Section 2.1. The complete proof can be found in the full version [54, Section 5.2].

Taken together, Proposition 7 and Theorem 8 collectively imply that for sufficiently large p, the value (2ln2)/m is tight: for any m, and sufficiently large p, the onset of m-OGP is (2ln2)/m. We make this more precise in Theorem 11, establishing a sharp phase transition.

We emphasize that Theorem 8 regards a single Hamiltonian, rather than a correlated ensemble. Crucially, it holds for any ξ and η, strengthening the ensuing results: the phase transition for the m-OGP is independent of ξ,η or the ensemble, making it inherently definition-robust.

Sharp Phase Transition.

We define the notion of admissible values of γ.

Definition 9.

Fix an m. A value γ>0 is called m-admissible if for any 0<η<ξ<1 there exists a P(m,γ,η,ξ) such that for every fixed pP(m,γ,η,ξ),

limn[𝒮pspin(γ,m,ξ,η)]=1.

Similarly, γ is called m-inadmissible if there exists 0<η<ξ<1, η sufficiently small, and a P^ such that for every fixed pP^,

limn[𝒮pspin(γ,m,ξ,η)]=0.

The sharp phase transition we investigate is formalized as follows.

Definition 10.

Fix m. The m-OGP exhibits a sharp phase transition at the threshold γ(m) if

sup{γ>0:γ is m-admissible}=γ(m)=inf{γ>0:γ is m-inadmissible}.

As noted above, the phase transition is definition-robust, i.e., it remains independent of ξ,η or the ensemble. We establish that:

Theorem 11.

For any m, the m-OGP for the Ising p-spin glass model exhibits a sharp phase transition in the sense of Definition 10 at γpspin(m)=1/m.

Theorem 11 follows directly from Proposition 7 and Theorem 8; the proof is omitted. We highlight that the phase transition point γpspin(m) is strictly monotonic in m.

2.1 Proof Overview for Theorem 8

Given m and 0<η<ξ<1, denote by (m,ξ,η) the set of all (𝝈(1),,𝝈(m)), satisfying the overlap constraints, n1𝝈(i),𝝈(j)[ξη,ξ] for all ij. To begin with, we must show that (m,ξ,η) is non-empty; otherwise the set 𝒮pspin in Definition 6 would be trivially empty. We establish this using probabilistic method. Specifically, we generate 𝝈(1),,𝝈(m) by independently sampling each coordinate 𝝈(i)(k){1,1} with an appropriate mean. Applying large deviations inequalities, we show that the resulting tuple satisfies the overlap constraints with positive probability, thereby ensuring (m,ξ,η).

The next step is applying the second moment method. Suppose that M is a non-negative integer-valued random variable with finite variance. Then, [M1]𝔼[M]2/𝔼[M2] by the Paley-Zygmund Inequality. We fix γ<1/m and apply this to M:=|𝒮pspin(γ,m,ξ,η)|. To estimate 𝔼[M2], we analyze a summation over all pairs of m-tuples in (m,ξ,η) satisfying Definition 6. Building on an overcounting argument, we show that for large p, these pairs behave approximately independently unless their corresponding coordinates exhibit extreme correlation. At the same time, enforcing a high degree of correlation incurs a steep entropic cost. This allows us to decompose 𝔼[M2] into two parts, each of which can be controlled separately. This leads to

[|𝒮pspin(γ,m,ξ,η)|1]exp(nop(1)) (2)

where op(1)0 as p. Thus, the second moment method alone falls short of establishing the desired result that 𝒮pspin w.p. 1o(1). While this issue could be resolved for large p if |𝒮pspin| were concentrated around its mean, such a concentration property is unclear. Instead, we proceed by defining a suitable proxy random variable that is closely related to |𝒮pspin| and more tractable:

Tm,ξ,η:=max(𝝈(1),,𝝈(m))(m,ξ,η)min1jmH(𝝈(j)).

We prove that Tm,ξ,η, viewed as a function of the tensor 𝑱 with i.i.d. 𝒩(0,1) entries (cf. (1)), satisfies a Lipschitz property. Consequently, standard concentration results for Lipschitz functions of normal random variables yield that for all ϵ0:

[|Tm,ξ,η𝔼[Tm,ξ,η]|ϵ]2exp(nϵ2/2). (3)

Second Moment Bound for Large 𝒑.

We now leverage an elegant argument of Frieze [33] to combine the second moment bound with concentration. The key observation is that:

|𝒮pspin(γ,m,ξ,η)|1Tm,ξ,ηγ2ln2, (4)

for any γ>0. Fixing γ(γ,1/m), we obtain that for all sufficiently large p and n,

[Tm,ξ,ηγ2ln2]exp(nop(1))2exp(nϵ2/2)[Tm,ξ,η𝔼[Tm,ξ,η]+ϵ]

using (2), (3), and (4). Consequently, 𝔼[Tm,ξ,η]γ2ln2ϵ. Applying (3) once more, we obtain w.h.p. Tm,ξ,η𝔼[Tm,ξ,η]ϵγ2ln22ϵ, which at least γ2ln2 provided ϵ>0 is sufficiently small. This bound, together with (4), establishes Theorem 8.

3 Sharp Phase Transition for the 𝒎-OGP: Random 𝒌-SAT Model

We now turn to the random k-SAT. The set of m-tuples we investigate is as follows.

Definition 12.

Let k, γ(0,1), m, and 0<η<ξ<1. Denote by 𝒮kSAT(γ,m,ξ,η) the set of all m-tuples 𝛔(t){0,1}n, 1tm, that satisfy the following.

  • Satisfiability: For any 1tm, Φ(𝝈(t))=1, where Φ() is a conjunction of nαγ independent k-clauses and αγ=γ2kln2.

  • Pairwise Distance: For any 1t<m, n1dH(𝝈(t),𝝈())[ξη,ξ].

Definition 12 regards m-tuples of satisfying solutions whose pairwise distances are constrained. The parameter αγ is the clause density: the formula Φ consists of nαγ independent k-clauses. Parameters ξ and η collectively control the region of overlaps. Similar to above, the model exhibits m-OGP above αγ if 𝒮kSAT is empty (w.h.p.) for suitable m,ξ and η.

Gamarnik and Sudan [41] established the symmetric m-OGP for a variant of random k-SAT known as NAE-k-SAT. We first extend their result to random k-SAT model.

Theorem 13.

For any m and any γ>1/m, there exists 0<η<ξ12 and K:=K(γ,m,ξ,η) such that the following holds. Fix any kK. Then, as n

[𝒮kSAT(γ,m,ξ,η)]eΘ(n).

Theorem 13 is shown via the first moment method, see [54, Section 5.4] for the proof. For any m and γ>1/m, the random k-SAT model exhibits m-OGP at clause density γ2kln2.

Our next result addresses the regime γ<1/m.

Theorem 14.

For any m, γ<1/m and 0<η<ξ12, there exists a constant C(γ,m,ξ,η)>0 such that the following holds. Fix any kC(γ,m,ξ,η)lnn. Then as n,

[𝒮kSAT(γ,m,ξ,η)]1eΘ(n).

See [54, Section 5.5] for the proof, which is based on the second moment method.

Theorem 14 yields that for any m, α<(2kln2)/m and k growing mildly in n, the m-OGP is absent: nearly equidistant m-tuples of satisfying solutions exist at all pairwise distances. Taken together, Theorems 13 and 14 collectively yield that for k=Ω(lnn), the onset of m-OGP occurs at density (2kln2)/m. In Theorem 16 below, we combine Theorems 13 and 14 to establish a sharp phase transition.

We remark on the condition k=Ω(logn). Several earlier developments in the random k-SAT literature, particularly those concerning the satisfiability threshold, were also established in the same regime k=Ω(lnn), see [32, 21, 57]. In Theorem 18 below, we establish the absence of the m-OGP for all sufficiently large k=O(1), in the set of nearly satisfying assignments that violate only a small fraction of clauses.

Our final remark concerns the technical condition ξ12 in Theorem 14. For Theorem 14 to be non-trivial, there must exist m-tuples 𝝈(1),,𝝈(m){0,1}n such that for all sufficiently small η>0, their Hamming distances satisfy dH(𝝈(i),𝝈(j))[ξη,ξ] for 1i<jm. (In fact, our proof extends to any ξ for which such tuples exist.) An application of the probabilistic method confirms the existence of such tuples for ξ12; however, the case ξ>12 remains unclear. Thus, we restrict our attention to ξ12, leaving ξ>12 for future work.

A Sharp Phase Transition.

Similar to the Ising p-spin glass model, we define the notion of admissible values of γ by modifying Definition 9.

Definition 15.

Fix an m. A value γ>0 is called m-admissible if for any 0<η<ξ<1 there exists a C(γ,m,ξ,η) such that for every kC(γ,m,ξ,η)lnn,

limn[𝒮kSAT(γ,m,ξ,η)]=1.

Similarly, γ is called m-inadmissible if there exists 0<η<ξ<1, η sufficiently small, and a C(γ,m,ξ,η) such that for every kC(γ,m,ξ,η)lnn,

limn[𝒮kSAT(γ,m,ξ,η)]=0.

Equipped with Definition 15, we now analyze the sharp phase transition of the m-OGP in the sense of Definition 10 and establish the following result.

Theorem 16.

For any m, the m-OGP for the random k-SAT model exhibits a sharp phase transition in the sense of Definition 10 at γkSAT=1/m.

Theorem 16 follows directly from Theorems 13 and 14 [54, Section 5.3]. Notably, the phase transition point γkSAT(m) is, once again, strictly monotonic in m.

3.1 Case of Constant 𝒌

The m-OGP result for the random k-SAT (Theorem 13) holds for all sufficiently large k, while Theorem 14 along with the sharp phase transition result (Theorem 16) apply to k=Ω(lnn). A fundamental question arises: can we extend the analysis to the challenging regime where k is constant?

In this section, we address this question by analyzing a variant of the k-SAT model that focuses on nearly satisfying assignments – assignments that violate only a small fraction of clauses. This setting is closely related to the maximum satisfiability (MAX-SAT) model. For this model, we establish the absence of the m-OGP for sufficiently large constant k.

An Objective Function: Number of Violated Constraints.

Given a random k-SAT formula Φ which is a conjunction of M independent k-clauses 𝒞1,,𝒞M, and a truth assignment 𝝈{0,1}n, define (𝝈) as the number of clauses violated by 𝝈: (𝝈)=1iM𝟙{𝒞i(𝝈)=0}. In particular, Φ(𝝈)=1 iff (𝝈)=0. With this, we modify Definition 12 accordingly.

Definition 17.

Let k, γ(0,1), m, 0<η<ξ<1, and κ[0,1]. Denote by 𝒮kSAT(γ,m,ξ,η,κ) the set of all m-tuples 𝛔(t){0,1}n, 1tm, that satisfy the following.

  • Near-Optimality: For any 1im, M1(𝝈(i))κ, where M=nαγ, αγ=γ2kln2.

  • Overlap Constraint: For any 1t<m, n1dH(𝝈(t),𝝈())[ξη,ξ].

That is, 𝒮kSAT(γ,m,ξ,η,κ) denotes the set of all nearly equidistant m-tuples of truth assignments such that for any (𝝈(1),,𝝈(m))𝒮kSAT(γ,m,ξ,η,κ) any 1im, fraction of clauses violated by 𝝈(i) is at most κ. In particular, when κ=0, we recover the original definition: 𝒮kSAT(γ,m,ξ,η)=𝒮kSAT(γ,m,ξ,η,0).

We are now ready to state our final main result.

Theorem 18.

For any m, γ<1/m, and 0<η<ξ<1, there exists constants C>0, K and ζ(0,1) such that the following holds. Fix any kK. Then as n,

[𝒮kSAT(γ,m,ξ,η,Cζk/2)]1eΘ(n).

See below for the proof sketch and [54, Section 5.6] for the full proof.

Theorem 18 asserts that for any m, γ<1/m and 0<η<ξ<1, there exists m-tuples (𝝈(1),,𝝈(m)) such that the normalized Hamming distances obey n1dH(𝝈(i),𝝈(j))[ξη,ξ], and each 𝝈(i) satisfies at least (1O(ζk/2))M many clauses. In other words, there exists m-tuples of nearly equidistant and nearly satisfying assignments below the density (2kln2)/m.

Proof Sketch for Theorem 18.

Recall from above that 𝒮kSAT(γ,m,ξ,η):=𝒮kSAT(γ,m,ξ,η,0). An inspection of the second moment calculation for Theorem 14 reveals:

[𝒮kSAT(γ,m,ξ,η)]exp(2αγnm2ζ¯k), (5)

for some ζ¯(0,1), where αγ=γ2kln2. Next, we define the proxy random variable

Zξ,η:=max𝝈(1),,𝝈(m){0,1}nn1dH(𝝈(i),𝝈(j))[ξη,ξ]min1im^(𝝈(i)), (6)

where ^(𝝈)=M(𝝈) is the number of satisfied clauses. Viewing Zξ,η as a function 𝒞1,,𝒞M, we obtain |Z(𝒞1,,𝒞M)Z(𝒞1,,𝒞i1,𝒞i,𝒞i+1,,𝒞M)|1 for all i, where 𝒞i is an independent copy of 𝒞i. So, Zξ,η concentrates due to McDiarmid’s inequality [80]:

[|Zξ,η𝔼[Zξ,η]|t0]2exp(t02/M), (7)

for any t00. Notice that Zξ,η=M iff |𝒮kSAT(γ,m,ξ,η)|1. Using (5) and (7), we have

[Zξ,η=M] exp(2αγnm2ζ¯k)exp((t)2/M)[Zξ,η𝔼[Zξ,η]+t],

where t=3nαγmζ¯k/2. Consequently, 𝔼[Zξ,η]Mt=nαγt. Applying (7) with t0=αγn, we obtain that w.h.p., Zξ,η𝔼[Zξ,η]αγnnαγ(1Cζk/2), where C>0 and ζ(0,1) are suitable constants. Finally, we complete the proof by recalling:

Zγ,ηnαγ(1Cζk/2)|𝒮kSAT(γ,m,ξ,η,Cζk/2)|1.

4 Future Directions & Further Background on OGP

An immediate direction is to complement Theorem 18 with an m-OGP result and to establish a sharp threshold for “almost solutions” to random k-SAT, analogous to Theorems 11 and 16. Extensions to other spin glass models, such as mixed p-spin or multi-species models, are also intriguing directions for future work (thanks to an anonymous referee for suggesting this).

Random 𝒌-SAT for Constant 𝒌.

Extending Theorem 14 to constant k remains an intriguing question we leave for future work. A promising starting point is the NAE-k-SAT model, a variant of k-SAT where each clause must contain at least one true and one false literal. The inherent symmetry of NAE-k-SAT makes it particularly amenable to rigorous analysis. While the proof of satisfiability conjecture for random k-SAT was a long and arduous journey, culminating in the breakthrough tour de force by Ding, Sly, and Sun [25], analogous results for the NAE-k-SAT were established much earlier, using fairly standard second moment calculations by Achlioptas and Moore [6]. This suggests that sharper results may be attainable for the NAE-k-SAT, potentially avoiding k=Ω(logn) growth.

OGP and Algorithms.

The interplay between the OGP and algorithms remains a key frontier, with far-reaching implications for average-case computational complexity. While the OGP formally implies the failure of large classes of algorithms, certain tractable optimization problems – solvable by linear programming – still exhibit the OGP [55]. What makes these cases exceptional? What is the broadest class of algorithms that OGP can provably rule out?

Likewise, what are the implications of the absence of the OGP? For instance, the algorithm by Montanari [61], finding a near-ground state for the SK model, crucially relies on the widely-believed conjecture that the model does not exhibit OGP. Our results indicate that the absence of OGP at a certain level m does not necessarily imply algorithmic tractability. Could there exist models without OGP that still pose insurmountable computational barriers? Finally, our findings reveal an intriguing scaling phenomenon: for certain models, the power of m-OGP in establishing algorithmic hardness strengthens indefinitely as m increases. When does this trend persist and when does it saturate?

References

  • [1] Emmanuel Abbe, Shuangping Li, and Allan Sly. Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster. arXiv preprint, 2021. arXiv:2111.03084.
  • [2] Emmanuel Abbe, Shuangping Li, and Allan Sly. Proof of the contiguity conjecture and lognormal limit for the symmetric perceptron. arXiv preprint, 2021. arXiv:2102.13069.
  • [3] Dimitris Achlioptas. Random satisfiability. Handbook of Satisfiability, 185:245–270, 2009. doi:10.3233/978-1-58603-929-5-245.
  • [4] Dimitris Achlioptas and Amin Coja-Oghlan. Algorithmic barriers from phase transitions. In 2008 49th Annual IEEE Symposium on Foundations of Computer Science, pages 793–802. IEEE, 2008. doi:10.1109/FOCS.2008.11.
  • [5] Dimitris Achlioptas, Amin Coja-Oghlan, and Federico Ricci-Tersenghi. On the solution-space geometry of random constraint satisfaction problems. Random Structures & Algorithms, 38(3):251–268, 2011. doi:10.1002/RSA.20323.
  • [6] Dimitris Achlioptas and Cristopher Moore. The asymptotic order of the random k-SAT threshold. In The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings., pages 779–788. IEEE, 2002. doi:10.1109/SFCS.2002.1182003.
  • [7] Dimitris Achlioptas and Federico Ricci-Tersenghi. On the solution-space geometry of random constraint satisfaction problems. In Proceedings of the thirty-eighth annual ACM symposium on Theory of computing, pages 130–139, 2006. doi:10.1145/1132516.1132537.
  • [8] Louigi Addario-Berry and Pascal Maillard. The algorithmic hardness threshold for continuous random energy models. Mathematical Statistics and Learning, 2(1):77–101, 2020.
  • [9] Michael Aizenman, Robert Sims, and Shannon L Starr. Extended variational principle for the Sherrington-Kirkpatrick spin-glass model. Physical Review B, 68(21):214403, 2003.
  • [10] Antonio Auffinger and Wei-Kuo Chen. On properties of Parisi measures. Probability Theory and Related Fields, 161(3-4):817–850, 2015.
  • [11] Antonio Auffinger and Wei-Kuo Chen. Parisi formula for the ground state energy in the mixed p-spin model. The Annals of Probability, 45(6B):4617–4631, 2017.
  • [12] Antonio Auffinger and Aukosh Jagannath. Thouless–Anderson–Palmer equations for generic p-spin glasses. The Annals of Probability, 47(4):2230–2256, 2019. doi:10.1214/18-AOP1307.
  • [13] Mohsen Bayati, David Gamarnik, and Prasad Tetali. Combinatorial approach to the interpolation method and scaling limits in sparse random graphs. In Proceedings of the forty-second ACM symposium on Theory of computing, pages 105–114, 2010. doi:10.1145/1806689.1806706.
  • [14] Gérard Ben Arous and Aukosh Jagannath. Shattering versus metastability in spin glasses. arXiv preprint, 2021. arXiv:2104.08299.
  • [15] Guy Bresler and Brice Huang. The algorithmic phase transition of random k-SAT for low degree polynomials. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 298–309. IEEE, 2022.
  • [16] Sourav Chatterjee and Leila Sloman. Average Gromov hyperbolicity and the Parisi ansatz. Advances in Mathematics, 376:107417, 2021.
  • [17] Wei-Kuo Chen, David Gamarnik, Dmitry Panchenko, and Mustazee Rahman. Suboptimality of local algorithms for a class of max-cut problems. The Annals of Probability, 47(3):1587–1618, 2019.
  • [18] Wei-Kuo Chen, Dmitry Panchenko, and Eliran Subag. Generalized TAP Free Energy. Communications on Pure and Applied Mathematics, 76(7):1329–1415, 2023.
  • [19] V. Chvatal and B. Reed. Mick gets some (the odds are on his side) (satisfiability). In Proceedings., 33rd Annual Symposium on Foundations of Computer Science, pages 620–627, 1992.
  • [20] Amin Coja-Oghlan. A better algorithm for random k-SAT. SIAM Journal on Computing, 39(7):2823–2864, 2010. doi:10.1137/09076516X.
  • [21] Amin Coja-Oghlan and Alan Frieze. Random k-SAT: The Limiting Probability for Satisfiability for Moderately Growing k. The Electronic Journal of Combinatorics, 15(1):N2, 2008. URL: http://www.combinatorics.org/Volume_15/Abstracts/v15i1n2.html.
  • [22] Amin Coja-Oghlan, Amir Haqshenas, and Samuel Hetterich. Walksat stalls well below satisfiability. SIAM Journal on Discrete Mathematics, 31(2):1160–1173, 2017. doi:10.1137/16M1084158.
  • [23] Amin Coja-Oghlan and Konstantinos Panagiotou. The asymptotic k-SAT threshold. Advances in Mathematics, 288:985–1068, 2016.
  • [24] Bernard Derrida. Random-energy model: Limit of a family of disordered models. Physical Review Letters, 45(2):79, 1980.
  • [25] Jian Ding, Allan Sly, and Nike Sun. Proof of the satisfiability conjecture for large k. In Proceedings of the forty-seventh annual ACM symposium on Theory of computing, pages 59–68, 2015. doi:10.1145/2746539.2746619.
  • [26] Ahmed El Alaoui. Near-optimal shattering in the ising pure p-spin and rarity of solutions returned by stable algorithms. arXiv preprint, 2024. arXiv:2412.03511.
  • [27] Ahmed El Alaoui, Andrea Montanari, and Mark Sellke. Optimization of mean-field spin glasses. The Annals of Probability, 49(6):2922–2960, 2021.
  • [28] Ahmed El Alaoui, Andrea Montanari, and Mark Sellke. Sampling from mean-field gibbs measures via diffusion processes. arXiv preprint, 2023. arXiv:2310.08912.
  • [29] Ahmed El Alaoui, Andrea Montanari, and Mark Sellke. Shattering in pure spherical spin glasses. arXiv preprint, 2023. arXiv:2307.04659.
  • [30] Ulisse Ferrari, Luca Leuzzi, Giorgio Parisi, and Tommaso Rizzo. Two-step relaxation next to dynamic arrest in mean-field glasses: Spherical and ising p-spin model. Physical Review B—Condensed Matter and Materials Physics, 86(1):014204, 2012.
  • [31] John Franco and Marvin Paull. Probabilistic analysis of the Davis Putnam procedure for solving the satisfiability problem. Discrete Applied Mathematics, 5(1):77–87, 1983. doi:10.1016/0166-218X(83)90017-3.
  • [32] Alan Frieze and Nicholas C Wormald. Random k-SAT: A tight threshold for moderately growing k. Combinatorica, 25(3):297–306, 2005. doi:10.1007/S00493-005-0017-3.
  • [33] Alan M Frieze. On the independence number of random graphs. Discrete Mathematics, 81(2):171–175, 1990. doi:10.1016/0012-365X(90)90149-C.
  • [34] David Gamarnik. The overlap gap property: A topological barrier to optimizing over random structures. Proceedings of the National Academy of Sciences, 118(41), 2021.
  • [35] David Gamarnik and Aukosh Jagannath. The overlap gap property and approximate message passing algorithms for p-spin models. The Annals of Probability, 49(1):180–205, 2021.
  • [36] David Gamarnik, Aukosh Jagannath, and Eren C Kızıldağ. Shattering in the Ising Pure p-Spin Model. arXiv preprint, 2023. arXiv:2307.07461.
  • [37] David Gamarnik, Aukosh Jagannath, and Alexander S Wein. Low-degree hardness of random optimization problems. In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), pages 131–140. IEEE, 2020. doi:10.1109/FOCS46700.2020.00021.
  • [38] David Gamarnik, Aukosh Jagannath, and Alexander S Wein. Circuit lower bounds for the p-spin optimization problem. arXiv preprint, 2021. arXiv:2109.01342.
  • [39] David Gamarnik, Eren C Kızıldağ, Will Perkins, and Changji Xu. Algorithms and barriers in the symmetric binary perceptron model. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 576–587. IEEE, 2022.
  • [40] David Gamarnik, Eren C Kızıldağ, Will Perkins, and Changji Xu. Geometric barriers for stable and online algorithms for discrepancy minimization. arXiv preprint, 2023. arXiv:2302.06485.
  • [41] David Gamarnik and Madhu Sudan. Performance of sequential local algorithms for the random NAE-k-SAT problem. SIAM Journal on Computing, 46(2):590–619, 2017. doi:10.1137/140989728.
  • [42] Francesco Guerra. Broken replica symmetry bounds in the mean field spin glass model. Communications in mathematical physics, 233:1–12, 2003.
  • [43] Francesco Guerra and Fabio Lucio Toninelli. The Thermodynamic Limit in Mean Field Spin Glass Models. Communications in Mathematical Physics, 230:71–79, 2002.
  • [44] Abhishek Hegade KR and Eren C Kızıldağ. Large average subtensor problem: Ground-state, algorithms, and algorithmic barriers. arXiv preprint, 2025. arXiv:2506.17118.
  • [45] Samuel Hetterich. Analysing survey propagation guided decimation on random formulas. arXiv preprint, 2016. arXiv:1602.08519.
  • [46] Brice Huang and Mark Sellke. Tight Lipschitz hardness for optimizing mean field spin glasses. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 312–322. IEEE, 2022. doi:10.1109/FOCS54457.2022.00037.
  • [47] Brice Huang and Mark Sellke. Algorithmic threshold for multi-species spherical spin glasses. arXiv preprint, 2023. doi:10.48550/arXiv.2303.12172.
  • [48] Aukosh Jagannath. Approximate ultrametricity for random measures and applications to spin glasses. Communications on Pure and Applied Mathematics, 70(4):611–664, 2017.
  • [49] Aukosh Jagannath and Ian Tobasco. Some properties of the phase diagram for mixed p-spin glasses. Probability Theory and Related Fields, 167:615–672, 2017.
  • [50] Theodore R Kirkpatrick and Devarajan Thirumalai. p-spin-interaction spin-glass models: Connections with the structural glass problem. Physical Review B, 36(10):5388, 1987.
  • [51] Lefteris M Kirousis, Evangelos Kranakis, Danny Krizanc, and Yannis C Stamatiou. Approximating the unsatisfiability threshold of random formulas. Random Structures & Algorithms, 12(3):253–269, 1998. doi:10.1002/(SICI)1098-2418(199805)12:3\%3C253::AID-RSA3\%3E3.0.CO;2-U.
  • [52] Justin Ko. Free energy of multiple systems of spherical spin glasses with constrained overlaps. Electronic Journal of Probability, 25:1–34, 2020. doi:10.1214/20-EJP431.
  • [53] Florent Krzakała, Andrea Montanari, Federico Ricci-Tersenghi, Guilhem Semerjian, and Lenka Zdeborová. Gibbs states and the set of solutions of random constraint satisfaction problems. Proceedings of the National Academy of Sciences, 104(25):10318–10323, 2007. doi:10.1073/PNAS.0703685104.
  • [54] Eren C. Kızıldağ. Sharp Thresholds for the Overlap Gap Property: Ising p-Spin Glass and Random k-SAT, 2025. arXiv:2309.09913.
  • [55] Shuangping Li and Tselil Schramm. Some easy optimization problems have the overlap-gap property. arXiv preprint, 2024. doi:10.48550/arXiv.2411.01836.
  • [56] Shuangping Li, Tselil Schramm, and Kangjie Zhou. Discrepancy algorithms for the binary perceptron. arXiv preprint, 2024. doi:10.48550/arXiv.2408.00796.
  • [57] Jun Liu, Zongsheng Gao, and Ke Xu. A Note on Random k-SAT for Moderately Growing k. The Electronic Journal of Combinatorics, pages P24–P24, 2012.
  • [58] Marc Mezard and Andrea Montanari. Information, physics, and computation. Oxford University Press, 2009.
  • [59] Marc Mézard, Giorgio Parisi, and Riccardo Zecchina. Analytic and algorithmic solution of random satisfiability problems. Science, 297(5582):812–815, 2002.
  • [60] Chao Ming-Te and John Franco. Probabilistic analysis of a generalization of the unit-clause literal selection heuristics for the k satisfiability problem. Information Sciences, 51(3):289–314, 1990. doi:10.1016/0020-0255(90)90030-E.
  • [61] Andrea Montanari. Optimization of the Sherrington-Kirkpatrick Hamiltonian. In 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS), pages 1417–1433, 2019. doi:10.1109/FOCS.2019.00087.
  • [62] Andrea Montanari and Federico Ricci-Tersenghi. On the nature of the low-temperature phase in discontinuous mean-field spin glasses. The European Physical Journal B-Condensed Matter and Complex Systems, 33:339–346, 2003.
  • [63] Dmitry Panchenko. The Parisi Ultrametricity Conjecture. Annals of Mathematics, pages 383–393, 2013.
  • [64] Dmitry Panchenko. The Sherrington-Kirkpatrick model. Springer Science & Business Media, 2013.
  • [65] Dmitry Panchenko. The Parisi formula for mixed p-spin models. The Annals of Probability, 42(3):946–958, 2014.
  • [66] Dmitry Panchenko. Free energy in the mixed p-spin models with vector spins. The Annals of Probability, 46(2):865–896, 2018. doi:10.1214/17-AOP1194.
  • [67] Giorgio Parisi. Infinite number of order parameters for spin-glasses. Physical Review Letters, 43(23):1754, 1979.
  • [68] Will Perkins and Changji Xu. Frozen 1-RSB structure of the symmetric Ising perceptron. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1579–1588, 2021. doi:10.1145/3406325.3451119.
  • [69] Mark Sellke. Optimizing mean field spin glasses with external field. arXiv preprint, 2021. arXiv:2105.03506.
  • [70] David Sherrington and Scott Kirkpatrick. Solvable model of a spin-glass. Physical review letters, 35(26):1792, 1975.
  • [71] Daniel L Stein and Charles M Newman. Spin glasses and complexity, volume 4. Princeton University Press, 2013.
  • [72] Eliran Subag. Free energy landscapes in spherical spin glasses. arXiv preprint, 2018. arXiv:1804.10576.
  • [73] Eliran Subag. Following the ground states of full-rsb spherical spin glasses. Communications on Pure and Applied Mathematics, 74(5):1021–1044, 2021.
  • [74] Michel Talagrand. Rigorous low-temperature results for the mean field p-spins interaction model. Probability theory and related fields, 117:303–360, 2000.
  • [75] Michel Talagrand. The Parisi formula. Annals of Mathematics, pages 221–263, 2006.
  • [76] Michel Talagrand. Mean field models for spin glasses: Volume I: Basic examples, volume 54. Springer Science & Business Media, 2010.
  • [77] Michel Talagrand. Mean Field Models for Spin Glasses: Advanced replica-symmetry and low temperature. Springer, 2011.
  • [78] Fabio Lucio Toninelli. About the Almeida-Thouless transition line in the Sherrington-Kirkpatrick mean-field spin glass model. Europhysics letters, 60(5):764, 2002.
  • [79] Neekon Vafa and Vinod Vaikuntanathan. Symmetric perceptrons, number partitioning and lattices. arXiv preprint, 2025. arXiv:2501.16517.
  • [80] Lutz Warnke. On the method of typical bounded differences. Combinatorics, Probability and Computing, 25(2):269–299, 2016. doi:10.1017/S0963548315000103.
  • [81] Alexander S Wein. Optimal low-degree hardness of maximum independent set. Mathematical Statistics and Learning, 4(3):221–251, 2022.