Abstract 1 Introduction 2 Preliminaries 3 An Approximation Algorithm 4 Hardness of Max-E𝟑-LIN𝑺(𝑮) References

Optimal Inapproximability of Generalized Linear Equations over a Finite Group

Amey Bhangale ORCID Department of Computer Science and Engineering, University of California, Riverside, CA, USA    Yezhou Zhang222Corresponding author ORCID Department of Computer Science and Engineering, University of California, Riverside, CA, USA
Abstract

Constraint satisfaction problems (CSPs) consist of a set of variables taking values from some finite domain and a set of local constraints on these variables. The objective is to find an assignment to the variables that maximizes the fraction of satisfied constraints.

In this work, we study the CSP where the constraints are generalized linear equations over a finite group G. More specifically, for a given SG, the constraints in this CSP are of the form addition of the values to the variables (similarly, product for non-abelian groups) belongs to the set S. We give an approximation algorithm for this problem on satisfiable instances and show that it is optimal for certain S assuming 𝐏𝐍𝐏.

This natural predicate is one of the very few known predicates that are approximation resistant on almost satisfiable instances, assuming 𝐏𝐍𝐏, but admits a non-trivial approximation algorithm on satisfiable instances.

Keywords and phrases:
Constraint satisfaction problems, inapproximability, approximation algorithms, non-abelian groups, Fourier analysis
Category:
Track A: Algorithms, Complexity and Games
Funding:
Amey Bhangale: Supported by the Hellman Fellowship award and NSF CAREER award 2440882.
Yezhou Zhang: Supported by the Hellman Fellowship award and NSF CAREER award 2440882.
Copyright and License:
[Uncaptioned image] © Amey Bhangale and Yezhou Zhang; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Problems, reductions and completeness
Related Version:
Full Version: https://arxiv.org/abs/2605.10010
Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele Puppis

1 Introduction

Constraint satisfaction problems (CSPs) are one of the most fundamental problems in theoretical computer science. A Max-P-CSP instance φ for a given predicate P:Σk{0,1} consists of a set of variables x1,x2,,xn taking values from the domain Σ and a collection of constraints C1,C2,,Cm where each Ci consists of a constraint of the form P(xi1,xi2,,xik). The constraints might involve literals instead of just the variables. The objective is to assign values to the variables that maximize the fraction of satisfied constraints from φ. An α-approximation for Max-P-CSP is an algorithm that, given an instance φ of Max-P-CSP, outputs an assignment that satisfies at least αOPT, where OPT is the optimal value of the instance φ.

A systematic study of the complexity of CSPs was started by Schaefer in 1978 [36], who showed that for every predicate P over a 2-element set, the problem P-CSP is either solvable in polynomial time or is 𝐍𝐏-complete. A famous dichotomy conjecture of Feder and Vardi [17, 18], which was resolved recently in huge breakthroughs by Bulatov [11] and Zhuk [38] independently, states that for every predicate P, checking the satisfiability of a P-CSP is either in 𝐏 or is 𝐍𝐏-complete. However, when it comes to approximation algorithms for Max-P-CSP, the question is wide open.

The optimal approximability results for Max-P-CSP for various predicates P are known starting with the seminal work of [24]. Håstad showed that Max-3SAT, where the predicate is over a Boolean alphabet and is an OR of three literals, is 𝐍𝐏-hard to approximate within a factor of 78+ε for every ε>0. The above hardness result also holds even if the given instance is guaranteed to have an assignment with value 1. It is also easy to get a 78-approximation algorithm for Max-3SAT – for each variable, pick a random value from {0,1}. This algorithm satisfies 78-fraction of the constraints in expectation. It is also easy to derandomize this algorithm by the method of conditional expectation. Thus, the hardness result is optimal. In the same work on the optimal hardness of Max-3SAT, Håstad [24] also studied the inapproximability of Max-3LIN over an abelian group G. In Max-3LIN over a group G, the variables take values from the group (G,+), and constraints are of the type xi1+xi2+xi3=c for some cG. If the given instance of Max-3LIN is fully satisfiable, then it is known [21] that the satisfying assignment can be found in polynomial time using techniques similar to Gaussian elimination. Furthermore, a random assignment to the variables satisfies 1|G| fraction of the constraints in expectation. Håstad [24] showed that this algorithm is optimal for general instances.

The Max-3LIN over a non-abelian group (G, ) is another interesting problem. Unlike the abelian group case, here, Goldmann and Russell showed [21] that it is 𝐍𝐏-complete to check the satisfiability of a given instance for every non-abelian group G. Engebretsen, Holmerin, and Russell gave [16] similar inapproximability results as in the case of abelian groups. More specifically, they showed that for every ε>0, if an instance of Max-3LIN over a non-abelian group (G, ) is given with value at least 1ε, then it is 𝐍𝐏-hard to find an assignment that satisfies at least 1|G|+ε fraction of the constraints. There is, however, a better than 1|G| approximation algorithm for certain groups on satisfiable instances. It is folklore to get a 1|[G,G]|-approximation algorithm for Max-3LIN over a non-abelian group (G, ) on satisfiable instances, where [G,G] is the commutator subgroup of G. A commutator of two group elements g and h is a group element g1 h1 g h, and a commutator subgroup [G,G] is the subgroup generated by all the commutators of the group G. Recently, Bhangale and Khot [4] showed that this algorithm is optimal on satisfiable instances assuming 𝐏𝐍𝐏.

Given these approximation algorithms and inapproximability results concerning Max-3LIN, it is natural to ask what role the abelian nature of a group G plays in such results. In this work, we study a generalized version of the Max-3LIN problem, denoted by Max-Ek-LINS(G), as defined below.

Fix a group (G, ) and a subset SG. In the instance of Max-Ek-LINS(G), the variables take values from G. A literal of a variable x is given by (g x) for some gG.

Definition 1 (Max-Ek-LINS(G)).

Consider a multiset of linear equations (C1,C2,,Cm) over variables {x1,x2,,xn|xiG} for a group G. Each constraint consists of a tuple of exactly k literals and will be considered satisfied when their sum/product over G is in SG. The Max-Ek-LINS(G) problem is to find an assignment to {x1,x2,,xn} that maximizes the number of satisfied constraints.

Observe that the problem Max-3LIN over a group G that was discussed earlier is Max-Ek-LIN{1G}(G) where 1G is the identity element of the group G. In Max-Ek-LINS(G), we allow more satisfying assignments in the predicate, i.e, ignoring the literals for simplicity, the condition that a tuple (a,b,c) satisfies a given constraint depends on the value of a b c, and hence we call the predicate a generalized linearity predicate over G.333This nomenclature was also used by Chattopadhyay and Wigderson [13] to describe similar predicates.

Approximation Algorithm for Max-E𝟑-LIN𝑺(𝑮)

To keep things simple, we restrict to the setting when G is an abelian group for this discussion. We start with a simple approximation algorithm for Max-E3-LINS(G). Let Φ be an instance of Max-E3-LINS(G) with constraints set (C1,C2,,Cm) over the variables X={x1,x2,,xn}. Here, the constraint Ci is of the form

(ai1+xi1)+(ai2+xi2)+(ai3+xi3)S.

One can try to replace checking this condition by a linear equation over a certain abelian group, hoping to solve this system using Gaussian elimination, and from this solution get a non-trivial solution to the original instance. The basic algorithmic idea is to relax the constraint by passing to a quotient group. Suppose HG is a subgroup such that Sg+H for some gG, and let Q:=G/H. Then the above constraint implies

([ai1]Q+[xi1]Q)+([ai2]Q+[xi2]Q)+([ai3]Q+[xi3]Q)=0Q, (1)

Thus, we convert the constraints in Φ to a system of equations Φ~ over Q. Since Φ is satisfiable, the system Φ~ is satisfiable as well. Hence, when Q is abelian, we can find a satisfying assignment to Φ~ in polynomial time using Gaussian elimination. Given such an assignment, we set each xi to be a uniformly random element from the corresponding coset in G. For every constraint, the resulting sum is uniformly distributed over the appropriate coset of H, and hence the constraint is satisfied with probability |S|/|H|. One natural first choice is to take H=cl(S), the subgroup generated by S, but this choice is not always optimal. For instance, when G=4×4 and S={(0,1),(1,0)}, the subgroup cl(S) is all of G, whereas S is contained in a coset of a smaller subgroup, giving a better approximation ratio. Therefore, the right choice is the smallest subgroup H such that S is contained in a coset of H. For non-abelian groups, we additionally require H to be normal and to contain the commutator subgroup [G,G], so that the quotient G/H is abelian. This leads to the following theorem.

Theorem 2.

Fix any finite group G and SG. Let HS is the smallest normal subgroup such that

  1. 1.

    [G,G]HS.

  2. 2.

    SgHS for some gG, i.e., S is a subset of some coset of HS.

then the problem Max-Ek-LINS(G) is approximable within a factor of |S||HS| on satisfiable instances. Furthermore, if S1S generates HS, assuming 𝐏𝐍𝐏, for every ε>0, it is 𝐍𝐏-hard to approximate Max-Ek-LINS(G) within a factor of |S||HS|+ε.

Note that for any abelian group G, the subgroup [G,G] consists only of the identity element of G. For non-abelian groups, the condition [G,G]HS guarantees that the quotient group Q:=G/HS is abelian, which was crucial for the above-discussed approximation algorithm. See Theorem 13 for a straightforward generalization of the above approximation algorithm for non-abelian groups. The above theorem shows that even for abelian groups G, the problem Max-Ek-LINS(G) is 𝐍𝐏-hard on satisfiable instances, in general.

A predicate P is called approximation resistant if it is 𝐍𝐏-hard to do better than the random assignment algorithm. We are aware of two results, one by Håstad [25] on satisfying degree-d equations over GF[2]n, and another by Bhangale-Khot [4] on Max-3LIN over non-abelian groups G where G is not a simple group. Both these predicates are approximation resistant in general (i.e., on almost satisfiable instances), but have non-trivial approximation algorithms on satisfiable instances. Thus, our result adds the generalized linear equation predicate to the small class of predicates that are known to be approximation resistant in general but have non-trivial approximation algorithms on satisfiable instances. We hope that our result gives another piece of information to help understand the approximability of Max-CSPs on satisfiable instances.

In Section 3, we give a simple |S||HS|-approximation algorithm for Max-Ek-LINS(G) for every finite group G. The algorithm implicitly uses the abelian embedding of the generalized linearity predicate as defined in the series of work [6, 7, 8, 9] towards understanding the approximability of satisfiable CSPs. To show this optimal hardness result, we design a novel decoding procedure in the soundness analysis of the reduction, which may be of independent interest towards understanding the approximability of satisfiable CSPs.

1.1 Related Work

In this section, we go over relevant work on the inapproximability of Max-CSPs. The PCP Theorem [1, 2, 19] shows that Max-P-CSPs are 𝐍𝐏-hard to approximate within a factor of (1δ) for some constant δ>0 if checking satisfiability of P-CSP is 𝐍𝐏-complete. Håstad in his seminal work [24] greatly improved the hardness of approximation results for a few CSPs. Notable examples of the CSPs from his work include Max-3SAT and Max-3LIN. For Max-CUT, which is a 2-ary CSP, Håstad showed that it is 𝐍𝐏-hard to approximate within a factor of 1617. Khot [29] formulated the Unique Games Conjecture (UGC), which is a conjecture on the hardness of the Label Cover instances (see Definition 4) restricted to the constraints being 1-to-1. Samorodnitsky and Trevisan [35] showed that Boolean Max-kCSP (with arbitrary k-ary Boolean predicates) is 𝐍𝐏-hard to approximate beyond O(k2k) assuming the UGC, matching the best algorithm up to a constant factor. Khot, Kindler, Mossel, and O’Donnell [30] showed that Max-CUT is 𝐍𝐏-hard to approximate within a factor of 0.878 assuming the UGC, which matches the approximation guarantee of the Goemans-Williamson [20] algorithm for Max-CUT.

Raghavendra [33] presented an elegant result that generalizes the above Max-CUT reduction and establishes, for any Max-P-CSP instance, the (c,s)-integrality gap of the basic Semidefinite programming relaxation implies finding an s+ε satisfying assignment on cε satisfiable instances is 𝐍𝐏-hard assuming the UGC. This result fully characterizes the approximability of Max-P-CSPs assuming the UGC on almost satisfiable instances. Furthermore, given a fixed predicate P, Raghavendra’s result does not explicitly give the optimal hardness factor for Max-P-CSP. Austrin and Mossel [3] gave the right threshold for predicates that support a uniform and pairwise independent distribution. A distribution μ on P1(1)Σk is said to be pairwise independent if for every distinct pair i,j[k], the marginal of μ restricted to the coordinates (i,j) is uniform over Σ2. Austrin and Mossel showed that such predicates are approximation resistant on almost satisfiable instances, assuming the UGC.

Chan [12] established a general criterion for approximation resistance, resolving the NP-hardness of Max-k-CSP up to a constant factor and assuming 𝐏𝐍𝐏. Specifically, he proved the hardness for Max-CSPs where the domain is an abelian group G and the predicate P1(1)Gk is a subgroup that satisfies a condition analogous to that identified by Austrin and Mossel.

The question of finding the optimal approximation algorithm (even assuming certain conjectures, like d-to-1 conjecture [29] or Rich 2-to-1 conjecture [10]) for satisfiable instances of Max-P-CSPs is wide open. In a recent series of work, Bhangale, Khot, and Minzer [6, 7] defined a property of abelian embeddability of the predicate towards understanding the approximability of satisfiable CSPs. A predicate P:Σk{0,1} is said to have an abelian embedding in an abelian group G, if there are maps αi:ΣG, not all constant, such that iαi(ai)=0G for every (a1,a2,,ak)P1(1). They gave an optimal dictatorship test for 3-ary predicates that have no abelian embedding. Very recently, for certain 3-ary predicates that have an abelian embedding, they gave an approximation algorithm [8, 9] for satisfiable instances that uses a combination of Gaussian elimination as well as the SDP rounding algorithm. They also showed the “optimality” of this algorithm by giving a dictatorship test with matching parameters.

1.2 Techniques

In this section, we give an overview of the techniques in the inapproximability results of our main theorem.

1.2.1 Abelian Groups

We begin with the case of abelian groups to highlight one of the main differences in the analysis of the reduction compared to the seminal work of Håstad on Max-3LIN over an abelian group. We assume some familiarity with the Fourier analysis of functions over abelian groups (for instance, Chapter 8 of Ryan O’Donnell’s book [32]). Throughout the section, ε>0 is an arbitrarily small constant.

Starting with a work of Håstad [24], a typical way to prove the hardness of approximation is to start with an 𝐍𝐏-hard problem called the Label Cover [22, 27, 28, 14, 31, 26, 23]. A gadget is built on top of the Label Cover instance to create an instance of a given CSP. For simplicity of the presentation, we focus here is on the most important and technical component of the reduction. This component is the construction of dictatorship tests and analyzing the tests.

A function f:[q]n[q] is called a dictator function if f(x1,x2,,xn)=xj for some j[n]. A dictatorship test for a predicate P:[q]k{0,1} consists of a distribution μ that is (almost) supported on the set of satisfying assignments of P. The test samples k inputs z1,z2,,zk as follows: For each coordinate i[n], the tuple ((z1)i,(z2)i,,(zk)i) is sampled independently from μ. The test accepts f if P(f(z1),f(z2),,f(zk)) evaluates to 1, i.e., f(z1),f(z2),,f(zk) forms a satisfying assignment for P. It is clear that if f is a dictator function, then the test passes with probability (almost) 1. This is because, in this case, we are checking if the ith coordinate of the inputs is from P1(1), which is always true by construction.

Once the distribution is fixed, the next step is to analyze the soundness of the dictatorship test, i.e., the probability with which the test passes if f is “far from the dictator functions”. The notion of far from dictator functions changes based on the hardness reduction. A typical notion that is used is that the function has all the variables with degree d=O(1) influences low. The influence of the ith coordinate on the function is the probability that, on a random input, changing the ith coordinate changes the values of the function. In terms of the Fourier coefficients of f, this is equal to the following quantity:

Infi(f):=α:αi0|f^(α)|2.

Thus, the ith dictator function has Infi(f)=1. A degree-d influence of the ith variable is given by the following expression,

Infid(f):=α:αi0|α|d|f^(α)|2,

where |α| is the number of non-zero coordinates of α. With this notion of far from dictator functions in mind, the dictatorship test used in the hardness reduction [24] of Max-3LIN works as follows.

  1. 1.

    Select 𝒙,𝒚Gn uniformly at random.

  2. 2.

    Set 𝒛=𝒙+𝒚.

  3. 3.

    For each i[n], resample (xi,yi,zi) from G3 uniformly at random, with probability ε.

  4. 4.

    Check if f(𝒙)+f(𝒚)=f(𝒛).

It is clear that any dictator function passes the above test with probability at least 1ε. To analyze the soundness of the test, we can express the test passing probability as follows:

Pr[Test passes]=1|G|𝔼(𝒙,𝒚,𝒛)[χρG^χρ(f(𝒙)+f(𝒚)+f(𝒛))],

where the summation is over all the characters of the group G. The term with χρ being the trivial character gives 1|G|. For the remaining terms with χρ being a non-trivial character, we are left with analyzing the following expectation

𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙)+f(𝒚)+f(𝒛))]=𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙))χρ(f(𝒚))χρ(f(𝒛))].

By letting F(𝒘)=χρ(f(𝒘)) and expanding the function F with the Fourier basis over Gn, and doing some simplifications, we get that the above expectation is upper bounded as follows.

𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙))χρ(f(𝒚))χρ(f(𝒛))]α|F^(α)|3(1ε)|α|
=α|α|d|F^(α)|3(1ε)|α|+α|α|>d|F^(α)|3(1ε)|α|.
Decoding Strategy

Now, because of the ‘noise’ (i.e., step 3 in the test), the second term can be shown to be negligible for some large d as a function of ε, by a simple application of Cauchy-Schwarz inequality and using Parseval’s identity. As for the first term, if it is non-negligible, then the structure of the function can be used in the hardness reduction starting from the Label Cover instance.

More precisely, the starting point of the reduction is a Label Cover instance (see Definition 4). It is 𝐍𝐏-hard to distinguish between the Label Cover instances with value 1 from instances with value at most δ for small δ>0. In the reduction, each vertex v of the Label Cover instance is replaced with a cloud of vertices C[v] where |C[v]| is GM where M is the label size of the vertex. These constitute the variables/literals of the reduced instance of Max-3LIN. The distribution on the constraints is specified by the above dictatorship test. If the value of the Label Cover instance is 1, then the value of the reduced Max-3LIN instance is at least 1ε. Now, similar to the above analysis, if we fix an assignment f to the Max-3LIN instance with value 1|G|+ε for some ε>0, then the assignment restricted to most of C[v], call it fv, has high degree-d influential variables. From this, one can come up with a labeling to the Label Cover instance with value greater than δ=δ(ε), thereby showing the soundness of the reduction. The strategy simply picks a random non-trivial character ρ, a Fourier coefficient χρ(fv)^(α) of fv with probability |χρ(fv)^(α)|2 and assign a label i such that αi is not a trivial character.

We now give the natural extension of the above dictatorship test to the generalized linear equation predicate that we consider in this paper. Towards this, fix an abelian group (G,+) and a subset SG. Consider the following dictatorship test.

  1. 1.

    Select 𝒙,𝒚Gn uniformly at random.

  2. 2.

    Select 𝒘Sn uniformly at random.

  3. 3.

    Set 𝒛=𝒙𝒚+𝒘.

  4. 4.

    Check if f(𝒙)+f(𝒚)+f(𝒛)S.

It is clear that every dictator function passes the test with probability 1. Similar to the above analysis, the soundness of the test can be expressed as follows:

Pr[Test passes]=1|G|𝔼(𝒙,𝒚,𝒛)[sSχρG^χρ(f(𝒙)+f(𝒚)+f(𝒛)s)],

Once again, the terms that correspond to the trivial character give |S||G| (which corresponds to the approximation ratio of the algorithm that picks a random assignment). Note that our goal is to show that the test passes with probability almost |S||HS|+ε in the soundness towards proving Theorem 2. Once again, the term that corresponds to a given sS and a character χρ gives,

𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙)+f(𝒚)+f(𝒛)s)]=𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙))χρ(f(𝒚))χρ(f(𝒛))χρ(s)].

Ignoring the constant shift χρ(s), we are again left with analyzing the expectation

𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙))χρ(f(𝒚))χρ(f(𝒛))].

Recall that the subgroup HS is the smallest subgroup such that Sg+HS for some gG. Now, unlike the Max-3LIN, we cannot expect this expectation to be small when the functions F have negligible degree-d influences for some d=O(1). To see this, consider a character χρ that is constant on the subgroup HS. If we let f(𝒙)=ixi where the sum is the group operation, then the derived function F has all degree-d influences 0. However, the expectation becomes 𝔼[χρ(iwi)], since Sg+HS for some g, we get that the iwing+HS, i.e, it always belongs to a fixed coset of HS. Since the character χρ is constant on the subgroup HS (and hence constant on every coset of HS), we get that the expectation is 1 in absolute value. The number of such characters (including the trivial character) for which we cannot bound the expectation is precisely |G|/|HS|. This gives the right factor |S||HS| in the test passing probability that we need for our Theorem 2.

Now, consider the character χρ, which is not constant on HS. Similar to Håstad’s analysis, we can upper bound the corresponding expectation as follows

𝔼(𝒙,𝒚,𝒛)[χρ(f(𝒙))χρ(f(𝒚))χρ(f(𝒛))] α|F^(α)|3(1η)|α|S,

where η>0 is a non-zero constant that only depends on |G| and |α|S is the number of coordinates of α where the character αi is not constant on the subgroup HS. In order to work with this expression, we modify the notion of far from dictator functions that will be useful for our hardness reduction as follows.

Modified low-degree influences

A modified degree-d influence of the ith variable is expressed as the following expression,

Infid(f):=α:αi0|α|Sd|f^(α)|2,

where |α|S is the number of coordinates of α where the character αi is not constant on the subgroup HS. With this change, we split the summation as follows:

α|F^(α)|3(1η)|α|S =α|α|Sd|F^(α)|3(1η)|α|S+α|α|S>d|F^(α)|3(1η)|α|S.

Again, the second term is negligible for some large d=O|G|(1).

Modified Decoding Strategy

In our analysis of the reduction, we need to show that the terms that are similar to the first term are not negligible, then there is a decoding strategy (similar to the one described in the reduction to Max-3LIN above) in the hardness reduction starting from the Label Cover instance. The following strategy works. The modified strategy picks a random non-trivial irreducible representation ρ that is not constant on HS, a Fourier coefficient χρ(fv)^(α) of fv with probability |χρ(fv)^(α)|2 and assign a label i such that the character corresponding to αi is not constant on HS.

1.2.2 Non-abelian Groups

The above dictatorship test can be easily modified for the non-abelian case in a natural way

  1. 1.

    Select 𝒙,𝒚Gn uniformly at random.

  2. 2.

    Select 𝒔Sn uniformly at random.

  3. 3.

    For each i[n], set zi=yi1 xi1 si.

  4. 4.

    Check if f(𝒙) f(𝒚) f(𝒛)S.

The completeness case is trivial. In the soundness case, we again express the test passing probability as

Pr[Test passes]=1|G|𝔼(𝒙,𝒚,𝒛)[sS[ρ𝖨𝗋𝗋𝖾𝗉(G)dim(ρ)χρ(f(𝒙) f(𝒚) f(𝒛) s1)]],

where the inner sum is over all irreducible representations of (G, ) and dim(ρ) is the dimension of the representation ρ. Similarly to the abelian case, for certain representations of dimension 1 (that are constant on the subgroup HS defined in Theorem 2), we bound the expectation by 1 in absolute value. This gives the factor |S||HS|. The analysis for the remaining dimension 1 representations, Lemma 16, is analogous to the one described in the abelian case but focuses on the natural structure of non-abelian groups and generalized linear equation predicates. For some technical reasons, for non-abelian groups, we could analyze this under the assumption that S1S generates the subgroup HS.

Regarding representations with dimension 2, we treat the analysis of Bhangale and Khot [4] as a black box (Lemma 19) to conclude that the associated expectations are small unless they yield a decoding strategy for the Label Cover instance. For some technical reasons, the analysis of this part of the reduction requires the use of Layered Label Cover instead of the bipartite Label Cover. Therefore, in our main reduction, we also use a Layered Label Cover instance as a starting point, but we only use the layered version in the proof of Lemma 19 to adopt results from [5]. For the primary part of this paper, we only need a bipartite Label Cover instance.

 Remark 3.

The conference version of the paper [4] had an error, which the authors fixed with the use of Layered Label Cover as a starting point.444personal communication [5] This fix is reflected in the Lemma 19 [5, Claim 4.5] that we use as black-box.

1.3 Organization

We begin Section 2 by defining the Label Cover instance and the hardness of approximation of Label Cover, which is the starting point of our reduction. In Section 2.2, we go over the basics of Fourier analysis over general finite groups. We formally give the approximation algorithm described in the introduction in Section 3. Finally, in Section 4 we give our hardness reduction for Max-E3-LINS(G) and analyze the reduction. The hardness for Max-Ek-LINS(G) for k4 follows easily from a similar reduction, thereby proving the main Theorem 2.

2 Preliminaries

2.1 Label Cover

We start by defining the Label Cover and Layered Label Cover problem, which we use as a starting point for our reduction.

Definition 4 (Label Cover).

An instance Ψ=(U,V,E,[L],[R],{πe}eE) of the Label Cover constraint satisfaction problem consists of a bi-regular bipartite graph (U,V,E), alphabets [L] and [R] and a surjective projection map πe:[L][R] for every edge eE. Given a labeling :U[L],:V[R], an edge e=(u,v) is said to be satisfied by if πe((u))=(v).

Ψ is said to be satisfiable if there exists a labeling that satisfies all the edges. Ψ is said to be at most δ-satisfiable if every labeling satisfies at most a δ fraction of the edges.

The hardness of Label Cover stated below follows from the PCP Theorem [2, 1, 19] and Raz’s Parallel Repetition Theorem [34].

Theorem 5 (Hardness of Label Cover).

For every r, there is a deterministic nO(r)-time reduction from a 3-SAT instance of size n to an instance Ψ=(U,V,E,[L],[R],{πe}eE) of Label Cover with the following properties: |U|,|V|nO(r); L,R2O(r); Ψ is bi-regular with degrees bounded by 2O(r).

YES Case: If the 3-SAT instance is satisfiable, then Ψ is satisfiable.
NO Case: If the 3-SAT instance is unsatisfiable, then Ψ is at most 2r satisfiable

For our hardness result, we need the following variant of the Label Cover problem.

Definition 6 (Layered Label Cover).

An T-Layered Label Cover instance, given by =(𝒱={V1,,VT},{Πi,j}1i<jT},{[Ri]i[T]} consist of T sets of vertices 𝒱={V1,,VT}. The label set of vertices in layer i is denoted by [Ri]. Every pair of layers 1i<jl has a set of constraints Πi,j between the vertices in Vi and Vj. The constraint between vVi and uVj (if it exists in Πi,j) is denoted by πvu. Moreover, every constraint between a pair of vertices is a projection constraint: for every assignment k[Ri] to vVi, there is a unique assignment to uVj that satisfies the constraint πvu.

Theorem 7 ([15], Hardness of Layered Label Cover).

For any constant parameters T2, r, the following problem is NP-hard. Given an T-Layered Label Cover instance =(𝒱={V1,,VT},{Πi,j}1i<jT,{[Rt]}t[T]) where all variable ranges Rt are of size 2O(Tr), distinguish between the following two cases:

Completeness.

There is an assignment satisfying all the constraints of the Label Cover instance. In this case, we say that is fully satisfiable.

Soundness.

For every 1i<jT, no assignment satisfies more than a 2r fraction of the set of constraints Πi,j between layers i and j. In this case, we say that is at most 2r-satisfiable.

2.2 Fourier analysis over non-abelian group

We assume familiarity with the representation theory and Fourier analysis of functions over finite non-abelian groups. We refer the reader to the book by Terras [37] and the work of Bhangale and Khot [4] for standard definitions (such as irreducible representations, characters, Plancherel’s, and Parseval’s identity) which we omit here for brevity.

In this paper, we only consider non-abelian groups that are finite. Let G=(G, ) be a finite non-abelian group. The identity element of a group is denoted by 1G. We assume familiarity with basic definitions of representations, dimensions, invariant subspaces, and tensor products. We will denote the set of all irreducible representations of G up to isomorphism by 𝖨𝗋𝗋𝖾𝗉(G).

Fact 8.

Let G be a group and H be any subgroup of G. If ρ𝖨𝗋𝗋𝖾𝗉(G) then ρ restricted to H is also a (not necessarily irreducible) representation of H.

The following proposition shows that matrix entries of irreducible representations are “orthogonal” with respect to a symmetric bilinear form, unless they are conjugates of each other, in which case the corresponding product is the inverse of the dimension of the representation.

Proposition 9.

If ρ and τ are two non-isomorphic irreducible representations of G then for any i,j,k,l we have

(ρ)ij(τ)klG=0, (2)

where f1f2G:=1|G|gGf1(g)f2(g1) (called a “symmetric bilinear form”). Also,

(ρ)ij(ρ)klG=δilδjkdim(ρ), (3)

where δij is the delta-function which is 1 if i=j and 0 otherwise.

We use Proposition 9 many times in the proof. For convenience, we note an important identity that follows from Proposition 9 (by setting τ to be the trivial map {𝟏}).

Proposition 10.

If ρ𝖨𝗋𝗋𝖾𝗉(G){𝟏}, gGρ(g)=0.

In this paper, we will be interested in studying L2(G), the space of functions from a finite group G to the complex numbers . Define the inner product ,L2(G) on L2(G) by f,gL2(G)=𝔼xG[f(x)g(x)¯]. The character of a representation ρ is the function χρ:G defined by χρ(g)=𝗍𝗋(ρ(g)).

We will use the following propositions.

Proposition 11 (Orthogonality of characters).

For ρ,τ𝖨𝗋𝗋𝖾𝗉(G), we have

1|G|gGχρ(g)χτ(g)¯={1ρVτV,0otherwise.

This proposition also shows that the maximum dimension of any irreducible representation of G is at most G.

Proposition 12.
ρ𝖨𝗋𝗋𝖾𝗉(G)dim(ρ)χρ(g)={|G|g=1G,0otherwise.

This implies ρ𝖨𝗋𝗋𝖾𝗉(G)dim(ρ)2=|G|.

3 An Approximation Algorithm

In this section, we give an approximation algorithm for Max-E3-LINS(G) for any group (G, ) and SG. This algorithm is a straightforward generalization of the algorithm for abelian groups G discussed in the introduction. We repeat it here for completeness.

Theorem 13.

There exists a |S||HS|-approximation algorithm for Max-E3-LINS(G), where HS is the smallest normal subgroup such that (i) [G,G]HS, and (ii) S is a subset of some coset of HS.

Proof.

Let Φ be an instance of Max-E3-LINS(G) with constraints (C1,C2,,Cm) over the variables X={x1,x2,,xn}. We first convert the set of constraints to a system of equations, denoted by Φ~, over the group (Q,+):=G/HS with variables Y={y1,y2,,yn}. Note that HS is a normal subgroup of G containing the commutator subgroup such that SgHS for some gG. Thus, Q is an abelian group.

Consider a constraint Ci which is of the form (ai1 xi1) (ai2 xi2) (ai3 xi3)S. We convert this to the equation over Q as

[ai1]Q+yi1+[ai2]Q+yi2+[ai3]Q+yi3=[S]Q,

where [S]Q is an element of Q that corresponds to the coset of HS containing S, and the element [g]Q corresponds to the coset of HS containing g.

As Φ is satisfiable, consider the satisfying assignment 𝜶:XG to Φ. Consider the assignment 𝜶~:YQ given by the natural map 𝜶~(yi)=[𝜶(xi)]Q . It is easy to see that 𝜶~ satisfies all the equations from the instance Φ~, and hence, Φ~ is satisfiable.

Since Φ~ is a system of equations over an abelian group (Q,+), we can find a satisfying assignment to Φ~ in polynomial time using Gaussian elimination [21]. Let 𝜷~ be the assignment returned by this procedure. To construct the final assignment to the X variables, we simply set xi to be a random element from the coset 𝜷~(yi). Let 𝜷:XG be the random assignment given by the above procedure. It can be easily observed that 𝜷 satisfies a given constraint Ci in Φ with probability |S||HS| and hence 𝜷 satisfies |S||HS| fraction of the constraints in expectation. The randomized algorithm can be easily derandomized using the method of conditional expectations.

4 Hardness of Max-E𝟑-LIN𝑺(𝑮)

We start with some basic facts. For a nonabelian group G, the quotient group G/[G,G] is an abelian group. The dual of G/[G,G] is isomorphic to

{χρ|ρ𝖨𝗋𝗋𝖾𝗉(G),dim(ρ)=1}

We denote this subgroup of G^ as G/[G,G]^.

Similarly, consider any normal subgroup HG such that [G,G]H, the quotient group G/H is an abelian group that is isomorphic to a subgroup of G/[G,G]. Furthermore, the dual of G/H is isomorphic to

{χρ|ρ𝖨𝗋𝗋𝖾𝗉(G),dim(ρ)=1,χρ(h)=1,hH}.
Main Reduction

We now give a reduction from a Layered Label Cover instance, denoted by, =(𝒱={V1,,VT},{Πi,j}1t<tT},{[Rt]t[T]} to a Max-E3-LINS(G) instance Φ over a non-abelian group G. For δ>0, we will use the following setting of T and r in Theorem 7

2rmin{δ10(2|G|)20,δ210|G|10K},T(8|G|3δ)4,

where K:=8|G|6δ2.

Consider the Layered Label Cover instance . For all t[T] and for each vVt, we create a cluster C[v] of literals of size |G|Rt. In each cluster C[v], each literal is indexed by a string of length Rt. For any string (1G,𝒚)GRt, its corresponding literals are g (1G,𝒚) for gG, where the string g (1G,𝒚) is (g,g y1,,g yRt1).

An assignment to the instance that we are going to create is given by the maps Av:GRtG for all vVt and all t[T]. Note that any such assignment is assumed to be folded, i.e., Av(g (1G,𝒚))=g Av((1G,𝒚)).

The distribution on the constraint of the reduced instance Φ of Max-E3-LINS(G) is given by the following PCP verifier.

  1. 1.

    Pick a uniformly random pair (t,t) satisfying 1t<tT.

  2. 2.

    Choose an edge constraint πuv:[Rt][Rt] from uniformly at random.

  3. 3.

    Sample a string 𝒙GRt and 𝒚GRt independently and uniformly at random.

  4. 4.

    Sample an element 𝒔SRt uniformly at random.

  5. 5.

    For each j[Rt], set zj=yj1 xπuv(j)1 sj.

  6. 6.

    Accept if and only if Av(𝒙) Au(𝒚) Au(𝒛)S.

4.1 Completeness

If is fully satisfiable, then there exists a corresponding assignment σ such that all the constraints are satisfiable. Let Av(𝒙)=xσ(v) and Au(𝒚)=yσ(u), i.e., the dictator functions. Then, the test passes as,

Av(𝒙) Au(𝒚) Au(𝒛)
=xσ(v) yσ(u) zσ(u)
=xσ(v) yσ(u) (yσ(u))1 (xπu,v(σ(u)))1 sσ(u)
=xσ(v) yσ(u) (yσ(u))1 (xσ(v))1 sσ(u) (Using πu,v(σ(u))=σ(v))
=sσ(u)S.

Hence, the test always passes. Thus, the value of the instance Φ is 1.

4.2 Soundness

In this section, we prove the soundness of the analysis.

Lemma 14.

For every δ>0, if the Layered Label Cover instance is at most 2r, then the Max-E3-LINS(G) instance Φ is at most |S||HS|+δ satisfiable.

Proof.

Fix the assignment {Av}v𝒱 to the instance Φ. We define the value of an assignment A, value(A), as the probability that the above test passes. The following expression gives the value of this assignment A,

𝔼1t<tT[𝔼πuvΠt,t(𝒙,𝒚,𝒔)[sS[1|G|ρ𝖨𝗋𝗋𝖾𝗉(G)dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]]].

By Proposition 12, this expression equals 1 if and only if Av(𝒙) Au(𝒚) Au(𝒛)S, and 0 otherwise. We can rewrite this expression according to the representations ρ𝖨𝗋𝗋𝖾𝗉(G),

value(A)
=1|G|𝔼1t<tT[ρ𝖨𝗋𝗋𝖾𝗉(G)sS𝔼πuvΠt,t𝒙,𝒚,𝒔[dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]]
=1|G|𝔼1t<tT[ρG/HS^dim(ρ)=1sS𝔼πuvΠt,t𝒙,𝒚,𝒔[dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]] (4)
+1|G|𝔼1t<tT[ρG/HS^dim(ρ)=1sS𝔼πuvΠt,t𝒙,𝒚,𝒔[dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]] (5)
+1|G|𝔼1t<tT[dim(ρ)2sS𝔼πuvΠt,t𝒙,𝒚,𝒔[dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]]. (6)

Term (4) is a constant between any two layers. As for term (5), we prove that they can be used to decode a valid assignment to any pair of layers unless they are negligible along a random path p. Finally, for term (6), we use [5] as a black box and show they are negligible along a random path p.

For term 4 and term 5, since they have dim(ρ)=1, the character χρ is a homomorphism. Thus, we have

dim(ρ)χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)=χρ(Av(𝒙) Au(𝒚) Au(𝒛))χρ(s1).

For term (4), as χρ is a 1-bounded function, it’s upper bounded by

1|G|ρG/HS^dim(ρ)=1sS1=1|G||S||GHS|=|S||HS|.

4.2.1 Bounding expressions in (5)

We now bound the term (5). Using |χρ(s1)|1, we have (5) is at most

|S||G|ρG/HS^dim(ρ)=1𝔼(u,v)𝒙,𝒚,𝒔[χρ(Av(𝒙))χρ(Au(𝒚))χρ(Au(𝒛))],

We argue that if this expression is large, then a decoding strategy exists for the Label Cover instance. We need the following simple lemma.

Lemma 15.

Let h:GnG be any folded function, β is a representation of Gn. Define s(β):={i|βiG/HS^}. Let g(𝐱)=χρ(h(𝐱)) for χρG/HS^ and dim(ρ)=1, then g^(β)=0 for all β with s(β)=.

Proof.

By definition, we have

g^(β) =𝔼𝒙Gn[χρ(h(𝒙))β(𝒙)]
=𝔼𝒚Gn1x1=1G[𝔼cG[χρ(h(c (1G,𝒚)))β(𝒄 (1G,𝒚))]]
=𝔼𝒚Gn1[𝔼cG[χρ(c)χρ(h((1G,𝒚)))β(𝒄)β((1G,𝒚))]]
=𝔼𝒚Gn1χρ(h((1G,𝒚)))β((1G,𝒚))𝔼cG[χρ(c)β(𝒄)].

If β satisfies |s(β)|=0, then β(𝒄)=i=1Lβi(c) is a complex number. Therefore, there always exists a ρ such that dim(ρ)=1 and χρ(c)β(𝒄)=χρ(c). Furthermore, such ρG/HS^ since for any element qG/HS, β(q)=1 and χρ(q)1, indicating that χρ(q)1. Hence, by Proposition 10,

g^(β)=𝔼𝒚Gn1χρ(h((1G,𝒚)))β((1G,𝒚))𝔼cG[χρ(c)]=0.

We now prove the following main lemma from this section.

Lemma 16.

If the Layered Label Cover instance is at most 2r satisfiable, then for any dim(ρ)=1 such that ρG/HS^,

|𝔼1t<tT[𝔼πuvΠt,t[𝔼𝒙,𝒚[χρ(Av(𝒙))χρ(Au(𝒚))χρ(Au(𝒛))]]]|δ2|G|, (7)
Proof.

Consider two layers U and V whose alphabets are [L] and [R] and an edge constraint e=(u,v) such that uU and vV. Let π denote the projection constraint on e. Let fv(𝒙)=χρ(Av(𝒙)), gu(𝒙)=χρ(Au(𝒙)) and hu𝒔(𝒙)=χρ(Au(𝒙 𝒔)). With these notations, we have

χρ(Au(𝒚))χρ(Au(𝒛))=gu(𝒚)hu𝒔(𝒚1 (𝒙π)1)=(guhu𝒔)((𝒙π)1),

where (𝒙π)j=xπ(j). Thus, the inner expectation can be written as

𝔼𝒙,𝒔[fv(𝒙)(guhu𝒔)((𝒙π)1)]
=𝔼𝒙,𝒔[α𝖨𝗋𝗋𝖾𝗉(GR)dim(α)𝗍𝗋(fv^(α)α(𝒙1))β𝖨𝗋𝗋𝖾𝗉(GL)dim(β)𝗍𝗋(gu^(β)hu𝒔^(β)β(𝒙π))]
=𝔼𝒙,𝒔[α,βdim(α)dim(β)𝗍𝗋(fv^(α)α(𝒙1))𝗍𝗋(gu^(β)hu𝒔^(β)β(𝒙π))]
=α,βdim(α)dim(β)𝔼𝒙,𝒔[𝗍𝗋(fv^(α)α(𝒙1))𝗍𝗋(gu^(β)hu𝒔^(β)β(𝒙π))].

Denote

𝐓𝐞𝐫𝐦e(α,β):=dim(α)dim(β)𝔼𝒙,𝒔[𝗍𝗋(fv^(α)α(𝒙1))𝗍𝗋(gu^(β)hu𝒔^(β)β(𝒙π))],

we have

𝐓𝐞𝐫𝐦e(α,β)
=dαdim(β)𝔼𝒙,𝒔[1p,qdαfv^(α)pqα(𝒙1)qp1i,kdim(β)gu^(β)hu𝒔^(β)ikβ(𝒙π)ki]
=dαdim(β)𝔼𝒔[p,q,i,kf^v(α)pq(g^u(β)hu𝒔^(β))ik𝔼𝒙[α(𝒙1)qpβ(𝒙π)ki]],

where (i,k) are the tuples i=(i1,i2,,iL) and k=(k1,k2,,kL). Similarly, (p,q) are tuples p=(p1,p2,,pR) and q=(q1,q2,,qR). Then,

𝔼𝒙[α(𝒙1)qpβ(𝒙π)ki] =𝔼𝒙[l=1Rαl(xl1)qlpll=1Lβl(xl)klil] (8)
=l=1R𝔼𝒙[αl(xl1)qlpllπ1(l)βl(xl)klil]. (9)

We argue that s(α)π(s(β)) to make this expression non-zero. Suppose that there exists a such that for all π1(), dim(β)=1, then the product of all such β must be 1 dimensional. According to Proposition 9, the expectation is 0 unless α is also 1 dimensional and isomorphic to the product of β. However, for an αlG/HS^, if βG/HS^ for all , then the product of β belongs to G/HS^ and is not isomorphic to α. Therefore, for the expectation to be non-zero, there exists some such that βG/HS^, indicating s(α)s(β).

Define a function Fβki(𝒙1):=β(𝒙π)ki, and note that

iFβki22=i𝔼𝒙[|β(𝒙1π)ki|2]=𝔼𝒙[i|β(𝒃1π)ki|2]=1, (10)

where the last equality follows from the fact that the sum expression is exactly the norm of the k-th row of the representation β. Since β(.) is unitary, the norm of its row is always 1. Using the function Fβki, we further simplify the expectation 𝔼𝒙[α(𝒙1)qpβ(𝒙π)ki] as follows.

𝔼𝒙[α(𝒙1)qpβ(𝒙π)ki] =𝔼𝒙[α(𝒙1)qpFβki(𝒙1)]
=𝔼𝒙[α(𝒙1)qpγdim(γ)𝗍𝗋(Fβki^(γ)γ(𝒙))]
=𝔼𝒙[γdim(γ)p,qFβki^(γ)pqγ(𝒙)qpα(𝒙1)qp]
=γdim(γ)p,qFβki^(γ)pq𝔼𝒙[γ(𝒙)qpα(𝒙1)qp].

By Proposition 9, the expectation is 0 unless α=γ, p=q and q=p. Hence, we have

𝔼𝒙[α(𝒙1)qpβ(𝒙π)ki]=Fβki^(α)pq.

Thus, we can express 𝐓𝐞𝐫𝐦e(α,β) as,

𝐓𝐞𝐫𝐦e(α,β)=dαdim(β)p,q,i,kf^v(α)pq𝔼𝒔[(g^u(β)hu𝒔^(β))ik]Fβki^(α)pq.

In addition, Lemma 15 indicates that s(α) and s(β) are non-empty. Therefore,

𝔼𝒙,𝒔[fv(𝒙)(gh𝒔)((𝒙π)1)] =α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))𝐓𝐞𝐫𝐦e(α,β)ΘLowe(u,v)+α,β|s(α)|,|s(β)|0|s(β)|Cs(α)π(s(β))𝐓𝐞𝐫𝐦e(α,β)ΘHighe(u,v),

where in the last expression we break the summation based on |s(β)|.

If (7) is not true, then we have

|𝔼e(u,v)[ΘLowe(u,v)+ΘHighe(u,v)]|δ.

where δ=δ2|G|. We will later show that that |𝔼e(u,v)[ΘHighe(u,v)]|δ/2. Assuming this, we have

|𝔼e(u,v)[ΘLowe(u,v)]|δ/2.

We now show how to come up with a decoding strategy based on the above lower bound.

Bounding the 𝚯𝐋𝐨𝐰𝒆(𝒖,𝒗) term.

Next, we argue that if |𝔼e[ΘLowe(u,v)]| is large, then we can decode an assignment to the Label Cover instance . We first simplify the expression,

|ΘLowe(u,v)|2
=|𝔼𝒔[α,βdim(α)dim(β)p,q,i,kf^v(α)pq(g^u(β)hu𝒔^(β))ikFβki^(α)pq]|2
=|𝔼𝒔[α,βdim(α)dim(β)p,q,i,j,kf^v(α)pqg^u(β)ijhu𝒔^(β)jkFβki^(α)pq]|2
(α,βdαdβp,qi,j,k|f^v(α)pq|2|g^u(β)ij|2)(α,βdαdβp,qi,j,k|F^βki(α)pq|2𝔼𝒔[h^u𝒔(β)jk]2)

The second term is bounded by 1 as

α,βdim(α)dim(β)p,qi,j,k|F^βki(α)pq|2𝔼𝒔[h^u𝒔(β)jk]2
𝔼𝒔[βdim(β)j,k|h^u𝒔(β)jk|2iαdim(α)p,q|F^βki(α)pq|2]
=𝔼𝒔[βdim(β)j,k|h^u𝒔(β)jk|2iFβki2]
=𝔼𝒔[βdim(β)j,k|h^u𝒔(β)jk|2] (Using Equation (10)
𝔼𝒔[hu𝒔22]=1,

Based on the above bound, the term |ΘLowe(u,v)|2 is upper bounded by

|ΘLowe(u,v)|2 α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))dim(α)dim(β)p,qi,j,k|f^v(α)pq|2|g^u(β)ij|2

Since for β such that |s(β)|C, dim(β)=i=1Ldim(βi)=i,dim(βi)2dim(βi)(|G|)C and the index i varies over the dimension of β,

|ΘLowe(u,v)|2 |G|C2α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))dim(α)dim(β)p,qi,j|f^v(α)pq|2|g^u(β)ij|2
=|G|C2α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))dim(α)dim(β)f^v(α)𝖧𝖲2g^u(β)𝖧𝖲2.

Now, we can present the decoding strategy for a typical edge e=(u,v):

Decoding strategy.
  1. 1.

    For each uU, consider a function gu(𝒙)=χρ(Au(𝒙)), sample a β with probability dim(α)g^u(β)𝖧𝖲2 and select a random coordinate j s.t. χβjG/HS^. If there is no such j, then return .

  2. 2.

    For each vV, consider a function fv(𝒙)=χρ(Av(𝒙)), sample an α with probability dim(α)fv(α)𝖧𝖲2 and select a random coordinate i s.t. χαiG/HS^. If there is no such i, then return .

For α,β such that s(α), s(β) are nonempty and s(α)π(s(β)), the strategy will succeed with probability at least 1/|s(β)|. This is because for any label returned by player v, the condition s(α)π(s(β)) guarantees that there exists a πe1() such that βG/HS^, and the player u returns this with probability 1/|s(β)|. Therefore, the expected value of the labeling returned by the strategy is given by

𝔼e(u,v)[α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))dαdim(β)f^v(α)𝖧𝖲2g^u(β)𝖧𝖲21|s(β)|]
1C𝔼e(u,v)[α,β|s(α)|,|s(β)|0|s(β)|<Cs(α)π(s(β))dim(α)dim(β)f^v(α)𝖧𝖲2g^u(β)𝖧𝖲2]
1C|G|C2𝔼e(u,v)[|ΘLowe(u,v)|2]
1C|G|C2|𝔼e(u,v)[ΘLowe(u,v)]|2δ24C|G|C/2. (Cauchy-Schwarz inequality)

We set C=ΩG(r2logδ) so that δ24C|G|C/2>O(2r), which contradicts that hardness of Label Cover. Therefore, |𝔼e(u,v)[ΘLowe(u,v)]|δ/4 for any two layers in , and hence

|𝔼1t<tT[𝔼πu,vΠt,t[ΘLowe(u,v)]]|δ4.
Bounding the 𝚯𝐇𝐢𝐠𝐡𝒆(𝒖,𝒗) term.

It remains to bound |𝔼e[ΘHighe]|. We divide the term into two parts for D such that CΩG(logDlogδ).

ΘHighe(u,v) =α,β|s(α)|,|s(β)|0|s(β)|Cs(α)π(s(β))dim(β)D𝐓𝐞𝐫𝐦e(α,β)+α,β|s(α)|,|s(β)|0|s(β)|Cs(α)π(s(β))dim(β)>D𝐓𝐞𝐫𝐦e(α,β),

We denote the first term by ΘHigh,De(u,v) and the second term by ΘHigh,>De(u,v). We bound these terms separately.

Bounding 𝚯𝐇𝐢𝐠𝐡,𝑫𝒆(𝒖,𝒗).

Starting with the simplified expression for 𝐓𝐞𝐫𝐦e(α,β), we have

ΘHigh,De(u,v)=α,βdim(α)dim(β)p,q,i,kf^v(α)pq𝔼𝒔[(g^u(β)hu𝒔^(β))ik]Fβki^(α)pq.

We now simplify the expectation over 𝒔. Recall that the function hu𝒔(𝒙):=χρ(Au(𝒙 𝒔))=gu(𝒙 𝒔). We now express the Fourier coefficient of hu𝒔 in terms of the Fourier coefficient of gu𝒔. By the Fourier inversion formula,

hu𝒔(𝒙)=gu(𝒙 𝒔) =βdim(β)𝗍𝗋(g^u(β)β(𝒙 𝒔))
=βdim(β)𝗍𝗋(g^u(β)(β(𝒙)β(𝒔))) (Using homomorphism of β)
=βdim(β)𝗍𝗋(g^u(β)β(𝒔)β(𝒙))

As the Fourier expansion is unique, we have h^u𝒔(β)=g^u(β)β(𝒔). Using this, we have

𝔼𝒔[(g^u(β)hu𝒔^(β))ik] =𝔼𝒔[(g^u(β)g^u(β)β(𝒔1))ik]
=𝔼𝒔[j,jg^u(β)ijg^u(β)jjβ(𝒔1)jk]
=j,jg^u(β)ijg^u(β)jj𝔼𝒔[β(𝒔1)jk]
=j,jg^u(β)ijg^u(β)jj𝔼𝒔[=1Lβ(s1)j,k]
=j,jg^u(β)ijg^u(β)jj=1L𝔼𝒔[β(s1)j,k]

Now, we are in the setting when dim(β)D but s(β)C. Hence, the number of dimension 2 representations in (β1,β2,,βL) is upper bounded by log2D. Thus, there are at least Clog2D coordinates [L] such that βG/HS^ and dim(β)=1. For each such β we can apply the following claim.

Claim 17.

For i such that is(β), we have 𝔼sS[βi(s)]𝗈𝗉21δG for some δG>0.

Proof.

We refer the reader to the full version of the paper for the proof.

When dim(β)=1 and βG/HS^, the above claim gives

εG>0,|𝔼sS[β(s1)]|1εG.

Correspondingly, we have

𝔼𝒔[(g^u(β)hu𝒔^(β))ik] =j,jg^u(β)ijg^u(β)jj=1L𝔼𝒔[β(s1)j,k]
(1εG)(Clog2D)j,j|g^u(β)ij||g^u(β)jj|.

Plugging this upper bound, we get

ΘHigh,De(u,v) =α,βdim(α)dim(β)p,q,i,kf^v(α)pq𝔼𝒔[(g^u(β)hu𝒔^(β))ik]Fβki^(α)pq
(1εG)(Clog2D)α,βdαdβp,q,i,kj,j|f^v(α)pq||g^u(β)ij||g^u(β)jj||Fβki^(α)pq|

Applying the Cauchy-Schwarz inequality,

|ΘHigh,De(u,v)|2(1εG)2(Clog2D)(α,βdim(α)dim(β)p,q,i,kj,j|f^v(α)pq|2|g^u(β)ij|2)
(α,βdim(α)dim(β)p,q,i,kj,j|F^βki(α)pq|2|g^u(β)jj|2).

Using the fact that i,j,j and k vary over the dimension of β, which is at most D, the first term is at most,

(α,βdim(α)dim(β)p,q,i,kj,j|f^v(α)pq|2|g^u(β)ij|2)
D2(αdim(α)p,q|f^v(α)pq|2)(βdim(β)i,j|g^u(β)ij|2)D2fv22gu22D2.

Similarly, the second term is

α,βdim(α)dim(β)p,q,i,kj,j|F^βki(α)pq|2|g^u(β)jj|2
Dβdim(β)j,j|h^u𝒔(β)jj|2iαdim(α)p,q|F^βki(α)pq|2
=Dβdim(β)jj|g^u(β)jj|2iFβki2
=Dβdim(β)j,j|g^u(β)jj|2 (Using Equation (10)
Dgu22=D,

Therefore, we have,

|𝔼e(u,v)[ΘHigh,De(u,v)]|2𝔼e(u,v)[|ΘHigh,De(u,v)|2](1εG)2(Clog2D)D3.

We verify that a setting of D satisfies (1εG)2(Clog2D)D3δ216:

(1εG)2(Clog2D)D3δ216CΩG(logDlogδ).
Bounding 𝚯𝐇𝐢𝐠𝐡,>𝑫𝒆(𝒖,𝒗).

We use the same high-degree argument as in the proof of the [4, Claim 4.5].

Claim 18.

For every edge e=(u,v), and C=ΩG(log(1/δ)), we have |𝔼𝒔[ΘHigh,>De(u,v)]|δ4.

Proof.

We refer the reader to the full version of the paper for the proof of this claim.

Finishing the proof.

Using these bounds, we have,

|𝔼e(u,v)[ΘHighe(u,v)]| =|𝔼e(u,v)[ΘHigh,De(u,v)+ΘHigh,>De(u,v)]|
|𝔼e(u,v)[ΘHigh,De(u,v)]|+|𝔼e(u,v)[ΘHigh,>De(u,v)]|δ4+δ4=δ2δ4|G|,

as required. Therefore, the term (5) collectively can be upper bounded by δ2.

4.2.2 Bounding expressions in (6)

The analysis for representations with dim(ρ)2 shares structural similarities with the proof of Max-3LIN over non-abelian groups in [4]. However, our setting introduces additional noise terms 𝒔SRt and sS that must be carefully handled. We provide a high-level proof outline here and defer the exhaustive algebraic expansion to the full version of the paper. The core of the bound relies on the following lemma:

Lemma 19.

Let K:=8|G|10δ2. If the Layered Label Cover instance is at most min(δ210|G|10K,δ22|G|20)-satisfiable, then

|𝔼1t<tT[𝔼πuvΠt,t[𝔼𝒙,𝒚,𝒛[χρ(Av(𝒙) Au(𝒚) Au(𝒛) s1)]]]|δ|G|3.
Proof Sketch.

The analysis for representations with dim(ρ)2 is structurally similar to the analysis in [5]. By fixing a noise vector 𝒔, we can follow the approach in [5]. we introduce a threshold parameter K:=8|G|10δ2 to divide the remaining summation into a low-degree component (Γlow) and a high-degree component (Γhigh), based on whether the number of dimensions 2 in the representation β is strictly less than K or at least K. See the full version of the paper for the actual proof.

By summing the result of Lemma 19 over all representations ρ with dim(ρ)2 and all sS, the total contribution to the expectation is at most δ2.

Combining this with the bound of δ2 on the terms for 1-dimensional representations (Equation 5), we conclude that if the Layered Label Cover instance is at most 2r-satisfiable, then value(A)|S||HS|+δ. This completes the proof of Lemma 14.

References

  • [1] Sanjeev Arora, Carsten Lund, Rajeev Motwani, Madhu Sudan, and Mario Szegedy. Proof verification and the hardness of approximation problems. Journal of the ACM (JACM), 45(3):501–555, 1998. doi:10.1145/278298.278306.
  • [2] Sanjeev Arora and Shmuel Safra. Probabilistic checking of proofs: A new characterization of NP. Journal of the ACM (JACM), 45(1):70–122, 1998. doi:10.1145/273865.273901.
  • [3] Per Austrin and Elchanan Mossel. Approximation resistant predicates from pairwise independence. Computational Complexity, 18(2):249–271, 2009. doi:10.1007/s00037-009-0272-6.
  • [4] Amey Bhangale and Subhash Khot. Optimal inapproximability of satisfiable k-lin over non-abelian groups. In Samir Khuller and Virginia Vassilevska Williams, editors, STOC ’21: 53rd Annual ACM SIGACT Symposium on Theory of Computing, Virtual Event, Italy, June 21-25, 2021, pages 1615–1628. ACM, 2021. doi:10.1145/3406325.3451003.
  • [5] Amey Bhangale and Subhash Khot. Optimal inapproximability of satisfiable k-LIN over non-abelian groups. (updated paper), 2026.
  • [6] Amey Bhangale, Subhash Khot, and Dor Minzer. On Approximability of Satisfiable k-CSPs: I. In 54th Annual Symposium on Theory of Computing (STOC’22), pages 976–988, New York, NY, USA, 2022. ACM. doi:10.1145/3519935.3520028.
  • [7] Amey Bhangale, Subhash Khot, and Dor Minzer. On Approximability of Satisfiable K-CSPs: II. In 55th Annual Symposium on Theory of Computing (STOC’23), pages 632–642, New York, NY, USA, 2023. ACM. doi:10.1145/3564246.3585120.
  • [8] Amey Bhangale, Subhash Khot, and Dor Minzer. On approximability of satisfiable k-csps: Iv. In 56th Annual Symposium on Theory of Computing (STOC’24), pages 1423–1434, New York, NY, USA, 2024. ACM. doi:10.1145/3618260.3649610.
  • [9] Amey Bhangale, Subhash Khot, and Dor Minzer. On approximability of satisfiable k-csps: V, 2025. doi:10.1145/3717823.3718127.
  • [10] Mark Braverman, Subhash Khot, and Dor Minzer. On rich 2-to-1 games. In James R. Lee, editor, 12th Innovations in Theoretical Computer Science Conference, ITCS 2021, Virtual Conference, January 6-8, 2021, LIPIcs, pages 27:1–27:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.ITCS.2021.27.
  • [11] Andrei A. Bulatov. A dichotomy theorem for nonuniform csps. In 58th Annual Symposium on Foundations of Computer Science (FOCS’17), pages 319–330, Piscataway, NJ, USA, 2017. IEEE. doi:10.1109/FOCS.2017.37.
  • [12] Siu On Chan. Approximation resistance from pairwise-independent subgroups. Journal of the ACM (JACM), 63(3):1–32, 2016. doi:10.1145/2873054.
  • [13] Arkadev Chattopadhyay and Avi Wigderson. Linear Systems over Composite Moduli . In 50th Annual Symposium on Foundations of Computer Science (FOCS’09), Los Alamitos, CA, USA, October 2009. IEEE. doi:10.1109/FOCS.2009.17.
  • [14] Irit Dinur and Venkatesan Guruswami. PCPs via low-degree long code and hardness for constrained hypergraph coloring. In 54th Annual Symposium on Foundations of Computer Science (FOCS’13), pages 340–349, Piscataway, NJ, USA, 2013. IEEE. doi:10.1109/FOCS.2013.44.
  • [15] Irit Dinur, Venkatesan Guruswami, Subhash Khot, and Oded Regev. A new multilayered pcp and the hardness of hypergraph vertex cover. In Proceedings of the Thirty-Fifth Annual ACM Symposium on Theory of Computing, STOC ’03, pages 595–601, New York, NY, USA, 2003. Association for Computing Machinery. doi:10.1145/780542.780629.
  • [16] Lars Engebretsen, Jonas Holmerin, and Alexander Russell. Inapproximability results for equations over finite groups. Theoretical Computer Science, 312(1):17–45, 2004. doi:10.1016/S0304-3975(03)00401-8.
  • [17] Tomás Feder and Moshe Y. Vardi. Monotone monadic SNP and constraint satisfaction. In S. Rao Kosaraju, David S. Johnson, and Alok Aggarwal, editors, Proceedings of the Twenty-Fifth Annual ACM Symposium on Theory of Computing, May 16-18, 1993, San Diego, CA, USA, pages 612–622. ACM, 1993. doi:10.1145/167088.167245.
  • [18] Tomás Feder and Moshe Y Vardi. The computational structure of monotone monadic snp and constraint satisfaction: A study through datalog and group theory. SIAM Journal on Computing, 28(1):57–104, 1998. doi:10.1137/S0097539794266766.
  • [19] Uriel Feige, Shafi Goldwasser, Laszlo Lovász, Shmuel Safra, and Mario Szegedy. Interactive proofs and the hardness of approximating cliques. Journal of the ACM (JACM), 43(2):268–292, 1996. doi:10.1145/226643.226652.
  • [20] Michel X. Goemans and David P. Williamson. Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. Journal of the ACM (JACM), 42(6):1115–1145, 1995. doi:10.1145/227683.227684.
  • [21] Mikael Goldmann and Alexander Russell. The complexity of solving equations over finite groups. Information and Computation, 178(1):253–262, 2002. doi:10.1006/inco.2002.3173.
  • [22] Venkatesan Guruswami, Johan Hastad, and Madhu Sudan. Hardness of approximate hypergraph coloring. SIAM Journal on Computing, 31(6):1663–1686, 2002. doi:10.1137/S0097539700377165.
  • [23] Venkatesan Guruswami, Johan Håstad, Rajsekar Manokaran, Prasad Raghavendra, and Moses Charikar. Beating the random ordering is hard: Every ordering csp is approximation resistant. SIAM Journal on Computing, 40(3):878–914, 2011. doi:10.1137/090756144.
  • [24] Johan Håstad. Some optimal inapproximability results. Journal of the ACM (JACM), 48(4):798–859, 2001. doi:10.1145/502090.502098.
  • [25] Johan Håstad. Satisfying degree-d equations over gf[2]n. Theory of Computing, 9(27):845–862, 2013. doi:10.4086/toc.2013.v009a027.
  • [26] Johan Håstad. On the np-hardness of max-not-2. SIAM Journal on Computing, 43(1):179–193, 2014. doi:10.1137/120882718.
  • [27] Subhash Khot. Hardness results for approximate hypergraph coloring. In 34th Annual Symposium on Theory of Computing (STOC’02), pages 351–359, New York, NY, USA, 2002. ACM. doi:10.1145/509907.509962.
  • [28] Subhash Khot. Hardness results for coloring 3 -colorable 3 -uniform hypergraphs. In 43rd Annual Symposium on Foundations of Computer Science (FOCS’02), pages 23–32, Piscataway, NJ, USA, 2002. IEEE. doi:10.1109/SFCS.2002.1181879.
  • [29] Subhash Khot. On the power of unique 2-prover 1-round games. In 34th Annual Symposium on Theory of Computing (STOC’02), pages 767–775, New York, NY, USA, 2002. ACM, ACM. doi:10.1145/509907.510017.
  • [30] Subhash Khot, Guy Kindler, Elchanan Mossel, and Ryan O’Donnell. Optimal inapproximability results for max-cut and other 2-variable csps? SIAM Journal on Computing, 37(1):319–357, 2007. doi:10.1137/S0097539705447372.
  • [31] Subhash Khot and Muli Safra. A two-prover one-round game with strong soundness. Theory of Computing, 9:863–887, 2013. doi:10.4086/toc.2013.v009a028.
  • [32] Ryan O’Donnell. Analysis of boolean functions. Cambridge University Press, USA, 2014. doi:10.1017/CBO9781139814782.
  • [33] Prasad Raghavendra. Approximating np-hard problems efficient algorithms and their limits. PhD thesis, University of Washington, Seattle, WA, USA, 2009. AAI3377316. doi:10.5555/1751149.
  • [34] Ran Raz. A parallel repetition theorem. SIAM Journal on Computing, 27(3):763–803, 1998. doi:10.1137/S0097539795280895.
  • [35] Alex Samorodnitsky and Luca Trevisan. A pcp characterization of np with optimal amortized query complexity. In 32nd Annual Symposium on Theory of Computing (STOC’00), pages 191–199, New York, NY, USA, 2000. ACM. doi:10.1145/335305.335329.
  • [36] Thomas J. Schaefer. The complexity of satisfiability problems. In 10th Annual Symposium on Theory of Computing (STOC’78), pages 216–226, New York, NY, USA, 1978. ACM. doi:10.1145/800133.804350.
  • [37] Audrey Terras. Fourier analysis on finite groups and applications. Cambridge University Press, USA, 1999. doi:10.1017/CBO9780511626265.
  • [38] Dmitriy Zhuk. A proof of the csp dichotomy conjecture. Journal of the ACM (JACM), 67(5), August 2020. doi:10.1145/3402029.