Optimal Inapproximability of Generalized Linear Equations over a Finite Group
Abstract
Constraint satisfaction problems (CSPs) consist of a set of variables taking values from some finite domain and a set of local constraints on these variables. The objective is to find an assignment to the variables that maximizes the fraction of satisfied constraints.
In this work, we study the CSP where the constraints are generalized linear equations over a finite group . More specifically, for a given , the constraints in this CSP are of the form addition of the values to the variables (similarly, product for non-abelian groups) belongs to the set . We give an approximation algorithm for this problem on satisfiable instances and show that it is optimal for certain assuming .
This natural predicate is one of the very few known predicates that are approximation resistant on almost satisfiable instances, assuming , but admits a non-trivial approximation algorithm on satisfiable instances.
Keywords and phrases:
Constraint satisfaction problems, inapproximability, approximation algorithms, non-abelian groups, Fourier analysisCategory:
Track A: Algorithms, Complexity and GamesFunding:
Amey Bhangale: Supported by the Hellman Fellowship award and NSF CAREER award 2440882.Copyright and License:
2012 ACM Subject Classification:
Theory of computation Problems, reductions and completenessEditors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele PuppisSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Constraint satisfaction problems (CSPs) are one of the most fundamental problems in theoretical computer science. A Max--CSP instance for a given predicate consists of a set of variables taking values from the domain and a collection of constraints where each consists of a constraint of the form . The constraints might involve literals instead of just the variables. The objective is to assign values to the variables that maximize the fraction of satisfied constraints from . An -approximation for Max--CSP is an algorithm that, given an instance of Max--CSP, outputs an assignment that satisfies at least , where is the optimal value of the instance .
A systematic study of the complexity of CSPs was started by Schaefer in 1978 [36], who showed that for every predicate over a -element set, the problem -CSP is either solvable in polynomial time or is -complete. A famous dichotomy conjecture of Feder and Vardi [17, 18], which was resolved recently in huge breakthroughs by Bulatov [11] and Zhuk [38] independently, states that for every predicate , checking the satisfiability of a -CSP is either in or is -complete. However, when it comes to approximation algorithms for Max--CSP, the question is wide open.
The optimal approximability results for Max--CSP for various predicates are known starting with the seminal work of [24]. Håstad showed that Max-3SAT, where the predicate is over a Boolean alphabet and is an OR of three literals, is -hard to approximate within a factor of for every . The above hardness result also holds even if the given instance is guaranteed to have an assignment with value . It is also easy to get a -approximation algorithm for Max-3SAT – for each variable, pick a random value from . This algorithm satisfies -fraction of the constraints in expectation. It is also easy to derandomize this algorithm by the method of conditional expectation. Thus, the hardness result is optimal. In the same work on the optimal hardness of Max-3SAT, Håstad [24] also studied the inapproximability of Max-3LIN over an abelian group . In Max-3LIN over a group , the variables take values from the group , and constraints are of the type for some . If the given instance of Max-3LIN is fully satisfiable, then it is known [21] that the satisfying assignment can be found in polynomial time using techniques similar to Gaussian elimination. Furthermore, a random assignment to the variables satisfies fraction of the constraints in expectation. Håstad [24] showed that this algorithm is optimal for general instances.
The Max-3LIN over a non-abelian group is another interesting problem. Unlike the abelian group case, here, Goldmann and Russell showed [21] that it is -complete to check the satisfiability of a given instance for every non-abelian group . Engebretsen, Holmerin, and Russell gave [16] similar inapproximability results as in the case of abelian groups. More specifically, they showed that for every , if an instance of Max-3LIN over a non-abelian group is given with value at least , then it is -hard to find an assignment that satisfies at least fraction of the constraints. There is, however, a better than approximation algorithm for certain groups on satisfiable instances. It is folklore to get a -approximation algorithm for Max-3LIN over a non-abelian group on satisfiable instances, where is the commutator subgroup of . A commutator of two group elements and is a group element , and a commutator subgroup is the subgroup generated by all the commutators of the group . Recently, Bhangale and Khot [4] showed that this algorithm is optimal on satisfiable instances assuming .
Given these approximation algorithms and inapproximability results concerning Max-3LIN, it is natural to ask what role the abelian nature of a group plays in such results. In this work, we study a generalized version of the Max-3LIN problem, denoted by , as defined below.
Fix a group and a subset . In the instance of , the variables take values from . A literal of a variable is given by for some .
Definition 1 ().
Consider a multiset of linear equations over variables for a group . Each constraint consists of a tuple of exactly literals and will be considered satisfied when their sum/product over is in . The problem is to find an assignment to that maximizes the number of satisfied constraints.
Observe that the problem Max-3LIN over a group that was discussed earlier is where is the identity element of the group . In , we allow more satisfying assignments in the predicate, i.e, ignoring the literals for simplicity, the condition that a tuple satisfies a given constraint depends on the value of , and hence we call the predicate a generalized linearity predicate over .333This nomenclature was also used by Chattopadhyay and Wigderson [13] to describe similar predicates.
Approximation Algorithm for
To keep things simple, we restrict to the setting when is an abelian group for this discussion. We start with a simple approximation algorithm for . Let be an instance of with constraints set over the variables . Here, the constraint is of the form
One can try to replace checking this condition by a linear equation over a certain abelian group, hoping to solve this system using Gaussian elimination, and from this solution get a non-trivial solution to the original instance. The basic algorithmic idea is to relax the constraint by passing to a quotient group. Suppose is a subgroup such that for some , and let . Then the above constraint implies
| (1) |
Thus, we convert the constraints in to a system of equations over . Since is satisfiable, the system is satisfiable as well. Hence, when is abelian, we can find a satisfying assignment to in polynomial time using Gaussian elimination. Given such an assignment, we set each to be a uniformly random element from the corresponding coset in . For every constraint, the resulting sum is uniformly distributed over the appropriate coset of , and hence the constraint is satisfied with probability . One natural first choice is to take , the subgroup generated by , but this choice is not always optimal. For instance, when and , the subgroup is all of , whereas is contained in a coset of a smaller subgroup, giving a better approximation ratio. Therefore, the right choice is the smallest subgroup such that is contained in a coset of . For non-abelian groups, we additionally require to be normal and to contain the commutator subgroup , so that the quotient is abelian. This leads to the following theorem.
Theorem 2.
Fix any finite group and . Let is the smallest normal subgroup such that
-
1.
.
-
2.
for some , i.e., is a subset of some coset of .
then the problem is approximable within a factor of on satisfiable instances. Furthermore, if generates , assuming , for every , it is -hard to approximate within a factor of .
Note that for any abelian group , the subgroup consists only of the identity element of . For non-abelian groups, the condition guarantees that the quotient group is abelian, which was crucial for the above-discussed approximation algorithm. See Theorem 13 for a straightforward generalization of the above approximation algorithm for non-abelian groups. The above theorem shows that even for abelian groups , the problem is -hard on satisfiable instances, in general.
A predicate is called approximation resistant if it is -hard to do better than the random assignment algorithm. We are aware of two results, one by Håstad [25] on satisfying degree- equations over GF, and another by Bhangale-Khot [4] on Max-3LIN over non-abelian groups where is not a simple group. Both these predicates are approximation resistant in general (i.e., on almost satisfiable instances), but have non-trivial approximation algorithms on satisfiable instances. Thus, our result adds the generalized linear equation predicate to the small class of predicates that are known to be approximation resistant in general but have non-trivial approximation algorithms on satisfiable instances. We hope that our result gives another piece of information to help understand the approximability of Max-CSPs on satisfiable instances.
In Section 3, we give a simple -approximation algorithm for for every finite group . The algorithm implicitly uses the abelian embedding of the generalized linearity predicate as defined in the series of work [6, 7, 8, 9] towards understanding the approximability of satisfiable CSPs. To show this optimal hardness result, we design a novel decoding procedure in the soundness analysis of the reduction, which may be of independent interest towards understanding the approximability of satisfiable CSPs.
1.1 Related Work
In this section, we go over relevant work on the inapproximability of Max-CSPs. The PCP Theorem [1, 2, 19] shows that Max--CSPs are -hard to approximate within a factor of for some constant if checking satisfiability of -CSP is -complete. Håstad in his seminal work [24] greatly improved the hardness of approximation results for a few CSPs. Notable examples of the CSPs from his work include Max-SAT and Max-LIN. For Max-CUT, which is a -ary CSP, Håstad showed that it is -hard to approximate within a factor of . Khot [29] formulated the Unique Games Conjecture (UGC), which is a conjecture on the hardness of the Label Cover instances (see Definition 4) restricted to the constraints being -to-. Samorodnitsky and Trevisan [35] showed that Boolean Max-CSP (with arbitrary -ary Boolean predicates) is -hard to approximate beyond assuming the UGC, matching the best algorithm up to a constant factor. Khot, Kindler, Mossel, and O’Donnell [30] showed that Max-CUT is -hard to approximate within a factor of assuming the UGC, which matches the approximation guarantee of the Goemans-Williamson [20] algorithm for Max-CUT.
Raghavendra [33] presented an elegant result that generalizes the above Max-CUT reduction and establishes, for any Max--CSP instance, the -integrality gap of the basic Semidefinite programming relaxation implies finding an satisfying assignment on satisfiable instances is -hard assuming the UGC. This result fully characterizes the approximability of Max--CSPs assuming the UGC on almost satisfiable instances. Furthermore, given a fixed predicate , Raghavendra’s result does not explicitly give the optimal hardness factor for Max--CSP. Austrin and Mossel [3] gave the right threshold for predicates that support a uniform and pairwise independent distribution. A distribution on is said to be pairwise independent if for every distinct pair , the marginal of restricted to the coordinates is uniform over . Austrin and Mossel showed that such predicates are approximation resistant on almost satisfiable instances, assuming the UGC.
Chan [12] established a general criterion for approximation resistance, resolving the NP-hardness of Max--CSP up to a constant factor and assuming . Specifically, he proved the hardness for Max-CSPs where the domain is an abelian group and the predicate is a subgroup that satisfies a condition analogous to that identified by Austrin and Mossel.
The question of finding the optimal approximation algorithm (even assuming certain conjectures, like -to- conjecture [29] or Rich -to- conjecture [10]) for satisfiable instances of Max--CSPs is wide open. In a recent series of work, Bhangale, Khot, and Minzer [6, 7] defined a property of abelian embeddability of the predicate towards understanding the approximability of satisfiable CSPs. A predicate is said to have an abelian embedding in an abelian group , if there are maps , not all constant, such that for every . They gave an optimal dictatorship test for -ary predicates that have no abelian embedding. Very recently, for certain -ary predicates that have an abelian embedding, they gave an approximation algorithm [8, 9] for satisfiable instances that uses a combination of Gaussian elimination as well as the SDP rounding algorithm. They also showed the “optimality” of this algorithm by giving a dictatorship test with matching parameters.
1.2 Techniques
In this section, we give an overview of the techniques in the inapproximability results of our main theorem.
1.2.1 Abelian Groups
We begin with the case of abelian groups to highlight one of the main differences in the analysis of the reduction compared to the seminal work of Håstad on Max-3LIN over an abelian group. We assume some familiarity with the Fourier analysis of functions over abelian groups (for instance, Chapter 8 of Ryan O’Donnell’s book [32]). Throughout the section, is an arbitrarily small constant.
Starting with a work of Håstad [24], a typical way to prove the hardness of approximation is to start with an -hard problem called the Label Cover [22, 27, 28, 14, 31, 26, 23]. A gadget is built on top of the Label Cover instance to create an instance of a given CSP. For simplicity of the presentation, we focus here is on the most important and technical component of the reduction. This component is the construction of dictatorship tests and analyzing the tests.
A function is called a dictator function if for some . A dictatorship test for a predicate consists of a distribution that is (almost) supported on the set of satisfying assignments of . The test samples inputs as follows: For each coordinate , the tuple is sampled independently from . The test accepts if evaluates to , i.e., forms a satisfying assignment for . It is clear that if is a dictator function, then the test passes with probability (almost) . This is because, in this case, we are checking if the coordinate of the inputs is from , which is always true by construction.
Once the distribution is fixed, the next step is to analyze the soundness of the dictatorship test, i.e., the probability with which the test passes if is “far from the dictator functions”. The notion of far from dictator functions changes based on the hardness reduction. A typical notion that is used is that the function has all the variables with degree influences low. The influence of the coordinate on the function is the probability that, on a random input, changing the coordinate changes the values of the function. In terms of the Fourier coefficients of , this is equal to the following quantity:
Thus, the dictator function has . A degree- influence of the variable is given by the following expression,
where is the number of non-zero coordinates of . With this notion of far from dictator functions in mind, the dictatorship test used in the hardness reduction [24] of Max-3LIN works as follows.
-
1.
Select uniformly at random.
-
2.
Set .
-
3.
For each , resample from uniformly at random, with probability .
-
4.
Check if .
It is clear that any dictator function passes the above test with probability at least . To analyze the soundness of the test, we can express the test passing probability as follows:
where the summation is over all the characters of the group . The term with being the trivial character gives . For the remaining terms with being a non-trivial character, we are left with analyzing the following expectation
By letting and expanding the function with the Fourier basis over , and doing some simplifications, we get that the above expectation is upper bounded as follows.
Decoding Strategy
Now, because of the ‘noise’ (i.e., step 3 in the test), the second term can be shown to be negligible for some large as a function of , by a simple application of Cauchy-Schwarz inequality and using Parseval’s identity. As for the first term, if it is non-negligible, then the structure of the function can be used in the hardness reduction starting from the Label Cover instance.
More precisely, the starting point of the reduction is a Label Cover instance (see Definition 4). It is -hard to distinguish between the Label Cover instances with value from instances with value at most for small . In the reduction, each vertex of the Label Cover instance is replaced with a cloud of vertices where is where is the label size of the vertex. These constitute the variables/literals of the reduced instance of Max-3LIN. The distribution on the constraints is specified by the above dictatorship test. If the value of the Label Cover instance is , then the value of the reduced Max-3LIN instance is at least . Now, similar to the above analysis, if we fix an assignment to the Max-3LIN instance with value for some , then the assignment restricted to most of , call it , has high degree- influential variables. From this, one can come up with a labeling to the Label Cover instance with value greater than , thereby showing the soundness of the reduction. The strategy simply picks a random non-trivial character , a Fourier coefficient of with probability and assign a label such that is not a trivial character.
We now give the natural extension of the above dictatorship test to the generalized linear equation predicate that we consider in this paper. Towards this, fix an abelian group and a subset . Consider the following dictatorship test.
-
1.
Select uniformly at random.
-
2.
Select uniformly at random.
-
3.
Set .
-
4.
Check if .
It is clear that every dictator function passes the test with probability . Similar to the above analysis, the soundness of the test can be expressed as follows:
Once again, the terms that correspond to the trivial character give (which corresponds to the approximation ratio of the algorithm that picks a random assignment). Note that our goal is to show that the test passes with probability almost in the soundness towards proving Theorem 2. Once again, the term that corresponds to a given and a character gives,
Ignoring the constant shift , we are again left with analyzing the expectation
Recall that the subgroup is the smallest subgroup such that for some . Now, unlike the Max-3LIN, we cannot expect this expectation to be small when the functions have negligible degree- influences for some . To see this, consider a character that is constant on the subgroup . If we let where the sum is the group operation, then the derived function has all degree- influences . However, the expectation becomes , since for some , we get that the , i.e, it always belongs to a fixed coset of . Since the character is constant on the subgroup (and hence constant on every coset of ), we get that the expectation is in absolute value. The number of such characters (including the trivial character) for which we cannot bound the expectation is precisely . This gives the right factor in the test passing probability that we need for our Theorem 2.
Now, consider the character , which is not constant on . Similar to Håstad’s analysis, we can upper bound the corresponding expectation as follows
where is a non-zero constant that only depends on and is the number of coordinates of where the character is not constant on the subgroup . In order to work with this expression, we modify the notion of far from dictator functions that will be useful for our hardness reduction as follows.
Modified low-degree influences
A modified degree- influence of the variable is expressed as the following expression,
where is the number of coordinates of where the character is not constant on the subgroup . With this change, we split the summation as follows:
Again, the second term is negligible for some large .
Modified Decoding Strategy
In our analysis of the reduction, we need to show that the terms that are similar to the first term are not negligible, then there is a decoding strategy (similar to the one described in the reduction to Max-3LIN above) in the hardness reduction starting from the Label Cover instance. The following strategy works. The modified strategy picks a random non-trivial irreducible representation that is not constant on , a Fourier coefficient of with probability and assign a label such that the character corresponding to is not constant on .
1.2.2 Non-abelian Groups
The above dictatorship test can be easily modified for the non-abelian case in a natural way
-
1.
Select uniformly at random.
-
2.
Select uniformly at random.
-
3.
For each , set .
-
4.
Check if .
The completeness case is trivial. In the soundness case, we again express the test passing probability as
where the inner sum is over all irreducible representations of and is the dimension of the representation . Similarly to the abelian case, for certain representations of dimension (that are constant on the subgroup defined in Theorem 2), we bound the expectation by in absolute value. This gives the factor . The analysis for the remaining dimension representations, Lemma 16, is analogous to the one described in the abelian case but focuses on the natural structure of non-abelian groups and generalized linear equation predicates. For some technical reasons, for non-abelian groups, we could analyze this under the assumption that generates the subgroup .
Regarding representations with dimension , we treat the analysis of Bhangale and Khot [4] as a black box (Lemma 19) to conclude that the associated expectations are small unless they yield a decoding strategy for the Label Cover instance. For some technical reasons, the analysis of this part of the reduction requires the use of Layered Label Cover instead of the bipartite Label Cover. Therefore, in our main reduction, we also use a Layered Label Cover instance as a starting point, but we only use the layered version in the proof of Lemma 19 to adopt results from [5]. For the primary part of this paper, we only need a bipartite Label Cover instance.
1.3 Organization
We begin Section 2 by defining the Label Cover instance and the hardness of approximation of Label Cover, which is the starting point of our reduction. In Section 2.2, we go over the basics of Fourier analysis over general finite groups. We formally give the approximation algorithm described in the introduction in Section 3. Finally, in Section 4 we give our hardness reduction for and analyze the reduction. The hardness for for follows easily from a similar reduction, thereby proving the main Theorem 2.
2 Preliminaries
2.1 Label Cover
We start by defining the Label Cover and Layered Label Cover problem, which we use as a starting point for our reduction.
Definition 4 (Label Cover).
An instance of the Label Cover constraint satisfaction problem consists of a bi-regular bipartite graph , alphabets and and a surjective projection map for every edge . Given a labeling , an edge is said to be satisfied by if .
is said to be satisfiable if there exists a labeling that satisfies all the edges. is said to be at most -satisfiable if every labeling satisfies at most a fraction of the edges.
The hardness of Label Cover stated below follows from the PCP Theorem [2, 1, 19] and Raz’s Parallel Repetition Theorem [34].
Theorem 5 (Hardness of Label Cover).
For every , there is a deterministic -time reduction from a 3-SAT instance of size to an instance of Label Cover with the following properties: ; ; is bi-regular with degrees bounded by .
- YES Case: If the 3-SAT instance is satisfiable, then is satisfiable.
- NO Case: If the 3-SAT instance is unsatisfiable, then is at most satisfiable
For our hardness result, we need the following variant of the Label Cover problem.
Definition 6 (Layered Label Cover).
An -Layered Label Cover instance, given by consist of sets of vertices . The label set of vertices in layer is denoted by . Every pair of layers has a set of constraints between the vertices in and . The constraint between and (if it exists in ) is denoted by . Moreover, every constraint between a pair of vertices is a projection constraint: for every assignment to , there is a unique assignment to that satisfies the constraint .
Theorem 7 ([15], Hardness of Layered Label Cover).
For any constant parameters , , the following problem is NP-hard. Given an -Layered Label Cover instance where all variable ranges are of size , distinguish between the following two cases:
- Completeness.
-
There is an assignment satisfying all the constraints of the Label Cover instance. In this case, we say that is fully satisfiable.
- Soundness.
-
For every , no assignment satisfies more than a fraction of the set of constraints between layers and . In this case, we say that is at most -satisfiable.
2.2 Fourier analysis over non-abelian group
We assume familiarity with the representation theory and Fourier analysis of functions over finite non-abelian groups. We refer the reader to the book by Terras [37] and the work of Bhangale and Khot [4] for standard definitions (such as irreducible representations, characters, Plancherel’s, and Parseval’s identity) which we omit here for brevity.
In this paper, we only consider non-abelian groups that are finite. Let be a finite non-abelian group. The identity element of a group is denoted by . We assume familiarity with basic definitions of representations, dimensions, invariant subspaces, and tensor products. We will denote the set of all irreducible representations of up to isomorphism by .
Fact 8.
Let be a group and be any subgroup of . If then restricted to is also a (not necessarily irreducible) representation of .
The following proposition shows that matrix entries of irreducible representations are “orthogonal” with respect to a symmetric bilinear form, unless they are conjugates of each other, in which case the corresponding product is the inverse of the dimension of the representation.
Proposition 9.
If and are two non-isomorphic irreducible representations of then for any we have
| (2) |
where (called a “symmetric bilinear form”). Also,
| (3) |
where is the delta-function which is if and otherwise.
We use Proposition 9 many times in the proof. For convenience, we note an important identity that follows from Proposition 9 (by setting to be the trivial map ).
Proposition 10.
If , .
In this paper, we will be interested in studying , the space of functions from a finite group to the complex numbers . Define the inner product on by . The character of a representation is the function defined by .
We will use the following propositions.
Proposition 11 (Orthogonality of characters).
For , we have
This proposition also shows that the maximum dimension of any irreducible representation of is at most .
Proposition 12.
This implies
3 An Approximation Algorithm
In this section, we give an approximation algorithm for for any group and . This algorithm is a straightforward generalization of the algorithm for abelian groups discussed in the introduction. We repeat it here for completeness.
Theorem 13.
There exists a -approximation algorithm for , where is the smallest normal subgroup such that (i) , and (ii) is a subset of some coset of .
Proof.
Let be an instance of with constraints over the variables . We first convert the set of constraints to a system of equations, denoted by , over the group with variables . Note that is a normal subgroup of containing the commutator subgroup such that for some . Thus, is an abelian group.
Consider a constraint which is of the form . We convert this to the equation over as
where is an element of that corresponds to the coset of containing , and the element corresponds to the coset of containing .
As is satisfiable, consider the satisfying assignment to . Consider the assignment given by the natural map . It is easy to see that satisfies all the equations from the instance , and hence, is satisfiable.
Since is a system of equations over an abelian group , we can find a satisfying assignment to in polynomial time using Gaussian elimination [21]. Let be the assignment returned by this procedure. To construct the final assignment to the variables, we simply set to be a random element from the coset . Let be the random assignment given by the above procedure. It can be easily observed that satisfies a given constraint in with probability and hence satisfies fraction of the constraints in expectation. The randomized algorithm can be easily derandomized using the method of conditional expectations.
4 Hardness of
We start with some basic facts. For a nonabelian group , the quotient group is an abelian group. The dual of is isomorphic to
We denote this subgroup of as .
Similarly, consider any normal subgroup such that , the quotient group is an abelian group that is isomorphic to a subgroup of . Furthermore, the dual of is isomorphic to
Main Reduction
We now give a reduction from a Layered Label Cover instance, denoted by, to a instance over a non-abelian group . For , we will use the following setting of and in Theorem 7
where .
Consider the Layered Label Cover instance . For all and for each , we create a cluster of literals of size . In each cluster , each literal is indexed by a string of length . For any string , its corresponding literals are for , where the string is .
An assignment to the instance that we are going to create is given by the maps for all and all . Note that any such assignment is assumed to be folded, i.e., .
The distribution on the constraint of the reduced instance of is given by the following PCP verifier.
-
1.
Pick a uniformly random pair satisfying .
-
2.
Choose an edge constraint from uniformly at random.
-
3.
Sample a string and independently and uniformly at random.
-
4.
Sample an element uniformly at random.
-
5.
For each , set .
-
6.
Accept if and only if .
4.1 Completeness
If is fully satisfiable, then there exists a corresponding assignment such that all the constraints are satisfiable. Let and , i.e., the dictator functions. Then, the test passes as,
| (Using ) | |||
Hence, the test always passes. Thus, the value of the instance is .
4.2 Soundness
In this section, we prove the soundness of the analysis.
Lemma 14.
For every , if the Layered Label Cover instance is at most , then the instance is at most satisfiable.
Proof.
Fix the assignment to the instance . We define the value of an assignment , , as the probability that the above test passes. The following expression gives the value of this assignment ,
By Proposition 12, this expression equals if and only if , and otherwise. We can rewrite this expression according to the representations ,
| (4) | |||
| (5) | |||
| (6) |
Term (4) is a constant between any two layers. As for term (5), we prove that they can be used to decode a valid assignment to any pair of layers unless they are negligible along a random path . Finally, for term (6), we use [5] as a black box and show they are negligible along a random path .
4.2.1 Bounding expressions in (5)
We now bound the term (5). Using , we have (5) is at most
We argue that if this expression is large, then a decoding strategy exists for the Label Cover instance. We need the following simple lemma.
Lemma 15.
Let be any folded function, is a representation of . Define . Let for and , then for all with .
Proof.
By definition, we have
If satisfies , then is a complex number. Therefore, there always exists a such that and . Furthermore, such since for any element , and , indicating that . Hence, by Proposition 10,
We now prove the following main lemma from this section.
Lemma 16.
If the Layered Label Cover instance is at most satisfiable, then for any such that ,
| (7) |
Proof.
Consider two layers and whose alphabets are and and an edge constraint such that and . Let denote the projection constraint on . Let , and . With these notations, we have
where . Thus, the inner expectation can be written as
Denote
we have
where are the tuples and . Similarly, are tuples and . Then,
| (8) | ||||
| (9) |
We argue that to make this expression non-zero. Suppose that there exists a such that for all , , then the product of all such must be 1 dimensional. According to Proposition 9, the expectation is unless is also 1 dimensional and isomorphic to the product of . However, for an , if for all , then the product of belongs to and is not isomorphic to . Therefore, for the expectation to be non-zero, there exists some such that , indicating .
Define a function , and note that
| (10) |
where the last equality follows from the fact that the sum expression is exactly the norm of the -th row of the representation . Since is unitary, the norm of its row is always . Using the function , we further simplify the expectation as follows.
By Proposition 9, the expectation is unless , and . Hence, we have
Thus, we can express as,
In addition, Lemma 15 indicates that and are non-empty. Therefore,
where in the last expression we break the summation based on .
If (7) is not true, then we have
where . We will later show that that . Assuming this, we have
We now show how to come up with a decoding strategy based on the above lower bound.
Bounding the term.
Next, we argue that if is large, then we can decode an assignment to the Label Cover instance . We first simplify the expression,
The second term is bounded by as
| (Using Equation (10) | |||
Based on the above bound, the term is upper bounded by
Since for such that , and the index varies over the dimension of ,
Now, we can present the decoding strategy for a typical edge :
Decoding strategy.
-
1.
For each , consider a function , sample a with probability and select a random coordinate s.t. . If there is no such , then return .
-
2.
For each , consider a function , sample an with probability and select a random coordinate s.t. . If there is no such , then return .
For such that , are nonempty and , the strategy will succeed with probability at least . This is because for any label returned by player , the condition guarantees that there exists a such that , and the player returns this with probability . Therefore, the expected value of the labeling returned by the strategy is given by
| (Cauchy-Schwarz inequality) |
We set so that , which contradicts that hardness of Label Cover. Therefore, for any two layers in , and hence
Bounding the term.
It remains to bound . We divide the term into two parts for such that .
We denote the first term by and the second term by . We bound these terms separately.
Bounding .
Starting with the simplified expression for , we have
We now simplify the expectation over . Recall that the function . We now express the Fourier coefficient of in terms of the Fourier coefficient of . By the Fourier inversion formula,
| (Using homomorphism of ) | ||||
As the Fourier expansion is unique, we have . Using this, we have
Now, we are in the setting when but . Hence, the number of dimension representations in is upper bounded by . Thus, there are at least coordinates such that and . For each such we can apply the following claim.
Claim 17.
For such that , we have for some .
Proof.
We refer the reader to the full version of the paper for the proof.
When and , the above claim gives
Correspondingly, we have
Plugging this upper bound, we get
Applying the Cauchy-Schwarz inequality,
Using the fact that and vary over the dimension of , which is at most , the first term is at most,
Similarly, the second term is
| (Using Equation (10) | |||
Therefore, we have,
We verify that a setting of satisfies :
Bounding .
We use the same high-degree argument as in the proof of the [4, Claim 4.5].
Claim 18.
For every edge , and , we have
Proof.
We refer the reader to the full version of the paper for the proof of this claim.
Finishing the proof.
Using these bounds, we have,
as required. Therefore, the term (5) collectively can be upper bounded by .
4.2.2 Bounding expressions in (6)
The analysis for representations with shares structural similarities with the proof of Max-3LIN over non-abelian groups in [4]. However, our setting introduces additional noise terms and that must be carefully handled. We provide a high-level proof outline here and defer the exhaustive algebraic expansion to the full version of the paper. The core of the bound relies on the following lemma:
Lemma 19.
Let . If the Layered Label Cover instance is at most -satisfiable, then
Proof Sketch.
The analysis for representations with is structurally similar to the analysis in [5]. By fixing a noise vector , we can follow the approach in [5]. we introduce a threshold parameter to divide the remaining summation into a low-degree component () and a high-degree component (), based on whether the number of dimensions in the representation is strictly less than or at least . See the full version of the paper for the actual proof.
By summing the result of Lemma 19 over all representations with and all , the total contribution to the expectation is at most .
References
- [1] Sanjeev Arora, Carsten Lund, Rajeev Motwani, Madhu Sudan, and Mario Szegedy. Proof verification and the hardness of approximation problems. Journal of the ACM (JACM), 45(3):501–555, 1998. doi:10.1145/278298.278306.
- [2] Sanjeev Arora and Shmuel Safra. Probabilistic checking of proofs: A new characterization of NP. Journal of the ACM (JACM), 45(1):70–122, 1998. doi:10.1145/273865.273901.
- [3] Per Austrin and Elchanan Mossel. Approximation resistant predicates from pairwise independence. Computational Complexity, 18(2):249–271, 2009. doi:10.1007/s00037-009-0272-6.
- [4] Amey Bhangale and Subhash Khot. Optimal inapproximability of satisfiable k-lin over non-abelian groups. In Samir Khuller and Virginia Vassilevska Williams, editors, STOC ’21: 53rd Annual ACM SIGACT Symposium on Theory of Computing, Virtual Event, Italy, June 21-25, 2021, pages 1615–1628. ACM, 2021. doi:10.1145/3406325.3451003.
- [5] Amey Bhangale and Subhash Khot. Optimal inapproximability of satisfiable k-LIN over non-abelian groups. (updated paper), 2026.
- [6] Amey Bhangale, Subhash Khot, and Dor Minzer. On Approximability of Satisfiable k-CSPs: I. In 54th Annual Symposium on Theory of Computing (STOC’22), pages 976–988, New York, NY, USA, 2022. ACM. doi:10.1145/3519935.3520028.
- [7] Amey Bhangale, Subhash Khot, and Dor Minzer. On Approximability of Satisfiable K-CSPs: II. In 55th Annual Symposium on Theory of Computing (STOC’23), pages 632–642, New York, NY, USA, 2023. ACM. doi:10.1145/3564246.3585120.
- [8] Amey Bhangale, Subhash Khot, and Dor Minzer. On approximability of satisfiable k-csps: Iv. In 56th Annual Symposium on Theory of Computing (STOC’24), pages 1423–1434, New York, NY, USA, 2024. ACM. doi:10.1145/3618260.3649610.
- [9] Amey Bhangale, Subhash Khot, and Dor Minzer. On approximability of satisfiable k-csps: V, 2025. doi:10.1145/3717823.3718127.
- [10] Mark Braverman, Subhash Khot, and Dor Minzer. On rich 2-to-1 games. In James R. Lee, editor, 12th Innovations in Theoretical Computer Science Conference, ITCS 2021, Virtual Conference, January 6-8, 2021, LIPIcs, pages 27:1–27:20. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.ITCS.2021.27.
- [11] Andrei A. Bulatov. A dichotomy theorem for nonuniform csps. In 58th Annual Symposium on Foundations of Computer Science (FOCS’17), pages 319–330, Piscataway, NJ, USA, 2017. IEEE. doi:10.1109/FOCS.2017.37.
- [12] Siu On Chan. Approximation resistance from pairwise-independent subgroups. Journal of the ACM (JACM), 63(3):1–32, 2016. doi:10.1145/2873054.
- [13] Arkadev Chattopadhyay and Avi Wigderson. Linear Systems over Composite Moduli . In 50th Annual Symposium on Foundations of Computer Science (FOCS’09), Los Alamitos, CA, USA, October 2009. IEEE. doi:10.1109/FOCS.2009.17.
- [14] Irit Dinur and Venkatesan Guruswami. PCPs via low-degree long code and hardness for constrained hypergraph coloring. In 54th Annual Symposium on Foundations of Computer Science (FOCS’13), pages 340–349, Piscataway, NJ, USA, 2013. IEEE. doi:10.1109/FOCS.2013.44.
- [15] Irit Dinur, Venkatesan Guruswami, Subhash Khot, and Oded Regev. A new multilayered pcp and the hardness of hypergraph vertex cover. In Proceedings of the Thirty-Fifth Annual ACM Symposium on Theory of Computing, STOC ’03, pages 595–601, New York, NY, USA, 2003. Association for Computing Machinery. doi:10.1145/780542.780629.
- [16] Lars Engebretsen, Jonas Holmerin, and Alexander Russell. Inapproximability results for equations over finite groups. Theoretical Computer Science, 312(1):17–45, 2004. doi:10.1016/S0304-3975(03)00401-8.
- [17] Tomás Feder and Moshe Y. Vardi. Monotone monadic SNP and constraint satisfaction. In S. Rao Kosaraju, David S. Johnson, and Alok Aggarwal, editors, Proceedings of the Twenty-Fifth Annual ACM Symposium on Theory of Computing, May 16-18, 1993, San Diego, CA, USA, pages 612–622. ACM, 1993. doi:10.1145/167088.167245.
- [18] Tomás Feder and Moshe Y Vardi. The computational structure of monotone monadic snp and constraint satisfaction: A study through datalog and group theory. SIAM Journal on Computing, 28(1):57–104, 1998. doi:10.1137/S0097539794266766.
- [19] Uriel Feige, Shafi Goldwasser, Laszlo Lovász, Shmuel Safra, and Mario Szegedy. Interactive proofs and the hardness of approximating cliques. Journal of the ACM (JACM), 43(2):268–292, 1996. doi:10.1145/226643.226652.
- [20] Michel X. Goemans and David P. Williamson. Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. Journal of the ACM (JACM), 42(6):1115–1145, 1995. doi:10.1145/227683.227684.
- [21] Mikael Goldmann and Alexander Russell. The complexity of solving equations over finite groups. Information and Computation, 178(1):253–262, 2002. doi:10.1006/inco.2002.3173.
- [22] Venkatesan Guruswami, Johan Hastad, and Madhu Sudan. Hardness of approximate hypergraph coloring. SIAM Journal on Computing, 31(6):1663–1686, 2002. doi:10.1137/S0097539700377165.
- [23] Venkatesan Guruswami, Johan Håstad, Rajsekar Manokaran, Prasad Raghavendra, and Moses Charikar. Beating the random ordering is hard: Every ordering csp is approximation resistant. SIAM Journal on Computing, 40(3):878–914, 2011. doi:10.1137/090756144.
- [24] Johan Håstad. Some optimal inapproximability results. Journal of the ACM (JACM), 48(4):798–859, 2001. doi:10.1145/502090.502098.
- [25] Johan Håstad. Satisfying degree- equations over . Theory of Computing, 9(27):845–862, 2013. doi:10.4086/toc.2013.v009a027.
- [26] Johan Håstad. On the np-hardness of max-not-2. SIAM Journal on Computing, 43(1):179–193, 2014. doi:10.1137/120882718.
- [27] Subhash Khot. Hardness results for approximate hypergraph coloring. In 34th Annual Symposium on Theory of Computing (STOC’02), pages 351–359, New York, NY, USA, 2002. ACM. doi:10.1145/509907.509962.
- [28] Subhash Khot. Hardness results for coloring 3 -colorable 3 -uniform hypergraphs. In 43rd Annual Symposium on Foundations of Computer Science (FOCS’02), pages 23–32, Piscataway, NJ, USA, 2002. IEEE. doi:10.1109/SFCS.2002.1181879.
- [29] Subhash Khot. On the power of unique 2-prover 1-round games. In 34th Annual Symposium on Theory of Computing (STOC’02), pages 767–775, New York, NY, USA, 2002. ACM, ACM. doi:10.1145/509907.510017.
- [30] Subhash Khot, Guy Kindler, Elchanan Mossel, and Ryan O’Donnell. Optimal inapproximability results for max-cut and other 2-variable csps? SIAM Journal on Computing, 37(1):319–357, 2007. doi:10.1137/S0097539705447372.
- [31] Subhash Khot and Muli Safra. A two-prover one-round game with strong soundness. Theory of Computing, 9:863–887, 2013. doi:10.4086/toc.2013.v009a028.
- [32] Ryan O’Donnell. Analysis of boolean functions. Cambridge University Press, USA, 2014. doi:10.1017/CBO9781139814782.
- [33] Prasad Raghavendra. Approximating np-hard problems efficient algorithms and their limits. PhD thesis, University of Washington, Seattle, WA, USA, 2009. AAI3377316. doi:10.5555/1751149.
- [34] Ran Raz. A parallel repetition theorem. SIAM Journal on Computing, 27(3):763–803, 1998. doi:10.1137/S0097539795280895.
- [35] Alex Samorodnitsky and Luca Trevisan. A pcp characterization of np with optimal amortized query complexity. In 32nd Annual Symposium on Theory of Computing (STOC’00), pages 191–199, New York, NY, USA, 2000. ACM. doi:10.1145/335305.335329.
- [36] Thomas J. Schaefer. The complexity of satisfiability problems. In 10th Annual Symposium on Theory of Computing (STOC’78), pages 216–226, New York, NY, USA, 1978. ACM. doi:10.1145/800133.804350.
- [37] Audrey Terras. Fourier analysis on finite groups and applications. Cambridge University Press, USA, 1999. doi:10.1017/CBO9780511626265.
- [38] Dmitriy Zhuk. A proof of the csp dichotomy conjecture. Journal of the ACM (JACM), 67(5), August 2020. doi:10.1145/3402029.
