Lower Bounds and Separations for Torus Polynomials
Abstract
The class consists of Boolean functions that can be computed by constant-depth circuits of polynomial size with and gates, where is a natural number. At the frontier of our understanding lies a widely believed conjecture asserting that does not belong to .
A few years ago, Bhrushundi, Hosseini, Lovett and Rao (ITCS 2019) introduced torus polynomial approximations as an approach towards this conjecture. Torus polynomials approximate Boolean functions when the fractional part of their value on Boolean points is close to half the value of the function. They reduced the conjecture that to a conjecture concerning the non-existence of low degree torus polynomials that approximate .
We reduce the non-existence problem further, to a statement about finding feasible solutions for an infinite family of linear programs. The main advantage of this statement is that it allows for incremental progress, which means finding feasible solutions for successively larger collections of these programs. As an immediate first step, we find feasible solutions for a large class of these linear programs, leaving only a finite set for further consideration. Our method is inspired by the method of dual polynomials, which is used to study the approximate degree of Boolean functions. Using our method, we also propose a way to progress further.
We prove several additional key results with the same method, which include:
-
A lower bound on the degree of symmetric torus polynomials that approximate the function. As a consequence, we get a separation that symmetric torus polynomials are weaker than their asymmetric counterparts.
-
An error-degree trade-off for symmetric torus polynomials approximating the function, strengthening the corresponding result of Bhrushundi, Hosseini, Lovett and Rao (ITCS 2019).
-
The first lower bounds against torus polynomials approximating , showcasing the power of the machinery we develop. This lower bound nearly matches the corresponding upper bound. Hence, we get an almost complete characterization of the torus polynomial approximation degree of .
-
Lower bounds against asymmetric torus polynomials approximating , or , in the very low error regime. This partially answers a question posed in Bhrushundi, Hosseini, Lovett and Rao (ITCS 2019) about error-reduction for torus polynomials.
Keywords and phrases:
Circuit complexity, ACC, lower bounds, polynomialsCopyright and License:
2012 ACM Subject Classification:
Theory of computation Circuit complexityAcknowledgements:
We thank Shachar Lovett for helpful feedback on an earlier draft. We also thank anonymous referees for their detailed feedback.Editor:
Shubhangi SarafSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Proving that an explicit function is not contained in a complexity class is the prime focus of complexity theorists, and such questions make up some of the hardest problems in computer science. We study such a question at the frontier of our knowledge about Boolean circuit complexity classes. To state the question, we first need to define the class of Boolean circuits we consider.
Denote by the class of constant-depth Boolean circuits of polynomial size comprising , and gates. A gate outputs if and only if the count of s in the input is divisible by . Nearly 35 years ago, Barrington [2] conjectured that does not contain . Here, outputs if and only if the number of s is at least half of the total number of inputs. This conjecture has remained unresolved since.
Conjecture 1 (Barrington’s conjecture [2]).
.
The objective of the conjecture is to prove that a particular circuit class cannot compute a certain function. In the literature, this task is referred to as proving lower bounds against that class. We outline a few major approaches that have led to Boolean circuit lower bounds in the past.
One of the approaches is based on “simplification”, and the probabilistic method, for example: using random restrictions. This is a classical technique, developed for studying various complexity classes, such as , the class of constant-depth circuits comprising and gates. A classic example is the landmark result of Håstad [15], who proved that circuits simplify when a significant fraction of the input variables are assigned values randomly. It is easy to see that the parity function does not undergo such simplification. The author formalized this intuition to prove nearly optimal lower bounds against circuits. However, random restrictions do not seem useful for lower bounds against , as it contains the parity function.
Another approach is to use the satisfiability algorithms–to–lower bounds connection, to prove lower bounds from high complexity classes such as . Williams [25] developed this approach in a groundbreaking work, and used it to prove that is not contained in . Subsequent works [13, 20, 9, 12, 10] have considerably strengthened this connection. In particular, Murray and Williams [20] have proved that is not contained in , improving the lower bound. However, it is not clear how to use this method to prove that an easily computable function, such as , is not contained in .
This leads us toward another classical approach, based on the polynomial method. In this framework, researchers study various notions of representing Boolean functions using polynomials. This framework is quite powerful, and has numerous applications across theoretical computer science, see Aaronson’s survey [1] for an interesting and insightful account. We describe two notions of polynomial representations that have found uses in the study of Boolean circuits.
The first notion, called real polynomial approximation, uses polynomials over the reals to approximate Boolean functions pointwise. Nisan and Szegedy [21], in a seminal work, studied this model, and proved its connections with other natural computational models, such as decision trees. Their work provided considerable impetus to the study of real polynomial approximations, and firmly established their use in mainstream complexity theory. Today, the study of real polynomial approximations is a subfield by itself, with well-developed techniques for lower bounds and upper bounds, and numerous applications. See Bun and Thaler’s survey [8] for a comprehensive discussion of real polynomial approximations.
The second notion of polynomial approximation, called probabilistic polynomials, uses a distribution of polynomials over a finite field. On any Boolean point, a polynomial from the distribution should match the value of the given function with “high” probability. Razborov [23], and Smolensky [24], pioneered the use of this model in independent works. Consider any function computable by constant-depth circuits of polynomial size with and gates, for a prime . The authors, independently, proved that there exists a distribution of “low” degree polynomial over that matches with “high” probability. They also proved that the same does not hold for , or for a prime , leading to a lower bound.
Broadly speaking, in order to prove that a function is not contained in a class , the theme here is to find a distinguisher. A distinguisher is a function that maps to a point outside the image of under , proving . That is, proving implies . For example, in [23, 24], the degree of the probabilistic polynomial acts as the distinguisher. This degree is low for functions in , while requires large degree, hence the lower bound .
The models of polynomial approximation defined above do not seem to give a distinguisher against . For example, circuits can use , which requires large degree in either model. In fact, for a long time, there were no polynomial method based approaches known for proving lower bounds.
Then, in a pivotal work few years ago, Bhrushundi, Hosseini, Lovett and Rao [4] made an inspired suggestion of using the degree of torus polynomials as a distinguisher towards the vs question. Torus polynomials approximate a Boolean function if their fractional part is close to 111 and have the same fractional part. Dividing by makes the fractional parts different.. They proved that torus polynomial approximations extend both real polynomial approximations and approximation using probabilistic polynomials (see [4, Lemma 14]). In fact, torus polynomials are more powerful, they can efficiently approximate for any . We define this model below, rephrasing [4, Definition 1].
Definition 2 (Torus Polynomial Approximation [4]).
Consider a Boolean function , a polynomial (we assume that is multilinear without losing generality) and a real number . is a torus polynomial that -approximates , if the following holds:
There exists a function , such that for any Boolean point , we have . In other words, the fractional part of is within of .
Denote the minimum degree of such a polynomial by .
Given any function , consider the unique polynomial that exactly matches on all Boolean points222The existence of such a polynomial is folklore.. This would require degree for most functions, with zero error of approximation. Naturally, the question is, for which functions can we construct a torus polynomial of much smaller degree, say , that -approximate , for example. In [4, Corollary 20], the authors proved that something similar holds for all functions in .
Theorem 3 ([4]).
Consider any function such that . Then, for any .
Hence, proving that the same does not hold for the majority function would prove is not contained in . This is precisely the goal of our work in this paper. While we could not take this task to completion, we do make progress towards it. Before discussing our contributions, we discuss previous work related to as well as torus polynomials.
1.1 Previous Work
Various works in the 90’s had proved conversion results for , with the purpose of proving lower bounds. For example, strengthening the results from [26, 3], Green, Köbler, Regan, Schwentick and Torán [14] proved that all functions have circuits computing them. Here, is the class of depth-two circuits, with gates at the bottom and a gate333A outputs the middle bit from the binary expansion of the number of s, with a fixed tie-breaking choice. at the top. The authors proposed to prove lower bounds against as an approach to prove lower bounds. They argued that the simpler structure of circuits might make it easier to prove lower bounds.
Along similar lines, by combining [16, 22], one gets a communication complexity based approach. These works together imply that lower bounds against the number-on-forehead communication model lead to lower bounds. However, lower bounds against this communication model also imply lower bounds. Hence, logically speaking, lower bounds against are an easier route to lower bounds.
In Krishan [17], the author proved that functions with low degree torus polynomial approximations belong to . Hence, one can argue that lower bounds against torus polynomials is an even more refined approach for lower bounds. Moreover, Chen, Lu, Lyu and Oliveira [11] proved that lower bounds against torus polynomials lead to average-case lower bounds, and pseudorandom generators, against . Both of these are major open questions, which gives us a further impetus for proving lower bounds against torus polynomials.
In [4], the authors introduced torus polynomials with the goal of proving that does not belong to . Now, is a symmetric function, as its value only depends on the number of s in the input. Hence, it is natural to study symmetric444A polynomial is symmetric if it is invariant under permutation of its variables. torus polynomials that approximate as the first step. The authors used a counting-based argument to prove the following lower bound.
Theorem 4 (Corollary 23 of [4]).
Any symmetric torus polynomial, that -approximates , must have degree .
Now, a priori, this does not resolve Barrington’s conjecture, it needs an analogous statement for asymmetric torus polynomials. Indeed, in [4, Conjecture 5], the authors conjectured that Theorem 4 holds for asymmetric torus polynomials.
Conjecture 5 ([4]).
Any torus polynomial, that -approximates , must have degree .
This conjecture, if true, proves Barrington’s conjecture. Moreover, it will separate from , improving our knowledge well beyond what is currently known.
1.2 Our Results
The main goal of our work is to resolve Conjecture 5. Towards this end, we outline a plan of attack in Section 3. A major contribution of this paper is a reduction of Conjecture 5 to a statement that allows for incremental progress.
Fix and , and suppose the goal is to prove the following: Any torus polynomial that -approximates over variables must have degree more than . Informally stated, we define a vector space of dimension , a vector of dimension , and conjecture that for any vector , there is a such that:
The vector has a very simple structure, it encodes the function for which we wish to prove the lower bound, say . See Theorem 8 for an exact statement. Incremental progress would mean proving the statement for larger and larger subsets of .
We take the first steps in this direction by first bounding the entries in , see Theorem 11. This immediately leaves us with only a finite subset of for which we need to argue further. Then, in Theorem 12, we take another step by showing that a few entries in determine the other entries.
We demonstrate the power of our method by proving a lower bound against torus polynomials approximating . No lower bounds were known for asymmetric torus polynomials prior to our work, and the lower bound we prove is only quadratically away from the corresponding upper bound for inverse-polynomial error. Following is the formal statement of the result.
Theorem 6.
Any torus polynomial, that -approximates , must have degree .
The result above also holds for , but it does not suffice to prove , which requires a lower bound of the form for some inverse-polynomial error. Further, as a special case of the result above, we study the case when is exponentially small. We show that requires full degree in this regime, and so does . In [4, Problem 6], the authors ask about error-reduction for torus polynomials. The full-degree lower bound allows us to conditionally answer this question for a particular error-regime, which we discuss in Subsection 4.1.
Our method also applies to symmetric torus polynomials, which we use to prove a much stronger lower bound against symmetric torus polynomials approximating . This lower bound matches the lower bound from [4, Corollary 23] (refer to Theorem 4), but for , rather than . Note that no such lower bound was known for before our work, and it matches the corresponding upper bound, barring some log factors. We state the result below.
Theorem 7.
Any symmetric torus polynomial, that -approximates , must have degree .
The lower bound for symmetric torus polynomials is higher than the upper bound for asymmetric torus polynomials approximating . Hence, as a corollary, we prove that symmetric torus polynomials are weaker than their asymmetric counterparts, see Corollary 23. Moreover, this shows that a symmetrization based approach is unlikely to work for Conjecture 5.
We also strengthen [4, Corollary 23], and prove stronger degree lower bounds for smaller error. If one follows the proof of [4, Corollary 23], for symmetric torus polynomials that -approximate , the lower bound remains the same, i.e. . We are able to prove as the lower bound in this case, strictly improving the degree, albeit by a log factor. In fact, we are able to prove an error-degree trade-off, see Theorem 28 for the exact statement.
Our Method
We use a linear programming based approach to prove our lower bound results. This approach, based on duality in linear programs, allows us to find a witness that certifies the non-existence of a torus polynomial approximation. We describe a broad outline of the method below.
Consider a torus polynomial , of degree at most , that -approximates . Then, there exists some integer function , such that is at most away from for any . For each , we can write as a particular linear combination of its coefficients, hence, the condition above is a linear constraint. Here, we make a crucial choice, with respect to how we treat . If we treat each as an integer-valued variable, we get a system of linear Diophantine inequalities, that are much harder to handle. Instead, we treat each as an indeterminate, and write one linear program for each possible function .
Thereby, we get an infinite family of linear programs, such that exists if and only if some program from the family is feasible. Hence, to prove that does not exist, we need to prove that each program is infeasible, for which we look at the dual of these programs. Using strong duality in linear programs, does not exist if and only if each of the dual programs is feasible.
Now, given a function , the dual program we obtain is as follows: For each , and each degree , we have a matrix , comprising the evaluations of all monomials of degree at most on each Boolean point. The set of solutions for the dual program consists of the nullspace of , i.e., vectors such that . Here, is a vector with many real entries, with each entry indexed by a Boolean point . A vector is a feasible solution for the dual, if it satisfies . For a detailed explanation on how we obtain the dual, please refer to Theorem 8.
With this method, our plan to prove Conjecture 5 is as follows. Fix , and any , with and . For any function , we plan to find a feasible solution for the dual corresponding to . To start, we find such a feasible solution if exceeds an upper bound for any , where the upper bound depends on . Then, we show how to infer the values of for each with Hamming weight , when all for are fixed. In other words, if does not take the inferred value for some , we find a feasible solution for the dual corresponding to . We propose to continue this plan further, by finding more feasible solutions to incrementally rule out all possible s.
Our method shares some similarities to how dual polynomials are used to prove lower bounds for real polynomial approximations. Each vector in the nullspace of is in fact a dual polynomial, with pure high-degree more than . We use a geometric perspective, as we find it more useful, especially for our lower bound results.
Organization
We discuss some preliminaries, and a general method for proving torus polynomial lower bounds, in Section 2. Based on this method, we propose a plan to prove Conjecture 5 in Section 3. Our lower bound results for asymmetric torus polynomials appear in Section 4. Finally, we prove lower bounds for symmetric torus polynomials in Section 5.
2 Preliminaries
We consider natural numbers without including , and denote it by . For and , we use the following notation for brevity:
2.1 Sets and Boolean Points
We identify with in the natural way, as follows. For , the corresponding Boolean point has a at position if and only if is present in . This defines a bijection between and . Using this bijection, we will often interpret a set as a Boolean point, and a Boolean point as a set, making the interpretation explicit wherever it is not clear from the context. denotes the Hamming weight of , which also equals its size when considered as a set.
2.2 Linear Algebra
Over the reals , we denote the set of matrices of size by . For a matrix , we denote its nullspace by . For a vector , we denote its -norm by . Of particular interest to us are the -norm and the -norm, defined for respectively. We will also consider the -norm, defined as .
2.3 Our Method for Torus Polynomial Lower Bounds
Now, we describe a general method for proving lower bounds on torus polynomial approximations. Fix and , such that . Also, fix a Boolean function , and an error of approximation . We start by defining a family of set-inclusion matrices that will be relevant for the method. For each monomial of degree at most over variables, the matrix contains one row, and the row encodes the evaluation of the monomial over all Boolean points.
Construction 1.
Define the matrix of size as follows. Its rows are indexed by elements of , and columns by elements of . The entries for are:
Here, is an indicator function, evaluating to if , and zero otherwise.
In the following statement, we convert the question of torus polynomial lower bounds to an existence based question.
Theorem 8.
The following are equivalent for any such that , and :
-
Any torus polynomial that -approximates has degree more than .
-
For any , there exists a vector , such that:
We do not present the proof here, as it is very similar to the method of dual polynomials (see [8] or refer to the full version for a proof).
3 Plan for Majority
In this section, we set up a program towards proving Conjecture 5. Fix the function for this section , some large enough , any , and . Call a function good, if there is a witness such that:
In other words, is good, if we can prove that the dual corresponding to is feasible. Conjecture 5 posits that all s are good. In this language, the lower bound result by Bhrushundi, Hosseini, Lovett and Rao [4, Corollary 3.3] states that all symmetric s are good.
Now, the challenge is that we need to argue about infinitely many s, and find a feasible solution from the vector space , which is also infinite. The latter is easy to fix using the theory of linear programming, as we can choose from the set of basic solutions, which is a finite set. Therefore, we focus on the set of good s, and show that it is cofinite. In other words, we show that all s, except for a finite set, are good.
Towards this goal, we first make an observation that allows us to consider s as functions over a smaller domain. Consider two functions and , such that . Then, equals for any . Hence, if is good, then any such that is also good. Therefore, define the relation if , which is an equivalence relation. We can pick a representative from each equivalence class of the relation, and it suffices to prove that the representative is good. The following statement formalizes this intuition.
Lemma 9.
Consider a polynomial of degree at most . Then, there exists a polynomial of degree at most , satisfying the following conditions:
-
If -approximates , then also -approximates .
-
If denotes the integer part of , then for any with .
The proof is based on a simple inductive argument, which we present in the full version. Henceforth, we will always assume that for any with . Now, we begin the task of proving that certain s are good. We will produce the vectors we need for this task using the following construction, which is only a minor generalization of the construction from [7].
Construction 2.
Construct a vector as follows.
- Input:
-
-
two natural numbers and ,
-
two subsets , such that , and ,
-
a set of size .
-
- Output:
-
A vector .
- Construction:
-
First, define a univariate polynomial , where . For any set , if , keep . Otherwise, keep .
Output .
Lemma 10.
Consider any , , such that and , and of size . Then, Construction 2, on input and , outputs a vector .
As the proof is similar to the proof of [8, Lemma 31], we omit it here (refer to the full version for a proof). Using these vectors constructed above, we prove an upper bound on the value of each . In other words, for each we describe an upper bound, such that if violates this bound, then is good. The reader may think of this as an upper bound on an appropriately defined weighted -norm of .
Theorem 11.
Choose a large enough . Consider a torus polynomial , of degree at most , that approximates within an error of . Then, the following holds for any and the function corresponding to :
In other words, if for some , then is good.
The statement above holds for any such that for each , e.g. 555As noted by an anonymous reviewer..
Proof.
Consider a set of size . Construct a ray using Construction 2 with and . The values we need to compare are and . Note that for any with . Hence, . Therefore, if , then is good.
For a set of size , by construction. Then, . Finally, for a set of size , . Note that there are such sets .
Hence, . Dividing by , we get:
This proves the claim as desired.
With the previous result, we have only a finite set of s remaining, that we need to prove are good. We continue with our program of shrinking the set of remaining s. Here, we consider some fixed value of for each with . Then, we show how to uniquely determine the remaining values of . In other words, if does not take the determined value for some , then is good.
Theorem 12.
For any large enough , any , and , the following holds: Fix values of for each point with . Then, consider a point with . For each with , define the following rational number:
If the following holds for any :
Then, is good. Note that all choices of , except for possibly a single choice, lead to a good . In other words, is uniquely determined.
Before we begin the proof, we would like to explain the expression in simple words as it may look complicated at first glance. First, the expression only looks at where belongs to the Hamming sub-cube between and . The expression is simply the average over the Hamming layer at distance below . This average is multiplied with the coefficient to obtain the expression. Now, we begin the proof.
Proof.
Fix a point with , and choose a subset with . Use Construction 10 with , to obtain . We denote the polynomial from the construction by for brevity.
Now, assume that the condition from the statement holds, which is as follows:
| (1) |
Then, we claim that is good, with as the witness, i.e.,
| (2) |
To see why 1 implies 2, consider the following equalities:
| (3) | ||||
| (4) | ||||
| (5) |
Equality 3 follows by expanding the expression. Note that for any with either or , as per the construction of . Hence, equality 4 follows. Finally, we substitute the values of to obtain equality 5.
Now, to calculate the RHS of inequality 2, expand the -norm of as . We divide the expression of the inner-product, as well as the -norm, to modify inequality 2 as:
Note that , hence, dividing by does not change the direction of the inequality. Next, we calculate as follows. Recall the expression for . Hence, we get the following expression for :
The calculation here is similar to the calculation performed in Section 6.1 of [8], following Fact 32 in the survey. Now, we can replace the final expression in the LHS of inequality 2 to get the LHS of inequality 1. Moreover, this calculation allows us to infer the following upper bound on the absolute value of the final ratio, for any :
| (6) |
Hence, we get that for large enough . Therefore, if holds, then is good, with as the witness. This completes the proof.
3.1 Proposed Directions
Finally, we pose the question to extend the set of good s.
Open Problem 1.
Find witnesses to extend the set of good s.
For example, can one find feasible solutions to prove that any with as its range is good?
Open Problem 2.
Prove that any is good.
Such statements will complement Theorem 11, as they will prove lower bounds on the values of . We believe that finding more structure in will help toward these problems. To that effect, we present a simple construction for vectors in , which we could not find in current literature.
Construction 3.
Fix some , such that , and such that . Construct a vector , indexed by , as follows:
If the indexing set has size , then set . Otherwise, for each , check whether . If the check above fails for some , set .
Otherwise, intersects exactly once with each pair . Then, set .
Output .
We claim that the construction above produces a vector . The proof follows by a simple argument, which we do not present.
Lemma 13.
For any and , such that , Construction 3 produces a vector .
Intuitively speaking, the construction above produces a vector with balanced and entries on the given Hamming layer. Hence, it may help with s that are highly unbalanced along the entries of this vector. We leave it open to rule out more s based on this vector.
Open Problem 3.
Use the vector from Construction 3 to extend the set of good s.
4 Lower Bounds for AND
In this section, we prove a lower bound for torus polynomials approximating . We restate the result below.
Theorem 6. [Restated, see original statement.]
Any torus polynomial, that -approximates , must have degree .
We plan to use Theorem 8 to prove this result. In this task, the main challenge is that there are infinitely many choices for , and we need to find a feasible solution for each choice. To make this task easier, we find a vector with integer entries and small -norm. This vector will serve as a feasible solution for any , if it satisfies the conditions that we detail in the next statement.
Lemma 14.
Fix a Boolean function and some . Consider a vector with integer entries, i.e. , such that is an odd integer. Then, for any and , the following holds:
Proof.
Let for some integer . Then, . Fix a function . Then, for some integer . Hence, . Consider the following two cases:
-
. In this case, .
-
. In this case, .
In both the cases, we observe that . Note that by the choice of , we have . This completes the proof.
To use the preceding statement for , we proceed as follows. For a vector , its inner product with is . Hence, we need a vector , such that is odd and is not too large. We find this vector in a basis for , we will find the basis useful later, such that each vector in that basis is integral and has a small enough -norm. One such vector in this basis will have . We present the construction below.
Construction 4.
Construct a matrix as follows.
- Input:
-
.
- Output:
-
A matrix .
- Construction:
-
For any set with , consider its elements in the increasing order . Denote as the set remaining after ignoring the first elements.
Now, create a matrix , of size , and index its rows by elements of and columns by elements of . For and , set the corresponding entry of as . Here, and denote the sets indexing the th row and the th column of , respectively.
Output .
We claim that this construction produces a basis for . A routine calculation proves the correctness of the construction, which we omit here (refer to the full version for a proof).
Claim 15.
Construction 4, on input , outputs a basis for .
We use this basis to prove Theorem 6 as follows.
Proof of Theorem 6.
First, construct using Construction 4, with and as the inputs to the construction. Now, denote by the column of indexed by . Clearly, , hence, is an odd integer. Moreover, . Therefore, if we apply Lemma 14, we get the following lower bound for : any torus polynomial that -approximates the function must have degree more than . This completes the proof.
Remark 16.
Consider the probabilistic polynomial that approximates over with probability , from [23], and combine it with [4, Lemma 14]. Then, one gets the following upper bound on .
Hence, the lower bound we have proved in Theorem 6 is only quadratically away from the upper bound for any .
Although we had infinitely many linear programs to work with, we have only used one vector for proving their feasibility. One could use multiple vectors in , such that for each dual corresponding to , one of these vectors is a feasible solution. By using multiple vectors, we believe that one can get stronger degree lower bounds, bringing it closer to the upper bound. We leave this task as an open problem.
Open Problem 4.
Bridge the gap between the lower and upper bound for the function.
4.1 The Very Small Error Case
The literature on polynomial approximations usually focuses on inverse-polynomial error regime. We study the case where the error is very small, as it allows us to partially answer a question posed in [4, Problem 6]. In [4, Problem 6], the authors ask about the relationship between and . In general, one can ask if there is an error-reduction procedure for torus polynomials. This procedure should take as input , and output an estimate for . Ideally, the output should not depend on , and the estimate should be reasonably close to optimal.
In what follows, we prove that torus polynomials require the same degree to approximate and when the error is very small. Now, if we assume Conjecture 5, then the degree required to -approximate is much smaller than the degree required for . Hence, any error-reduction procedure as described above will produce a suboptimal output if it does not depend on the function being approximated, conditionally answering [4, Problem 6] for the error-regime . Formally, we prove the following result.
Theorem 18.
Depending on the value of , the following cases hold.
-
If , then the following holds for as well as , and infinitely many . Any torus polynomial that -approximates has degree .
-
If , then the following holds for any Boolean function . There exists a torus polynomial of degree at most approximating within an error of . Moreover, if is symmetric, then we can take to be symmetric as well.
We do not prove the statement here (refer to the full version for a proof), as it is a special case of the proof of Theorem 6. The upper bound above only states the existence of torus polynomials approximating Boolean functions for a tiny error. We leave it as an open problem to explicitly construct them.
Open Problem 5.
For and a given function , construct a torus polynomial of degree at most that -approximates .
5 Lower Bounds for the Symmetric Case
In this section, we prove lower bounds against symmetric torus polynomials approximating symmetric functions. To describe the general method, we proceed along the lines of the proof for Theorem 8, with two crucial modifications. The polynomial is symmetric if each monomial of the same degree has the same coefficient, which reduces the number of variables to . Similarly, as the function is symmetric, the number of constraints reduces to . To describe the much shorter linear program we obtain, we first construct the following matrix.
Construction 5.
Define the matrix of size . For , the corresponding entry is .
Now, the analogue of Theorem 8 for symmetric torus polynomials is as follows. Note that we define symmetric functions with as the domain, such that is the output when the input has Hamming weight .
Theorem 19.
The following statements are equivalent for any , , and any symmetric function .
-
Any symmetric torus polynomial that -approximates has degree more than .
-
For any function , there exists a vector such that:
The proof of this statement is very similar to the proof of Theorem 8, which we skip. The challenge here is also similar, having to deal with infinitely many linear programs, and proving that they are all feasible. We proceed similar to the previous section, by choosing a short enough with integer entries, which gives us the following analogue of Lemma 14.
Lemma 20.
Fix a symmetric Boolean function and some . Consider a vector with integer entries, i.e. , such that is an odd integer. Then, for any and , the following holds:
Now, we recall the statement of our main lower bound against symmetric torus polynomial approximations.
Theorem 7. [Restated, see original statement.]
Any symmetric torus polynomial, that -approximates , must have degree .
Proof.
To prove this statement, we claim that for any , contains a vector with -norm . Moreover, the last entry of is . Hence, its inner product with the function is , which is an odd integer. We state the claim formally below.
Claim 21.
For some universal constant , consider any large enough and . Then, contains a vector with and .
Assume, for now, that the claim is true. Then, we have . Further, we get . Finally, we use Lemma 20, using , which we can apply for any . Note that our choice of satisfies this inequality for large enough . This completes the proof.
Remark 22.
Buhrman, Cleve, de Wolf and Zalka [6] proved an upper bound of on the degree of a real polynomial approximating the function within an error of . Note that we can consider this real polynomial, after symmetrizing, as a symmetric torus polynomial approximating the function within an error of . For , this gives an upper bound of on the degree. Hence, the lower bound of we have proved above is tight within logarithmic factors in .
We also get a separation between symmetric torus polynomials and asymmetric torus polynomials as a corollary of Theorem 7.
Corollary 23.
Symmetric torus polynomials are weaker than their asymmetric counterparts.
Proof.
We compare the symmetric torus polynomial lower bound with the upper bound from Lemma 17. Using Lemma 17, we get . On the other hand, symmetric torus polynomials require much higher degree to -approximate . This proves the separation of their power.
We complete the remaining part of the proof for Theorem 7, which is to prove Claim 21. For this purpose, we will need the following statement from [5].
Theorem 24 ([5]).
Consider a full-rank integer matrix of size , with . Then, contains a non-zero vector with its -norm bounded by:
Here, is the GCD of all minors of .
To prove Claim 21 using Theorem 24, we first describe a basis for . We state the construction without proof, omitting tedious calculations.
Lemma 25.
For , and , construct a matrix , of size . Keep the following entry for and : .
Then, the columns of form a basis for .
Now, to apply Theorem 24, we need to estimate . We state the result below without proof, omitting tedious calculations (refer to the full version for a proof).
Lemma 26.
There exists a universal constant such that .
Finally, we need the following statement to find a vector with an odd entry at the desired place. Informally speaking, consider a vector such that . Then, we note that is a column-circulant matrix, with s beyond the two main diagonals. Hence, we can shift to obtain such that contains the last non-zero entry of . We formalize this in the statement below, stated without proof.
Lemma 27.
Consider a vector such that the maximum index where is . Define the following vector :
Then, .
Now, we are ready to prove Claim 21, as follows.
Proof of Claim 21.
First, choose any . Then, apply Theorem 24 for with as its basis. Note that contains a minor, of size , with value . Hence, we get when we apply Theorem 24. Therefore, there exists a non-zero vector with . As must be a positive integer, and , this shows that .
Now, if , then, either or satisfies the claimed conditions. Otherwise, if , use Lemma 27 to obtain from . Note that , and . Hence, we get the desired lower bound using . This completes the proof of the claim.
5.1 Error-Degree Trade-off
The lower bound described in Theorem 7 applies to a particular error. It is natural to attempt to prove a stronger lower bound for a tighter error. Indeed, we are able to prove stronger lower bounds for tighter errors, but for . This significantly strengthens the lower bound from [4, Corollary 23]. Following is the statement of the lower bound.
Theorem 28.
Fix , . For any , any symmetric torus polynomial that -approximates has degree at least .
To prove this statement, we plan to use Minkowski’s Theorem on the length of shortest vectors in a lattice. Following is the version we need.
Lemma 29 (Minkowski’s Theorem [19]).
Consider a full-rank integer matrix of size , with . Then, the lattice contains a vector with
We plan to produce short vectors using Minkowski’s Theorem, and then invoke Lemma 20 to argue the lower bound. Toward this, we need to argue that should be odd for a short vector which, unfortunately, we could not prove. We prove the lower bound indirectly, by looking at a wider class of symmetric functions. The function is defined as follows: if and only if . We obtain the following lower bound for these functions.
Lemma 30.
For any large enough , there exists a , such that the following holds:
Any symmetric torus polynomial that -approximates the function over variables, for , must have degree .
Proof.
We start by appealing to Minkowski’s theorem (Lemma 29).
Say for some , and denote . We use Lemma 26, together with Minkowski’s theorem, to get that there exists a non-zero vector with . We want to choose a , and prove the lower bound with respect to that . Hence, we need to find a such that is odd.
Consider a non-zero vector with the smallest -norm. At least one of the entries of must be odd. Otherwise, if they are all even, then has strictly smaller -norm. The containment follows, because is a vector space, and has integral entries. This is a contradiction.
This still does not tell us which entry of will be odd. Hence, it is still not clear which we should choose. Note that we have to choose to write the family of linear programs, all of them must use the same function . To make our life easy, we turn the problem over its head.
We notice that we just need to choose independent of , but it can depend on . Hence, as the vector with the smallest -norm depends only on , we can choose based on . This is exactly what we do, we choose such that is odd. Note that at least one such must exist, we pick one of them arbitrarily. This completes the proof of the statement.
Now, we apply a trick employed in the proof of [4, Corollary 23]. We describe it below without proof, as it is very similar to [4, Lemma 22].
Lemma 31.
For any , , and large enough , the following holds: If there exists a symmetric torus polynomial of degree that -approximates , then for any , there exists a symmetric torus polynomial of degree that -approximates .
Now, we can finish the proof of Theorem 28 as follows.
Proof of Theorem 28.
For some , consider . Assume that there exists a symmetric torus polynomial that -approximates with degree . Then, for each , there exists a symmetric torus polynomial that -approximates . Moreover, each of these polynomials have degree . This contradicts Lemma 30, completing the proof of the theorem.
To us, it is a bit unsatisfactory that we cannot prove this lower bound for . Note that the main hurdle for us is not knowing which entry of is odd. If we can prove that is odd, then the lower bound goes through for . Hence, we state a conjecture that will prove the error-degree trade-off for as well. In fact, we believe that the following holds, which is stronger than what we need.
Conjecture 32.
For any , there is a vector with the smallest -norm and .
References
- [1] Scott Aaronson. The Polynomial Method in Quantum and Classical Computing. In 49th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2008, Philadelphia, PA, USA, October 25-28, 2008, page 3. IEEE, IEEE Computer Society, 2008. doi:10.1109/FOCS.2008.91.
- [2] David A. Mix Barrington. Bounded-Width Polynomial-Size Branching Programs Recognize Exactly Those Languages in NC1. J. Comput. Syst. Sci., 38(1):150–164, 1989. doi:10.1016/0022-0000(89)90037-8.
- [3] Richard Beigel and Jun Tarui. On ACC. Comput. Complex., 4:350–366, 1994. doi:10.1007/BF01263423.
- [4] Abhishek Bhrushundi, Kaave Hosseini, Shachar Lovett, and Sankeerth Rao. Torus Polynomials: An Algebraic Approach to ACC Lower Bounds. In Avrim Blum, editor, 10th Innovations in Theoretical Computer Science Conference, ITCS 2019, January 10-12, 2019, San Diego, California, USA, volume 124 of LIPIcs, pages 13:1–13:16. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2019. doi:10.4230/LIPIcs.ITCS.2019.13.
- [5] Enrico Bombieri and Jeffrey D. Vaaler. On Siegel’s lemma. Inventiones mathematicae, 73:11–32, 1983. URL: https://api.semanticscholar.org/CorpusID:121274024.
- [6] Harry Buhrman, Richard Cleve, Ronald de Wolf, and Christof Zalka. Bounds for Small-Error and Zero-Error Quantum Algorithms. In 40th Annual Symposium on Foundations of Computer Science, FOCS 1999, New York, NY, USA, October 17-18, 1999, pages 358–368. IEEE, IEEE Computer Society, 1999. doi:10.1109/SFFCS.1999.814607.
- [7] Mark Bun and Justin Thaler. Dual lower bounds for approximate degree and Markov-Bernstein inequalities. Inf. Comput., 243:2–25, 2015. doi:10.1016/j.ic.2014.12.003.
- [8] Mark Bun and Justin Thaler. Approximate Degree in Classical and Quantum Computing. Found. Trends Theor. Comput. Sci., 15(3-4):229–423, 2022. doi:10.1561/0400000107.
- [9] Lijie Chen. Non-deterministic Quasi-Polynomial Time is Average-Case Hard for ACC Circuits. In David Zuckerman, editor, 60th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2019, Baltimore, Maryland, USA, November 9-12, 2019, pages 1281–1304. IEEE, IEEE Computer Society, 2019. doi:10.1109/FOCS.2019.00079.
- [10] Lijie Chen. New Lower Bounds and Derandomization for ACC, and a Derandomization-Centric View on the Algorithmic Method. In Yael Tauman Kalai, editor, 14th Innovations in Theoretical Computer Science Conference, ITCS 2023, January 10-13, 2023, MIT, Cambridge, Massachusetts, USA, volume 251 of LIPIcs, pages 34:1–34:15. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2023. doi:10.4230/LIPIcs.ITCS.2023.34.
- [11] Lijie Chen, Zhenjian Lu, Xin Lyu, and Igor C. Oliveira. Majority vs. Approximate Linear Sum and Average-Case Complexity Below NC1. In Nikhil Bansal, Emanuela Merelli, and James Worrell, editors, 48th International Colloquium on Automata, Languages, and Programming, ICALP 2021, July 12-16, 2021, Glasgow, Scotland (Virtual Conference), volume 198 of LIPIcs, pages 51:1–51:20. Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.ICALP.2021.51.
- [12] Lijie Chen, Xin Lyu, and R. Ryan Williams. Almost-Everywhere Circuit Lower Bounds from Non-Trivial Derandomization. In Sandy Irani, editor, 61st IEEE Annual Symposium on Foundations of Computer Science, FOCS 2020, Durham, NC, USA, November 16-19, 2020, pages 1–12. IEEE, IEEE, 2020. doi:10.1109/FOCS46700.2020.00009.
- [13] Ruiwen Chen, Igor C. Oliveira, and Rahul Santhanam. An Average-Case Lower Bound Against ACC0. In Michael A. Bender, Martin Farach-Colton, and Miguel A. Mosteiro, editors, LATIN 2018: Theoretical Informatics - 13th Latin American Symposium, Buenos Aires, Argentina, April 16-19, 2018, Proceedings, volume 10807 of Lecture Notes in Computer Science, pages 317–330. Springer, Springer, 2018. doi:10.1007/978-3-319-77404-6_24.
- [14] Frederic Green, Johannes Köbler, Kenneth W. Regan, Thomas Schwentick, and Jacobo Torán. The Power of the Middle Bit of a #P Function. J. Comput. Syst. Sci., 50(3):456–467, 1995. doi:10.1006/jcss.1995.1036.
- [15] Johan Håstad. Almost Optimal Lower Bounds for Small Depth Circuits. In Juris Hartmanis, editor, Proceedings of the 18th Annual ACM Symposium on Theory of Computing, May 28-30, 1986, Berkeley, California, USA, pages 6–20. ACM, 1986. doi:10.1145/12130.12132.
- [16] Johan Håstad and Mikael Goldmann. On the Power of Small-Depth Threshold Circuits. Comput. Complex., 1(2):113–129, 1991. doi:10.1007/BF01272517.
- [17] Vaibhav Krishan. Upper Bound for Torus Polynomials. In Rahul Santhanam and Daniil Musatov, editors, Computer Science - Theory and Applications - 16th International Computer Science Symposium in Russia, CSR 2021, Sochi, Russia, June 28 - July 2, 2021, Proceedings, volume 12730 of Lecture Notes in Computer Science, pages 257–263. Springer, Springer, 2021. doi:10.1007/978-3-030-79416-3_15.
- [18] Vaibhav Krishan and Sundar Vishwanathan. Degree Lower Bounds for Torus Polynomials and MAJORITY vs ACC0. Electron. Colloquium Comput. Complex., TR24-074, 2024. URL: https://eccc.weizmann.ac.il/report/2024/074/#revision1.
- [19] Hermann Minkowski. Geometrie der zahlen. BG Teubner, 1910.
- [20] Cody D. Murray and R. Ryan Williams. Circuit Lower Bounds for Nondeterministic Quasi-polytime from a New Easy Witness Lemma. SIAM J. Comput., 49(5):STOC18–300, 2020. doi:10.1137/18M1195887.
- [21] Noam Nisan and Mario Szegedy. On the Degree of Boolean Functions as Real Polynomials. Comput. Complex., 4:301–313, 1994. doi:10.1007/BF01263419.
- [22] Alexander A. Razborov and Avi Wigderson. Lower Bounds on the Size of Depth-3 Threshold Circuits with AND Gates at the Bottom. Inf. Process. Lett., 45(6):303–307, 1993. doi:10.1016/0020-0190(93)90041-7.
- [23] Alexander Alexandrovich Razborov. Lower bounds on the size of bounded depth circuits over a complete basis with logical addition. Matematicheskie Zametki, 41(4):598–607, 1987.
- [24] Roman Smolensky. Algebraic Methods in the Theory of Lower Bounds for Boolean Circuit Complexity. In Alfred V. Aho, editor, Proceedings of the 19th Annual ACM Symposium on Theory of Computing, 1987, New York, New York, USA, pages 77–82. ACM, 1987. doi:10.1145/28395.28404.
- [25] Ryan Williams. Nonuniform ACC Circuit Lower Bounds. J. ACM, 61(1):2:1–2:32, 2014. doi:10.1145/2559903.
- [26] Andrew Chi-Chih Yao. On ACC and Threshold Circuits. In 31st Annual Symposium on Foundations of Computer Science, St. Louis, Missouri, USA, October 22-24, 1990, Volume II, pages 619–627. IEEE, IEEE Computer Society, 1990. doi:10.1109/FSCS.1990.89583.
