Abstract 1 Introduction 2 Preliminaries 3 Cost of Boolean Summation 4 Two variables suffice for VNP-hardness 5 The permanent is VNP-complete References

The Algebraic Cost of a Boolean Sum

Ian Orzel ORCID Department of Computer Science, The University of Copenhagen, Denmark Srikanth Srinivasan ORCID Department of Computer Science, The University of Copenhagen, Denmark Sébastien Tavenas ORCID Chargé de Recherche CNRS au Laboratoire LAMA de l’Université Savoie Mont Blanc, France Amir Yehudayoff ORCID Department of Computer Science, The University of Copenhagen, Denmark
Department of Mathematics, Technion-IIT, Haifa, Israel
Abstract

It is a well-known fact that the permanent polynomial is complete for the complexity class VNP, and it is largely suspected that the determinant does not share this property, despite its similar expression. We study the question of why the VNP-completeness proof of the permanent fails for the determinant. We isolate three fundamental properties that are sufficient to prove a polynomial sequence is VNP-hard, of which two are shared by both the permanent and the determinant. We proceed to show that the permanent satisfies the third property, which we refer to as the “cost of a boolean sum”, while the determinant does not, showcasing the fundamental difference between the polynomial families. We further note that this differentiation also applies in the border complexity setting and that our results apply for counting complexity.

Keywords and phrases:
Algebraic Complexity, Computational Complexity, Permanent, Determinant
Funding:
Ian Orzel: funded by the European Research Council (ERC) under grant agreement no. 101125652 (ALBA).
Srikanth Srinivasan: funded by the European Research Council (ERC) under grant agreement no. 101125652 (ALBA).
Sébastien Tavenas: supported by ANR-22-CE48-0007.
Amir Yehudayoff: supported by a DNRF chair grant, and partially supported by BARC.
Copyright and License:
[Uncaptioned image] © Ian Orzel, Srikanth Srinivasan, Sébastien Tavenas, and Amir Yehudayoff; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Algebraic complexity theory
Editors:
C. Aiswarya, Ruta Mehta, and Subhajit Roy

1 Introduction

In an attempt to introduce an algebraic approach to solving the classical P versus NP problem, [15] introduces algebraic circuits and the complexity classes VP and VNP. Central to this approach were two fundamental objects: the determinant and the permanent. The determinant belongs to the class VP (it is, in fact, complete for a restriction of this class, VBP, or even VP if we consider quasi-polynomial projections), and the permanent is complete for the class VNP, as proven in [15]. We suspect that the determinant is not VNP-complete, meaning that Valiant’s proof of the VNP-hardness of the permanent should fail when the determinant is used in its place. It has been unclear exactly why this is the case, although one would expect it to be related to the construction of a particular graph-theoretical gadget, known as the iff-coupling gadget, being impossible in the model of the determinant. However, this is a somewhat narrow and technical reason.

This paper seeks to develop a more general understanding of the reasons this VNP-hardness proof fails when applied to the determinant. In exploring this question, we simplify the proof for the VNP-completeness of the permanent and isolate the exact property that the determinant lacks which causes this VNP-hardness proof to fail (assuming all other properties are the same).

Recall that the VNP-completeness proof of the permanent begins by taking a formula and summing it over all 0-1 substitutions of some of its variables (representing an element of a VNP polynomial sequence). This formula is then transformed into a similarly-sized permanent. We then iteratively remove each 0-1 substitution of a particular variable by modifying the matrix we take the permanent of, only increasing its size by a small amount. This iterative removal is the key piece of the proof that makes it work in the case of the permanent, but, to the authors’ knowledge, there does not exist a proof that this step breaks down for the determinant. Studying this step in its full generality is difficult, as the given matrix could have a complex structure. In this paper, we simplify the VNP-completeness proof by showing that we can, without loss of generality, assume that the matrix has exactly two instances of the variable that we seek to remove. Using a small (standard) gadget construction, a boolean sum over two variables can be simulated by a permanent of a matrix that is bigger only by an additive constant, which shows that the permanent is VNP-complete. We can then show that the proof fails for the determinant by proving that the last step of this process must incur a super-constant (in fact, a constant multiplicative factor) increase in the size of the matrix.

We generalize this concept of “iterated substitutions” to arbitrary polynomials through the boolean sum. Given a polynomial f𝔽[𝒳] and a subset of its variables S𝒳, we can represent the boolean sum, which we denote by ΣSf, as the sum of taking f with each variable in S set to 0 and the same with respect to 1. We can now rephrase this step of the proof as converting a boolean sum over an arbitrary-sized set of variables to multiple boolean sums over two variables.

In this paper, we have isolated the following properties as sufficient for proving the VNP-hardness of a polynomial:

  1. 1.

    The polynomial sequence is VF-hard, i.e., a polynomial computed by a formula can be represented as a projection of a polynomial in the sequence (we can replace arguments by variables or constants), indexed by a polynomial in the size of the formula,

  2. 2.

    A boolean sum over many variables can be rewritten as a sequence of boolean sums of the polynomial, each over two variables, and

  3. 3.

    A boolean sum of a polynomial over two variables can be rewritten as a simple projection of itself, whose index is only increased by a fixed constant.

With these properties in mind, the main results of our paper can be summarized as follows:

  • A polynomial sequence satisfying properties (1), (2), and (3) is VNP-hard.

  • Both the determinant and the permanent satisfy properties (1) and (2).

  • The permanent satisfies property (3), but the determinant does not.

In short, we have isolated the simple property that differentiates the determinant from the permanent in our ability to prove VNP-completeness.

1.1 Related Work

The focus of this paper is on studying the noteworthy differences in properties between the permanent and the determinant polynomials, which is an important research direction, as it seems that the separation between VP and VNP is encoded in the differences between these polynomials. It is therefore that the differences in these polynomials have been well-studied.

One significant line of study was that seeking to find lower bounds on the size of a determinant that simulates the permanent (determinantal complexity). In a result of von zur Gathen [17], a lower bound was determined by studying the algebraic-geometric properties of the determinant and the permanent. Specifically, there was a difference between the dimension of the spaces of singular points of the determinant and permanent (points where a polynomial and all of its first-order partial derivatives vanish). Then, in a result of Mignon and Ressayre [11] (see also [3]), the bound was strengthened by studying the rank of the Hessian of these polynomials at vanishing points. It was shown that all zeros of the determinant have a very small Hessian rank, whereas the permanent has zero points with very large Hessian rank.

The work of Landsberg and Ressayre [8] gives an exponential lower bound on the determinantal complexity of the permanent in a restricted setting. They showed that any reductions from the permanent to the determinant that preserve the underlying symmetries must have exponential cost.

Recent work of Hruběs and Joglekar [6] points to a distinction in reductions to read-once determinants and permanents, which forces each variable to appear in the corresponding matrix at most once. Here, they show that every multilinear polynomial can be represented as a read-once permanent, whereas representations using the determinant could require a variable to appear at least ω(n/lgn) times.

1.2 Our Results

We have isolated three properties that are fundamental to understanding our VNP-completeness results for the permanent. We will begin by formally stating these properties.

Definition 1.

We say that a polynomial sequence f=(fi)i𝔽[𝒳] simulates formulas if, for every polynomial g𝔽[𝒳] that can be computed by a formula of size s, g is a projection of some fi, where i is polynomial in s. In other words, f is VF-hard.

We further say that k variable instances are sufficient for boolean sums of f if, for every boolean sum ΣS1ΣSfi [see (2.1)], there is an and m that are polynomial in i and such that this sum can be rewritten as ΣT1ΣTfm, where the size of each Ti is k.

Finally, we define the algebraic additive cost of boolean summation over f via the map αf:{}, defined as follows: for each s, let αf(s) be the minimum integer111If there is no such integer, then it is infinite. k so that, for every n and S𝒳n of size |S|s, the polynomial ΣSfn is a simple projection of fn+k. In other words, αf(s) is the additive f-cost of performing a boolean sum over s variables.

We can further naturally move the definition of αf into the border complexity setting, which we denote by αf¯. Formally, we let αf¯(s) be the minimum integer k so that there is a border sequence F=(Fi)i over 𝔽(ϵ)[𝒳] such that, for every i, there exist polynomials gi𝔽[𝒳{ϵ}] and Qi𝔽[ϵ] and M such that

Fi=ϵMfi+ϵM+1gi1+ϵQi(ϵ),

and furthermore, αF(s)=k. The algebraic expression captures our intuition that limϵ0Fi=fi.

 Remark 2.

Notice that αf(s) has no dependence on n (the number of variables) and instead is a bound that applies for all n. One could modify the definition to allow for dependence on n, let’s call this new function βf(s,n). Then, instead of the hypothesis we include in Theorem 3, namely αf(k)<, we could rephrase it in terms of βf(s,n). Clearly, αf(k)< if and only if βf(s,n)=O(1), but, more generally, it is sufficient that the sequence n,n+βf(s,n),n+βf(s,n+βf(s,n)), iterated n times is polynomially bounded. Observe that a lower bound of βf(s,n)(1+ϵ)n is enough to make the sequence grow exponentially. To avoid the technicalities involved in characterizing such functions βf, we have decided to use the αf(s) notation.

We can now introduce our main results that use these properties. We first have that these properties are sufficient for VNP-hardness.

Theorem 3.

If, for a fixed k, f=(fi)i𝔽[𝒳] is such that

  1. 1.

    f simulates formulas,

  2. 2.

    k variables instances are sufficient for boolean sums over f, and

  3. 3.

    αf(k)<,

then f is VNP-hard.

Further, if the projections and reductions associated with these three properties can be completed in polynomial time, then f is #P-hard.

We use 𝗉𝖾𝗋𝗆 and 𝖽𝖾𝗍 to denote the permanent and determinant polynomials respectively. It is a well-known fact that 𝗉𝖾𝗋𝗆 and 𝖽𝖾𝗍 can simulate formulas.

Lemma 4 ([15]).

The 𝗉𝖾𝗋𝗆 and 𝖽𝖾𝗍 polynomial sequences can simulate formulas.

Our main deviation from the well-known VNP-hardness proof is through the decrease of the number of instances of the variables we sum over to two. This idea is stated in the following lemma.

Lemma 5.

Two variables instances are sufficient for boolean sums over the 𝗉𝖾𝗋𝗆 and 𝖽𝖾𝗍 polynomials.

Finally, the main result of this paper is through differentiating the determinant from the permanent, which is stated in the following theorem.

Theorem 6.

We have that α𝗉𝖾𝗋𝗆(2)3, but α𝖽𝖾𝗍(2)=. We further observe that α𝖽𝖾𝗍¯(2)=.

1.3 Structure of Paper

First, in Section 2, we will introduce our notation and definitions. Then, in Section 3, we will prove Theorem 6, which will differentiate the permanent from the determinant. We will do this using a well-known result of Mignon and Ressayre[11] and through a careful selection of matrices. In Section 4, we will prove Lemma 5, showing that we can transform arbitrarily-sized boolean sums to those of size two. In Section 5, we provide the proof of Theorem 3, which is (in our opinion) a slightly simpler and more modular proof of the VNP-completeness of the permanent.

2 Preliminaries

Let 𝔽 be a field of characteristic not two. Let 𝒳 be an infinite set of indeterminants and 𝔽[𝒳] be the polynomial ring containing polynomials that use a finite number of indeterminants in 𝒳. We will write (fi)i𝔽[𝒳] to denote a sequence a polynomials (we will somtimes simply write it as (fi)), and it is assumed that fi𝔽[𝒳i], where 𝒳i𝒳 has size polynomial in i. Given a set S, we may use S𝒳i to denote an assignment of the variables in 𝒳i to elements of S, so that we can then see fi(a) to represent evaluating fi at the point aS𝒳i.

We will use the typical definitions for circuits, formulas, the complexity classes VF, VP, and VNP, and hardness within these classes. For more information, see [15].

A fundamental tool in computational complexity theory is reduction between problems [7]. Reductions allow us to compare the complexities of different problems. In the algebraic setting, reductions are projections. The polynomial f𝔽[𝒳] is a projection of g𝔽[𝒴] if there is a map ϕ:𝒴𝒳𝔽 so that f=λ(gϕ), where λ𝔽{0}. The projection is called simple if for each x𝒳 the cardinality of ϕ1(x) is at most one.

For boolean summation, we use the following notation. For S𝒳, denote by fS the polynomial in the variables 𝒳{y}, where y is a new variable, that is obtained from f by the substitution x=y for all xS. For example, (x1+x22+x3){x1,x2}=y+y2+x3. Denote by ΣSf the polynomial

ΣSf=fS|y=0+fS|y=1. (2.1)

For example, Σ{x1,x2}(x1+x22+x3)=2+2x3. The variables in S do not appear in fS and ΣSf.

For two polynomial sequences g=(gi)i and f=(fi)i, we say that g is an iterated boolean sum of f if, for every i, there are disjoint sets S1,,S𝒳 such that gi=ΣS1ΣSfj, where and j are polynomial in i. Observe that a polynomial sequence being in VNP is equivalent to there being a sequence in VF each element in the VNP sequence is an iterated boolean sum of a (polynomially-indexed) element in the VF sequence.

The two central polynomial families in algebraic complexity are the permanent and the determinant, defined by,

𝗉𝖾𝗋𝗆(X)=𝗉𝖾𝗋𝗆n(X)=πixi,π(i)

and

𝖽𝖾𝗍(X)=𝖽𝖾𝗍n(X)=π(1)𝗌𝗂𝗀𝗇(π)ixi,π(i),

where X=(xi,j) is an n×n matrix of variables, the sum is over permutations π of [n], and the product is over i[n]. The permanent and determinant can be equivalently defined as the sum of the (signed) weights of cycle covers over a graph, whose adjacency matrix is given; see [9]. The permanent is VNP-complete, so that VP VNP if and only if 𝗉𝖾𝗋𝗆 is not in VP [15]. It also appears in many places in computer science because it encapsulates many counting problems (see e.g. [16, 14, 1] and references within); by definition, it counts the number of perfect matchings in a bipartite graph. The VP versus VNP problem is (essentially) about the relationship between the permanent and the determinant (see [15, 12, 10] and references within).

The determinant defines a complexity measure; the determinantal complexity 𝖽𝖼(f) of a polynomial f is the minimum k so that f is a projection of 𝖽𝖾𝗍k. It is known that 𝖽𝖼(f)< for all f. The VP versus VNP problem is roughly captured by what is 𝖽𝖼(𝗉𝖾𝗋𝗆n)? Proving that 𝖽𝖼(𝗉𝖾𝗋𝗆n) is super-polynomial in n is one of the major open problems in computer science. The best lower bound we know is 𝖽𝖼(𝗉𝖾𝗋𝗆n)n22; see [11, 3].

Given a complexity measure L:𝔽[𝒳], we can define its corresponding “border” measure, denoted L¯, to be the polynomial with the smallest L measure that approximates the original polynomial. More formally, given an f𝔽[𝒳], we define L¯(f) to be the smallest k such that there exist F𝔽(ϵ)[𝒳], g𝔽[𝒳{ϵ}], Q𝔽[ϵ], and M such that

F=ϵMf+ϵM+1g1+ϵQ(ϵ),

and furthermore, L(F)=k.

In the field of counting complexity, we study the complexity of functions that “count” some quantity, mapping φ:{0,1}. Recall that we define the class NP as the set of decision problems, denoted by φ:{0,1}{0,1}, such that there is a Turing Machine taking in the input and a special “witness” string such that the Turing Machine runs in polynomial time and a string is in the language if and only if there is at least one “witness” string for which the Turing Machine accepts it. We then define the complexity class P similarly, but instead we require the related Turing Machine to have the number of accepting witness strings to a given input to be the same as that defined by φ. The quintessential P-complete problem is 3-SAT, which, given a 3-CNF formula, counts the number of satisfying assignments.

3 Cost of Boolean Summation

This section will focus on proving Theorem 6. We will separate the proof of this theorem into two sub-claims. The first is used to show that αdet(2)=.

Claim 7.

For any n, we have that

𝖽𝖼(Σ{x1,1,x2,2}𝖽𝖾𝗍n)2(n2).

Next, we will prove that α𝗉𝖾𝗋𝗆(2)3 through another claim.

Claim 8.

There exists a matrix E(𝒳𝔽)(n+3)×(n+3) such that

Σ{x1,1,x1,2}𝗉𝖾𝗋𝗆=𝗉𝖾𝗋𝗆(E).

Observe that, due to row and column swaps (and the fact that, if the two indeterminants were on the same row or column, the claim would be trivially true), these claims imply what we want.

3.1 Lower Bound on Determinantal Boolean Sums

We now prove that α𝖽𝖾𝗍(2)= by proving Claim 7. The proof relies on a mechanism developed by Mignon and Ressayre to lower bound the determinantal complexity [11]. For a polynomial f𝔽[𝒳], denote by Hf the |𝒳|×|𝒳| Hessian matrix of f defined by

(Hf)x,x=2xxf.
Lemma 9 ([11]; see also Lemma 13.3 in [4]).

Let f be a polynomial in the variables x=(x1,,xn) and let a𝔽n be so that f(a)=0 then

𝖽𝖼(f)𝗋𝖺𝗇𝗄(Hf|x=a)2.

The theorem follows by considering the polynomial

f=Σ{x1,1,x2,2}𝖽𝖾𝗍n

and the n×n matrix

A=[121I],

where I is the (n2)×(n2) identity matrix. In the two claims below (which complete the proof), let H=Hf.

Claim 10.

f(A)=0.

Proof of Claim 10.

f(A) =𝖽𝖾𝗍([121I])+𝖽𝖾𝗍([11211I])
=12+112=0.

Claim 11.

𝗋𝖺𝗇𝗄(H|X=A)4(n2).

Proof of Claim 11.

Focus on the 4(n2) variables 𝒱i={x1,i,x2,i,xi,1,xi,2} for i>2. Furthermore, we consider G to be the 4(n2)×4(n2) sub-matrix of H whose rows and columns are labeled by variables in i>2𝒱i. Let f0=𝖽𝖾𝗍n|x1,1=x2,2=0 and f1=𝖽𝖾𝗍n|x1,1=x2,2=1, so that f=f0+f1.

An entry in the Hessian of 𝖽𝖾𝗍 is plus/minus the determinant of the (n2)-minor obtained by deleting the corresponding rows and columns from X (or zero if the two variables share a row or a column).

For convenience, denote by Hkmp the (xk,,xm,p)-entry in H (and in G).

We first claim that after substituting A, the sub-matrix G of H has n2 blocks, each of size 4×4:

[G3G4Gn]

where for i>2

Gi=[H1i1iH1i2iH1ii1H1ii2H2i1iH2i2iH2ii1H2ii2Hi11iHi12iHi1i1Hi1i2Hi21iHi22iHi2i1Hi2i2].

Indeed, for ij, the matrix obtained from A by deleting row i and column j has a zero row so its determinant is zero. It follows for k,{1,2} that

(Hf)ikj|X=A=(Hf0)ikj|X=A+(Hf1)ikj|X=A=0+0=0.

A similar argument holds for the other entries Hikj, Hkij, and Hkij.

Now fix i and focus on Gi. Entries of the form 1i1i and 1i2i are also zero. So, we are left with

Gi=[H1ii1H1ii2H2ii1H2ii2Hi11iHi12iHi21iHi22i].

The matrix Gi is symmetric so it is enough to understand

[H1ii1H1ii2H2ii1H2ii2].

This matrix is a sum of two matrices (one from f0 and one from f1). For f0, this matrix is

[112].

For f1, this matrix is

[11121].

The sum of the two matrices is

[1211],

which always has rank two. Rolling back

𝗋𝖺𝗇𝗄([G3G4Gn])=4(n2).

Observation 12.

We note that this result also applies in the border complexity setting. Specifically, it also follows that 𝖽𝖼¯(Σ{x1,1,x2,2}𝖽𝖾𝗍n)2(n2). This fact follows from [5], where it is shown that the lower bound from [11] of the determinantal complexity of the permanent also applies in the border complexity setting. Although the proof presented there is specifically for the permanent polynomial, it is easy to see that it also works if you use any arbitrary homogeneous polynomial. We should observe that Σ{x1,1,x2,2}𝖽𝖾𝗍n is not homogeneous, but one can easily see that we can apply the result to the natural homogenization of the polynomial and get the desired result.

3.2 Upper Bound on Permanental Boolean Sum

In this section, we will prove that α𝗉𝖾𝗋𝗆(2)3 by proving Claim 8. Specifically, we will select the matrix E to be

E=[1111011121232110x1,2x1,31x2,10x2,3x3,1x3,2x3,3].

Proof of Claim 8.

To see this, denote by X[b] the matrix X after the substitution x1,1=x2,2=b for b{0,1}. For S{1,2}, denote by X[b]S the matrix X[b] after deleting the rows and columns in S. We have

𝗉𝖾𝗋𝗆(X[1]) =𝗉𝖾𝗋𝗆([1x1,2x1,3x2,11x2,3x3,1x3,2x3,3])
=𝗉𝖾𝗋𝗆(X[0])+𝗉𝖾𝗋𝗆(X[0]{1})+𝗉𝖾𝗋𝗆(X[0]{2})+𝗉𝖾𝗋𝗆(X[0]{1,2}).

Now, consider a permutation π such that the associated value of the permutation on E is nonzero. We can then notice that such a permutation falls into one of four categories:

  • π({1,2,3})={1,2,3},

  • π(2)=4 and π({1,3})={1,3},

  • π(3)=5 and π({1,2})={1,2}, or

  • π(2)=4, π(3)=5, and π(1)=1.

Let U be the 3×3 upper-left block

U=[111101121232].

For S,T{1,2,3} with |S|=|T|, we denote by UST the sub-matrix of U obtained by keeping the rows of S and the columns of T. The matrix U is chosen such that

𝗉𝖾𝗋𝗆(U{1,2}{1,3})=𝗉𝖾𝗋𝗆(U{1,3}{1,2})=0,
𝗉𝖾𝗋𝗆(U{1}{1})=𝗉𝖾𝗋𝗆(U{1,2}{1,2})=𝗉𝖾𝗋𝗆(U{1,3}{1,3})=1,
𝗉𝖾𝗋𝗆(U)=2.

In the first of the above 4 cases, it must be that π({4,5,,m})={4,5,,m}. Therefore, the sum of the weights of these permutations corresponds to

𝗉𝖾𝗋𝗆([UX[0]])=2𝗉𝖾𝗋𝗆(X[0]).

In the second case, it must be that π(4)=2 and π({5,6,,m})={5,6,,m}. Thus, this case corresponds to

𝗉𝖾𝗋𝗆([U{1,3}{1,3}X[0]{1}])=𝗉𝖾𝗋𝗆(X[0]{1}).

In the third case, we have that π(5)=3 and π({4,6,7,,m})={4,6,7,,m}. Thus, this case corresponds to

𝗉𝖾𝗋𝗆([U{1,2}{1,2}X[0]{2}])=𝗉𝖾𝗋𝗆(X[0]{2}).

Finally, in the fourth case, it must be that π(4),π(5){2,3} and π({6,7,,m})={6,7,,m}. This case then corresponds to

𝗉𝖾𝗋𝗆([U{1}{1}X[0]{1,2}])=𝗉𝖾𝗋𝗆(X[0]{1,2}).

Summing it together,

𝗉𝖾𝗋𝗆(E)=𝗉𝖾𝗋𝗆(X[0])+𝗉𝖾𝗋𝗆(X[1]).

3.3 Boolean Sum over a Single Variable

Interestingly, considering boolean sums of two variables is necessary to separate 𝗉𝖾𝗋𝗆 from 𝖽𝖾𝗍. This is becaues the boolean cost of removing one variable is the same for both polynomial sequences.

Claim 13.

We have that α𝖽𝖾𝗍(1)=α𝗉𝖾𝗋𝗆(1)=0.

Proof.

Σ{x1,1}𝖽𝖾𝗍(X)
=𝖽𝖾𝗍[0x1,2x1,3x1,nx2,1x2,2x2,3x2,nx3,1x3,2x3,3x3,nxn,1xn,2xn,3xn,n]+𝖽𝖾𝗍[1x1,2x1,3x1,nx2,1x2,2x2,3x2,nx3,1x3,2x3,3x3,nxn,1xn,2xn,3xn,n]
=2𝖽𝖾𝗍[1/2x1,2x1,3x1,nx2,1x2,2x2,3x2,nx3,1x3,2x3,3x3,nxn,1xn,2xn,3xn,n].

A similar calculation holds for the permanent.

4 Two variables suffice for VNP-hardness

The aim of this section is to prove Lemma 5 that shows that summation over two variables suffices for VNP-hardness. We prove it for the determinant (the proof for the permanent is similar). The following construction shows how to replace a boolean summation over m variables by m boolean summations over two variables.

Observation 14.

Let f𝔽[𝒳] and S={x1,,xm}𝒳. Let y1,,ym be m new variables, and define

g(y)=(i[m]yi)+(i[m](1yi)).

Then

Σ{x1,y1}Σ{x2,y2}Σ{xm,ym}gf=ΣSf.

Indeed, on the l.h.s. there is a sum over 2m terms, but g picks exactly two of them that perfectly agree with the r.h.s.

The observation allows to replace a boolean sum over many variables by several sums, each over just two.

Observation 15.

Let g be the polynomial defined above. Then, there is a 2m×2m matrix A with entries in {y1,,ym,0,1,1} so that each yi appears once in A and

g=𝖽𝖾𝗍(A).

The matrix A is the m-variate version of the following matrix:

A=[1111y11111y21111y31111y4].

To see that 𝖽𝖾𝗍(A) is the polynomial g, it is easier to see the determinant as a signed sum of the weights of the cycles covers of the graph GA whose A is the adjacency matrix (see Figure 1)

𝖽𝖾𝗍(A)=C cycles cover[σ cycle of C(1)1+length of Cweight(C)].

The reader could find more details about this characterization by cycles covers in [9]. The only cycle which contains a dashed edge is exactly the union of the dashed edges. So the only cover that contains this cycle also contains the m yi-loops. It corresponds to one cover of signed weight ((1)m+1(1)m1)i=1myi=i=1myi. Otherwise, the covers contain no dashed edges and are given by m disjoint graphs. The signed weight is the product of them: i((1)(1)+(1)(yi))=i(1yi). The sum of the covers gives exactly the polynomial g.

Figure 1: The graph GA.
 Remark 16.

For the permanent, every 1 above the diagonal of the matrix A should be changed into a 1, and the 2×2 blocks into [111y1].

Proof of Lemma 5.

Let B(𝒳𝔽)n×n and S1,,S𝒳 be such that S1,,S are disjoint. Then, by previous

ΣS𝖽𝖾𝗍(B)=Σ{x1,y1}Σ{xm,ym}g𝖽𝖾𝗍(B)=Σ{x1,y1}Σ{xm,ym}𝖽𝖾𝗍(B00A)

Notice here that m|S| and the size of the block matrix is at most n+2mn+2|S|. We can then use induction on S1,,S1 to conclude that we can write

ΣS1ΣS𝖽𝖾𝗍(A)=ΣT1ΣT𝖽𝖾𝗍(C),

where i=1|S|n2 and the size of C is at most n+2i=1|S|n+2n2.

5 The permanent is VNP-complete

This section will finally provide the proof of Theorem 3, showing that the three properties we have isolated are sufficient for VNP-hardness. The proof proceeds similarly to Valiant’s VNP-completeness proof of the permanent with a few variations. This section thus also provides a (arguably) more modular proof of the VNP-completeness of the permanent.

Proof of Theorem 3.

Because f simulates formulas, we can write every n-variate g𝔽[𝒴] in VNP (see [2, 13]) as

g=(ΣS1ΣSfd)(a)

where a(𝔽𝒴)𝒳d is a variable assignment such that d is polynomial in n, each entry in a is a variable or a field element, and S1,,S are pairwise disjoint (implying is polynomial in d).

Because k variables are sufficient for boolean sums over f, we can assume without loss of generality that |S1|==|S|=k. Further, as αf(k)<, we know that we can write

ΣSfd=fd+αf(k)(b),

for some simple variable assignment b(𝔽𝒴)𝒳i+αf(k). Observe that, because this is a simple projection, we can easily (after modifying our sets S1,,S1) bring out b and write (ΣS1ΣS1fd+αf(k))(b)=g, for some assignment b. Thus, after repeating this process times, we can write

(ΣS1ΣSfd)(a)=fd+αf(k)(c),

where c(𝔽𝒴)𝒳d+αf(k) is a variable assignment. Because and d are polynomial in n, we can conclude that f is VNP-hard.

Observation 17.

We will then conclude with the observation that this proof also works for proving P-hardness if each of the steps that we took in this proof can be done in polynomial time. Consider 3-SAT, a complete problem for P, where we are given a 3-CNF and must return the number of satisfying assignments it has. Consider some 3-CNF φ in n variables, and observe that the number of possible clauses is polynomial in n, so we can easily encode it using one bit for each possible clause. We will write this number as mn, and one can easily see that there is a polynomial fn𝔽[y1,,ymn,x1,,xn] such that, if we provide the yi variables with the 0/1 encoding of φ and the xi variables with a variable assignment, it will output 0/1 depending on whether this assignment is a satisfying assignment of φ. One can easily see that fn can be computed by a formula that is polynomial in n. Finally, we observe that the polynomial gn=Σ{x1}Σ{xn}fn provides the exact answer for 3SAT when given the binary encoding of a 3-CNF. Hence, we can carry out our previous proof from the sequence g=(gn)n to reduce it to a polynomial with the three properties (ensuring that the steps along the way can be done in polynomial time). At the end, we conclude that we can reduce 3-SAT to our polynomial sequence.

References

  • [1] Scott Aaronson. A linear-optical proof that the permanent is #P-hard. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 467(2136):3393–3405, 2011.
  • [2] Peter Bürgisser. Completeness and reduction in algebraic complexity theory, volume 7. Springer Science & Business Media, 2000.
  • [3] Jin-Yi Cai, Xi Chen, and Dong Li. Quadratic lower bound for permanent vs. determinant in any characteristic. computational complexity, 19(1):37–56, 2010. doi:10.1007/S00037-009-0284-2.
  • [4] Xi Chen, Neeraj Kayal, and Avi Wigderson. Partial derivatives in arithmetic complexity and beyond. Foundations and Trends in Theoretical Computer Science, 6(1–2):1–138, 2011. doi:10.1561/0400000043.
  • [5] Joshua A. Grochow. Unifying known lower bounds via geometric complexity theory. computational complexity, 24:393–475, 2015. doi:10.1007/S00037-015-0103-X.
  • [6] Pavel Hrubes and Pushkar S. Joglekar. On read-k projections of the determinant. Electron. Colloquium Comput. Complex., TR24-125, 2024. URL: https://eccc.weizmann.ac.il/report/2024/125.
  • [7] Richard M. Karp. On the computational complexity of combinatorial problems. Networks, 5(1):45–68, 1975. doi:10.1002/NET.1975.5.1.45.
  • [8] Joseph M. Landsberg and Nicolas Ressayre. Permanent v. determinant: An exponential lower bound assuming symmetry. In Madhu Sudan, editor, Proceedings of the 2016 ACM Conference on Innovations in Theoretical Computer Science, Cambridge, MA, USA, January 14-16, 2016, pages 29–35. ACM, 2016. doi:10.1145/2840728.2840735.
  • [9] Meena Mahajan and V Vinay. Determinant: Old algorithms, new insights. SIAM journal on Discrete Mathematics, 12(4):474–490, 1999. doi:10.1137/S0895480198338827.
  • [10] Guillaume Malod and Natacha Portier. Characterizing Valiant’s algebraic complexity classes. Journal of complexity, 24(1):16–38, 2008. doi:10.1016/J.JCO.2006.09.006.
  • [11] Thierry Mignon and Nicolas Ressayre. A quadratic bound for the determinant and permanent problem. International Mathematics Research Notices, (79):4241–4253, 2004.
  • [12] Ketan D Mulmuley. On P vs. NP and geometric complexity theory. Journal of the ACM, 58(2):1–26, 2011.
  • [13] Amir Shpilka and Amir Yehudayoff. Arithmetic circuits: A survey of recent results and open questions. Foundations and Trends in Theoretical Computer Science, 5(3–4):207–388, 2010. doi:10.1561/0400000039.
  • [14] Seinosuke Toda. PP is as hard as the polynomial-time hierarchy. SIAM Journal on Computing, 20(5):865–877, 1991. doi:10.1137/0220053.
  • [15] Leslie G. Valiant. Completeness classes in algebra. In STOC, pages 249–261, 1979. doi:10.1145/800135.804419.
  • [16] Leslie G. Valiant. The complexity of computing the permanent. Theoretical computer science, 8(2):189–201, 1979. doi:10.1016/0304-3975(79)90044-6.
  • [17] Joachim von zur Gathen. Permanent and determinant. In 27th Annual Symposium on Foundations of Computer Science, Toronto, Canada, 27-29 October 1986, pages 398–401. IEEE Computer Society, 1986. doi:10.1109/SFCS.1986.42.