Proving Algebraic Independence in Zero-Knowledge
Abstract
A set of multivariate polynomials is algebraically independent if they exhibit no non-trivial algebraic relations, and this notion is fundamental in algebra. When these polynomials are given as algebraic circuits, deciding algebraic independence has several applications in algebraic complexity theory. Over fields of zero (or exponentially large) characteristic, this problem is known to have an efficient randomized algorithm. Over finite fields of small characteristic, a sequence of works has culminated in showing that algebraic independence admits Arthur-Merlin proofs, in particular giving the complexity bound of ([14]).
We improve the complexity of deciding algebraic independence over finite fields by showing that it admits zero-knowledge proofs, in particular giving the upper bound of , the class of problems admitting non-interactive statistical zero-knowledge proofs. This is achieved by arguing that algebraically independent polynomials yield maps whose output distribution has high-entropy, while algebraically dependent polynomials yield maps with low-entropy. We can then reduce to the question of approximating entropy, which is a known -complete problem.
We also more generally show that transcendence degree, which quantifies the independence of a set of possibly dependent polynomials, can be computed in .
Keywords and phrases:
Algebraic Dependence, Non-Interactive Statistical Zero-KnowledgeCategory:
Track A: Algorithms, Complexity and GamesFunding:
Michael A. Forbes: Supported by NSF CAREER award 2047310.Copyright and License:
2012 ACM Subject Classification:
Theory of computation Algebraic complexity theory ; Theory of computation Complexity classesEditors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele PuppisSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
Linear algebra plays a fundamental role in mathematics, and a main question there is understanding whether a given set of linear forms over variables are linearly dependent. Higher algebra generalizes this notion to that of algebraic dependence, where we ask if a given set of polynomials are dependent, meaning there exists a non-zero annihilating polynomial such that . If no such exists then the polynomials are algebraically independent. We can quantify beyond just dependence-vs-independence to define transcendence degree, which is the size of the largest subset of the polynomials that are algebraically independent. Like linear independence, algebraic independence and transcendence degree play a fundamental role in understanding multivariate polynomials, for example in how the dimension of an algebraic variety is defined.
In this paper we study algebraic independence as a computational problem, so that given the polynomials we seek to decide if they are independent. In formalizing this problem, one must set the encoding of the input. In the complexity-theoretic literature, it is most often assumed that the polynomials are given by algebraic circuits, which are syntactic diagrams that construct polynomials from the variables using basic operations such as addition, multiplication, and scalars from the underlying field . Algebraic circuits are the most natural succinct way to present algebraic computation, see for example the survey of Shpilka and Yehudayoff [28]. This encoding is particularly well-motivated as algebraic independence then (trivially) generalizes the polynomial identity testing (PIT) problem, which asks whether a given algebraic circuit computes a non-zero polynomial. That is, a single polynomial is algebraically dependent iff is constant iff is zero. As developing (deterministic) PIT algorithms is a central challenge in algebraic complexity theory, one can view the problem of deciding (succinct) algebraic independence as a far-reaching generalization of PIT.
The expressiveness of the algebraic independence testing problem leads to a number of important applications. One application is PIT itself. In particular, deterministic PIT algorithms for certain restricted classes of algebraic circuits can be solved by a general “rank bounds” methodology. One first shows a structural result, arguing that “simple and minimal” circuits from these classes that express polynomial identities necessarily have a small “rank bound”. One then argues that the number of variables can (in a derandomized way) be reduced to this rank bound, at which point brute-force methodologies become comparatively efficient. This methodology was done for bounded top-fan-in depth-3 circuits, using linear independence as the notion of rank, in a series of works culminating in the work of Saxena and Seshadri [24]. This paradigm was generalized to bounded top- and middle-fan-in depth-4 circuits by [6], where the notion of rank is now that of transcendence degree. Rank bounds in this setting are much more difficult, but have been established in some settings, see Garg-Oliveira-Sengupta [10]. A key difficulty in using transcendence degree for PIT is arguing that transcendence degree is preserved in the derandomized variable reduction. This requires a reasonable mathematical criterion for computing transcendence degree; this roughly corresponds to an efficient algorithm for computing transcendence degree.
Other applications include designing extractors for the images of polynomial maps ([8]), and for computing the maximum tensor rank of a given format ([7, Chapter 20]).
Over a field of characteristic 0 (or exponentially large), it is known that one can reduce the notion of algebraic dependence to that of linear dependence. As is typical in any sort of linearization, one uses differential techniques; in particular the transcendence degree of is equal to the (linear) rank of the Jacobian matrix of . Whether the Jacobian is full-rank then is asking if a certain determinant is zero, which can be solved using PIT techniques. This shows that algebraic independence can be solved in .
Unfortunately, in a field of characteristic one has that , so the Jacobian criterion then fails. Further, it is known that while both linear and algebraic dependence structures form matroids over any field ([20]), it is known that there are algebraic matroids (over fields of small characteristic) that are not representable by linear dependence structures (over any field) ([20]). This indicates that in small characteristic linearization methods will necessarily fail to capture algebraic dependencies.
Absent the Jacobian criterion, one can still show that deciding algebraic independence can be done in over any field. This is done using degree bounds for annihilating polynomials, alongside parallel linear algebra techniques. The gap between and for general fields has thus prompted a sequence of works seeking better and better algorithms for algebraic independence. The work of [17] gave an algorithm, and [21] gave an algorithm that ran efficiently when the “inseparable degree” was small. Guo, Saxena and Sinhababu [14] gave an upper bound for finite fields, in particular putting this problem in the polynomial hierarchy as well as suggesting algebraic independence is not -hard (unless the polynomial hierarchy collapses). Incomparably, Garg and Saxena [11] gave an improved exponential-time algorithm.
1.1 Our Results
The starting point for this work is that Guo-Saxena-Sinhababu [14] seems unlikely to be unimprovable, as is not a syntactically-defined class and as such is not known to have complete language problems (as far as we are aware). As such, it would be surprising if algebraic independence was -complete. Furthermore, to obtain their result Guo-Saxena-Sinhababu [14] gave two algorithms, one for and one for . While highly related, they used slightly different logic; it seems natural that a single algorithm should encompass both results.
Correspondingly, in this work we improve on the Guo-Saxena-Sinhababu [14] result, showing that algebraic independence over finite fields can be solved in non-interactive statistical zero-knowledge. That is, Guo-Saxena-Sinhababu [14] showed that there are Arthur-Merlin proofs certifying that independent polynomials are independent, as well as showing that there are such proofs that dependent polynomials are dependent. Arthur-Merlin proofs are interactions between an all-powerful prover (Merlin) and a resource-bounded verifier (Arthur). Babai-Moran [5] showed that while these interactions can include many rounds, one can convert them to the following type of protocol. First, Arthur sends Merlin a random string. Merlin then produces a purported proof, which Arthur then verifies. We observe here that the proof that an honest Merlin produces can be approximately simulated by a resource-bounded third party, who only knows that the polynomials are algebraically independent (and in particular knows nothing more). The approximation error between the true distribution of Merlin’s proofs and the simulator’s version is negligible, so this forms a statistical zero-knowledge guarantee: Arthur learns from Merlin that the are algebraically independent, and nothing more. This protocol is considered to be non-interactive because the challenge that Arthur sends to Merlin in the first round is a completely random string independent of the input.
Formally, we have the following result.
Theorem 1.1 (Corollary 4.5).
Given a finite field and polynomials represented by size- circuits, there is a non-interactive statistical zero-knowledge proof that are algebraically independent. That is, .
The above exposition immediately suggests that proofs are a subset of proofs, which as-is would only improve the Guo-Saxena-Sinhababu [14] result to . However, known complexity theoretic results show that , where is the class of statistical zero-knowledge proofs (hence allowing more interaction). Further, it is known that ([18]) and that , and as such we have that . Hence, we have a single algorithmic result that in particular implies the Guo-Saxena-Sinhababu [14] result. Moreover, this result exposes what we believe is the natural conclusion of the techniques of Guo-Saxena-Sinhababu [14] .
Placing algebraic independence in has potential cryptographic implications. Ostrovsky [19] showed that any problem that is hard on average, that also possesses statistical zero-knowledge proofs, will imply one-way functions (and hence all of private-key cryptography). While it seems possible that algebraic dependence in small-characteristic is easy, it also seems possible it is difficult. If so, as an algebraic problem, it would likely also be hard on average as many algebraic problems have worse-case to average-case reductions; one would then conclude that one-way functions exist. This line of thought, along with our work, suggests exploring algebraic dependence as a possible source of cryptographic hardness.
1.2 Our Techniques
Our techniques largely follow that of Guo-Saxena-Sinhababu [14] , but with a focus on incorporating zero-knowledge methods into our proofs. In particular, we view the polynomials as a map and study the image of this map. Guo-Saxena-Sinhababu [14] showed that when are independent the image is “large” (when possibly passing to a field extension ), while when the are dependent the image is “small”. This yields an protocol for algebraic independence by appealing to the set-size approximation protocol of Goldwasser and Sipser [13] to distinguish between large and small sets. For their protocol they instead look at the pre-images of the map defined by . That is, when are independent the image is large, and hence “most” pre-images must be small. Similarly, when the are dependent the image is small, and hence “most” pre-images must be large. One then again appeals to the Goldwasser and Sipser [13] protocol.
We combine the ideas of the above two protocols to obtain our result. While one could construct a protocol directly, we instead use that has well-known complete (promise) problems, in particular that estimating the entropy of a distribution given by a boolean circuit is -complete. That is, one is given a boolean circuit computing a function , and one can then ask questions about the distribution of the random variable where is the uniform distribution on bits. Goldreich, Sahai and Vadhan [12] showed that there is an protocol to prove that the entropy of is “high”, in comparison to when the entropy is “low”; this is a promise problem because of the gap between low- and high-entropy.
We show that for a polynomial map given by , we can naturally interpret it as a boolean function for . When are independent, then (after possibly passing to a field extension ) “most” pre-images of (and hence ) are small, and this implies that has low collision probability and hence high entropy. When are dependent, then the image of (and hence ) is “small”, so that the entropy must also be small. By setting parameters carefully, one can find that there is a sufficient entropy gap in when comparing the dependent and independent cases; completing the reduction.
However, there are various subtleties. This includes encoding issues, such as dealing with how is not (generally) a power of 2. There is also that our reduction is randomized, due to the need to find irreducible polynomials (to construct an extension field), as well as to randomly change variables so that is polynomials on variables. We then need to invoke the fact that is closed under randomized reductions, which involves some slight care because the failure probability must be negligible.
We finally note here that our techniques extend to certifying transcendence degree in .
Theorem 1.2 (Corollary 4.13).
Given a finite field , represented by size- circuits, and number , there is a non-interactive statistical zero-knowledge proof that .
This is achieved by randomly reducing this problem to the case when , solved above, by taking random linear combinations of the .
2 Preliminaries
Notation
We briefly here set notation for the paper, most of which is standard. For logarithms, we denote for . We will denote to be a general field, and denotes the finite field with elements. The algebraic closure of a field will be denoted as . A polynomial ring in indeterminates will be denoted by . We will write for the tuple (or alternatively as a column vector) when the dimensionality is clear from context. Similarly, we will write to express a tuple from for a set . We will sometimes use the -norm to measure degrees of monomials, so that for , we have (note that as no absolute values are needed).
We extend the notion of the degree of a polynomial to tuples of polynomials, so that .
For any polynomial , will denote the set of zeros of over , that is, . Given polynomials over we often abuse notation and interpret as a map given by . Note that we can also interpret this map over any extension field .
We also denote as the pre-image of , so that for , (which is possibly empty). We write to emphasize the pre-image is taken over , but often this is omitted when clear.
We will use the following non-standard notation often, which we now highlight.
Definition 2.1.
For polynomials , we denote their degree product , as .
Algebraic Dependence and Transcendence Degree
Definition 2.2.
Polynomials are algebraically dependent (over ) if there exists a non-zero such that in . They are otherwise algebraically independent. The polynomial is said to be an annihilator of .
The transcendence degree of (over ), denoted , is the size of the largest subset such that is algebraically independent. The field is omitted when clear from context.
Note that the polynomials being algebraically independent is equivalent to requiring that the map
is injective. The kernel of is precisely the set of annihilators. We note here the folklore fact that transcendence degree is preserved by moving to field extensions, which our methods will exploit.
Lemma 2.3 (e.g., Kayal [15, Claim 7.2], Beecken-Mittmann-Saxena [6, Lemma A.2]).
Let be an algebraic field extension of , and . Then are algebraically independent over iff are algebraically independent over .
To say that are algebraically dependent stipulates that there exists a non-zero annihilator , but a priori there is no bound on the degree of . For computational efficiency we need such a bound for annihilators, attributed to Perron, which shows that in the case of variables there exists an annihilator of degree at most . Płoski [22] has given a simple proof. The bound was sharpened by Beecken, Mittmann and Saxena [6] to reduce the exponent from , the number of polynomials, to , as well as to make the number of variables arbitrary.
Testing Algebraic Independence and Transcendence Degree
We now define the computational problems of interest to this paper.
We first briefly recall how finite fields are presented, see Shoup [27] for details. For a prime power , the finite field is given by , where is an irreducible polynomial of degree . As such, every element of can be represented as a degree polynomial over , and as such they take bits to represent in the natural encoding. Note that as primality of integers can be deterministically decided ([2]), and irreducibility of polynomials over prime fields can also be deterministically checked ([23]); hence this encoding can be efficiently and deterministically verified.
Our polynomials will be represented by algebraic circuits over the field , which is the natural succinct way to represent algebraic computation (see for example Shpilka and Yehudayoff [28]). An algebraic circuit is a labelled directed acyclic graph. The leaves are labelled with variables or field elements, and internal gates are labelled with either addition or multiplication. The circuit naturally computes a polynomial from its leaves. The output of the circuit is the polynomial computed by the designated output node. The size of the circuit is the description size of the directed acyclic graph, along with the description size of the corresponding labels. When the field is we use the above-mentioned encoding, and assume that the constant is used in the circuit. It follows that the circuit size is at least so that algorithms can be considered efficient when using arithmetic.
Definition 2.5.
The algebraic independence problem, denoted , is to decide, given algebraic circuits representing polynomials over , whether the polynomials are algebraically independent.
Note that the input size of this problem is , where is the size of the largest algebraic circuit given and by the discussion above. Thus, an algorithm that runs in will be efficient. We will need our reductions to be length increasing, and consequently we will need an upper bound on the input length, which is clearly .
We will also consider the more general problem of computing transcendence degree. We give here the natural decision version of this problem.
Definition 2.6.
The transcendence degree problem, denoted , is to decide, given algebraic circuits representing polynomials over , and a number whether the transcendence degree of obeys .
Non-Interactive Statistical Zero-Knowledge
Recall that the statistical distance of two random variables and taking values on a finite set , denoted , is given by
The class is defined in terms of non-interactive proof systems. Recall that a promise problem is defined by a disjoint pair of sets of strings and corresponds to the problem of deciding if a string is in or .
Definition 2.7.
A non-interactive statistical zero-knowledge proof system for a promise problem, given by , is defined by a triple of probabilistic machines , , and where and run in polynomial time and is computationally unbounded, a polynomial (which gives the size of a random reference string ) and a function such that the conditions below hold.
-
1.
(Completeness) For all , .
-
2.
(Soundness) For all and all provers , .
-
3.
(Zero Knowledge) For all the statistical distance between the following two distributions is at most :
-
(a)
Choose uniformly, sample from and output .
-
(b)
where the coins for are chosen uniformly at random.
-
(a)
For any polynomial there exists such that for all , , i.e. is a negligible function.
The class of problems that have a non-interactive statistical zero-knowledge proof system is denoted by .
Shannon Entropy
Recall the Shannon entropy of a random variable , which takes values on a finite set , is given by:
If is a circuit we associate with the probability distribution induced on by evaluating on the uniform distribution on .
Definition 2.8.
The promise problem Entropy Approximation, denoted , is defined on the set of encodings of circuits outputting bits, such that
The main tool in our argument is the following theorem of Goldreich, Sahai, and Vadhan, showing is complete for the class .
Theorem 2.9 ([12, Theorem 1.3]).
The promise problem is complete for .
Note that we do not need that is -hard, only that it is in .
2.1 Bounds on Polynomial Maps
In this section we look at polynomial maps and study the sizes of the images of these maps. If are algebraically dependent, then there must exist a non-zero annihilator, so the image of must be contained in the zero set of a polynomial, thus is small. We use a result proven by [14]; we include a proof for completeness.
If are algebraically independent, we show that the pre-image of is small for almost all . A similar result was proven by [14, Lemma 7], but our proof and final result improve on theirs. Their proof uses the affine Bézout theorem in high dimensions [25], but that argument is highly non-trivial, while our argument is considerably more elementary and direct. Additionally, we give a better bound on the number of exceptional points with large pre-image.
First we state and prove the bound for algebraically dependent polynomials. The upper bound is a consequence of Perron’s bound and the Schwartz-Zippel lemma.
Lemma 2.10 ([14, Lemma 11]).
If are algebraically dependent then:
Proof.
Let be the minimum degree non-zero annihilator of , since in , it follows that . By Lemma 2.4 , so by [26] we get the upper bound which implies .
In the case where the polynomials are algebraically independent, we show that for a generic element of , its pre-image maps linearly to a distinct set of points that are the root of a univariate polynomial with known degree. We first show that a generic linear map is injective on any finite set of points in . For brevity of notation define .
Proposition 2.11.
Let be distinct points in . There is a non-zero polynomial such that if then for any .
Proof.
Define by
Since are distinct points, is the product of non-zero polynomials, thus is non-zero. If then for all , , therefore all are distinct.
To use the above statement, we find an annihilator of the polynomials over the ring . In other words, this annihilator works for all choices of linear forms . We then partially evaluate it at , and argue that outside the zero-set of a polynomial in , the annihilator becomes a non-zero univariate polynomial. This is enough to argue that the number of points in the pre-image at almost every point of is small.
Lemma 2.12.
Suppose are algebraically independent, then
Proof.
Define , the rational function field over variables . The collection is algebraically dependent over so by [22], there exists an annihilator with . After clearing denominators, we can assume has coefficients in . Write as a polynomial in and coefficients in as
where is non-zero. Similarly, write as a polynomial in
Thus, there exists with non-zero and by the algebraic independence of over , and the degree bound of gives the upper bound .
For any with , suppose there exist distinct points
by Proposition 2.11, there is a non-zero polynomial such that if then are all distinct. Note implies , and since is infinite there must exist with and .
In particular is a non-zero polynomial in , and by definition of , for all
therefore, .
We conclude that if , there cannot be more than points in . All that is left is to bound the number of points in from above with [26],
2.2 Generating Finite Fields
In order for the above lemmas to give non-trivial bounds, we need to create field extensions. Here we detail the randomized algorithm described by [23] and show its error probability is exponentially small. It is known how to construct large extension fields deterministically and efficiently by a result of Adleman and Lenstra [1]. However, the randomized algorithm we present here is considerably simpler and sufficient for our purposes.
Let be a power of a prime and let . We want to generate the field as a field extension over . Since for any irreducible polynomial of degree , generating finite field extensions is equivalent to finding irreducible polynomials. To do this in general we need randomness. Let denote the set of irreducible monic polynomials in of degree , by [27, Theorem 19.12] we know
[23] also gives an algorithm for testing irreducibility of a polynomial in time . This gives a randomized algorithm for finding a degree irreducible polynomial with high probability.
Lemma 2.13.
Given integers , and a representation for a field , there is a randomized algorithm running in time that returns an irreducible polynomial of degree , except with probability in which case it returns .
Proof.
Pick monic polynomials of degree uniformly and independently by picking the coefficients uniformly from . Test each for irreducibility using the algorithm given in [23]. If some is irreducible, halt and output . If all are reducible output .
Correctness.
It is obvious that if any polynomial is returned it must be irreducible.
Success Probability.
Let be the event all are reducible and the event is reducible, we know , which implies
The probability some is irreducible is at least , and by correctness of the irreducibility test of [23] it will be output. This gives the desired error probability.
Complexity.
It takes time to write down , and testing if is irreducible by [23] takes time , thus the algorithm runs in .
2.3 Randomized Reductions for NISZK
The reductions we develop in this paper will use randomness in several ways. In particular, we will take random linear combinations of polynomials, random changes of bases, and randomness for constructing finite fields. We note randomness for constructing finite fields is not strictly essential due to [1]. Common definitions of randomized reductions allow for a constant or inverse polynomial error probability, is not currently known to be closed under such reductions, but is known to be closed under randomized reductions with negligible error [3].
Definition 2.14.
A promise problem is -reducible to a promise problem with error probability if there is a polynomial and a deterministic Turing machine running in time such that,
-
implies that ,
-
implies that .
We write . If for all then we say the reduction is length-increasing.
The issue with constant error -reductions is that we only have a zero-knowledge on yes instances of . If we use the natural zero knowledge proof system for , created by the “pullback” of the protocol for via the reduction , a constant fraction of for some will be sent outside . A valid proof system for could reveal information to the verifier on these inputs, in which case this proof system for is not zero knowledge. To avoid this issue, we require that the error probability of a randomized reduction is exponentially small in the input length.
Furthermore, using this proof system for the statistical distance between the output of the prover and simulator on an input is . To ensure that this value is indeed , we require that the reduction is length-increasing. We note however that most natural reductions, in particular all of our reductions, are length-increasing.
Remark 2.15.
If there exists such that for all and , , then we say the reduction is honest. It is clear that length-increasing reductions are honest. [3, Theorem 14] shows that is closed under honest reductions with exponentially small error probability by passing through Kolmogorov complexity, we will only need the following weaker statement, which we prove in the full version.
Lemma 2.16.
is closed under length-increasing reductions that have error probability .
3 Algebraic Independence of Polynomials in
We first focus on the case where the number of polynomials equals the number of variables. We show that the problem corresponding to instances of with the additional restriction that the number of polynomials is equal to the number of variables is in . We denote this problem by .
Definition 3.1.
The algebraic independence with equal variables and polynomials problem, denoted , is to decide, given algebraic circuits representing polynomials over , whether are algebraically independent.
We show that deciding if polynomials in variables are algebraically independent is in by reducing to . Our goal is to use the difference in image sizes shown previously to design a boolean circuit from polynomials where the entropy differs significantly depending on if the polynomials are algebraically dependent or algebraically independent.
3.1 Circuit Construction
Notice that takes in an encoding of a boolean circuit. Therefore, to describe a reduction to from , we need to turn the algebraic circuits into boolean circuits and evaluate at an approximately uniform point in . As the characteristic of may not be exactly , we design a map where , and take any bit-string to its value modulo . This turns out to output a nearly uniform element of .
Definition 3.2.
Given some enumeration of and an integer , define by taking to the element where
For any integer , let by .
With this definition we can describe the construction of the circuit from to .
Construction 3.3.
Given as algebraic circuits over , irreducible of degree , and an integer , let be a circuit on bits, outputting bits, representing the function represented as .
We will show now that the algorithm described above is computable in polynomial time. This implies that we can output the encoding of the circuit which computes this function in polynomial time as well.
Proposition 3.4.
Given as algebraic circuits over each of size at most , an irreducible polynomial of degree , and an integer , the encoding for can be computed in time .
Proof.
It suffices to show that can be computed in time . For any -bit integer , the value can be computed in time , so the corresponding element can be found in , and decoding all integers can be done in
Addition and multiplication in represented as can be done in operations over , addition and multiplication in can be done in operations, so addition and multiplication can be done in . This implies, given the algebraic circuit of , we can compute on any in time. Hence we can compute in time as desired.
3.2 Entropy of the Circuit
Throughout this section let be the uniform distribution on . Recall that is defined by an irreducible polynomial of degree , so we will think of in the section.
Here we show that if the input polynomials are algebraically independent then the entropy of the random variable can be made large. If the polynomials are algebraically dependent, then the entropy is necessarily smaller. We first deal with the case where the polynomials are algebraically dependent, this is immediate from Lemma 2.10.
Proposition 3.5.
If are algebraically dependent, then .
Proof.
By construction and by Lemma 2.10, , therefore .
In the case the polynomials are algebraically independent, in order to give a lower bound on we need to give tight upper and lower bounds of for . First, we need to argue that the distribution arising from evaluating the decoding map on the uniform distribution on is approximately uniform on .
Proposition 3.6.
For any
Proof.
Each coordinate of is independent, so it suffices to show for any that . If we enumerate , by the definition of
Since , we have:
The claim follows from and .
As has support only on the image of , we can split into points with small pre-image and large pre-image. By Lemma 2.12, when are algebraically independent there are sufficiently many points in the image of with small pre-image that their contribution to entropy alone grows like for the appropriate choice of .
Proposition 3.7.
If are algebraically independent and then
Proof.
Let be the set of points such that . From Proposition 3.6, we know that for
Now we can look at the contribution of restricted to to
By Lemma 2.12, we know that , by the lower bound of Proposition 3.6 we get
The final inequality follows from Bernoulli’s inequality since . Additionally, implies , so after dropping all positive terms from the expression, apart from , we get
which proves the claim.
3.3 Reduction to EA
Recall is parametrized by , an irreducible polynomial of degree , and an integer .
From Proposition 3.4, we know we can output the encoding for Construction 3.3 efficiently in terms of , , , , and , and if the reduction runs polynomial in , , and , then it is polynomial in the input length to . Therefore, all that is left to check is that there are values for and that are polynomial in , , and such that the entropy lower bound of when are independent is larger than the entropy upper bound of when are dependent.
Proposition 3.8.
Suppose are algebraically independent, , and then
Proof.
Since , we can apply Proposition 3.7 to get the lower bound
The bound implies , equivalently . Similarly, using the observation we see
Therefore, , which implies both and and simplifies the lower bound on to
Re-using the lower bound on and we find that
and thus
With this technical statement, we can construct the encoding for the circuit that maps to a yes instance of if are algebraically independent and a no instance of if are algebraically dependent, in time polynomial in the input length. In our reduction we use the following fact that shows that encodings of boolean circuits can be padded.
Lemma 3.9.
Given a boolean circuit of size computing and in unary, there is a polynomial time algorithm that outputs a boolean circuit for of size .
We proceed to prove the main theorem.
Theorem 3.10.
There is a length-increasing randomized reduction from to with error probability on inputs of size , that is, .
Proof.
We are given as algebraic circuits each of size at most , suppose the input size is . We will produce a boolean circuit such that if the are independent has high entropy and if are dependent has low entropy. As the reduction needs to be length-increasing, we require an upper bound on the length of the input, which can be taken to be .
We will evaluate the polynomials over a field extension of , which is encoded as bits. To use the tools above, we need to construct a large field extension of of degree , which we denote by . is the encoding length of each , we need to pick large to ensure that uniform on is approximately uniform on .
We want to use Rabin’s algorithm (Lemma 2.13), which gives an error probability of . For this to be exponentially small in the input size we set . Pick and to satisfy the conditions for Proposition 3.8.
Run Rabin’s algorithm with and . Suppose it outputs an irreducible polynomial of degree . Compute the encoding for the circuit from Construction 3.3 with , , and as input. We can pad so that it is larger than the input size. Compute the entropy threshold , which is and output .
If the algorithm does not output an irreducible polynomial, then output a no instance of , we can pad to ensure the encoding has size at least by Lemma 3.9.
Length-increasing.
The reduction is always length increasing as we pad the output appropriately.
Complexity.
By Lemma 2.13, we can find in time by the definition of and . By Proposition 3.4, the encoding for can be computed in time . The chosen values for and are polynomial in , , and , thus the encoding for can be computed in time .
Completeness.
We need to show that if are algebraically independent that encodes a distribution with entropy strictly larger than with high probability.
Suppose that Rabin’s algorithm finds an irreducible polynomial of degree . Notice that encodes the distribution and and satisfy the assumptions for Proposition 3.8, which implies
and thus is in . Therefore, the probability that is not in is bounded from above by the probability the algorithm fails to find an irreducible polynomial. By Lemma 2.13 the error probability is .
Soundness.
We need to show that if are algebraically dependent then encodes a distribution with entropy strictly smaller than .
Suppose Rabin’s algorithm finds an irreducible polynomial . As above, encodes the distribution , and by Proposition 3.5 we know that
therefore . If Rabin’s algorithm fails to find an irreducible polynomial, we output a no instance of . Hence, is always in .
Therefore, by Lemma 2.16, we see that is indeed in as desired.
Corollary 3.11.
.
4 Changing Parameters in Algebraic Dependence Testing
Previously we showed that testing if polynomials are algebraically independent in variables is in . We now show that the general problem can be reduced to this case.
We prove here two facts. First, composing a random affine map from variables to variables with algebraically independent polynomials on variables keeps the polynomials algebraically independent, giving the reduction from to . We then prove that random linear combinations of polynomials are algebraically independent if their transcendence degree was at least , giving the reduction from to .
4.1 Changing the Number of Variables
In this section we show how to reduce the number of variables from to the number of polynomials while maintaining algebraic independence. Similar results were achieved by [9, Theorem 5.2.4] using more sophisticated algebraic geometry, our techniques are more elementary.
The following statement follows from the elementary proof of [6, Lemma 16]: that there exists an affine map from to that does not affect transcendence degree.
Lemma 4.1 ([6, Lemma 16]).
Let be algebraically independent polynomials and let . If then there exists and such that are algebraically independent over .
This lemma by itself is insufficient for our purposes, because the construction they give uses the computation of transcendence degree. Instead, we will use this lemma to show that generic affine transformations also preserve algebraic independence. We want to find a criterion for the entries of a generic affine linear transformation that governs whether the transformation preserves the algebraic independence of .
Specifically, we see that the bad choices for an affine linear transformation are contained in a zero locus of a polynomial. By computing the degree of this polynomial, we get an explicit bound on the probability of a good variable reduction by Schwartz-Zippel. The proof of the following statement is deferred to the full version.
Lemma 4.2.
Let be algebraically independent polynomials, an matrix of indeterminates, , and , then there exists with such that if for and then are algebraically independent over .
Here we show that testing algebraic independence of polynomials is in by reducing to the case where we have an equal number of polynomials and variables. The above statement allows us to ensure that if the field is large enough, then with high probability the reduction of variables does not decrease the transcendence degree of the output. In our reduction we use the following fact that shows that encodings of algebraic circuits can be padded.
Lemma 4.3.
Given an algebraic circuit computing of size and in unary, there is a polynomial time algorithm that outputs an algebraic circuit for of size .
We now proceed to prove the main theorem.
Theorem 4.4.
There is a length-increasing randomized reduction with error probability on inputs of size from to , that is, .
Proof.
We are given as algebraic circuits each of size at most . We will produce over a field extension . As the reduction needs to be length increasing, we require an upper bound on an input of length , which can be taken to be .
If we output a circuit computing the zero polynomial, padding to ensure the output is larger than the input. Trivially are algebraically dependent, so the reduction has zero error probability. It is clearly length-increasing and runs in polynomial time. For the remainder of the proof we assume .
We will pass to a field extension to use the above machinery. Over this field we will take a uniformly random affine transformation from to . To create a field extension of , of size , we use Rabin’s algorithm (Lemma 2.13) to generate an irreducible polynomial of degree , which gives an error probability of . To make this exponentially small in the input length we set .
For the affine transformation to be good with high probability, using Lemma 4.2 and [26], we need to pick . Recall that the maximum degree of any given is . As the error probability needs to also be exponentially small in the output length we set .
We run Rabin’s algorithm with and described above. If it outputs an irreducible polynomial , we construct . Sample and uniformly, and output the algebraic circuit for for all . If Rabin’s algorithm fails to find an irreducible polynomial, we output a circuit computing the zero polynomial. In both cases we pad to ensure that the output is length-increasing.
Length-increasing.
The reduction is always length increasing as we pad the output appropriately.
Complexity.
Rabin’s algorithm (Lemma 2.13) for finding irreducible polynomials runs in time .
Sampling and uniformly and creating the algebraic circuits described by can be done in . Constructing the circuits for involves composing the circuits for with each and replacing all constants in the algebraic circuit for by their image under the inclusion map . We can do this in .
Lastly we can pad to make the output larger than the input in (Lemma 4.3).
All steps run in time and by the choice of and , this is polynomial in the input length.
Completeness.
We need to show that if the are algebraically independent, then the output is algebraically independent with high probability.
One source of error is that Rabin’s algorithm fails to find an irreducible polynomial. The error probability of Rabin’s algorithm is .
Another source of error is that the polynomials , where , fail to be algebraically independent. From Lemma 4.2, we know that if fail to be algebraically independent then there exists a polynomial such that . Since and , by [26]
The total probability the reduction fails to output algebraically independent polynomials is at most .
Soundness.
We need to show that if the are algebraically dependent then the output is always algebraically dependent.
If Rabin’s algorithm fails, the output is the zero polynomial, which is algebraically dependent. If the reduction finds an irreducible polynomial, the output is where . Let be any annihilator of , then , thus are algebraically dependent.
By Lemma 2.16 and Corollary 3.11, since and reduces to by a length-increasing randomized reduction with exponentially small error probability, we conclude that .
Corollary 4.5.
.
4.2 Changing the Number of Polynomials
Here we show that if we have polynomials of transcendence degree at least , we can generate linear combinations of that will be algebraically independent with high probability. We show this by carefully following the proof of the Noether Normalization Lemma over infinite fields, found in [4]. Please refer to the full version for the proofs of the statements below.
Remark 4.6.
Our result, Corollary 4.11, is similar, but incomparable, to [9, Theorem 5.2.3]. Garg shows that with probability the resulting polynomials are algebraically independent where the coefficients of the linear combinations are sampled uniformly from . We show, with probability , the resulting polynomials are algebraically independent, and we give no restriction on the set , however, the resulting linear combinations are created using in a non-standard way.
Transcendence Degree
Throughout this section we will use an equivalent definition of transcendence degree in terms of fields, for more background see [16, Chapter 8], we omit the proof of its equivalence. Recall that a field extension is algebraic over if for every there is a non-zero polynomial with .
Definition 4.7.
Suppose , the transcendence degree of over is the size of the smallest set such that is algebraic over . The transcendence degree of , is the transcendence degree of over .
This definition gives insight as to how transcendence degree behaves when we remove polynomials. If there exists an annihilator for , such that in , then is algebraic over . If is algebraic, then the extension is algebraic, and
When such a exists, we say that is algebraically dependent on . By definition, if then .
In the proof of the Noether Normalization Lemma, found in [4], we begin with algebraically dependent polynomials , find a non-zero polynomial where implies that taking the last polynomial and subtracting from each preserves transcendence degree. We observe that the degree of the polynomial is at most the degree of an annihilator, and thus the Perron bound (Lemma 2.4) gives an effective version of the Noether Normalization Lemma.
Proposition 4.8.
If are algebraically dependent with a non-zero annihilator of degree at most , then there exists a non-zero with such that if for then
If we started with polynomials algebraically dependent, applying Proposition 4.8 tells us something about the polynomials given by the linear transformation where is a matrix over . It will be useful to have notation for this linear transformation. For all and let denote the matrix
If we repeatedly apply Proposition 4.8 times using vectors where each , the resulting polynomials are .
We want algebraically independent polynomials from , so we only apply Proposition 4.8 times on . Therefore, we can afford a union bound over each of these steps as the degree of an annihilator of is significantly larger than typically. This implies that if the vectors are chosen uniformly from a large enough set, with high probability the output is algebraically independent.
Lemma 4.9.
If have transcendence degree and , let and suppose each is chosen uniformly from , then
We can now verify that once we have algebraically independent polynomials, we can continue to left multiply by matrices and the polynomials stay algebraically independent.
Proposition 4.10.
Suppose are algebraically independent and , for any where , the set is algebraically independent.
We conclude that if we started with polynomials of transcendence degree greater than , with high probability the polynomials are algebraically independent.
Corollary 4.11.
Suppose , , and , let and suppose are chosen uniformly from , then
The above corollary essentially gives the reduction from to . We sketch the argument below.
On any input we will pass to a field extension, which we can construct via Rabin’s algorithm (Lemma 2.13), to apply the above machinery. Over this large field we will take the random linear combinations described in Corollary 4.11 and output these polynomials. We note that these polynomials can be constructed efficiently in the input size. The degree of the field extension we pick is polynomial in the input size, therefore every step in the reduction runs efficiently.
If the input polynomials had high transcendence degree then we use Corollary 4.11 to argue that the probability the output is algebraically dependent is negligible. If the input polynomials had low transcendence degree then we output “too many” polynomials for them to be algebraically independent.
Theorem 4.12.
There is a length-increasing randomized reduction with error probability on inputs of size from to , that is, .
By Lemma 2.16 and Corollary 4.5, and reduces to by a length-increasing randomized reduction with negligible error probability, we conclude .
Corollary 4.13.
.
References
- [1] Leonard M. Adleman and Hendrik W. Lenstra Jr. Finding irreducible polynomials over finite fields. In Juris Hartmanis, editor, Proceedings of the 18th Annual ACM Symposium on Theory of Computing, May 28-30, 1986, Berkeley, California, USA, pages 350–355. ACM, 1986. doi:10.1145/12130.12166.
- [2] Manindra Agrawal, Neeraj Kayal, and Nitin Saxena. PRIMES is in P. Annals of mathematics, pages 781–793, 2004.
- [3] Eric Allender, Shuichi Hirahara, and Harsha Tirumala. Kolmogorov complexity characterizes statistical zero knowledge. In Innovations in Theoretical Computer Science Conference, 2023.
- [4] Allen Altman and Steven Kleiman. A term of commutative algebra. Worldwide Center of Mathematics, 2013.
- [5] László Babai and Shlomo Moran. Arthur-Merlin games: a randomized proof system, and a hierarchy of complexity classes. Journal of Computer and System Sciences, 36(2):254–276, 1988. doi:10.1016/0022-0000(88)90028-1.
- [6] Malte Beecken, Johannes Mittmann, and Nitin Saxena. Algebraic independence and blackbox identity testing. Information and Computation, 222:2–19, 2013. doi:10.1016/J.IC.2012.10.004.
- [7] Peter Bürgisser, Michael Clausen, and Mohammad A Shokrollahi. Algebraic complexity theory, volume 315. Springer Science & Business Media, 2013.
- [8] Zeev Dvir, Ariel Gabizon, and Avi Wigderson. Extractors and rank extractors for polynomial sources. computational complexity, 18(1):1–58, 2009. doi:10.1007/S00037-009-0258-4.
- [9] Abhibhav Garg. Special case algorithms for Nullstellensatz and transcendence degree. Master’s thesis, IIT Kanpur, 2020.
- [10] Abhibhav Garg, Rafael Oliveira, and Akash Kumar Sengupta. Rank Bounds and PIT for circuits via a non-linear Edelstein-Kelly theorem. 2025 IEEE 66th Annual Symposium on Foundations of Computer Science (FOCS), 2025.
- [11] Abhibhav Garg and Nitin Saxena. Special-case algorithms for blackbox radical membership, nullstellensatz and transcendence degree. In Ioannis Z. Emiris and Lihong Zhi, editors, ISSAC ’20: International Symposium on Symbolic and Algebraic Computation, Kalamata, Greece, July 20-23, 2020, pages 186–193. ACM, 2020. doi:10.1145/3373207.3404030.
- [12] Oded Goldreich, Amit Sahai, and Salil Vadhan. Can statistical zero knowledge be made non-interactive? or on the relationship of szk and niszk. In Annual International Cryptology Conference, pages 467–484. Springer, 1999. doi:10.1007/3-540-48405-1_30.
- [13] Shafi Goldwasser and Michael Sipser. Private coins versus public coins in interactive proof systems. In Proceedings of the eighteenth annual ACM symposium on Theory of computing, pages 59–68, 1986. doi:10.1145/12130.12137.
- [14] Zeyu Guo, Nitin Saxena, and Amit Sinhababu. Algebraic dependencies and pspace algorithms in approximative complexity over any field. Theory of Computing, 15(1):1–30, 2019. doi:10.4086/TOC.2019.V015A016.
- [15] Neeraj Kayal. The complexity of the annihilating polynomial. In 2009 24th Annual IEEE Conference on Computational Complexity, pages 184–193. IEEE, 2009. doi:10.1109/CCC.2009.37.
- [16] Serge Lang. Algebra, volume 211. Springer Science & Business Media, 2012.
- [17] Johannes Mittmann, Nitin Saxena, and Peter Scheiblechner. Algebraic independence in positive characteristic: A p-adic calculus. Transactions of the American Mathematical Society, 366(7):3425–3450, 2014.
- [18] Tatsuaki Okamoto. On relationships between statistical zero-knowledge proofs. In Proceedings of the twenty-eighth annual ACM symposium on Theory of computing, pages 649–658, 1996. doi:10.1145/237814.238016.
- [19] Rafail Ostrovsky. One-way functions, hard on average problems, and statistical zero-knowledge proofs. In Proceedings of the Sixth Annual Structure in Complexity Theory Conference, Chicago, Illinois, USA, June 30 - July 3, 1991, pages 133–138. IEEE Computer Society, 1991. doi:10.1109/SCT.1991.160253.
- [20] James G Oxley. Matroid theory, volume 3. Oxford University Press, USA, 2006.
- [21] Anurag Pandey, Nitin Saxena, and Amit Sinhababu. Algebraic independence over positive characteristic: New criterion and applications to locally low-algebraic-rank circuits. Comput. Complex., 27(4):617–670, 2018. doi:10.1007/S00037-018-0167-5.
- [22] Arkadiusz Płoski. Algebraic dependence of polynomials after o. perron and some applications. Computational Commutative and Non-Commutative Algebraic Geometry, pages 167–173, 2005.
- [23] Michael O Rabin. Probabilistic algorithms in finite fields. SIAM Journal on computing, 9(2):273–280, 1980. doi:10.1137/0209024.
- [24] Nitin Saxena and Comandur Seshadhri. Blackbox identity testing for bounded top fanin depth-3 circuits: the field doesn’t matter. In Proceedings of the forty-third annual ACM symposium on Theory of computing, pages 431–440, 2011.
- [25] Joachim Schmid. On the affine bezout inequality. manuscripta mathematica, 88(1):225–232, 1995.
- [26] Jacob T Schwartz. Fast probabilistic algorithms for verification of polynomial identities. Journal of the ACM (JACM), 27(4):701–717, 1980. doi:10.1145/322217.322225.
- [27] Victor Shoup. A computational introduction to number theory and algebra. Cambridge university press, 2009.
- [28] Amir Shpilka, Amir Yehudayoff, et al. Arithmetic circuits: A survey of recent results and open questions. Foundations and Trends® in Theoretical Computer Science, 5(3–4):207–388, 2010. doi:10.1561/0400000039.