Abstract 1 Introduction 2 Preliminaries 3 Algebraic Independence of 𝒏 Polynomials in 𝗡𝗜𝗦𝗭𝗞 4 Changing Parameters in Algebraic Dependence Testing References

Proving Algebraic Independence in Zero-Knowledge

Michael A. Forbes Department of Computer Science, University of Illinois at Urbana-Champaign, IL, USA    Andrei Staicu Department of Computer Science, University of Illinois at Urbana-Champaign, IL, USA
Abstract

A set of multivariate polynomials is algebraically independent if they exhibit no non-trivial algebraic relations, and this notion is fundamental in algebra. When these polynomials are given as algebraic circuits, deciding algebraic independence has several applications in algebraic complexity theory. Over fields of zero (or exponentially large) characteristic, this problem is known to have an efficient randomized algorithm. Over finite fields of small characteristic, a sequence of works has culminated in showing that algebraic independence admits Arthur-Merlin proofs, in particular giving the complexity bound of 𝖠𝖬𝖼𝗈𝖠𝖬 ([14]).

We improve the complexity of deciding algebraic independence over finite fields by showing that it admits zero-knowledge proofs, in particular giving the upper bound of 𝖭𝖨𝖲𝖹𝖪𝖠𝖬𝖼𝗈𝖠𝖬, the class of problems admitting non-interactive statistical zero-knowledge proofs. This is achieved by arguing that algebraically independent polynomials yield maps whose output distribution has high-entropy, while algebraically dependent polynomials yield maps with low-entropy. We can then reduce to the question of approximating entropy, which is a known 𝖭𝖨𝖲𝖹𝖪-complete problem.

We also more generally show that transcendence degree, which quantifies the independence of a set of possibly dependent polynomials, can be computed in 𝖭𝖨𝖲𝖹𝖪.

Keywords and phrases:
Algebraic Dependence, Non-Interactive Statistical Zero-Knowledge
Category:
Track A: Algorithms, Complexity and Games
Funding:
Michael A. Forbes: Supported by NSF CAREER award 2047310.
Andrei Staicu: Supported by NSF CAREER award 2047310.
Copyright and License:
[Uncaptioned image] © Michael A. Forbes and Andrei Staicu; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Algebraic complexity theory
; Theory of computation Complexity classes
Editors:
Sayan Bhattacharya, Danupon Nanongkai, Michael Benedikt, and Gabriele Puppis

1 Introduction

Linear algebra plays a fundamental role in mathematics, and a main question there is understanding whether a given set of linear forms 1(x¯),,m(x¯) over variables x¯=(x1,,xn) are linearly dependent. Higher algebra generalizes this notion to that of algebraic dependence, where we ask if a given set of polynomials f1(x¯),,fm(x¯) are dependent, meaning there exists a non-zero annihilating polynomial P such that P(f1,,fm)=0. If no such P exists then the polynomials f¯ are algebraically independent. We can quantify beyond just dependence-vs-independence to define transcendence degree, which is the size of the largest subset of the polynomials fi that are algebraically independent. Like linear independence, algebraic independence and transcendence degree play a fundamental role in understanding multivariate polynomials, for example in how the dimension of an algebraic variety is defined.

In this paper we study algebraic independence as a computational problem, so that given the polynomials f¯ we seek to decide if they are independent. In formalizing this problem, one must set the encoding of the input. In the complexity-theoretic literature, it is most often assumed that the polynomials f¯ are given by algebraic circuits, which are syntactic diagrams that construct polynomials from the variables x¯ using basic operations such as addition, multiplication, and scalars from the underlying field 𝔽. Algebraic circuits are the most natural succinct way to present algebraic computation, see for example the survey of Shpilka and Yehudayoff [28]. This encoding is particularly well-motivated as algebraic independence then (trivially) generalizes the polynomial identity testing (PIT) problem, which asks whether a given algebraic circuit computes a non-zero polynomial. That is, a single polynomial f1 is algebraically dependent iff f1 is constant iff f1(x¯)f1(0) is zero. As developing (deterministic) PIT algorithms is a central challenge in algebraic complexity theory, one can view the problem of deciding (succinct) algebraic independence as a far-reaching generalization of PIT.

The expressiveness of the algebraic independence testing problem leads to a number of important applications. One application is PIT itself. In particular, deterministic PIT algorithms for certain restricted classes of algebraic circuits can be solved by a general “rank bounds” methodology. One first shows a structural result, arguing that “simple and minimal” circuits from these classes that express polynomial identities necessarily have a small “rank bound”. One then argues that the number of variables can (in a derandomized way) be reduced to this rank bound, at which point brute-force methodologies become comparatively efficient. This methodology was done for bounded top-fan-in depth-3 circuits, using linear independence as the notion of rank, in a series of works culminating in the work of Saxena and Seshadri [24]. This paradigm was generalized to bounded top- and middle-fan-in depth-4 circuits by [6], where the notion of rank is now that of transcendence degree. Rank bounds in this setting are much more difficult, but have been established in some settings, see Garg-Oliveira-Sengupta [10]. A key difficulty in using transcendence degree for PIT is arguing that transcendence degree is preserved in the derandomized variable reduction. This requires a reasonable mathematical criterion for computing transcendence degree; this roughly corresponds to an efficient algorithm for computing transcendence degree.

Other applications include designing extractors for the images of polynomial maps ([8]), and for computing the maximum tensor rank of a given format ([7, Chapter 20]).

Over a field of characteristic 0 (or exponentially large), it is known that one can reduce the notion of algebraic dependence to that of linear dependence. As is typical in any sort of linearization, one uses differential techniques; in particular the transcendence degree of f¯ is equal to the (linear) rank of the Jacobian matrix of f¯. Whether the Jacobian is full-rank then is asking if a certain determinant is zero, which can be solved using PIT techniques. This shows that algebraic independence can be solved in 𝖱𝖯.

Unfortunately, in a field of characteristic p one has that xxp=0, so the Jacobian criterion then fails. Further, it is known that while both linear and algebraic dependence structures form matroids over any field ([20]), it is known that there are algebraic matroids (over fields of small characteristic) that are not representable by linear dependence structures (over any field) ([20]). This indicates that in small characteristic linearization methods will necessarily fail to capture algebraic dependencies.

Absent the Jacobian criterion, one can still show that deciding algebraic independence can be done in 𝖯𝖲𝖯𝖠𝖢𝖤 over any field. This is done using degree bounds for annihilating polynomials, alongside parallel linear algebra techniques. The gap between 𝖯𝖲𝖯𝖠𝖢𝖤 and 𝖱𝖯 for general fields has thus prompted a sequence of works seeking better and better algorithms for algebraic independence. The work of [17] gave an 𝖭𝖯#𝖯 algorithm, and [21] gave an algorithm that ran efficiently when the “inseparable degree” was small. Guo, Saxena and Sinhababu [14] gave an 𝖠𝖬𝖼𝗈𝖠𝖬 upper bound for finite fields, in particular putting this problem in the polynomial hierarchy as well as suggesting algebraic independence is not 𝖭𝖯-hard (unless the polynomial hierarchy collapses). Incomparably, Garg and Saxena [11] gave an improved exponential-time algorithm.

1.1 Our Results

The starting point for this work is that Guo-Saxena-Sinhababu [14] seems unlikely to be unimprovable, as 𝖠𝖬𝖼𝗈𝖠𝖬 is not a syntactically-defined class and as such is not known to have complete language problems (as far as we are aware). As such, it would be surprising if algebraic independence was (𝖠𝖬𝖼𝗈𝖠𝖬)-complete. Furthermore, to obtain their result Guo-Saxena-Sinhababu [14] gave two algorithms, one for 𝖠𝖬 and one for 𝖼𝗈𝖠𝖬. While highly related, they used slightly different logic; it seems natural that a single algorithm should encompass both results.

Correspondingly, in this work we improve on the Guo-Saxena-Sinhababu [14] result, showing that algebraic independence over finite fields can be solved in non-interactive statistical zero-knowledge. That is, Guo-Saxena-Sinhababu [14] showed that there are Arthur-Merlin proofs certifying that independent polynomials are independent, as well as showing that there are such proofs that dependent polynomials are dependent. Arthur-Merlin proofs are interactions between an all-powerful prover (Merlin) and a resource-bounded verifier (Arthur). Babai-Moran [5] showed that while these interactions can include many rounds, one can convert them to the following type of protocol. First, Arthur sends Merlin a random string. Merlin then produces a purported proof, which Arthur then verifies. We observe here that the proof that an honest Merlin produces can be approximately simulated by a resource-bounded third party, who only knows that the polynomials are algebraically independent (and in particular knows nothing more). The approximation error between the true distribution of Merlin’s proofs and the simulator’s version is negligible, so this forms a statistical zero-knowledge guarantee: Arthur learns from Merlin that the f¯ are algebraically independent, and nothing more. This protocol is considered to be non-interactive because the challenge that Arthur sends to Merlin in the first round is a completely random string independent of the input.

Formally, we have the following result.

Theorem 1.1 (Corollary 4.5).

Given a finite field 𝔽q and polynomials f1,,fm𝔽[x1,,xn] represented by size-s circuits, there is a non-interactive statistical zero-knowledge proof that f¯ are algebraically independent. That is, 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉𝖭𝖨𝖲𝖹𝖪.

The above exposition immediately suggests that 𝖭𝖨𝖲𝖹𝖪 proofs are a subset of 𝖠𝖬 proofs, which as-is would only improve the Guo-Saxena-Sinhababu [14] result to 𝖭𝖨𝖲𝖹𝖪𝖼𝗈𝖠𝖬. However, known complexity theoretic results show that 𝖭𝖨𝖲𝖹𝖪𝖲𝖹𝖪, where 𝖲𝖹𝖪 is the class of statistical zero-knowledge proofs (hence allowing more interaction). Further, it is known that 𝖲𝖹𝖪=𝖼𝗈𝖲𝖹𝖪 ([18]) and that 𝖲𝖹𝖪𝖠𝖬, and as such we have that 𝖭𝖨𝖲𝖹𝖪𝖠𝖬𝖼𝗈𝖠𝖬. Hence, we have a single algorithmic result that in particular implies the Guo-Saxena-Sinhababu [14] result. Moreover, this result exposes what we believe is the natural conclusion of the techniques of Guo-Saxena-Sinhababu [14] .

Placing algebraic independence in 𝖭𝖨𝖲𝖹𝖪 has potential cryptographic implications. Ostrovsky [19] showed that any problem that is hard on average, that also possesses statistical zero-knowledge proofs, will imply one-way functions (and hence all of private-key cryptography). While it seems possible that algebraic dependence in small-characteristic is easy, it also seems possible it is difficult. If so, as an algebraic problem, it would likely also be hard on average as many algebraic problems have worse-case to average-case reductions; one would then conclude that one-way functions exist. This line of thought, along with our work, suggests exploring algebraic dependence as a possible source of cryptographic hardness.

1.2 Our Techniques

Our techniques largely follow that of Guo-Saxena-Sinhababu [14] , but with a focus on incorporating zero-knowledge methods into our proofs. In particular, we view the polynomials f¯ as a map f¯:𝔽qn𝔽qm and study the image im(f¯) of this map. Guo-Saxena-Sinhababu [14] showed that when f¯ are independent the image is “large” (when possibly passing to a field extension 𝔽qt𝔽q), while when the f¯ are dependent the image is “small”. This yields an 𝖠𝖬 protocol for algebraic independence by appealing to the 𝖠𝖬 set-size approximation protocol of Goldwasser and Sipser [13] to distinguish between large and small sets. For their 𝖼𝗈𝖠𝖬 protocol they instead look at the pre-images of the map defined by f¯. That is, when f¯ are independent the image is large, and hence “most” pre-images must be small. Similarly, when the f¯ are dependent the image is small, and hence “most” pre-images must be large. One then again appeals to the Goldwasser and Sipser [13] protocol.

We combine the ideas of the above two protocols to obtain our result. While one could construct a 𝖭𝖨𝖲𝖹𝖪 protocol directly, we instead use that 𝖭𝖨𝖲𝖹𝖪 has well-known complete (promise) problems, in particular that estimating the entropy of a distribution given by a boolean circuit is 𝖭𝖨𝖲𝖹𝖪-complete. That is, one is given a boolean circuit computing a function g:{0,1}n{0,1}m, and one can then ask questions about the distribution of the random variable g(𝖴n) where 𝖴n is the uniform distribution on n bits. Goldreich, Sahai and Vadhan [12] showed that there is an 𝖭𝖨𝖲𝖹𝖪 protocol to prove that the entropy of g(𝖴n) is “high”, in comparison to when the entropy is “low”; this is a promise problem because of the gap between low- and high-entropy.

We show that for a polynomial map given by f¯:𝔽qn𝔽qn, we can naturally interpret it as a boolean function gf¯:{0,1}m{0,1}m for mnlogq. When f¯ are independent, then (after possibly passing to a field extension 𝔽qt𝔽q) “most” pre-images of f¯ (and hence gf¯) are small, and this implies that gf¯(𝖴m) has low collision probability and hence high entropy. When f¯ are dependent, then the image of f¯ (and hence gf¯) is “small”, so that the entropy must also be small. By setting parameters carefully, one can find that there is a sufficient entropy gap in gf¯(𝖴m) when comparing the dependent and independent cases; completing the reduction.

However, there are various subtleties. This includes encoding issues, such as dealing with how qn is not (generally) a power of 2. There is also that our reduction is randomized, due to the need to find irreducible polynomials (to construct an extension field), as well as to randomly change variables so that f¯ is n polynomials on n variables. We then need to invoke the fact that 𝖭𝖨𝖲𝖹𝖪 is closed under randomized reductions, which involves some slight care because the failure probability must be negligible.

We finally note here that our techniques extend to certifying transcendence degree in 𝖭𝖨𝖲𝖹𝖪.

Theorem 1.2 (Corollary 4.13).

Given a finite field 𝔽q, f1,,fm𝔽q[x1,,xn] represented by size-s circuits, and number r1, there is a non-interactive statistical zero-knowledge proof that trdeg(f¯)r.

This is achieved by randomly reducing this problem to the case when n=m=r, solved above, by taking random linear combinations of the f¯.

2 Preliminaries

Notation

We briefly here set notation for the paper, most of which is standard. For logarithms, we denote lg for log2. We will denote 𝔽 to be a general field, and 𝔽q denotes the finite field with q elements. The algebraic closure of a field 𝔽 will be denoted as 𝔽¯. A polynomial ring in n indeterminates will be denoted by 𝔽[x1,,xn]. We will write x¯ for the tuple (x1,,xn) (or alternatively as a column vector) when the dimensionality is clear from context. Similarly, we will write a¯ to express a tuple from Sn for a set S. We will sometimes use the 1-norm to measure degrees of monomials, so that for a¯n, we have |a¯|1=i=1nai (note that as ai0 no absolute values are needed).

We extend the notion of the degree of a polynomial to tuples of polynomials, so that deg(f¯)=maxideg(fi).

For any polynomial f𝔽[x1,,xn], 𝕍𝔽(f) will denote the set of zeros of f over 𝔽, that is, 𝕍𝔽(f):={α¯𝔽n:f(α¯)=0}. Given m polynomials f¯=(f1,,fm) over 𝔽[x1,,xn] we often abuse notation and interpret f¯ as a map f¯:𝔽n𝔽m given by f¯:α¯(f1(α¯),,fm(α¯)). Note that we can also interpret this map over any extension field 𝕂𝔽.

We also denote f¯1 as the pre-image of f¯, so that for β¯𝔽n, f¯1(β¯)={α¯𝔽n:f¯(α¯)=β¯} (which is possibly empty). We write f¯𝔽1 to emphasize the pre-image is taken over 𝔽, but often this is omitted when clear.

We will use the following non-standard notation often, which we now highlight.

Definition 2.1.

For polynomials f1,,fm𝔽[x¯], we denote their degree product D(f¯), as D(f¯):=i=1mdeg(fi).

Algebraic Dependence and Transcendence Degree

Definition 2.2.

Polynomials f1,,fm𝔽[x1,,xn] are algebraically dependent (over 𝔽) if there exists a non-zero g𝔽[y1,,ym] such that g(f¯)=0 in 𝔽[x¯]. They are otherwise algebraically independent. The polynomial g is said to be an annihilator of f¯.

The transcendence degree of f¯ (over 𝔽), denoted trdeg𝔽(f¯), is the size of the largest subset S[m] such that f¯|S=(fi)iS is algebraically independent. The field is omitted when clear from context.

Note that the polynomials f¯ being algebraically independent is equivalent to requiring that the map

φ:𝔽[y¯] 𝔽[x¯]
yi fi(x¯),

is injective. The kernel of φ is precisely the set of annihilators. We note here the folklore fact that transcendence degree is preserved by moving to field extensions, which our methods will exploit.

Lemma 2.3 (e.g., Kayal [15, Claim 7.2], Beecken-Mittmann-Saxena [6, Lemma A.2]).

Let 𝕂𝔽 be an algebraic field extension of 𝔽, and f1,,fm𝔽[x¯]𝕂[x¯]. Then f¯ are algebraically independent over 𝔽 iff f¯ are algebraically independent over 𝕂.

To say that f1,,fm are algebraically dependent stipulates that there exists a non-zero annihilator g, but a priori there is no bound on the degree of g. For computational efficiency we need such a bound for annihilators, attributed to Perron, which shows that in the case of m1 variables there exists an annihilator of degree at most D(f¯). Płoski [22] has given a simple proof. The bound was sharpened by Beecken, Mittmann and Saxena [6] to reduce the exponent from m, the number of polynomials, to trdeg(f¯), as well as to make the number of variables arbitrary.

Lemma 2.4 (Perron’s Bound ([22], [6, Corollary 6])).

Suppose f1,,fm𝔽[x1,,xn] are algebraically dependent. Then there exists a non-zero annihilator g𝔽[y1,,ym] with

deg(g)(deg(f¯))trdeg(f¯).

Testing Algebraic Independence and Transcendence Degree

We now define the computational problems of interest to this paper.

We first briefly recall how finite fields are presented, see Shoup [27] for details. For a prime power q=pt, the finite field 𝔽q is given by 𝔽q=𝔽p[z]/h(z), where h𝔽p[z] is an irreducible polynomial of degree t. As such, every element of 𝔽q can be represented as a degree <t polynomial over 𝔽p, and as such they take Θ(tlgp)=Θ(lgq) bits to represent in the natural encoding. Note that as primality of integers can be deterministically decided ([2]), and irreducibility of polynomials over prime fields can also be deterministically checked ([23]); hence this encoding can be efficiently and deterministically verified.

Our polynomials will be represented by algebraic circuits over the field 𝔽q, which is the natural succinct way to represent algebraic computation (see for example Shpilka and Yehudayoff [28]). An algebraic circuit is a labelled directed acyclic graph. The leaves are labelled with variables xi or field elements, and internal gates are labelled with either addition or multiplication. The circuit naturally computes a polynomial from its leaves. The output of the circuit is the polynomial computed by the designated output node. The size of the circuit is the description size of the directed acyclic graph, along with the description size of the corresponding labels. When the field is 𝔽q we use the above-mentioned encoding, and assume that the constant 0 is used in the circuit. It follows that the circuit size is at least Θ(lgq) so that algorithms can be considered efficient when using 𝔽q arithmetic.

Definition 2.5.

The algebraic independence problem, denoted 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉, is to decide, given algebraic circuits representing polynomials f1,,fm over 𝔽q, whether the polynomials f¯ are algebraically independent.

Note that the input size of this problem is Ω(m+s), where s is the size of the largest algebraic circuit given and slgq by the discussion above. Thus, an algorithm that runs in 𝗉𝗈𝗅𝗒(m,s,lgq) will be efficient. We will need our reductions to be length increasing, and consequently we will need an upper bound on the input length, which is clearly ms.

We will also consider the more general problem of computing transcendence degree. We give here the natural decision version of this problem.

Definition 2.6.

The transcendence degree problem, denoted 𝖳𝗋𝖣𝖾𝗀, is to decide, given algebraic circuits representing polynomials f1,,fm over 𝔽q, and a number r whether the transcendence degree of f¯ obeys trdeg(f¯)r.

Non-Interactive Statistical Zero-Knowledge

Recall that the statistical distance of two random variables 𝖷 and 𝖸 taking values on a finite set T, denoted Δ(𝖷,𝖸), is given by

Δ(𝖷,𝖸)=α12|Pr[𝖷=α]Pr[𝖸=α]|.

The class 𝖭𝖨𝖲𝖹𝖪 is defined in terms of non-interactive proof systems. Recall that a promise problem is defined by a disjoint pair of sets of strings (ΠY,ΠN) and corresponds to the problem of deciding if a string xΠYΠN is in ΠY or ΠN.

Definition 2.7.

A non-interactive statistical zero-knowledge proof system for a promise problem, given by Π=(ΠY,ΠN), is defined by a triple of probabilistic machines P, V, and S where V and S run in polynomial time and P is computationally unbounded, a polynomial r(n) (which gives the size of a random reference string σ) and a function β(n) such that the conditions below hold.

  1. 1.

    (Completeness) For all xΠY, Prσ{0,1}r(|x|)[V(x,σ,P(x,σ))=1]23.

  2. 2.

    (Soundness) For all xΠN and all provers P~, Prσ{0,1}r(|x|)[V(x,σ,P~(x,σ))=1]13.

  3. 3.

    (Zero Knowledge) For all xΠY the statistical distance between the following two distributions is at most β(|x|):

    1. (a)

      Choose σ{0,1}r(|x|) uniformly, sample p from P(x,σ) and output (p,σ).

    2. (b)

      S(x,c) where the coins c for S are chosen uniformly at random.

For any polynomial g there exists n0 such that for all nn0, β(n)<1/g(n), i.e. β is a negligible function.

The class of problems that have a non-interactive statistical zero-knowledge proof system is denoted by 𝖭𝖨𝖲𝖹𝖪.

Shannon Entropy

Recall the Shannon entropy of a random variable 𝖷, which takes values on a finite set T, is given by:

H(𝖷):=αSupp𝖷Pr[𝖷=α]lg(1/Pr[𝖷=α]).

If C is a circuit {0,1}m{0,1}n we associate C with the probability distribution 𝖷C induced on {0,1}n by evaluating C on the uniform distribution on {0,1}m.

Definition 2.8.

The promise problem Entropy Approximation, denoted 𝖤𝖠, is defined on the set of encodings of circuits {0,1}m{0,1}n outputting n bits, such that

𝖤𝖠Y ={(C,k):H(𝖷C)>k+1}
𝖤𝖠N ={(C,k):H(𝖷C)<k1}.

The main tool in our argument is the following theorem of Goldreich, Sahai, and Vadhan, showing 𝖤𝖠 is complete for the class 𝖭𝖨𝖲𝖹𝖪.

Theorem 2.9 ([12, Theorem 1.3]).

The promise problem 𝖤𝖠 is complete for 𝖭𝖨𝖲𝖹𝖪.

Note that we do not need that 𝖤𝖠 is 𝖭𝖨𝖲𝖹𝖪-hard, only that it is in 𝖭𝖨𝖲𝖹𝖪.

2.1 Bounds on Polynomial Maps

In this section we look at polynomial maps f¯:𝔽qn𝔽qn and study the sizes of the images of these maps. If f¯ are algebraically dependent, then there must exist a non-zero annihilator, so the image of f¯ must be contained in the zero set of a polynomial, thus is small. We use a result proven by [14]; we include a proof for completeness.

If f¯ are algebraically independent, we show that the pre-image of f¯(α¯) is small for almost all α¯. A similar result was proven by [14, Lemma 7], but our proof and final result improve on theirs. Their proof uses the affine Bézout theorem in high dimensions [25], but that argument is highly non-trivial, while our argument is considerably more elementary and direct. Additionally, we give a better bound on the number of exceptional points with large pre-image.

First we state and prove the bound for algebraically dependent polynomials. The upper bound is a consequence of Perron’s bound and the Schwartz-Zippel lemma.

Lemma 2.10 ([14, Lemma 11]).

If f1,,fn𝔽q[x1,,xn] are algebraically dependent then:

|im(f¯)|(deg(f¯)q)n1
Proof.

Let P𝔽q[y¯] be the minimum degree non-zero annihilator of f1,,fn, since P(f¯)0 in 𝔽q[x¯], it follows that im(f¯)𝕍𝔽q(P). By Lemma 2.4 degP(deg(f¯))n1, so by [26] we get the upper bound |𝕍𝔽q(P)|(degP)qn1 which implies |im(f¯)|(deg(f¯)q)n1.

In the case where the polynomials are algebraically independent, we show that for a generic element of 𝔽n, its pre-image maps linearly to a distinct set of points that are the root of a univariate polynomial with known degree. We first show that a generic linear map 𝔽n𝔽 is injective on any finite set of points in 𝔽n. For brevity of notation define c¯(x¯)=c1x1++cnxn.

Proposition 2.11.

Let α¯1,,α¯m be distinct points in 𝔽n. There is a non-zero polynomial P𝔽[c1,,cn] such that if P(γ¯)0 then γ¯(α¯i)γ¯(α¯j) for any ij.

Proof.

Define P𝔽[c¯] by

P(c¯)=i<j(k=1nck((α¯i)k(α¯j)k)).

Since α¯i are distinct points, P is the product of non-zero polynomials, thus P is non-zero. If P(γ¯)0 then for all ij, γ¯(α¯i)γ¯(α¯j)=k=1nγk((α¯i)k(α¯j)k)0, therefore all γ¯(α¯j) are distinct.

To use the above statement, we find an annihilator of the polynomials f1,,fn,c¯(x¯) over the ring 𝔽[c¯]. In other words, this annihilator works for all choices of linear forms c¯(x¯). We then partially evaluate it at f¯, and argue that outside the zero-set of a polynomial in 𝔽[x¯], the annihilator becomes a non-zero univariate polynomial. This is enough to argue that the number of points in the pre-image at almost every point of 𝔽n is small.

Lemma 2.12.

Suppose f1,,fn are algebraically independent, then

|{α¯𝔽qn:|f¯𝔽¯q1(f¯(α¯))|D(f¯)}|qn(deg(f¯)D(f¯))qn1.
Proof.

Define 𝔽=𝔽q(c1,,cn), the rational function field over variables c¯. The collection {f1,,fn,c¯(x¯)} is algebraically dependent over 𝔽[x¯] so by [22], there exists an annihilator Q𝔽[y1,,yn,z] with degy¯,zQD(f¯). After clearing denominators, we can assume Q has coefficients in 𝔽q[c¯]. Write Q as a polynomial in z and coefficients in 𝔽q[c¯,y¯] as

Q(c¯,y¯,z)=i=0degzQQi(c¯,y¯)zi,

where QdegzQ(c¯,y¯) is non-zero. Similarly, write QdegzQ(c¯,y¯) as a polynomial in (𝔽q[y¯])[c¯]

QdegzQ(c¯,y¯)=a¯Ca¯(y¯)c¯a¯.

Thus, there exists a¯ with S(y¯):=Ca¯(y¯) non-zero and by the algebraic independence of f¯ over 𝔽q, S(f¯)0 and the degree bound of Q gives the upper bound degy¯Sdegy¯QD(f¯).

For any α¯𝔽qn with S(f¯(α¯))0, suppose there exist K distinct points

{β¯1,,β¯K}f¯𝔽¯q1(f¯(α¯)),

by Proposition 2.11, there is a non-zero polynomial P𝔽¯q[c¯] such that if P(γ¯)0 then γ¯(β¯i) are all distinct. Note S(f¯(α¯))0 implies QdegzQ(c¯,f¯(α¯))0, and since 𝔽¯q is infinite there must exist γ¯ with P(γ¯)0 and QdegzQ(γ¯,f¯(α¯))0.

In particular Q(γ¯,f¯(α¯),z) is a non-zero polynomial in 𝔽¯q[z], and by definition of Q, for all iK

Q(γ¯,f¯(α¯),γ¯(β¯i))=Q(γ¯,f¯(β¯i),γ¯(β¯i))=0,

therefore, KdegzQD(f¯).

We conclude that if S(f¯(α¯))0, there cannot be more than D(f¯) points in f¯𝔽¯q1(f¯(α¯)). All that is left is to bound the number of points in 𝕍𝔽q(S(f¯)) from above with [26],

|𝕍𝔽q(S(f¯))|degS(f¯)qn1(deg(f¯)degy¯S)qn1(deg(f¯)D(f¯))qn1.

2.2 Generating Finite Fields

In order for the above lemmas to give non-trivial bounds, we need to create field extensions. Here we detail the randomized algorithm described by [23] and show its error probability is exponentially small. It is known how to construct large extension fields deterministically and efficiently by a result of Adleman and Lenstra [1]. However, the randomized algorithm we present here is considerably simpler and sufficient for our purposes.

Let q0 be a power of a prime and let q=q0t. We want to generate the field 𝔽q as a field extension over 𝔽q0. Since 𝔽q𝔽q0[z]/h(z) for any irreducible polynomial h𝔽q0[z] of degree t, generating finite field extensions is equivalent to finding irreducible polynomials. To do this in general we need randomness. Let I(t) denote the set of irreducible monic polynomials in 𝔽q0[z] of degree t, by [27, Theorem 19.12] we know

q0t2t|I(t)|q0tt.

[23] also gives an algorithm for testing irreducibility of a polynomial in time 𝗉𝗈𝗅𝗒(t,logq0). This gives a randomized algorithm for finding a degree t irreducible polynomial with high probability.

Lemma 2.13.

Given integers N,t1, and a representation for a field 𝔽q0, there is a randomized algorithm running in time 𝗉𝗈𝗅𝗒(t,N,logq0) that returns an irreducible polynomial h𝔽q0[z] of degree t, except with probability δeN/2t in which case it returns .

Proof.

Pick monic polynomials h1,,hN of degree t uniformly and independently by picking the Nt coefficients uniformly from 𝔽q0. Test each hi for irreducibility using the algorithm given in [23]. If some hi is irreducible, halt and output hi. If all hi are reducible output .

Correctness.

It is obvious that if any polynomial is returned it must be irreducible.

Success Probability.

Let E be the event all hi are reducible and Ei the event hi is reducible, we know Pr[Ei]11/2t, which implies

Pr[E]=Pr[i=1NEi]=i=1NPr[Ei](112t)NeN/2t.

The probability some hi is irreducible is at least 1eN/2t, and by correctness of the irreducibility test of [23] it will be output. This gives the desired error probability.

Complexity.

It takes time 𝗉𝗈𝗅𝗒(N,t,logq0) to write down h1,,hN, and testing if hi is irreducible by [23] takes time 𝗉𝗈𝗅𝗒(t,logq0), thus the algorithm runs in 𝗉𝗈𝗅𝗒(N,t,logq0).

2.3 Randomized Reductions for NISZK

The reductions we develop in this paper will use randomness in several ways. In particular, we will take random linear combinations of polynomials, random changes of bases, and randomness for constructing finite fields. We note randomness for constructing finite fields is not strictly essential due to [1]. Common definitions of randomized reductions allow for a constant or inverse polynomial error probability, 𝖭𝖨𝖲𝖹𝖪 is not currently known to be closed under such reductions, but is known to be closed under randomized reductions with negligible error [3].

Definition 2.14.

A promise problem Π=(ΠY,ΠN) is mBPP-reducible to a promise problem Π=(ΠY,ΠN) with error probability δ<1/2 if there is a polynomial p and a deterministic Turing machine M running in time p such that,

  • xΠY implies that Prr{0,1}p(|x|)[M(x,r)ΠY]1δ,

  • xΠN implies that Prr{0,1}p(|x|)[M(x,r)ΠN]1δ.

We write ΠmBPPΠ. If |M(x,r)||x| for all r then we say the reduction is length-increasing.

The issue with constant error mBPP-reductions is that we only have a zero-knowledge on yes instances of Π. If we use the natural zero knowledge proof system for Π, created by the “pullback” of the 𝖭𝖨𝖲𝖹𝖪 protocol for Π via the reduction M, a constant fraction of M(x,) for some xΠY will be sent outside ΠY. A valid proof system for Π could reveal information to the verifier on these inputs, in which case this proof system for Π is not zero knowledge. To avoid this issue, we require that the error probability of a randomized reduction is exponentially small in the input length.

Furthermore, using this proof system for Π the statistical distance between the output of the prover and simulator on an input x is 1/|M(x,r)|ω(1). To ensure that this value is indeed 1/|x|ω(1), we require that the reduction M is length-increasing. We note however that most natural reductions, in particular all of our reductions, are length-increasing.

 Remark 2.15.

If there exists ϵ>0 such that for all x and r, |M(x,r)||x|ϵ, then we say the reduction is honest. It is clear that length-increasing reductions are honest. [3, Theorem 14] shows that 𝖭𝖨𝖲𝖹𝖪 is closed under honest mBPP reductions with exponentially small error probability by passing through Kolmogorov complexity, we will only need the following weaker statement, which we prove in the full version.

Lemma 2.16.

𝖭𝖨𝖲𝖹𝖪 is closed under mBPP length-increasing reductions that have error probability δ2|x|.

3 Algebraic Independence of 𝒏 Polynomials in 𝗡𝗜𝗦𝗭𝗞

We first focus on the case where the number of polynomials equals the number of variables. We show that the problem corresponding to instances of 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉 with the additional restriction that the number of polynomials is equal to the number of variables is in 𝖭𝖨𝖲𝖹𝖪. We denote this problem by 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=.

Definition 3.1.

The algebraic independence with equal variables and polynomials problem, denoted 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=, is to decide, given algebraic circuits representing polynomials f1,,fn over 𝔽q, whether f¯ are algebraically independent.

We show that deciding if n polynomials in n variables are algebraically independent is in 𝖭𝖨𝖲𝖹𝖪 by reducing to 𝖤𝖠. Our goal is to use the difference in image sizes shown previously to design a boolean circuit C from polynomials f1,,fn𝔽q0[x1,,xn] where the entropy differs significantly depending on if the polynomials are algebraically dependent or algebraically independent.

3.1 Circuit Construction

Notice that 𝖤𝖠 takes in an encoding of a boolean circuit. Therefore, to describe a reduction to 𝖤𝖠 from 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=, we need to turn the algebraic circuits into boolean circuits and evaluate at an approximately uniform point in 𝔽qn. As the characteristic of 𝔽q may not be exactly 2, we design a map {0,1}L𝔽q where 2Lq, and take any bit-string to its value modulo q. This turns out to output a nearly uniform element of 𝔽q.

Definition 3.2.

Given some enumeration of 𝔽q and an integer L, define Decq,L:{0,1}L𝔽q by taking b¯ to the element αk𝔽q where

k=(i=1Lbi2i1)modq.

For any integer n, let Decq,Ln:{0,1}nL𝔽qn by (b¯1,,b¯n)(Decq,L(b¯1),,Decq,L(b¯n)).

With this definition we can describe the construction of the circuit from 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉= to 𝖤𝖠.

Construction 3.3.

Given f1,,fn as algebraic circuits over 𝔽q0[x1,,xn], h(z)𝔽q0[z] irreducible of degree t, and an integer L, let Cf,h,L be a circuit on nL bits, outputting nlgq0t bits, representing the function Ff,h,L(b¯)=f¯(Decq0t,Ln(b¯)):{0,1}nL𝔽qn represented as 𝔽q0[z]/h.

We will show now that the algorithm described above is computable in polynomial time. This implies that we can output the encoding of the circuit which computes this function in polynomial time as well.

Proposition 3.4.

Given f1,,fn as algebraic circuits over 𝔽q0[x1,,xn] each of size at most s, an irreducible polynomial h𝔽q0[z] of degree t, and an integer L, the encoding for Cf,h,L can be computed in time 𝗉𝗈𝗅𝗒(n,L,t,s,lgq0).

Proof.

It suffices to show that Ff,h,L(b¯) can be computed in time 𝗉𝗈𝗅𝗒(n,L,t,lgq0). For any L-bit integer a, the value amodq0t can be computed in time 𝗉𝗈𝗅𝗒(L), so the corresponding element α𝔽q can be found in 𝗉𝗈𝗅𝗒(t,lgq0), and decoding all n integers can be done in 𝗉𝗈𝗅𝗒(n,t,lgq0)

Addition and multiplication in 𝔽q represented as 𝔽q0[z]/h(z) can be done in 𝗉𝗈𝗅𝗒(t) operations over 𝔽q0[z], addition and multiplication in 𝔽q0 can be done in 𝗉𝗈𝗅𝗒(lgq0) operations, so addition and multiplication can be done in 𝗉𝗈𝗅𝗒(t,lgq0). This implies, given the algebraic circuit of fi, we can compute fi(α¯) on any α𝔽qn in 𝗉𝗈𝗅𝗒(lgq0,t,s) time. Hence we can compute Ff,h,L in time 𝗉𝗈𝗅𝗒(n,L,t,s,lgq0) as desired.

3.2 Entropy of the Circuit

Throughout this section let 𝖴m be the uniform distribution on {0,1}m. Recall that Ff,h,L is defined by an irreducible polynomial h𝔽q0[z] of degree t, so we will think of q=q0t in the section.

Here we show that if the input polynomials are algebraically independent then the entropy of the random variable 𝖷:=Ff,h,L(𝖴nL) can be made large. If the polynomials are algebraically dependent, then the entropy is necessarily smaller. We first deal with the case where the polynomials are algebraically dependent, this is immediate from Lemma 2.10.

Proposition 3.5.

If f1,,fn are algebraically dependent, then H(𝖷)(n1)lg(deg(f¯)q).

Proof.

By construction Supp𝖷imf¯ and by Lemma 2.10, |imf¯|deg(f¯)n1qn1, therefore H(𝖷)lg|Supp𝖷|(n1)lg(deg(f¯)q).

In the case the polynomials are algebraically independent, in order to give a lower bound on H(𝖷) we need to give tight upper and lower bounds of Pr[𝖷=β¯] for β¯𝔽qn. First, we need to argue that the distribution arising from evaluating the decoding map on the uniform distribution on {0,1}nL is approximately uniform on 𝔽qn.

Proposition 3.6.

For any α¯𝔽qn

(1q/2Lq)nPr[Decq,Ln(𝖴nL)=α¯](1+q/2Lq)n.
Proof.

Each coordinate of Decq,Ln is independent, so it suffices to show for any α𝔽q that (1q/2L)/qPr[Decq,L(𝖴L)=α](1+q/2L)/q. If we enumerate 𝔽q, by the definition of Decq,L

Pr[Decq,L(𝖴L)=αi]=Pr[𝖴L=imodq].

Since Pr[𝖴L=imodq]=|{kkq+i2L1}|/2L, we have:

Pr[UL=imodq]={2L/q/2L if i2Lmodq2L/q/2L otherwise.

The claim follows from 2L/q/2L(1q/2L)/q and 2L/q/2L(1+q/2L)/q.

As 𝖷 has support only on the image of f¯, we can split Supp𝖷 into points with small pre-image and large pre-image. By Lemma 2.12, when f¯ are algebraically independent there are sufficiently many points in the image of f¯ with small pre-image that their contribution to entropy alone grows like Θ(nlgq) for the appropriate choice of L.

Proposition 3.7.

If f1,,fn are algebraically independent and q<2L then

H(𝖷)>(1degf¯D(f¯)qnq2L)nlgq(1+ndegf¯D(f¯)2L)(n+lgD(f¯)).
Proof.

Let Aimf¯ be the set of points β¯imf¯ such that |f¯1(β¯)|D(f¯). From Proposition 3.6, we know that for β¯A

Pr[𝖷=β¯]=α¯f¯1(β¯)Pr[Decq,Ln(𝖴nL)=α¯]D(f¯)(1+q/2Lq)n.

Now we can look at the contribution of 𝖷 restricted to A to H(𝖷)

H(𝖷) β¯APr[𝖷=β¯]lg(1Pr[𝖷=β¯])(Pr[𝖷A])lg(qnD(f¯)(1+q/2L)n)
(α¯f¯1(A)Pr[Decq,Ln(𝖴nL)=α¯])lg(qnD(f¯)(1+q/2L)n).

By Lemma 2.12, we know that |f¯1(A)|qn(degf¯D(f¯))qn1, by the lower bound of Proposition 3.6 we get

H(𝖷) (qn(degf¯D(f¯))qn1)(1q/2Lq)nlg(qnD(f¯)(1+q/2L)n)
(1degf¯D(f¯)q)(1nq2L)(nlgqnlg(1+q/2L)lgD(f¯)).

The final inequality follows from Bernoulli’s inequality since q/2L<1. Additionally, q/2L<1 implies lg(1+q/2L)<1, so after dropping all positive terms from the expression, apart from nlgq, we get

H(𝖷)>(1degf¯D(f¯)qnq2L)nlgq(1+ndegf¯D(f¯)2L)(n+lgD(f¯)),

which proves the claim.

3.3 Reduction to EA

Recall 𝖷=Ff,h,L(𝖴nL) is parametrized by f1,,fn𝔽[x¯], an irreducible polynomial h𝔽q0[z] of degree t, and an integer L.

From Proposition 3.4, we know we can output the encoding for Construction 3.3 efficiently in terms of t, L, s, n, and lgq0, and if the reduction runs polynomial in s, lgq0, and n, then it is polynomial in the input length to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=. Therefore, all that is left to check is that there are values for t and L that are polynomial in s, lgq0, and n such that the entropy lower bound of 𝖷 when f¯ are independent is larger than the entropy upper bound of 𝖷 when f¯ are dependent.

Proposition 3.8.

Suppose f1,,fn are algebraically independent, L>2lgn+tlgq0+2, and tlgq0>6(n+1)lg(degf¯)+4n+8 then

H(𝖷)>(n1)lg(degf¯q)+4.
Proof.

Since L>tlgq0, we can apply Proposition 3.7 to get the lower bound

H(𝖷)>(1degf¯D(f¯)q0tnq0t2L)nlgq0t(1+ndegf¯D(f¯)2L)(n+lgD(f¯)).

The bound L>2lgn+tlgq0+2 implies 2L>4n2q0t, equivalently nq0t/2L<1/4n. Similarly, using the observation (degf¯)n+1deg(f¯)D(f¯) we see

tlgq0>6(n+1)lg(degf¯)+4n+8lg(deg(f¯)D(f¯))+lg(4n)=lg(4ndeg(f¯)D(f¯)).

Therefore, q0t>4ndeg(f¯)D(f¯), which implies both deg(f¯)D(f¯)/q0t+nq0t/2L1/2n and ndeg(f¯)D(f¯)/2L1/16n2 and simplifies the lower bound on H(𝖷) to

H(𝖷) >(112n)nlgq0t(1+116n2)(n+lgD(f¯))
>nlgq0t12lgq0t2n2lgD(f¯).

Re-using the lower bound on tlgq0 and (degf¯)n+1D(f¯) we find that

12lgq0t>3(n+1)lg(degf¯)+2n+4>(n1)lg(degf¯)+2lg(D(f¯))+2n+4

and thus

H(𝖷)>(n1)lgq0t+12lgq0t2n2lgD(f¯)>(n1)lg(degf¯q)+4.

With this technical statement, we can construct the encoding for the circuit Cf that maps to a yes instance of 𝖤𝖠 if f1,,fn are algebraically independent and a no instance of 𝖤𝖠 if f1,,fn are algebraically dependent, in time polynomial in the input length. In our reduction we use the following fact that shows that encodings of boolean circuits can be padded.

Lemma 3.9.

Given a boolean circuit C of size s computing f:{0,1}m{0,1}n and N in unary, there is a polynomial time algorithm that outputs a boolean circuit for f of size Θ(s+N).

We proceed to prove the main theorem.

Theorem 3.10.

There is a length-increasing randomized reduction from 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉= to 𝖤𝖠 with error probability δ2 on inputs of size , that is, 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=mBPP𝖤𝖠.

Proof.

We are given f1,,fn𝔽q0[x1,,xn] as algebraic circuits each of size at most s, suppose the input size is . We will produce a boolean circuit C such that if the f¯ are independent C has high entropy and if f¯ are dependent C has low entropy. As the reduction needs to be length-increasing, we require an upper bound on the length of the input, which can be taken to be ns.

We will evaluate the polynomials over a field extension of 𝔽q0, which is encoded as bits. To use the tools above, we need to construct a large field extension of 𝔽q0 of degree t, which we denote by 𝔽q. L is the encoding length of each 𝔽q, we need to pick L large to ensure that uniform on 𝖴L is approximately uniform on 𝔽q.

We want to use Rabin’s algorithm (Lemma 2.13), which gives an error probability of exp(N/2t). For this to be exponentially small in the input size we set N=2t(ns). Pick t=6(n+1)lg(degf¯)+4n+9 and L=2lgn+tlgq0+3 to satisfy the conditions for Proposition 3.8.

Run Rabin’s algorithm with N and t. Suppose it outputs an irreducible polynomial h of degree t. Compute the encoding for the circuit C from Construction 3.3 with f1,,fn, L, and h as input. We can pad C so that it is larger than the input size. Compute the entropy threshold k, which is k=(n1)lg(degf¯q0t)+2 and output (C,k).

If the algorithm does not output an irreducible polynomial, then output a no instance of 𝖤𝖠, we can pad to ensure the encoding has size at least ns by Lemma 3.9.

Length-increasing.

The reduction is always length increasing as we pad the output appropriately.

Complexity.

By Lemma 2.13, we can find h in 𝗉𝗈𝗅𝗒(n,s,lgq0) time by the definition of t and N. By Proposition 3.4, the encoding for C can be computed in time 𝗉𝗈𝗅𝗒(n,s,t,lgq0,L). The chosen values for t and L are polynomial in s, t, and lgq0, thus the encoding for C can be computed in time 𝗉𝗈𝗅𝗒(n,s,lgq0).

Completeness.

We need to show that if f1,,fn are algebraically independent that C encodes a distribution with entropy strictly larger than k+1 with high probability.

Suppose that Rabin’s algorithm finds an irreducible polynomial h of degree t. Notice that C encodes the distribution 𝖷=f¯(Decq,Ln(𝖴nL)) and t and L satisfy the assumptions for Proposition 3.8, which implies

H(𝖷)>(n1)lg(degf¯q0t)+4(n1)lg(degf¯q0t)+3=k+1,

and thus (C,k) is in 𝖤𝖠Y. Therefore, the probability that (C,k) is not in 𝖤𝖠Y is bounded from above by the probability the algorithm fails to find an irreducible polynomial. By Lemma 2.13 the error probability is exp(ns)<2.

Soundness.

We need to show that if f1,,fn are algebraically dependent then C encodes a distribution with entropy strictly smaller than k1.

Suppose Rabin’s algorithm finds an irreducible polynomial h. As above, C encodes the distribution 𝖷=f¯(Decq,Ln(𝖴nL)), and by Proposition 3.5 we know that

H(𝖷)<(n1)lg(degf¯q0t)(n1)lg(degf¯q0t)+1=k1,

therefore (C,k)𝖤𝖠N. If Rabin’s algorithm fails to find an irreducible polynomial, we output a no instance of 𝖤𝖠. Hence, (C,k) is always in 𝖤𝖠N.

Therefore, by Lemma 2.16, we see that 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉= is indeed in 𝖭𝖨𝖲𝖹𝖪 as desired.

Corollary 3.11.

𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=𝖭𝖨𝖲𝖹𝖪.

4 Changing Parameters in Algebraic Dependence Testing

Previously we showed that testing if n polynomials are algebraically independent in n variables is in 𝖭𝖨𝖲𝖹𝖪. We now show that the general problem can be reduced to this case.

We prove here two facts. First, composing a random affine map from m variables to n variables with m algebraically independent polynomials on n variables keeps the polynomials algebraically independent, giving the reduction from 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉 to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=. We then prove that r random linear combinations of m polynomials are algebraically independent if their transcendence degree was at least r, giving the reduction from 𝖳𝗋𝖣𝖾𝗀 to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉.

4.1 Changing the Number of Variables

In this section we show how to reduce the number of variables from n to the number of polynomials m while maintaining algebraic independence. Similar results were achieved by [9, Theorem 5.2.4] using more sophisticated algebraic geometry, our techniques are more elementary.

The following statement follows from the elementary proof of [6, Lemma 16]: that there exists an affine map from 𝔽[x1,,xn] to 𝔽[y1,,ym] that does not affect transcendence degree.

Lemma 4.1 ([6, Lemma 16]).

Let f1,,fm𝔽[x1,,xn] be algebraically independent polynomials and let y¯=(y1,,ym). If |𝔽|>mdegf¯D(f¯) then there exists A𝔽n×m and β¯𝔽n such that f1(Ay¯+β¯),,fm(Ay¯+β¯) are algebraically independent over 𝔽.

This lemma by itself is insufficient for our purposes, because the construction they give uses the computation of transcendence degree. Instead, we will use this lemma to show that generic affine transformations also preserve algebraic independence. We want to find a criterion for the entries of a generic affine linear transformation x¯Ay¯+β¯ that governs whether the transformation f¯(x¯)f¯(Ay¯+β¯) preserves the algebraic independence of f¯.

Specifically, we see that the bad choices for an affine linear transformation are contained in a zero locus of a polynomial. By computing the degree of this polynomial, we get an explicit bound on the probability of a good variable reduction by Schwartz-Zippel. The proof of the following statement is deferred to the full version.

Lemma 4.2.

Let f1,,fm𝔽[x1,,xn] be algebraically independent polynomials, Z=(z1,1,,zn,m) an n×m matrix of indeterminates, w¯=(w1,,wn), and y¯=(y1,,ym), then there exists P𝔽[Z,w¯] with degP(degf¯)m(m+deg(f¯)m1)m such that if P(A,β¯)0 for A𝔽n×m and β¯𝔽n then f1(Ay¯+β¯),,fm(Ay¯+β¯) are algebraically independent over 𝔽.

Here we show that testing algebraic independence of polynomials is in 𝖭𝖨𝖲𝖹𝖪 by reducing to the case where we have an equal number of polynomials and variables. The above statement allows us to ensure that if the field is large enough, then with high probability the reduction of variables does not decrease the transcendence degree of the output. In our reduction we use the following fact that shows that encodings of algebraic circuits can be padded.

Lemma 4.3.

Given an algebraic circuit computing f𝔽[x¯] of size s and N in unary, there is a polynomial time algorithm that outputs an algebraic circuit for f of size Θ(s+N).

We now proceed to prove the main theorem.

Theorem 4.4.

There is a length-increasing randomized reduction with error probability δ2 on inputs of size from 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉 to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=, that is, 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉mBPP𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=.

Proof.

We are given f1,,fm𝔽q0[x1,,xn] as algebraic circuits each of size at most s. We will produce g1,,gm over a field extension 𝔽q[y1,,ym]. As the reduction needs to be length increasing, we require an upper bound on an input of length , which can be taken to be ms.

If m>n we output a circuit computing the zero polynomial, padding to ensure the output is larger than the input. Trivially f¯ are algebraically dependent, so the reduction has zero error probability. It is clearly length-increasing and runs in polynomial time. For the remainder of the proof we assume mn.

We will pass to a field extension to use the above machinery. Over this field we will take a uniformly random affine transformation from 𝔽qn to 𝔽qm. To create a field extension of 𝔽q0, of size q0t, we use Rabin’s algorithm (Lemma 2.13) to generate an irreducible polynomial of degree t, which gives an error probability of exp(N/2t). To make this exponentially small in the input length we set N=2t(ms+1).

For the affine transformation to be good with high probability, using Lemma 4.2 and [26], we need to pick tmlg(degf¯)+mlg(m+degf¯m1). Recall that the maximum degree of any given fi is 2s. As the error probability needs to also be exponentially small in the output length we set t=(m2s+m)+(ms+1).

We run Rabin’s algorithm with N and t described above. If it outputs an irreducible polynomial h, we construct 𝔽q=𝔽q0[z]/h. Sample A𝔽qn×m and β¯𝔽qn uniformly, and output the algebraic circuit for gi(Ay¯+β¯) for all i[m]. If Rabin’s algorithm fails to find an irreducible polynomial, we output a circuit computing the zero polynomial. In both cases we pad to ensure that the output is length-increasing.

Length-increasing.

The reduction is always length increasing as we pad the output appropriately.

Complexity.

Rabin’s algorithm (Lemma 2.13) for finding irreducible polynomials runs in time 𝗉𝗈𝗅𝗒(t,N,lgq0).

Sampling A𝔽qn×m and β¯𝔽qn uniformly and creating the n algebraic circuits described by Ay¯+β¯ can be done in 𝗉𝗈𝗅𝗒(m,t,lgq0). Constructing the circuits for g¯ involves composing the circuits for Ay¯+β¯ with each fi and replacing all constants in the algebraic circuit for fi by their image under the inclusion map 𝔽q0𝔽q. We can do this in 𝗉𝗈𝗅𝗒(s,m,t,lgq0).

Lastly we can pad to make the output larger than the input in 𝗉𝗈𝗅𝗒(s,m,lgq0) (Lemma 4.3).

All steps run in time 𝗉𝗈𝗅𝗒(n,s,t,N,lgq0) and by the choice of t and N, this is polynomial in the input length.

Completeness.

We need to show that if the f¯ are algebraically independent, then the output is algebraically independent with high probability.

One source of error is that Rabin’s algorithm fails to find an irreducible polynomial. The error probability of Rabin’s algorithm is exp(N/2t)2ms1.

Another source of error is that the polynomials g¯, where gi=fi(Ay¯+β¯), fail to be algebraically independent. From Lemma 4.2, we know that if g¯ fail to be algebraically independent then there exists a polynomial P𝔽q[Z,w¯] such that P(A,β¯)=0. Since q02 and degf¯2s, by [26]

PrA,β¯[P(A,β¯)=0]degPq(deg(f¯))m(2deg(f¯)m1)mq0t2m+m2s2t2ms1.

The total probability the reduction fails to output algebraically independent polynomials is at most 2ms1+2ms12ms2.

Soundness.

We need to show that if the f¯ are algebraically dependent then the output is always algebraically dependent.

If Rabin’s algorithm fails, the output is the zero polynomial, which is algebraically dependent. If the reduction finds an irreducible polynomial, the output is g¯ where gi=fi(Ay¯+β¯). Let Q be any annihilator of f¯, then Q(g¯)=Q(f¯(Ay¯+β¯))=0, thus g¯ are algebraically dependent.

By Lemma 2.16 and Corollary 3.11, since 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉=𝖭𝖨𝖲𝖹𝖪 and 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉 reduces to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉= by a length-increasing randomized reduction with exponentially small error probability, we conclude that 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉𝖭𝖨𝖲𝖹𝖪.

Corollary 4.5.

𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉𝖭𝖨𝖲𝖹𝖪.

4.2 Changing the Number of Polynomials

Here we show that if we have m polynomials f1,,fm of transcendence degree at least r, we can generate r linear combinations of f1,,fm that will be algebraically independent with high probability. We show this by carefully following the proof of the Noether Normalization Lemma over infinite fields, found in [4]. Please refer to the full version for the proofs of the statements below.

 Remark 4.6.

Our result, Corollary 4.11, is similar, but incomparable, to [9, Theorem 5.2.3]. Garg shows that with probability 12(r+1)(degf¯)m1/|S| the resulting r polynomials are algebraically independent where the coefficients of the linear combinations are sampled uniformly from S𝔽{0}. We show, with probability 1(mr)(degf¯)m1/|S|, the r resulting polynomials are algebraically independent, and we give no restriction on the set S, however, the resulting linear combinations are created using S in a non-standard way.

Transcendence Degree

Throughout this section we will use an equivalent definition of transcendence degree in terms of fields, for more background see [16, Chapter 8], we omit the proof of its equivalence. Recall that a field extension 𝕂 is algebraic over 𝔽 if for every α𝕂 there is a non-zero polynomial P𝔽[z] with P(α¯)=0.

Definition 4.7.

Suppose 𝔽𝕂𝔽(x¯), the transcendence degree of 𝕂 over 𝔽 is the size of the smallest set B𝕂 such that 𝕂 is algebraic over 𝔽(B). The transcendence degree of f1,,fm𝔽[x¯], is the transcendence degree of 𝔽(f¯) over 𝔽.

This definition gives insight as to how transcendence degree behaves when we remove polynomials. If there exists an annihilator P for f¯, such that P(f1,,fm1,ym)0 in 𝔽(f1,,fm1)[ym], then fm is algebraic over 𝔽(f1,,fm1). If 𝔽(B)𝔽(f1,,fm1) is algebraic, then the extension 𝔽(B)𝔽(f1,,fm) is algebraic, and

trdeg(f1,,fm)=trdeg(f1,,fm1).

When such a P exists, we say that fm is algebraically dependent on f1,,fm1. By definition, if 𝔽(f¯)𝔽(g¯) then trdeg(f¯)trdeg(g¯).

In the proof of the Noether Normalization Lemma, found in [4], we begin with m+1 algebraically dependent polynomials g¯, find a non-zero polynomial P where P(α¯)0 implies that taking the last polynomial gm+1 and subtracting αigm+1 from each im preserves transcendence degree. We observe that the degree of the polynomial P is at most the degree of an annihilator, and thus the Perron bound (Lemma 2.4) gives an effective version of the Noether Normalization Lemma.

Proposition 4.8.

If g1,,gm+1𝔽[x1,,xn] are algebraically dependent with a non-zero annihilator of degree at most D, then there exists a non-zero P𝔽[y1,,ym] with degPD such that if P(α¯)0 for α¯𝔽m then

trdeg(g1α1gm+1,,gmαmgm+1)=trdeg(g1,,gm+1).

If we started with polynomials f1,,fm algebraically dependent, applying Proposition 4.8 tells us something about the m1 polynomials h¯ given by the linear transformation h¯=Af¯ where A=(Ik1|α¯) is a k1×k matrix over 𝔽. It will be useful to have notation for this linear transformation. For all k and γ¯𝔽k1 let Ak(γ¯) denote the matrix

Ak(γ¯):=(Ik1γ¯).

If we repeatedly apply Proposition 4.8 mr times using vectors γ¯m,,γ¯r+1 where each γ¯i𝔽i1, the resulting polynomials are (Ar+1(γ¯r+1)Am(γ¯m))f¯.

We want algebraically independent polynomials from f¯, so we only apply Proposition 4.8 mtrdeg(f¯) times on f¯. Therefore, we can afford a union bound over each of these steps as the degree of an annihilator of f¯ is significantly larger than mtrdeg(f¯) typically. This implies that if the vectors γ¯i are chosen uniformly from a large enough set, with high probability the output is algebraically independent.

Lemma 4.9.

If f1,,fm𝔽[x1,,xn] have transcendence degree r and S𝔽, let Γ={γ¯}i=r+1m and suppose each γ¯k is chosen uniformly from Sk1, then

PrΓ[trdeg((Ar+1(γ¯r+1)Am(γ¯m))f¯)<r](mr)(degf¯)r|S|.

We can now verify that once we have algebraically independent polynomials, we can continue to left multiply by matrices Ak(γ¯k) and the polynomials stay algebraically independent.

Proposition 4.10.

Suppose g1,,gm𝔽[x1,,xn] are algebraically independent and rm, for any {γ¯i}i=r+1m where γ¯i𝔽i1, the set (Ar+1(γ¯r+1)Am(γ¯m))g¯ is algebraically independent.

We conclude that if we started with polynomials of transcendence degree greater than r, with high probability the polynomials (Ar+1(γ¯r+1)Am(γ¯m))f¯ are algebraically independent.

Corollary 4.11.

Suppose f1,,fm𝔽[x¯], trdeg(f¯)r, and S𝔽, let Γ={γ¯i}i=r+1m and suppose γ¯k are chosen uniformly from Sk1, then

PrΓ[trdeg((Ar+1(γ¯r+1)Am(γ¯m))f¯)<r](mr)(degf¯)m1|S|.

The above corollary essentially gives the reduction from 𝖳𝗋𝖣𝖾𝗀 to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉. We sketch the argument below.

On any input we will pass to a field extension, which we can construct via Rabin’s algorithm (Lemma 2.13), to apply the above machinery. Over this large field we will take the random linear combinations described in Corollary 4.11 and output these polynomials. We note that these polynomials can be constructed efficiently in the input size. The degree of the field extension we pick is polynomial in the input size, therefore every step in the reduction runs efficiently.

If the input polynomials had high transcendence degree then we use Corollary 4.11 to argue that the probability the output is algebraically dependent is negligible. If the input polynomials had low transcendence degree then we output “too many” polynomials for them to be algebraically independent.

Theorem 4.12.

There is a length-increasing randomized reduction with error probability δ2 on inputs of size from 𝖳𝗋𝖣𝖾𝗀 to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉, that is, 𝖳𝗋𝖣𝖾𝗀mBPP𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉.

By Lemma 2.16 and Corollary 4.5, 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉𝖭𝖨𝖲𝖹𝖪 and 𝖳𝗋𝖣𝖾𝗀 reduces to 𝖠𝗅𝗀𝖨𝗇𝖽𝖾𝗉 by a length-increasing randomized reduction with negligible error probability, we conclude 𝖳𝗋𝖣𝖾𝗀𝖭𝖨𝖲𝖹𝖪.

Corollary 4.13.

𝖳𝗋𝖣𝖾𝗀𝖭𝖨𝖲𝖹𝖪.

References

  • [1] Leonard M. Adleman and Hendrik W. Lenstra Jr. Finding irreducible polynomials over finite fields. In Juris Hartmanis, editor, Proceedings of the 18th Annual ACM Symposium on Theory of Computing, May 28-30, 1986, Berkeley, California, USA, pages 350–355. ACM, 1986. doi:10.1145/12130.12166.
  • [2] Manindra Agrawal, Neeraj Kayal, and Nitin Saxena. PRIMES is in P. Annals of mathematics, pages 781–793, 2004.
  • [3] Eric Allender, Shuichi Hirahara, and Harsha Tirumala. Kolmogorov complexity characterizes statistical zero knowledge. In Innovations in Theoretical Computer Science Conference, 2023.
  • [4] Allen Altman and Steven Kleiman. A term of commutative algebra. Worldwide Center of Mathematics, 2013.
  • [5] László Babai and Shlomo Moran. Arthur-Merlin games: a randomized proof system, and a hierarchy of complexity classes. Journal of Computer and System Sciences, 36(2):254–276, 1988. doi:10.1016/0022-0000(88)90028-1.
  • [6] Malte Beecken, Johannes Mittmann, and Nitin Saxena. Algebraic independence and blackbox identity testing. Information and Computation, 222:2–19, 2013. doi:10.1016/J.IC.2012.10.004.
  • [7] Peter Bürgisser, Michael Clausen, and Mohammad A Shokrollahi. Algebraic complexity theory, volume 315. Springer Science & Business Media, 2013.
  • [8] Zeev Dvir, Ariel Gabizon, and Avi Wigderson. Extractors and rank extractors for polynomial sources. computational complexity, 18(1):1–58, 2009. doi:10.1007/S00037-009-0258-4.
  • [9] Abhibhav Garg. Special case algorithms for Nullstellensatz and transcendence degree. Master’s thesis, IIT Kanpur, 2020.
  • [10] Abhibhav Garg, Rafael Oliveira, and Akash Kumar Sengupta. Rank Bounds and PIT for Σ3ΠΣΠd circuits via a non-linear Edelstein-Kelly theorem. 2025 IEEE 66th Annual Symposium on Foundations of Computer Science (FOCS), 2025.
  • [11] Abhibhav Garg and Nitin Saxena. Special-case algorithms for blackbox radical membership, nullstellensatz and transcendence degree. In Ioannis Z. Emiris and Lihong Zhi, editors, ISSAC ’20: International Symposium on Symbolic and Algebraic Computation, Kalamata, Greece, July 20-23, 2020, pages 186–193. ACM, 2020. doi:10.1145/3373207.3404030.
  • [12] Oded Goldreich, Amit Sahai, and Salil Vadhan. Can statistical zero knowledge be made non-interactive? or on the relationship of szk and niszk. In Annual International Cryptology Conference, pages 467–484. Springer, 1999. doi:10.1007/3-540-48405-1_30.
  • [13] Shafi Goldwasser and Michael Sipser. Private coins versus public coins in interactive proof systems. In Proceedings of the eighteenth annual ACM symposium on Theory of computing, pages 59–68, 1986. doi:10.1145/12130.12137.
  • [14] Zeyu Guo, Nitin Saxena, and Amit Sinhababu. Algebraic dependencies and pspace algorithms in approximative complexity over any field. Theory of Computing, 15(1):1–30, 2019. doi:10.4086/TOC.2019.V015A016.
  • [15] Neeraj Kayal. The complexity of the annihilating polynomial. In 2009 24th Annual IEEE Conference on Computational Complexity, pages 184–193. IEEE, 2009. doi:10.1109/CCC.2009.37.
  • [16] Serge Lang. Algebra, volume 211. Springer Science & Business Media, 2012.
  • [17] Johannes Mittmann, Nitin Saxena, and Peter Scheiblechner. Algebraic independence in positive characteristic: A p-adic calculus. Transactions of the American Mathematical Society, 366(7):3425–3450, 2014.
  • [18] Tatsuaki Okamoto. On relationships between statistical zero-knowledge proofs. In Proceedings of the twenty-eighth annual ACM symposium on Theory of computing, pages 649–658, 1996. doi:10.1145/237814.238016.
  • [19] Rafail Ostrovsky. One-way functions, hard on average problems, and statistical zero-knowledge proofs. In Proceedings of the Sixth Annual Structure in Complexity Theory Conference, Chicago, Illinois, USA, June 30 - July 3, 1991, pages 133–138. IEEE Computer Society, 1991. doi:10.1109/SCT.1991.160253.
  • [20] James G Oxley. Matroid theory, volume 3. Oxford University Press, USA, 2006.
  • [21] Anurag Pandey, Nitin Saxena, and Amit Sinhababu. Algebraic independence over positive characteristic: New criterion and applications to locally low-algebraic-rank circuits. Comput. Complex., 27(4):617–670, 2018. doi:10.1007/S00037-018-0167-5.
  • [22] Arkadiusz Płoski. Algebraic dependence of polynomials after o. perron and some applications. Computational Commutative and Non-Commutative Algebraic Geometry, pages 167–173, 2005.
  • [23] Michael O Rabin. Probabilistic algorithms in finite fields. SIAM Journal on computing, 9(2):273–280, 1980. doi:10.1137/0209024.
  • [24] Nitin Saxena and Comandur Seshadhri. Blackbox identity testing for bounded top fanin depth-3 circuits: the field doesn’t matter. In Proceedings of the forty-third annual ACM symposium on Theory of computing, pages 431–440, 2011.
  • [25] Joachim Schmid. On the affine bezout inequality. manuscripta mathematica, 88(1):225–232, 1995.
  • [26] Jacob T Schwartz. Fast probabilistic algorithms for verification of polynomial identities. Journal of the ACM (JACM), 27(4):701–717, 1980. doi:10.1145/322217.322225.
  • [27] Victor Shoup. A computational introduction to number theory and algebra. Cambridge university press, 2009.
  • [28] Amir Shpilka, Amir Yehudayoff, et al. Arithmetic circuits: A survey of recent results and open questions. Foundations and Trends® in Theoretical Computer Science, 5(3–4):207–388, 2010. doi:10.1561/0400000039.