Abstract 1 Introduction 2 Preliminaries 3 Inapproximability of ROABP Order-Finding 4 Hardness of Equivalence Testing for ROABPs 5 Hardness of Order-Finding for Quadratic Forms References

On the Hardness of Order Finding and Equivalence Testing for ROABPs

C. Ramya ORCID The Institute of Mathematical Sciences, Chennai, India Pratik Shastri ORCID The Institute of Mathematical Sciences, Chennai, India
Abstract

The complexity of representing a polynomial by a Read-Once Oblivious Algebraic Branching Program (ROABP) is highly dependent on the chosen variable ordering. Bhargava et al. [5] prove that finding the optimal ordering is NP-hard, and provide some evidence (based on the Small Set Expansion hypothesis) that it is also hard to approximate the optimal ROABP width. In another work, Baraskar et al. [3] show that it is NP-hard to test whether a polynomial is in the GLn orbit of a polynomial of sparsity at most s.

Building upon these works, we show the following results: first, we prove that approximating the minimum ROABP width up to any constant factor is NP-hard, when the input is presented as a circuit. This removes the reliance on stronger conjectures in the previous work [5]. Second, we show that testing if an input polynomial given in the sparse representation is in the affine GLn orbit of a width-w ROABP is NP-hard. Furthermore, we show that over fields of characteristic 0, the problem is NP-hard even when the input polynomial is homogeneous. This provides the first NP-hardness results for membership testing for a dense subclass of polynomial sized algebraic branching programs (VBP). Finally, we locate the source of hardness for the order finding problem at the lowest possible non-trivial degree, proving that the problem is NP-hard even for quadratic forms.

Keywords and phrases:
ROABP, Order Finding, Equivalence Testing, NP-hardness, Hardness of Approximation
Funding:
C. Ramya: Research supported by INSPIRE Faculty Fellowship of DST.
Copyright and License:
[Uncaptioned image] © C. Ramya and Pratik Shastri; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Algebraic complexity theory
Editors:
C. Aiswarya, Ruta Mehta, and Subhajit Roy

1 Introduction

Algebraic circuits provide a powerful framework for understanding the complexity of computing multivariate polynomial over a field. These are directed acyclic graphs whose in-degree 0 vertices are labeled by variables or field constants and internal vertices are either addition or multiplication gates. Several computational problems concerning polynomials such as identity testing, polynomial factoring, equivalence testing and reconstruction have been studied intensively for various structured subclasses of circuits.

In this article, we are interested in Read-Once Oblivious Algebraic Branching Programs (ROABPs for short), the algebraic analogs of ordered binary decision diagrams (OBDDs). Informally, an ROABP is layered DAG with a designated source and sink vertex whose edges are labeled by univariate polynomials. More importantly, all edges in the same layer use the same variable and a variable occurs in exactly one layer. The polynomial computed by the ROABP is the sum over all source-to-sink paths of the product of edge weights along each path. In this work, we study the computational complexity of two problems concerning ROABPs: order-finding and equivalence testing. Before delving into the details of these two problems, we note that in algorithms concerning polynomials, a polynomial f(x1,,xn) of degree d can be given as an input to an algorithm in one of the following standard representations:

  • Dense Representation: a list (of size (n+dd)) of coefficients for all possible monomials up to degree d.

  • Sparse Representation: a list of pairs, where each pair consists of a non-zero coefficient and its corresponding monomial (represented by its exponent vector).

  • Circuit Representation: an algebraic circuit computing f.

  • Black-Box Access: an oracle access to evaluations of f.

It is important to note that the choice of representation can critically affect the complexity of a computational problem. The input representations above are ordered in increasing order of compactness. As a rule, problems considered in this paper become harder when the input is presented more compactly. Conversely, proving hardness becomes easier.

First, we begin with the order finding problem for ROABPs. It is easy to see that with every ROABP computing a polynomial f(x1,,xn) we can associate a unique permutation σ:[n][n] which we call the order of the ROABP. The size of an ROABP, particularly its width, which is the maximum number of vertices in any of its layers serves as a key measure of complexity. A crucial feature of ROABPs is that the width required to compute a polynomial f is critically dependent on the order. A poor choice of ordering can lead to an exponential blow-up in the required width compared to an optimal one. For instance, the minimal widths of ROABPs computing (x1+y1)(x2+y2)(xn+yn) in orders (x1,y1,x2,y2,,xn,yn) and (x1,,xn,y1,,yn) are drastically different. This sensitivity gives rise to the natural computational question of order finding introduced in Bhargava et al. [5]:

Problem 1 (𝖢𝗄𝗍𝖱𝖮𝖶𝗂𝖽𝗍𝗁-𝖽).

[Decision version of order-finding]: Given a polynomial f𝔽[x1,,xn] of degree at most d as an algebraic circuit and an integer w in binary, decide whether there exists an ROABP for f of width at most w, in some order.

Problem 2 (𝖲𝖾𝖺𝗋𝖼𝗁𝖢𝗄𝗍𝖱𝖮𝖶𝗂𝖽𝗍𝗁-𝖽).

[Search version of order-finding]: Given an algebraic circuit C computing an n-variate polynomial f of degree d, find an order σSn that minimizes the ROABP width for f.

Depending on the input representation, other variations of these problems are defined analogously. For instance, DenseROWidth-d is the decision version of the problem when the input is provided in the dense representation.

Bhargava, Dutta, Ghosh, and Tengse [5] study the complexity of the order-finding problem. In particular, they show that DenseROWidth-6 is 𝖭𝖯-hard. Their proof is an interesting reduction from the cutwidth problem for graphs. This is a linear arrangement problem in which given a graph the goal is to find an ordering (a.k.a linear arrangement) of the vertices that minimizes the maximum number of edges between any prefix and the corresponding suffix in that ordering. It is known that the cutwidth problem is 𝖭𝖯 hard even for graphs with maximum degree 3. Their reduction is parameter preserving: The graph is transformed into a polynomial in such a way that ROABP width of the polynomial is 2 more than the cutwidth of the graph. The degree of the polynomial constructed is exactly 2Δ, where Δ denotes the maximum degree of the graph.

Furthermore, Bhargava et al. [5] also study the problem of approximating ROABP width. They provide two pieces of evidence that indicate hardness of approximation, both stemming from their reduction. First, as noted earlier, the reduction in [5] is parameter preserving. Hence, hardness of approximation for the cutwidth problem directly translates to hardness of approximation for ROABP width. Austrin et al. [2] showed that cutwidth is hard to approximate assuming the small set expansion (SSE) hypothesis thus implying hardness of approximating ROABP width assuming the SSE hypothesis, even when the input is given in the dense representation. Second, they develop a tensoring technique through which they show that a constant factor approximation for Search-CktROWidth would imply a PTAS for Search-CktROWidth, and therefore, by their reduction, for cutwidth. This is (potentially stronger) evidence against the existence of a constant factor approximation for Search-CktROWidth, since Ambühl et al. [1] show that for a problem related to cutwidth, a PTAS does not exist under assumptions weaker than SSE (but stronger than 𝖯𝖭𝖯).

In this work, we prove 𝖭𝖯-Hardness of approximating Search-CktROWidth up to any arbitrary constant factor.

Theorem 3 (Inapproximability of Search-CktROWidth-d).

Let α be an arbitrary constant. Let n,d be given as input, in unary. Let f𝔽[x1,,xn] of degree d be given as input, as an arithmetic circuit. Let w also be give as input, in binary. It is 𝖭𝖯-hard to α-approximate the width of the smallest ROABP for f.

Our reduction is natural, direct, and again, from cutwidth. It works over any field. We use the power of the circuit representation to construct, from a graph G, a depth three circuit for a polynomial fG such that for every subset S of vertices, rank of the Nisan matrix of fG with respect to the set S is exactly 2|cut(S)|. For a subset of vertices S, cut(S) denotes the number of edges going out of S. See Section 2 for definition of Nisan matrices. This already gives NP-hardness of 2-approximation. Then, we use the tensoring technique from [5] to get hardness of α-approximation for any constant α.

Next, we move on to the problem of testing equivalence to ROABPs. Polynomial equivalence testing is a well-studied problem in algebraic complexity theory: given two polynomials the goal is to decide if one is equivalent to the other via an invertible affine transformation of the variables. Several special cases of the polynomial equivalence problem have been studied time and again. In order to understand recent progress on this problem, we consider the notion of orbits of polynomial families. Let 𝐱 denote (x1,,xn). The orbit of an n-variate polynomial f is the set of polynomials obtained from f by applying an invertible affine transformation to the variables, i.e., 𝗈𝗋𝖻𝗂𝗍(f)={f(A𝐱+𝐛)AGLn(𝔽) and 𝐛𝔽n}. For any class C of polynomials, the orbit of C is the union of orbits of polynomials in C. The orbits of the determinant and permanent polynomials are central to geometric complexity theory.

In the equivalence problem for a certain class C of circuits we are given a polynomial f (in some representation) and the goal is to determine if f is in the (GLn) orbit of a certain circuit class C. In other words, decide if f affine equivalent (under invertible transformations) to some polynomial in C. Medini and Shpilka [9] study the orbit of the continuant polynomial which is the trace of a certain product of matrices of dimension two and design polynomial time reconstruction algorithms for the same.

In the context of testing whether a given polynomial promised to be in the orbit of a certain circuit class is identically zero or not, Medini and Shpilka [9] construct hitting sets for orbits of read-once formulas111Read-once formulas are arithmetic formulas where every variable appears as a leaf at most once. and certain dense subclasses of depth three circuits. Saha and Thankey [12] designed hitting sets for orbits of ROABPs. Recently, Bhargava and Ghosh [6] obtained smaller hitting sets for the same class of polynomials. It is known [12] that orbits of polynomial size ROABPs are a dense subclass of the the class of polynomial size general algebraic branching programs.

Gupta et al. [8] consider the equivalence problem for read-once arithmetic formulas and give a randomized polynomial-time algorithm (with oracle access to quadratic form equivalence) for the same over fields of characteristic zero. Baraskar et al. [4] give a randomized algorithm to test equivalence to design polynomials222Design polynomials are a special class of polynomials in which the degree of the GCD of every pair of monomials is bounded. over fields of sufficiently large size and characteristic. In a recent, beautiful work, Baraskar et al. [3] show 𝖭𝖯 hardness of testing equivalence to sparse polynomials over any field when the input polynomial is given in the sparse representation. The problem is as follows: given f in the sparse representation and in integer w, does there exist an AGLn, 𝐛𝔽n and a polynomial g(𝐱) with at most w non-zero monomials such that f=g(A𝐱+𝐛)? They also show that a related problem, that of deciding equivalence to constant support polynomials, is NP hard.

In this work, we consider the problem of testing equivalence to ROABPs.

Problem 4 (ROABP-Equivalence).

Given an n-variate polynomial f𝔽[x1,xn] in its sparse representation and an integer w in binary, decide if there exists an AGLn(𝔽) and a 𝐛𝔽n such that f(A𝐱+𝐛) has an ROABP of width at most w.

We show that this problem is 𝖭𝖯-hard over all fields. Over fields of characteristic 0, it remains hard even when the input polynomial is homogeneous. To the best of our knowledge, this provides the first 𝖭𝖯-hardness result for membership testing for a dense subclass of polynomial size ABPs:

Theorem 5.

Over fields of characteristic 0, the ROABP-Equivalence problem is 𝖭𝖯-hard even when the input polynomial f is homogeneous. Over fields of prime characteristic, the ROABP-Equivalence problem is 𝖭𝖯-hard.

Our proof combines ideas from the papers of Baraskar et al. [3] and Bhargava et al. [5]. Specifically, we reduce from cutwidth and construct a polynomial f such that the linear transformation which minimizes the ROABP width of f(A𝐱+𝐛) is always the product of a diagonal matrix and a permutation matrix.

In our final result, we pinpoint the hardness of the original order-finding problem to the simplest non-trivial class of polynomials. We show that ROABP order finding is NP-hard even when the input is restricted to be a quadratic form (Theorem 25).

Theorem 6.

The problem DenseROWidth-2 is NP-hard over all fields.

Previously, 𝖭𝖯-hardness was known for polynomials of degree 6 [5]. To show this, we reduce from a different, more algebraic linear arrangement problem called linear rank-width (Problem 14).

2 Preliminaries

We now formally define the concepts central to our results, including ROABPs, Nisan’s characterization, and the graph theoretic computational problems we reduce from.

2.1 ROABPs and Width Characterization

Definition 7 (Read-Once Oblivious ABP (ROABP)).

Let 𝔽 be a field. An ROABP R computing an n-variate polynomial f(x1,,xn) over 𝔽 in a variable order σSn is a layered, directed graph with n+1 layers, indexed 0 to n.

  • The 0th layer contains a single source vertex s, and the nth layer contains a single sink vertex t.

  • Edges only exist between adjacent layers, from layer i1 to layer i for i[n].

  • Edges between layer i1 and i are labeled with univariate polynomials in the variable xσ(i).

The polynomial computed by the ROABP is the sum of products of edge weights over all paths from s to t.

Definition 8 (Width of an ROABP).

The width of an ROABP is the maximum number of vertices in any of its layers. For a polynomial f and an order σ, the ROABP-width, RO-widthσ(f), is the width of the minimal-width ROABP for f in order σ. Then RO-width(f) is defined as minσSnRO-widthσ(f).

Nisan’s work [10] provides an exact algebraic characterization of ROABP width, as the rank of a certain matrix of coefficients.

Definition 9 (Nisan Matrix).

For a polynomial f(x1,,xn)𝔽[x1,,xn] and a set of variables XT={xi}iT, the Nisan Matrix MT(f) is a matrix whose rows are indexed by monomials in variables from XT and columns by monomials in variables from {x1,,xn}XT. The (m1,m2)-th entry is the coefficient of m1m2 in f.

Theorem 10 (Nisan’s Characterization [10]).

For any polynomial f𝔽[x1,,xn] and order σ, the number of vertices in the ith layer of an optimal ROABP for f in order σ is exactly rank(MTi(f)), where Ti={σ(1),,σ(i)}.

Next, we define two graph layout problems. They will be central to our reductions.

2.2 Graph Layout Problems

The authors of [5] prove that DenseROwidth-d is NP hard (for d6) via a reduction from a particular NP-hard graph layout problem called Cutwidth. We define this problem next.

Definition 11 (Cutwidth [7]).

Given a graph G=([n],E), a linear arrangement is a permutation π:[n][n]. The cutwidth of G with respect to π is maxi[n1]|cut({π(1),,π(i)})|333For a graph G=([n],E) and a subset S[n] of vertices, cut(S) denotes the number of edges with one endpoint in S and the other in [n]S. The Cutwidth of G is the minimum cutwidth over all arrangements.

It is known [7] that the following problem is NP hard, even for graphs with maximum degree 3:

Problem 12 (CutWidth [7]).

Given a graph G=([n],E) with maximum degree 3 and an integer w in binary, decide whether the cutwidfth of G is at most w.

Next we define a similar looking graph layout problem, called Linear Rank-Width. Here, the cut size is replaced by the rank of a certain matrix.

Definition 13 (Linear Rank-WidthF [11]).

Let G=([n],E) be a graph and let π:[n][n] be a linear arrangement. For i[n1], let Ai be a matrix over 𝔽 with rows indexed by vertices {vπ(v)i} and columns by vertices {vπ(v)>i}. The entry (u,v) is 1 if {u,v}E and 0 otherwise. The linear rank-width of G with respect to π is maxi[n1]rank(Ai). The linear rank-width of G is the minimum linear rank-width over all arrangements.

It is known [11] that the the analogous decision problem of minimizing linear rank-width is also NP-hard, over any field.

Problem 14 (Linear Rank-WidthF [7]).

Given a graph G=([n],E) and an integer w in binary, decide whether the linear rank-width of G over 𝔽 is at most w.

3 Inapproximability of ROABP Order-Finding

In this section, we show the NP-hardness of approximating ROABP width up to an arbitrary constant factor, when the input is a circuit. We will require the following Lemma of Bhargava et al.

Lemma 15 ([5]).

Given a polynomial f(x1,,xn)𝔽[x1,,xn] with individual degree d and an l, define

fl(x1,,xn)=k=0l1f(x1(d+1)k,,xn(d+1)k)

For every subset S[n], we have Rank(MS(fl))=Rank(MS(f))l.

Theorem 16 (Inapproximability of Search-CktROwidth).

Let α be an arbitrary constant. Let n,d be given as input, in unary. Let f𝔽[x1,,xn] of degree d be given as input, as an arithmetic circuit. Let w also be give as input, in binary. It is NP-hard to distinguish between the following two cases:

  1. 1.

    f has an ROABP of width w in some order.

  2. 2.

    Every ROABP for f has width >αw.

Proof.

We reduce from CutWidth for graphs with maximum degree 3. Given a graph G=([n],E), we first construct a small ΠΣΠ circuit computing a polynomial fG(x1,,xn) such that for any S[n], Rank(MS(fG))=2|cut(S)|. For a vertex i[n] and a neighbour j of i, let ni(j) denote the number of neighbours of i less than or equal to j.

Define

fG(x1,,xn)={i,j}E(1+xini(j)xjnj(i))=TE({i,j}Txini(j)xjnj(i))

Let S[n] be arbitrary. Define the following sets of edges: E1={{i,j}{i,j}E and i,jS}, E2={{i,j}{i,j}E and i,j[n]S} and E3=cut(S)=E(E1E2). Then, the non-zero rows of MS(fG) are indexed by monomials m of the following type: m is characterized by a subset E1E1 and a subset E3E3 such that m=({i,j}E1xini(j)xjnj(i))({i,j}E3iSxini(j)). Call E3 the subset of cut edges picked by such a monomial/row. Similarly, the non-zero columns of MS(fG) are indexed by monomials m which are characterized by a subset E2E2 and a subset E3E3 such that m=({i,j}E2xini(j)xjnj(i))({i,j}E3j[n]Sxjnj(i))

Observe the following:

  • For a row indexed by m and column indexed by m, if the subset of cut edges picked by m and m are not identical, MS(fG)(m,m)=0.

  • The submatrix induced by row and column monomials that pick the same subset of cut edges has rank 1, since every row in this matrix is all 1’s.

Therefore MS(fG) is a block diagonal matrix with 2|cut(S)| disjoint rank 1 blocks and so Rank(MS(fG))=2|cut(S)|. Next, set l=logα+1 and consider the polynomial fGl. It has degree (6|E|+1)logα+11, it has a formula of size Oα(|E|) which can be computed from G in polynomial time, and by Lemma 15, for every S[n] it satisfies Rank(MS(fGl))=2l|cut(S)|. Therefore, it holds that

  • If G has cutwidth k, then RO-width(fGl)2lk

  • If G has cutwidth k+1, then RO-width(fGl)2l2lk>α2lk.

This finishes the proof of Theorem 16.

4 Hardness of Equivalence Testing for ROABPs

Bhargava et al. [5] demonstrate 𝖭𝖯-hardness of order-finding problem for ROABPs via a reduction from the cutwidth problem for graphs. More precisely, given a graph G=([n],E) with maximum degree Δ, the authors of [5] construct the polynomial fG𝔽[x1,,xn] defined as

fG={i,j}Exini(j)xjnj(i)+i=1nxiΔ+1 (1)

where ni(j)[Δ] is the number of neighbours of i less than or equal to j. The claim ([5], Claim 4.4) central to their reduction is that for every S[n], Rank(MS(fG))=|cut(S)|+2. This implies that the ROABP width of the polynomial fG is exactly two more the cutwidth of the graph G and the reduction is order preserving, i.e., an optimal arrangement of the vertices in G is exactly an optimal order for an ROABP computing fG.

In this section, we prove that over all fields, testing equivalence to width w ROABPs is 𝖭𝖯-hard. Over fields of characteristic 0, we show that this problem is 𝖭𝖯-hard even when the input polynomial is homogeneous, whereas in positive characteristic, we require inhomogeneity. Our reductions build on the reductions in Bhargava et al. [5] and Baraskar et al. [3]. In particular, given a graph G=([n],E), we construct a polynomial fG𝔽[x1,,xn] with the following two properties:

  1. 1.

    If AGLn(𝔽) is a permutation matrix times a diagonal matrix, then for every 𝐛𝔽n, the ROABP width of f(A𝐱+𝐛) is cutwidth(G)+2.

  2. 2.

    If AGLn(𝔽) is not a permutation matrix times a diagonal matrix, then for every 𝐛𝔽n, the ROABP width of f(A𝐱+𝐛) is at least |E|+3 in every order.

Property 2 essentially forces the width minimizing A to have a nice form, namely it is a permutation matrix times a diagonal matrix. This is because cutwidth(G)|E|. With this overall plan, we proceed with the details of the reduction.

4.1 Characteristic Zero

Over characteristic 0, we construct a homogeneous fG. In order to show property 2 for a homogeneous fG, we need the following Lemma from [3] that provides a lower bound on the sparsity of a polynomial divisible by a high power of a linear form with support at least 2.

Lemma 17 ([3]).

Let 𝔽 be a field of characteristic 0. Let l𝔽[x1,,xn] be a linear polynomial with support 2, let h𝔽[x1,,xn] be arbitrary and let d. Then ld×h has at least d+1 non-zero monomials.

In fact, we need a strengthening of this lemma. In the sequel, we strengthen this lemma and show that any polynomial divisible by the dth power of a linear form with support at least 2 has ROABP width at least d+1, in every order.

Lemma 18.

Let 𝔽 be a field of characteristic zero. Let be a linear polynomial with support at least 2 and h𝔽[x1,,xn] be any non-zero polynomial and d. Let F=dh. Then for any σSn, RO-widthσ(f)d+1.

Proof.

Without loss of generality, let x1,x2 be in the support of , i.e., =a1x1+a2x2+ such that a1,a20. Then, F=dh=(a1x1+a2x2+)dh. We can view h as a polynomial in 𝔽(x3,,xn)[x1,x2], i.e., a polynomial in x1,x2 with coefficients in the field 𝔽(x3,,xn). Let k be the degree of h (over 𝔽(x3,,xn)). That is, k is the maximal i+j such that h contains the monomial ci,jx1ix2j with ci,j𝔽(x3,,xn) and ci,j0. We denote by hk the homogeneous component of h of degree k. Then, F=F1+F2 where F1=(a1x1+a2x2)dhk. Every monomial m in F1 satisfies degx1(m)+degx2(m)=d+k. Furthermore, every monomial in F2 satisfies degx1(m)+degx2(m)<k+d. Next, by applying Lemma 17 to (a1x1+a2x2)d×hk over the field 𝔽(x3,,xn), we get (a1x1+a2x2)d×hk=i,ji+j=d+kci,jx1ix2j such that ci,j𝔽[x3,,xn] and at least d+1 of the ci,j’s non-zero. Let mi,j be the leading monomial of ci,j. Observe that:

  • There exists a set P of at least d+1 pairs (i,j) with i+j=d+k such that for each pair (i,j) in P, the coefficient of the monomial x1ix2jmi,j in F1 is non-zero.

  • There is no monomial m in F with non-zero coefficient such that degx1(m)+degx2(m)>d+k.

Now, consider any ROABP for F, in an arbitrary order xπ(1),,xπ(n). Let S be a prefix of π that separates 1 and 2. Without loss of generality, assume that 1S and 2[n]S. Since width of the ROABP is at least Rank(MS)(F) we now prove that Rank(MS(F))d+1. For a monomial m𝔽[x1,,xn], let m[S] denote the monomial obtained from m by setting variables outside {xiiS} to 1. Consider the submatrix of MS(F) induced by the row monomials {mi,j[S]x1i(i,j)P} (order the rows by increasing values of i) and the column monomials {mi,j[[n]S]x2j(i,j)P} (order the columns by increasing value of j). By our observations above, this is a full rank, square, anti-triangular matrix with non-zero entries on the main anti-diagonal. It has at least d+1 rows. Therefore, the rank of this submatrix is at least |P|d+1 and so is the rank of MS(F).

Theorem 19.

The Equivalence to ROABP problem (Problem 4) is 𝖭𝖯-hard over fields of characteristic 0. 𝖭𝖯-hardness holds even when the input polynomial f is homogeneous.

Proof.

We reduce from CutWidth. Let (G=([n],E),w) be an instance of CutWidth. We map it to an instance (fG,w+2) of ROABP-Equivalence. To this end, introduce a total order e1<e2<<e|E| on the edges of G. For iE, let ei={i1,i2} such that i1<i2. Let 𝐱=(x1,,xn). For S[n], define ΠS(𝐱)(jSxj|E|+2) and define the polynomial

fG(𝐱)Π[n](𝐱)(i=1|E|xi1ixi22|E|i+1)

Clearly, fG is a homogeneous polynomial of degree (n+2)|E|+2n+1. We now prove both the forward and reverse directions of the reduction.

Forward Direction: If 𝑮 has cutwidth at most 𝒘, then there exist 𝑨𝐆𝐋𝒏(𝔽) and 𝐛𝔽𝒏 such that 𝒇𝑮(𝑨𝐱+𝐛) has an ROABP of width at most 𝒘+𝟐 in some order.

The proof of the forward direction follows the outline of the corresponding proof in [5]. In particular, we pick A=In, the n×n identity matrix, and 𝐛=0. Consider any subset S[n] and fG ca be expressed as

fG(𝐱)= (ΠS(𝐱)i[|E|]i1,i2Sxi1ixi22|E|i+1)Π[n]S(𝐱)f1
+(Π[n]S(𝐱)i[|E|]i1,i2[n]Sxi1ixi22|E|i+1)ΠS(𝐱)f2
+(i[|E|]{i1,i2}cut(S)ΠS(𝐱)Π[n]S(𝐱)xi1ixi22|E|i+1)f3

Observe that f1 and f2 are non-zero polynomials of the form g(𝐱S)×h(𝐱[n]S), where for a subset S of [n], 𝐱S are the x variables indexed by S. Therefore, we have that Rank(MS(f1))=Rank(MS(f2))=1. Finally, notice that f3 can be written as a sum of |cut(S)| monomials. For every monomial m, Rank(MS(m))=1 for each S. Since MS(fG)=MS(f1)+MS(f2)+MS(f3), by subadditivity of rank, we have that Rank(MS(fG))|cut(S)|+2. Consider a linear arrangement π:[n][n] that witnesses cutwidth(G)w. Due to the above reasoning, combined with Nisan’s characterization, we have that fG has an ROABP in order π, of width w+2.

Reverse Direction: If there exist 𝑨𝐆𝐋𝒏(𝔽) and 𝐛𝔽𝒏 such that 𝒇𝑮(𝑨𝐱+𝐛) has an ROABP of width at most 𝒘+𝟐 in some order, then 𝑮 has cutwidth at most 𝒘.

In order to prove the reverse direction, we need the following key lemma.

Lemma 20.

Suppose AGLn(𝔽) is not the product of a permutation matrix and a diagonal matrix, then for every 𝐛𝔽n, every ROABP computing fG(A𝐱+𝐛) must have width at least |E|+3.

Proof.

If A is not the product of a permutation matrix and a diagonal matrix, then A𝐱+𝐛 must send at least one x variable to a linear polynomial with support at least 2. We may then write fG(A𝐱+𝐛)=l(𝐱)|E|+2×h for a nonzero polynomial h. By Lemma 18, for any σSn, RO-widthσ(fG(A𝐱+𝐛))|E|+3. We use Lemma 20 to complete the reverse direction of the reduction. First, we observe that if A is the product of a diagonal matrix and a permutation matrix, then RO-widthσ(fG(A𝐱+b))=RO-widthσ(fG(𝐱)): Suppose A has this form. Then there exist a1,,an𝔽, all non-zero, and a permutation π:[n][n] such that A𝐱+𝐛=(a1xπ(1)+b1,a2xπ(2)+b2,,anxπ(n)+bn). We can obtain an ROABP for fG(𝐱) from an ROABP for fG(a1xπ(1)+b1,,anxπ(n)+bn) by replacing each xπ(i) with (xibi)/ai. The resulting ABP is still an ROABP, with the same width as before. Also, this process is clearly reversible.

By the proof of the forward direction, we know that RO-width(fG)cutwidth(G)+2|E|+2. Now suppose there exist AGLn and 𝐛𝔽n such that fG(A𝐱+𝐛) has ROABP width at most w+2 in some order. Due to Lemma 20 and the observation above, we may assume that A is the identity matrix and 𝐛=𝟎. Next, we show that for each S[n], Rank(MS(fG))|cut(S)|+2 by a proof similar to the 𝖭𝖯 hardness in [5] by exhibiting a submatrix of MS(fG) that is a |cut(S)|×|cut(S)| permutation matrix, along with two rows that lie in disjoint spaces.

This suffices for the reverse direction, for if fG has an ROABP of width w+2 in order π, then due to Nisan’s characterization (Theorem 10), we would have that cutwidth(G)w, witnessed by the linear arrangement π.

Define E1{eieicut(S),i1S,i2[n]S} and E2{eieicut(S),i1[n]S,i2S}. We look at the submatrix of MS(fG) induced by the row monomials R={ΠS(𝐱)xi1ieiE1}{ΠS(𝐱)xi22|E|+1ieiE2} and column monomials C={Π[n]S(𝐱)xi1ieiE2}{Π[n]S(𝐱)xi22|E|+1eiE1}. This is a permutation matrix, since each monomoial labeling both the rows an columns can be associated with a unique end point of an edge in cut(S), and the only non-zero entry (in the entirety of MS(fG), not just the submatrix) in that row/column corresponds to the monomial labeling the column/row associated with the other end point of that edge. On the other hand, consider the row labeled by ΠS(𝐱). This has non-zero entries in the columns labeled by the monomials Π[n]S(𝐱)xi2|E|+1, for each i[n]S (note that these monomials are not contained in C), and a zero entry in the column labeled by x[n]S. Also, a row labeled by ΠS(𝐱)xi2|E|+1 for an i[S] (again, note that this monomial is not contained in R) has a non-zero entry in the column labeled by Π[n]S. This gives us that Rank(MS(fG))|cut(S)|+2.

4.2 Characteristic 𝒑

In this section, we prove hardness of testing equivalence to width w ROABPs, over characteristic p. In this setting, we resort to inhomogeneity to prove hardness. This is because Lemma 17, and therefore, Lemma 20 fail to hold over small characteristic. In particular, we show that a skewed version of the polynomial in Equation (1) gives us hardness, even over characteristic p. Recall the polynomial fG={i,j}Exini(j)xjnj(i)+i=1nxiΔ+1 constructed in [5]. Instead of the term i=1nxiΔ+1, we introduce the asymmetric i=1nxiDj. We carefully choose distinct exponents Dj such that they are polynomial in the size of the graph while also allowing us to prove NP-hardness.

We will use the following well known result of Lucas.

Theorem 21.

Let p be a prime and m,n be integers such that m=k=0tmkpk and n=k=0tnkpk are the base p expansions of m and n respectively. Then,

(mn)k=0t(mknk)modp

where we use the convention that (mknk)=0 if mk<nk.

Theorem 22.

Let p be a prime and let 𝔽 be a field of characteristic p. The Equivalence to ROABP problem (Problem 4) is 𝖭𝖯-hard over 𝔽.

Proof.

Let (G=([n],E),w) be an instance of the CutWidth problem with maximum degree of G is 3. We map it to an instance (fG,w+2) of ROABP-Equivalence.

Let M=max{|E|+4,7}. Let L be the smallest integer such that pL>M. For each j[n], define the exponent

Dj:=(pL1)+(j1)pL.

Note that each Dj is 𝗉𝗈𝗅𝗒(n,|E|). For each vertex i, let ni(j)[deg(i)], as before, be number of neighbours of i less than or equal to j. Note that ni(j)3 for each {i,j}E. Let 𝐱=(x1,,xn). Define the polynomial

fG(𝐱){i,j}Exini(j)xjnj(i)+j=1nxjDj. (2)

First, we check that a statement analogous to Claim 4.4 in [5] continues to hold for the fG we have defined. The proof in [5] works for our fG as well, we include a proof here for completeness.

Claim 23 (Analogous to Claim 4.4 in [5]).

For each S[n], we have Rank(MS(fG))=|cut(S)|+2.

Proof.

The nonzero rows of MS(fG) are of at most three types:

  1. (1)

    Row indexed by the constant monomial 1;

  2. (2)

    Rows indexed by xini(j) for iS and j[n]S;

  3. (3)

    Rows indexed by xini(j)xjnj(i) for i,jS or by xiDi for iS.

Similarly, columns of MS(fG) are of at most three types:

  1. (1)

    Column indexed by the constant monomial 1;

  2. (2)

    Columns indexed by xjnj(i) for j[n] and iS;

  3. (3)

    Columns indexed by xini(j)xjnj(i) for i,j[n]S or by xjDj for j[n]S.

Let Mi,j denote the submatrix of MS(fG) induced by rows of type (i) and columns of type (j) from the possibilities mentioned above. By construction, M2,2 is a |cut(S)|×|cut(S)| permutation matrix. On the other hand, M1,3 and M3,1 are non-zero row and column matrices respectively (due to the presence of the xjDj monomials in fG). All the other submatrices Mi,j are zero matrices. Therefore, Rank(MS(fG))=Rank(M2,2)+Rank(M1,3)+Rank(M3,1)=|cut(S)|+2.

Forward Direction: If 𝑮 has cutwidth at most 𝒘, then there exist 𝑨𝐆𝐋𝒏(𝔽) and 𝐛𝔽𝒏 such that 𝒇𝑮(𝑨𝐱+𝐛) has an ROABP of width at most 𝒘+𝟐 in some order.

We pick A=In and 𝐛=0. By Claim 23, we have for each S[n], that Rank(MS(fG))=|cut(S)|+2. If there is a linear arrangement π that witnesses cutwidth(G)w, then by Nisan’s characterization (Theorem 10), fG has an ROABP in order π of width w+2.

Reverse Direction: If there exist 𝑨𝐆𝐋𝒏(𝔽) and 𝐛𝔽𝒏 such that 𝒇𝑮(𝑨𝐱+𝐛) has an ROABP of width at most 𝒘+𝟐 in some order, then 𝑮 has cutwidth at most 𝒘.

We first prove the following key lemma which is the analogue of Lemma 20 in the case of characteristic p:

Lemma 24.

Suppose AGLn(𝔽) is not the product of a permutation matrix and a diagonal matrix. Then for every 𝐛𝔽n, every ROABP computing fG(A𝐱+𝐛) must have width at least |E|+3.

Proof.

If A is not the product of a permutation matrix and a diagonal matrix, there is a row of A, say Aj, with at least two non-zero entries. Let j be the largest index for which this holds. The linear form lj(𝐱)=Aj𝐱+bj has support at least 2. Assume, without loss of generality, that lj(𝐱)=ajk1xk1+ajk2xk2+ with k1k2 and ajk1,ajk20.

The polynomial fG(A𝐱+𝐛) contains the term (lj(𝐱))Dj. By our choice of Dj=(pL1)+(j1)pL, Lucas’s Theorem (Theorem 21) guarantees that (Dji)0(modp) for all 1iM<Dj. This ensures that in the expansion of (lj(𝐱))Dj, the coefficient of xk1ixk2Dji is non-zero for all 1iM1. Note that the support of these monomials is at least 2.

The other terms in fG(A𝐱+𝐛) have lower total degree or have support at most 1: For l>j, the term (Al𝐱+bl)Dl only involves one variable. For l<j, the term (Al𝐱+bl)Dl has total degree Dl<Dj. The edge terms have total degree at most 6<Dj. Thus, the analysis is dominated by (lj(𝐱))Dj.

Now, consider any ROABP for fG(A𝐱+𝐛) in an arbitrary order π. Pick a prefix S of π that separates k1 and k2. The width of the ROABP is at least Rank(MS(fG(A𝐱+𝐛))). The submatrix of MS corresponding to row monomials {xk1i}i=1M1 and column monomials {xk2Dji}i=1M1 is an anti-triangular matrix of size (M1)×(M1) with non-zero entries on its anti-diagonal. Its rank is therefore M1|E|+3. Since π was arbitrary, this holds for any order.

We use Lemma 24 to prove the reverse direction. Suppose there exist AGLn(𝔽) and 𝐛𝔽n such that fG(A𝐱+𝐛) has ROABP width at most w+2. Combining with Lemma 24 the reasoning provided in the proof of Theorem 19 we may assume that A is the identity matrix and that 𝐛=𝟎. By Claim 23, we have

cutwidth(G)+2=RO-width(fG(𝐱))w+2,

which implies cutwidth(G)w. This completes the soundness argument and the proof of the theorem.

5 Hardness of Order-Finding for Quadratic Forms

The NP hardness reduction for ROABP order finding provided by [5] embeds the cut sizes of the graph into the ranks of the corresponding Nisan matrices. Instead, we can also embed the cut-rank information into the Nisan matrices. Let G be a graph and S be a subset of it’s vertices. For a field 𝔽, cut-rank𝔽(S) is defined as the rank over 𝔽 of the 01 matrix whose rows are indexed by vertices of G in S, columns by vertices not in S, and the (u,v)-th entry is 1 iff {u,v} is an edge of G. This leads us to our next reduction, which gives NP-Hardness of order finding for quadratic forms. This is an improvement over [5], who give hardness for degree 6 polynomials).

Theorem 25.

DenseROwidth-2 is NP-hard over any field 𝔽.

Proof.

We reduce from the linear rank-width problem over 𝔽. Let (G=([n],E),w) be an instance of the linear rank-width problem. Construct the polynomial fG over 𝔽 defined as

fG={i,j}Exixj+i=1nxi2

The proof of NP-hardness follows from the next claim.

Claim 26.

Let S[n] be such that 1|S|n1. Then Rank(MS(fG))=cut-rank𝔽(S)+2

Proof.

The proof follows by inspecting the structure of the matrix MS(fG). Since fG is a quadratic form, we only need to consider monomials of degree at most 2. We partition the rows and columns of the Nisan matrix MS(fG) by the degree of the indexing monomials and obtain the following block structure for MS(fG)

MS(fG)(M0,0M0,1M0,2M1,0M1,1M1,2M2,0M2,1M2,2)

Here, Mi,j is the submatrix induced by row monomials of degree i and column monomials of degree j. First, note that M1,1 is exactly the cut-rank matrix for the subset S. Also, note that M2,0 and M0,2 are non-zero (because of the xi2 terms) column and row matrices respectively, and so they have rank 1. Finally, note that the rest of the Mi,j are all 𝟎. Therefore, Rank(MS(fG))=Rank(M0,2)+Rank(M2,0)+Rank(M1,1)=cut-rank𝔽(S)+2 In particular, this implies that RO-width(fG) is linear rank-width of G plus 2.

References

  • [1] Christoph Ambühl, Monaldo Mastrolilli, and Ola Svensson. Inapproximability results for maximum edge biclique, minimum linear arrangement, and sparsest cut. SIAM Journal on Computing, 40(2):567–596, 2011. doi:10.1137/080729256.
  • [2] Per Austrin, Toniann Pitassi, and Yu Wu. Inapproximability of treewidth, one-shot pebbling, and related layout problems. In Anupam Gupta, Klaus Jansen, José Rolim, and Rocco Servedio, editors, Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, pages 13–24, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg. doi:10.1007/978-3-642-32512-0_2.
  • [3] O. Baraskar, A. Dewan, C. Saha, and P. Sinha. NP-hardness of testing equivalence to sparse polynomials and to constant-support polynomials. In Proceedings of the 51st International Colloquium on Automata, Languages, and Programming (ICALP), 2024.
  • [4] Omkar Baraskar, Agrim Dewan, and Chandan Saha. Testing equivalence to design polynomials. In Olaf Beyersdorff, Mamadou Moustapha Kanté, Orna Kupferman, and Daniel Lokshtanov, editors, 41st International Symposium on Theoretical Aspects of Computer Science, STACS 2024, March 12-14, 2024, Clermont-Ferrand, France, volume 289 of LIPIcs, pages 9:1–9:22. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2024. doi:10.4230/LIPICS.STACS.2024.9.
  • [5] V. Bhargava, P. Dutta, S. Ghosh, and A. Tengse. The complexity of order-finding for roabps. arXiv preprint arXiv:2411.18981, 2024. arXiv:2411.18981.
  • [6] Vishwas Bhargava and Sumanta Ghosh. Improved hitting set for orbit of roabps. computational complexity, 31(2):15, October 2022. doi:10.1007/s00037-022-00230-9.
  • [7] J. Díaz, J. Petit, and M. Serna. A survey of graph layout problems. ACM Computing Surveys, 34(3):313–356, 2002. doi:10.1145/568522.568523.
  • [8] Nikhil Gupta, Chandan Saha, and Bhargav Thankey. Equivalence Test for Read-Once Arithmetic Formulas, pages 4205–4272. SIAM, 2023. doi:10.1137/1.9781611977554.ch162.
  • [9] Dori Medini and Amir Shpilka. Hitting sets and reconstruction for dense orbits in vp_{e} and ΣΠΣ circuits. In Valentine Kabanets, editor, 36th Computational Complexity Conference, CCC 2021, July 20-23, 2021, Toronto, Ontario, Canada (Virtual Conference), volume 200 of LIPIcs, pages 19:1–19:27. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPICS.CCC.2021.19.
  • [10] N. Nisan. Lower bounds for non-commutative computation. In Proceedings of the 23rd Annual ACM Symposium on Theory of Computing (STOC), pages 410–418, 1991.
  • [11] S. Oum. Rank-width: Algorithmic and structural results. Discrete Applied Mathematics, 231:15–24, 2017. doi:10.1016/J.DAM.2016.08.006.
  • [12] Chandan Saha and Bhargav Thankey. Hitting sets for orbits of circuit classes and polynomial families. ACM Trans. Comput. Theory, 16(3), September 2024. doi:10.1145/3665800.