Degrees of Second and Higher-Order Polynomials
Abstract
Second-order polynomials generalize classical (=first-order) ones in allowing for additional variables that range over functions rather than values. We are motivated by their applications in higher-order computational complexity theory, extending for instance discrete classes (like or ) to operators in Analysis [Kapron&Cook’96], [Kawamura&Cook’12]. The degree subclassifies ordinary polynomial growth into linear, quadratic, cubic, etc. To similarly classify second-order polynomials, we (well-)define their degree by structural induction as an “arctic” first-order polynomial: a term/expression over integer variable and operations and and binary . This generalized degree turns out to transform nicely under (now two kinds of) polynomial composition. As examples, we collect and determine the degrees of previous and new asymptotic analyses of algorithms and operators receiving function/oracle arguments. Then we motivate and introduce third-order polynomials and their degrees as arctic second-order polynomials, along with their transformations under three kinds of composition. Proceeding to fourth order and beyond yields a hierarchy, with characterization in Simply Typed Lambda Calculus.
Keywords and phrases:
Logic in Computer Science, Higher Order Program Analysis, Asymptotic Type TheoryCopyright and License:
2012 ACM Subject Classification:
Mathematics of computing ; Theory of computation Higher order logic ; Theory of computation Type theoryAcknowledgements:
We thank anonymous reviewers for feedback and guidance.Funding:
This work was supported by the National Research Foundation of Korea and by the Korean Ministry of Science and ICT with grants NRF-2017R1E1A1A03071032 and NRF-2016K1A3A7A03950702 and by KAIST in-house grant.Editors:
C. Aiswarya, Ruta Mehta, and Subhajit RoySeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Motivating Examples and Overview
Polynomial – as opposed to, say, exponential – growth is investigated in areas such as Chemistry (reaction kinetics) and Mathematics (Gromov’s theorem) and of course Computer Science (Cobham–Edmonds Thesis). The degree of polynomial growth provides a refined classification into linear, quadratic, cubic, quartic, quintic, etc. We focus on univariate polynomials over . For example is of degree 3 in variable .
So-called second-order polynomials, involving an additional variable ranging over functions on natural numbers (instead of values, i.e., one step up the type hierarchy), arise naturally in many areas: including but not limited to characterizations of computational complexity classes and reductions on higher types [30, 13, 15, 7, 25, 2].
Example 1.
is a second-order polynomial in first-order variable
and second-order variable .
The degree of this second-order polynomial turns out to be the following expression
| (1) |
Other than classical polynomials, it involves the (binary) operation and is thus called “arctic”: see Remark 2a) below. However, whenever has value , Expression (1) semantically coincides with the above simple cubic polynomial .
In Section 2 below, Definition 5 formally recalls second-order polynomials; and Subsection 2.3 collects both previous and new examples and applications from Complexity Theory and Analysis. In Subsection 2.1, Definition 9 introduces the notion of second-order polynomial degree; and Proposition 12 records some of its properties as well as connections to ordinary (=first-order) polynomial degrees. Theorem 7 asserts semantic completeness.
Section 3 climbs further up the type hierarchy: first to third-order polynomials, whose degrees are arctic second-order polynomials (Subsection 3.2); and then (Subsection 3.3) to the higher-order cases, including a characterization in terms of a certain fragment of Simply Typed Lambda Calculus in Subsection 3.4. Proofs are deferred to Appendices A and B; those omitted due to page constraints can be found in [21].
Our notions of higher-order degrees offer sub-classifications of higher-degree polynomial growth to various levels of detail; cf. Table 2 in Subsection 2.1. Such a sub-classification had been envisioned/requested by Akitoshi Kawamura (personal conversation, ca. 2015).
Remark 2.
- a)
-
b)
First-order polynomials are commonly defined syntactically as a family of well-formed expressions over and and : over one or several () variables , with or without (=“pure”) additional constants from some semi/ring , with or without (=“positive”) subtraction. Logically speaking, they are precisely the elements of a suitable term language. Each syntactic polynomial gives rise semantically to a unique total function .
-
c)
Regarding the converse direction – namely translating certain functions (semantics) to syntactic polynomials – existence and uniqueness questions can be challenging depending on the particular setting. [28] for example investigates which multivariate functions over a ring with zero-divisors can be represented as polynomials at all. And Hilbert’s famous Nullstellensatz characterizes the non-uniqueness of polynomial representations of a multivariate partial function, defined on some algebraic variety over .
-
d)
By virtue of Commutative and Associative and Distributive Laws, any classical multivariate polynomial can be rewritten – see Equation (3) – as a linear combination of monomials of lexicographically strictly increasing multidegrees . And for , this syntactic normal form is also semantically unique:
-
e)
Let denote two ordinary syntactically non-equivalent (Equation 3) positive pure polynomials in variables over . Then there exists an assignment that makes them evaluate differently: .
Item e) follows for instance from the (DeMillo-Lipton-) Schwartz-Zippel Lemma, based on monomial normal form. Theorem 7 generalizes Item e) to the second-order case.
Introducing second-order polynomial degrees had been attempted in [31]: a brief note summarizing a spontaneous short Dagstuhl idea without (explicit) definitions nor proofs, which furthermore wrongly claims that the second-order degree is a (non-arctic) polynomial – rendering the remaining claims moot. Section 2 puts said ideas from [31] on a sound foundation with definitions and proofs and elaborate examples; and Section 3 takes a new perspective on the first and second-order case, in order to then generalize to third and higher-order polynomials and degrees.
| first-order variables | |
| values of said variables | |
| pure positive multi/uni-variate 1st-order polynomials | |
| induced monotonic functions | |
| (total) degree of non-zero first-order polynomial | |
| arctic first-order polynomials | |
| induced asymptotic first-order polynomial | |
| second-order variables | |
| values of said variables | |
| (multi/uni-variate) second-order polynomials | |
| induced monotonic mixed functionals | |
| Curry-ed monotonic operator | |
| arctic first-order polynomial as second-order degree | |
| 1st-order polynomial as asymptotic 2nd-order degree | |
| nesting depth of second-order polynomial | |
| arctic second-order polynomials | |
| third-order variables | |
| values of said variables | |
| third-order polynomials | |
| induced monotonic mixed hyper-functional | |
| Curry-ed monotonic mixed operator | |
| Curry-ed monotonic hyper-operator | |
| arctic second-order polynomial as third-order degree |
1.1 Arctic First-Order Polynomials
Definition 9 below defines the degree of a second-order polynomial to be an ordinary polynomial, but one involving .
Definition 3.
An arctic (first-order) polynomial in variables is a well-formed expression over and constant symbols (unary) and binary .
Recall Example 1 and Remark 2a). As opposed to Definition 5, the constant 0 is permitted here. We refrain from spelling out the obvious semantics of an arctic polynomial . Note that, when evaluating on an arbitrary fixed integer vector , any occurrence of evaluates to at least one of its two arguments. Moreover, in the univariate case and as , the role of the dominant argument in may switch only finitely often, as one can see by structural induction:
Lemma 4.
-
a)
For any two distinct univariate positive ordinary polynomials and , their associated polynomial functions and satisfy
(2) -
b)
Fix univariate arctic polynomial . Its value coincides, for all sufficiently large arguments , with for a unique ordinary (positive pure) polynomial .
Call from Lemma 4b) the asymptotic polynomial induced by univariate arctic , written . There is no risk of confusing the polynomial with the “value” . We record that and . Lemma 4 is limited to the univariate case: multivariate arctic terms like may not asymptotically coincide with an ordinary one; see also Example 19.
2 Second-Order Polynomials
We consider “positive pure” (univariate) second-order polynomials, that is, with syntactically well-formed expressions involving – in addition to operations and as only constant and classical variables – some unary function-type variable [13]:
Definition 5.
Second-order polynomials, like and , are syntactically generated by the Backus-Naur rules
In other words, second-order polynomials are the least class of formal expressions (=terms)
-
that include constant and variables
-
and are closed under binary addition and product
-
Moreover, when is a second-order polynomial, then so is :
Regarding semantics, we continue using overline to denote the interpretation of an expression as a mapping: Each variable may take values ranging over ; and ranges over , the set of nondecreasing total unary functions . Extended by structural induction to compound expressions, let evaluate to and .
Recall Example 1, note that we prohibit the constant 0. Exponentiation (only to a natural number power) abbreviates repeated multiplication: and , as opposed to repeated composition . Commutative, associative, distributive laws extend from numbers to (both first and) second-order polynomials pointwise:
Definition 6.
Let “” denote syntactic equivalence of terms up to Associative, Commutative, and Distributive Laws; formally the equivalence relation generated by the following rules:
| (3) | |||
Syntactic equivalence is semantically sound for 2nd-order polynomials: . Generalizing Remark 2e), the converse – semantic completeness – is also true, but less obvious:
Theorem 7.
Let be syntactically non-equivalent second-order polynomials. There exists an assignment and such that .
See [20, 21] for a proof, omitted here due to space limitations. A similar result has been shown for Simply Typed Lambda Calculus (see also Subsection 3.4 below) modulo integer arithmetic [27, Theorems 5.2+5.6], with two caveats: function variable is supposed bi-variate [27, p.684] and runs over all (not just monotonic) total integer mappings [27, Definition 4.11].
2.1 Second-Order Polynomial Degree
The total degree of a classical multivariate polynomial is commonly defined first for monomials, and then for linear combinations of the latter: relying on the monomial normal form, recall Remark 2d+e). An alternative equivalent definition proceeds by structural induction, for instance for positive pure polynomials as follows:
| (4) | |||
The former approach builds on monomial normal form (Remark 2d) while the latter needs to separately establish well-definition, namely invariance under syntactic equivalence (3):
| (5) |
which we generalize in Remark 10 below. Either way, the Rule of Composition then follows, in the univariate case expressed concisely as: .
Remark 8.
Strictly speaking, needs to be defined syntactically: for instance by structural induction on , essentially replacing each occurrence of variable in with . And said inductive definition then gets justified semantically by concluding , where (only) the right-hand side means composition of functions. Definition 11 and Proposition 12 below proceed in this very way, for second-order polynomials.
For univariate polynomials, the integer total order on degrees “” captures Landau’s pre-order of asymptotic growth “”; recall Lemma 4a). This suggests extending Equation (4) from ordinary to second-order polynomials:
Definition 9.
The (second-order) degree of a second-order polynomial in and is an arctic polynomial in , given inductively by
| (6) |
We write “” to emphasize that first-order variable in corresponds to second-order argument in , particularly when later generalizing to several second-order variables; see Remark 13b+e).
Related work [16] had investigated linear second-order polynomials: defined by omitting/prohibiting multiplication from Definition 5 (but still allowing for addition and nesting ). These are precisely those having as degree an arctic polynomial without addition (but still with multiplication and ); recall that Definition 5 allows only the constant .
Remark 10.
Definition 9 is well-defined, namely it respects syntactic equivalence (3): Arithmetical commutativity and associativity of and translate to “arctic” commutativity and associativity of and , respectively; multiplication by translates to addition of ; and distributivity translates to
| (7) |
Reflecting that every ordinary polynomial is a fortiori also a second-order polynomial, Definition 9 extends the classical degree: for any (positive pure) multivariate first-order polynomial .
According to Lemma 4b), the degree of a second-order polynomial induces an ordinary univariate polynomial – which we call ’s asymptotic degree.
| Growing as … | Example |
|---|---|
| a given second-order polynomial | (complicated) from Example 1 |
| (some unspecified second-order polynomial) having a given arctic first-order polynomial as degree | (simpler) from Example 1 |
| (some unspecified second-order polynomial) having a given first-order polynomial as asymptotic degree | “” (Example 1) |
| (some unspecified second-order polynomial) having a given nesting depth according to Proposition 12d) | “” in Example 1 |
| some unspecified second order polynomial | [15, Definition 3.2] |
2.2 Second-Order Polynomial Compositions
Second-order polynomials naturally compose in two different ways, here denoted and :
Definition 11.
Let and be univariate second-order polynomials. Define their compositions and by structural induction as follows:
essentially replaces in every occurrence of first-order variable with ;
and replaces
in every occurrence of second-order variable with .
Note that ; and for first-order polynomials :
justifying the common notation .
In the second-order case,
there is no danger of confusing the notation
with a composition,
since the pair is not a single
second-order polynomial.
Like in the classical case, the notion of degree translates composition “” to multiplication “”. The other kind “” of composition, new to the second-order case, translates as ordinary composition “” of first-order (arctic) polynomials:
Proposition 12.
Fix univariate second-order polynomials and .
-
a)
is again a second-order polynomial in , with semantics for all and all . Furthermore
-
b)
is again a second-order polynomial in , with semantics for and . Here denotes the monotonic mapping . Furthermore
-
c)
Moreover, if is an ordinary polynomial, then so is . For the family of constant ordinary polynomials, is a bivariate polynomial in .
-
d)
is well-defined, and coincides with the (nesting) depth of in according to [13, Definition 5.9].
The proofs proceed by straight-forward structural induction and are omitted.
Remark 13.
-
a)
Proposition 12a) extends and recovers the first-order case, when and are ordinary polynomials. When is first-order, then : an integer multiple of ; analogously when is first-order.
- b)
-
c)
Regarding Proposition 12d), recall Lemma 4b) that denotes the unique ordinary polynomial coinciding with arctic on all sufficiently large arguments. In view of Proposition 12d), second-order polynomial asymptotic growth can be stated with various decreasing degrees of detail and increasing conciseness, as illustrated in Table 2.
- d)
- e)
-
f)
and both have same degree , but neither nor ; see also Example 19.
2.3 Examples and Applications
Polynomial bounds capture “tame” (as opposed to, say, exponential) growth in many areas:
-
In classical Complexity Theory, denotes the amount of resources used to process inputs of length .
-
In Geometric Group Theory, denotes the number of distinct group elements expressible by words of length over a fixed symmetric set of generators [9].
-
In statistical physics / probability theory, denotes the mixing time of a dynamical system or stochastic process over a element universe [19].
Generally, establishing polynomially bounded growth is followed by further investigating the (least) degree of said polynomial [29, 8, 6]. Recall (before Definition 9) that the integer total order on degrees captures Landau’s preorder of asymptotic growth.
The present work enables similarly refined analyses of higher-type problems: Extending the Cobham-Edmonds Thesis, asymptotic growth of a functional depending on (first-order and on) a second-order parameter is commonly considered “tame” iff it is bounded by (the values of) some second-order polynomial . And its degree captures, and allows to concisely compare, second-order asymptotic growth; recall Remark 13c) and see Table 2. When its argument itself grows exponentially, then as a relative polynomial bound [24, §4] may grow like an exponential tower of height , recall Proposition 12d). We collect here some old and new examples, proofs in Appendix B.
Example 14 (String Functionals).
-
i)
Suppose traditional Turing machine computes function in polynomial time and machine computes in polynomial time . Then executing on input of length , obtained by executing on input , results in a Turing machine computing in total running time : a polynomial of degree for non-constant . This simple observation appears ubiquitously, often implicitly.
-
ii)
An oracle Turing machine computing is said [13] to run in second-order polynomial time if the following holds: On input of any string and for any string function oracle , outputs and makes at most steps, where .
-
iii)
Similarly to (i), let us analyze the running time of oracle Turing machine composition in (iv)+(v). Indeed, second-order string functionals naturally compose in two distinct ways, similarly to second-order polynomials in Subsection 2.2: For , let and , where .
-
iv)
Let and denote oracle Turing machines computing and , respectively, in second-order running time bounds and . Then can be computed by an oracle Turing machine in second-order polynomial time of degree for non-constant .
-
v)
Let and and be as in (iv). Then can be computed by an oracle Turing machine in second-order polynomial time of degree .
-
vi)
[14] designs and analyzes running times of oracle Turing machines computing certain other mixed functionals . Specifically, [14, Proposition 2.8] establishes a time bound , where denotes some (unspecified, cf.Table 2) ordinary polynomial and indicates how often to iterate . The degree of the this second-order polynomial is .
The second-order running time bound in Example 14vi) is already rather concise to begin with, hence here considering its second-order degree does not yield as much further simplification as in, say, Example 1. Asymptotic growth w.r.t. of a second-order polynomial depends additionally on that of its second-order argument , and the second-order degree captures both: cf. Remark 13. In Example 14, the second-order parameter measures the “size” of function-type argument . Other applications, like in Examples 14 above and 17 below, assign other meanings to the second-order parameter:
Example 15.
-
a)
To any continuous real function (as argument to an operator in Analysis, say) assign as size its modulus of uniform continuity [17, Definition 2.12]: pointwise minimal such that .
-
b)
To any pre-compact metric space assign as size its Kolmogorov entropy [23]: pointwise minimal such that there exist balls of radius covering .
-
c)
For , to any -summable sequence assign as size its modulus of convergence: pointwise minimal such that .
- d)
Example 16 (1D Real Function Inversion).
Recall Example 15a) and record [17, Theorem 2.19] that any polynomial-time computable bijection has a polynomial modulus of uniform continuity; and its inverse is again polynomial-time computable – provided that it, too, admits a polynomial modulus of continuity [17, Corollary 4.7].
More generally and more precisely, let denote the set of bijections having modulus and whose inverse has modulus . Note that : the identity on , with modulus and similarly .
-
i)
By the proof of [17, Theorem 4.6], there exists an oracle Turing machine computing the family of inversion operators in time : a second-order polynomial in first-order variable111The kind reader may generously forgive us for relaxing the distinction between syntax and semantics. and in two independent second-order variables and . This polynomial has degree : a bivariate first-order polynomial in and according to Remark 13e).
-
ii)
Trisection (Appendix A) yields another oracle Turing machine computing the same family of inversion operators in time : a second-order polynomial of degree since by the above considerations.
-
iii)
Combining and in the single second-order parameter , the runtime bound from (i) becomes of univariate degree in ; the bound from (ii) becomes of univariate degree .
In Example 16, the degree captures concisely that Trisection (ii) is asymptotically more efficient – and thus preferable over – the algorithm from (i) whenever , i.e., when grows faster than .
Example 17 (Continuous Operator in Functional Analysis).
Fix and recall that denotes the space of -summable complex sequences . Write for the sphere with radius , that is, the subset of those sequences having -norm . For let furthermore denote the subset of all sequences having modulus of convergence .
We record that is compact and, conversely, any compact subset of is contained in for some and some .
-
i)
Consider some continuous (but not necessarily linear) . By continuity, maps compact subsets of to compact subsets of . In particular it maps every to for some minimal and some minimal which also depends on . Let denote the thus well-defined mapping associated with . Note that is non-decreasing: implies . The case of continuous (linear) operators on Fourier series is particularly relevant [18, Remark 26].
-
ii)
The identity operator has the identity. The “repetition” operator is linear and 2-Lipschitz and has .
-
iii)
For any bijection (aka infinite permutation) , the linear operator is isometric. Its associated is bounded by a second-order polynomial iff for some ordinary polynomial .
We close this subsection with some further, sporadic examples:
- i)
-
ii)
[22, Corollary 3.6a] uses the expression , where denotes the class of univariate ordinary polynomials. Its degree is ; here the constant hidden in captures (the degrees of) the particular ordinary polynomials.
- iii)
2.4 Arctic Second-Order Polynomials
Definition 23d) below considers the degree of a third-order polynomial to be an arctic second-order polynomial.
Definition 18.
-
a)
Arctic second-order polynomials in first-order variables and one second-order variable are generated by
with obvious semantics similar to (non-arctic) second-order polynomials.
-
b)
Regarding syntactic equivalence, extend Rules (3) to capturing monotonicity:
(8)
Lemma 4 about the asymptotic behaviour of arctic first-order polynomials does not extend to the second-order case:
Example 19.
Consider and . They both have the same degree . For all integers and for all sufficiently large , they evaluate
In particular the arctic univariate second-order polynomial cannot reasonably be said to “asymptotically” coincide with any ordinary second-order polynomial.
3 Higher-Order Polynomials and Degrees
We now climb further up in the type hierarchy: by one step to the third-order case in Subsection 3.2, and then to the general case in Subsection 3.3. But first revisit and take a new perspective on the first and second-order case:
3.1 First and Second-Order Case Revisited
Section 2 had regarded compositions and as operators on previously defined second-order polynomials, and the algebraic properties of these operators were consequences. This is the traditional perspective [13, 15]. In order to proceed to third and higher order polynomials, we now take a new but equivalent perspective on the same families of traditional first and second-order polynomials, considering compositions as part of their syntactic definition:
Remark 20 (First-Order Polynomials, Revisited).
Note that the semantics of ordinary polynomials is based on “values”, namely starting with and and proceeding inductively via and . Alternatively, ordinary polynomials can be considered as certain mappings
Here, and are tacitly “overloaded” to denote pointwise addition and multiplication of functions instead of values.
-
a)
A univariate first-order polynomial in is syntactically generated by the rules
-
b)
The semantics of is the canonical interpretation as map .
-
c)
Syntactic equivalence is generated by the Rules (3), together with these for :
-
d)
The degree of is defined inductively by
Well-definition follows from (c), together with Commutative/Associative/ Distributive Laws of captured in (h).
-
e)
For any first-order polynomial according to (a), there exists a syntactically equivalent first-order polynomial devoid of composition symbol .
-
f)
Every classical univariate polynomial (function) can be expressed in the form (a) with semantics (b). Conversely every polynomial according to (a) without composition symbol (e) amounts to a classical polynomial with same semantics.
-
g)
An arctic first-order polynomial in is syntactically generated by the rules
-
h)
Arctic syntactic rules extend (c) with: , , , ,
Item e) follows from c) by structural induction, which also implies .
Remark 21 (Second-Order Polynomials, Revisited).
Curry-ing (Schönfinkel-ing) suggests considering a second-order polynomial as
family of first-order polynomials, parameterized by an additional variable
ranging over : .
Second-order polynomials can alternatively be interpreted as operators :
Let us re-introduce to denote the composition of operators, for composition of functions.
-
a)
A univariate second-order polynomial in is syntactically generated by
-
b)
The semantics is given as follows, subject to implicit Curry-ing:
-
c)
Regarding syntactic equivalence we record, in addition to Remark 20c):
(9) -
d)
The degree of is an arctic first-order polynomial in variable , defined inductively as in Remark 20d) and, additionally, .
-
e)
To any 2nd-order polynomial according to (a) there is a syntactically equivalent one
(i) devoid of composition symbol and (ii) whenever occurs, its left argument is . - f)
-
g)
An arctic univariate second-order polynomial in is syntactically generated by
- h)
Items e+f) record that this new perspective coincides with Definition 5. Note that now both and are of type but, other than for composition “”, the type of its two arguments tacitly gets Curry-ed for composition “”; and Proposition 12 is now axiomatized in Item d). Again, Item e) follows from structural induction using Item c), and implies congruence w.r.t. ; but congruence w.r.t. now needs to be postulated as Rule (9). Regarding the first part of Item f), rewrite as . Second-order polynomials according to Remark 21 use brackets only to express priority, not anymore to express “application”.
3.2 Third-Order Polynomials and Degrees
Second-order polynomials describe “tame” dependencies on both integer arguments and integer function arguments . Third-order polynomials should additionally take into account dependency on integer operator arguments . Recall Example 17 where continuous operators between Banach spaces give rise to all possible such . In addition to variable ranging over and ranging over , now introduce indeterminate to range over the set of total monotonic integer operators.
Remark 22.
Curry-ing respects monotonicity: is non-decreasing iff is non-decreasing and well-defined regarding its co-domain. Write .
A third-order polynomial can thus be considered as a certain family of monotonic first-order polynomials, parameterized monotonically by two variables and that range over second-order and third-order arguments and , respectively; or alternatively as a family of monotonic second-order polynomials, parameterized monotonically by ; or as monotonic “hyper”-operator of type . We introduce to denote the composition of such hyper-operators.
After first and second-order Remarks 20 and 21, the following Definition 23 and Theorem 25 about third-order polynomials and their degrees follow naturally:
Definition 23.
-
a)
A third-order polynomial in is syntactically generated by
-
b)
Its semantics is ,
all of (or Curry-ed to) type . Moreover
- c)
- d)
-
e)
An arctic third-order polynomial in is syntactically generated by
-
f)
Syntactic rules extend (c) and Remark 21h) with .
Example 24.
-
a)
Consider the following third-order polynomial
where “” abbreviates . has degree
and semantics
- b)
-
c)
A first-order polynomial is a second-order polynomial which does not “depend” on , i.e., whose semantics of type is a constant of type ; recall Theorem 7. A second-order polynomial is a third-order polynomial whose semantics of type is a constant of type .
Theorem 25.
- a)
-
b)
The degree of third-order polynomials is well-defined, namely invariant under the syntactic congruence relations from Definition 23c)+e).
Example 26.
Consider the third-order polynomial in
with implicit default operator precedence after after after . Noting that , the semantics of means mapping argument pairs and to the value . here coincides with the arctic second-order polynomial from Example 19.
3.3 Polynomials and Degrees of Arbitrary Order
Definition 27.
Let denote the order of the polynomials under consideration.
-
a)
With “” we abbreviate the type in case ; “” means , and “” is . Let “” mean multiplication “” and ” addition and, for , “” denotes the typed composition of .
In the sequel, variable ranges over values ; . -
b)
Univariate order- polynomials in variables are syntactically generated by
-
c)
The semantics is , where
are all understood via Curry-ing as of type . Moreover, as structural induction:
-
d)
Syntactic rules are: , ,
-
e)
A univariate arctic order- polynomial in is syntactically generated by
-
f)
Syntactic equivalence among arctic order- polynomials extends (d) with these rules:
-
g)
The degree of (non-arctic) order- polynomial is the arctic order- polynomial in defined inductively by
Theorem 28.
-
a)
Every -order polynomial as in Definition 27b) can be syntactically transformed, using Definition 27d), into an equivalent form in which (i) does not occur; (ii) whenever occurs, its left argument is ; (iii) whenever occurs, its left argument is or or of the form ; (iv) whenever occurs, its left argument is or or or of the form or of the form .
-
b)
The degree of -order polynomials is well-defined, namely invariant under syntactic equivalences according to Definition 27d+f).
Conjecture 29.
Let denote two syntactically non-equivalent order- polynomials. Then there exists an assignment , , … such that .
3.4 Simply Typed Lambda Calculus Perspective
We have already employed Lambda notation, for instance when expressing the semantics of higher-order polynomials in Remark 21b) and in Definitions 23b) and 27c). A reader familiar with Type Theory might appreciate the following alternative characterization of order- polynomials, here for simplicity only in the non-arctic case.
Remark 30.
-
a)
Let denote variables, and a constant symbol. For each let denote an associative binary function symbol.
-
b)
Write for the set of syntactically valid expressions over said variables and symbols. Order- polynomials are Lambda Terms of the form
(10) -
c)
Towards the semantics of such a Lambda Term, impose initial types as follows:
-
d)
Let and and
where denotes the polymorphic composition of .
-
e)
Next consider extended pointwise to type . And, for , consider of type as constant mapping of type
- f)
-
g)
This fragment of Simply Typed Lambda Calculus allows only terms in “head” normal form (10) without inner bound variables, cmp. Example 24b). Item e) employs two kinds of type coercion: i) Extending each binary operation pointwise from its initial to a higher type . And ii) considering an element of some type as constant function of type . Thus any (sub-)expression semantically induces an operator of same pure input and output type.
References
- [1] Aras Bacho and Martin Ziegler. Second-order parameterizations for the complexity theory of integrable functions. arXiv CoRR, 2506.11210, 2025. doi:10.48550/arXiv.2506.11210.
- [2] Patrick Baillot, Ugo Dal Lago, Cynthia Kop, and Deivid Vale. On basic feasible functionals and the interpretation method. In Naoki Kobayashi and James Worrell, editors, Proc.II of 27th Int. Conf. Foundations of Software Science and Computation Structures (FoSSaCS2024), held as part of the European Joint Conferences on Theory and Practice of Software (ETAPS2024) in Luxembourg, volume 14575 of Lecture Notes in Computer Science, pages 70–91. Springer, 2024. doi:10.1007/978-3-031-57231-9_4.
- [3] Eyvind Martol Briseid. Fixed point of generalized contractive mappings. Journal of Nonlinear and Convex Analysis, 9:2:181–204, 2008.
- [4] Eyvind Martol Briseid. Logical aspects of rates of convergence in metric spaces. The Journal of Symbolic Logic, 74(4):1401–1428, 2009. doi:10.2178/jsl/1254748697.
- [5] Michael Codish, Yoav Fekete, Carsten Fuhs, Jürgen Giesl, and Johannes Waldmann. Exotic Semiring Constraints. In SMT 2012. 10th International Workshop on Satisfiability Modulo Theories, volume 20 of EasyChair Proceedings in Computing, pages 88–97. EasyChair, 2013. doi:10.29007/QQVT.
- [6] Martin Dietzfelbinger. Primality Testing in Polynomial Time, volume 3000 of Lecture Notes in Computer Science. Springer, 2004. doi:10.1007/B12334.
- [7] Hugo Férée and Mathieu Hoyrup. Higher-order complexity in analysis. HAL Archive, July 2013. Proc 10th Int.Conf. Computability and Complexity in Analysis (CCA). URL: https://hal.inria.fr/hal-00915973.
- [8] Anka Gajentaan and Mark H Overmars. On a class of O() problems in computational geometry. Computational Geometry, 5(3):165–185, 1995. doi:10.1016/0925-7721(95)00022-2.
- [9] Mikhail Gromov. Groups of polynomial growth and expanding maps. Publications Mathématiques de L’Institut des Hautes Scientifiques, 53:53–78, 1981. doi:10.1007/BF02698687.
- [10] Emmanuel Hainry, Bruce M. Kapron, Jean-Yves Marion, and Romain Péchoux. Declassification policy for program complexity analysis. In Pawel Sobocinski, Ugo Dal Lago, and Javier Esparza, editors, Proc. 39th Annual ACM/IEEE Symposium on Logic in Computer Science, LICS 2024, Tallinn, Estonia, pages 41:1–41:14. ACM, 2024. doi:10.1145/3661814.3662100.
- [11] Emmanuel Hainry and Romain Péchoux. Higher order interpretation for higher order complexity. In Thomas Eiter and David Sands, editors, LPAR-21, 21st International Conference on Logic for Programming, Artificial Intelligence and Reasoning, Maun, Botswana, May 7-12, 2017, volume 46 of EPiC Series in Computing, pages 269–285. EasyChair, 2017. doi:10.29007/1TKW.
- [12] Peter Hertling. Topological complexity with continuous operations. Journal of Complexity, 12(4):315–338, 1996. doi:10.1006/jcom.1996.0021.
- [13] Bruce M. Kapron and Stephen A. Cook. A new characterization of type-2 feasibility. SIAM J. Comput., 25(1):117–132, 1996. doi:10.1137/S0097539794263452.
- [14] Bruce M. Kapron and Florian Steinberg. Type-two polynomial-time and restricted lookahead. In Proceedings of the 33rd Annual ACM/IEEE Symposium on Logic in Computer Science, LICS ’18, pages 579–588, New York, NY, USA, 2018. Association for Computing Machinery. doi:10.1145/3209108.3209124.
- [15] Akitoshi Kawamura and Stephen A. Cook. Complexity theory for operators in analysis. ACM Trans. Comput. Theory, 4(2):5:1–5:24, 2012. doi:10.1145/2189778.2189780.
- [16] Akitoshi Kawamura, Florian Steinberg, and Holger Thies. Second-order linear-time computability with applications to computable analysis. In Proc. 15th Conf. on Theory and Applications of Models of Computation (TAMC), pages 337–358, Berlin, Heidelberg, 2019. Springer-Verlag. doi:10.1007/978-3-030-14812-6_21.
- [17] Ker-I Ko. Complexity Theory of Real Functions, volume 3 of Progress in theoretical computer science. Birkhäuser / Springer, 1991. doi:10.1007/978-1-4684-6802-1.
- [18] Ivan Koswara, Gleb Pogudin, Svetlana Selivanova, and Martin Ziegler. Bit-complexity of classical solutions of linear evolutionary systems of partial differential equations. Journal of Complexity, 76:101727, 2023. doi:10.1016/j.jco.2022.101727.
- [19] David A. Levin and Yuval Peres. Markov chains and mixing times. American Mathematical Society, Providence, Rhode Island, 2009.
- [20] Donghyun Lim. Degrees of second and higher-order polynomials. 4th Workshop on Mathematical Logic and its Applications, March 2021. URL: http://jaist.ac.jp/event/mla2021.
- [21] Donghyun Lim and Martin Ziegler. Degrees of second and higher-order polynomials. arXiv CoRR, 2305.03439, 2023. doi:10.48550/arXiv.2305.03439.
- [22] Donghyun Lim and Martin Ziegler. Quantitative coding and complexity theory of Continuous data: Part I. J. ACM, 72(1):4:1–4:39, 2025. doi:10.1145/3705609.
- [23] George G. Lorentz. Metric entropy and approximation, volume 72. AMS, 1996.
- [24] Kurt Mehlhorn. Polynomial and abstract subrecursive classes. Journal of Computer and System Sciences, 12(2):147–178, 1976. doi:10.1016/S0022-0000(76)80035-9.
- [25] Eike Neumann and Florian Steinberg. Parametrised second-order complexity theory with applications to the study of interval computation. Theor. Comput. Sci., 806:281–304, 2020. doi:10.1016/j.tcs.2019.05.009.
- [26] Jürgen Richter-Gebert, Bernd Sturmfels, and Thorsten Theobald. First steps in tropical geometry. Idempotent Mathematics and Mathematical Physics, 377:289–317, 2005.
- [27] Jon G. Riecke and Ramesh Subrahmanyam. Conditions for the completeness of functional and algebraic equational reasoning. Mathemat.Structures Computer Science, 9(6):651–685, 1999. doi:10.1017/S0960129599002807.
- [28] Ernst Specker, Norbert Hungerbühler, and Micha Wasem. Polyfunctions over commutative rings. J. Algebra and Applications, 23(01):2450014, 2024. doi:10.1142/S0219498824500142.
- [29] Volker Strassen. Gaussian elimination is not optimal. Numer.Mathematik, 13:354–356, 1969.
- [30] Mike Townsend. Complexity for type-2 relations. Notre Dame Formal Logic, 31(2):241–262, 1990. doi:10.1305/NDJFL/1093635419.
- [31] Martin Ziegler. Hyper-degrees of 2nd-order polynomial-time reductions. Technical report, Dagstuhl Seminar #15392, 2016. abstract §3.20. doi:10.4230/DagRep.5.9.77.
Appendix A Proof of Example 16b
Recall [12, bottom of p.336] the Trisection Algorithm 1 below, approximating up to error . Traditional bisection in for with fails in case , since test for equality is impossible reliably. Inequalities and on the other hand can be verified reliably, subject to the promise . Trisection instead performs both tests and simultaneously, for and : Whichever test succeeds reliably, is taken to proceed either to or to , respectively.
In Line 6 of the Pseudo-code 1, xorif indicates that both comparisons “” and “” are conducted in parallel such that, non-deterministically, precisely one of the two assignments gets executed. Since is guaranteed strictly increasing, at least one of the two conditions holds; possibly both. To find out which one, take approximations to and to up to sufficient precision. For that in turn take approximations to and up to sufficient precision. This incurs total bit-cost , as argued in the sequel:
Indeed, being a modulus of continuity of implies since for . Hence dyadic approximations to and to and to , all up to error , will confirm at least one of the two inequalities
satisfied as witnesses to or , respectively; to which in turn approximations to suffice up to error . Hence Lines 6 and 4 and 5 incur bit-cost
And these lines are repeated times according to Line 3. ∎
Appendix B Selected Further Deferred Proofs
Proof of Example 19.
Calculate
where “” means first (few) terms in the Taylor expansion w.r.t. .
Proof of Example 14iv+v.
-
iv)
By definition of , running makes at most steps. In particular its output has length at most . By definition of , in turn makes at most steps.
-
v)
makes at most steps and in particular makes at most that many queries “” to oracle , each of bounded length . Similarly, answering any such query takes time at most and in particular returns an answer of length : hence .
Proof of Example 17iii.
For one direction, suppose that satisfies
| (11) |
Then and therefore
for by hypothesis. Hence is a (not necessarily minimal, i.e. an upper bound on the) modulus of convergence of the image sequence.
Conversely suppose is some (upper bound on the minimal) modulus of convergence of the image sequence whenever is for the original sequence: Since is monotone, also need not be minimal. Fix and note that constitutes a joint modulus of convergence to all sequences with value 1 only at one index . The image of is the sequence , which by hypothesis satisfies unless for all , with a first-order polynomial according to Proposition 12c).
