Abstract 1 Motivating Examples and Overview 2 Second-Order Polynomials 3 Higher-Order Polynomials and Degrees References Appendix A Proof of Example 16b Appendix B Selected Further Deferred Proofs

Degrees of Second and Higher-Order Polynomials

Donghyun Lim ORCID KAIST, Daejeon, Republic of Korea Martin Ziegler ORCID KAIST, Daejeon, Republic of Korea
Abstract

Second-order polynomials generalize classical (=first-order) ones in allowing for additional variables that range over functions rather than values. We are motivated by their applications in higher-order computational complexity theory, extending for instance discrete classes (like P/FP or PSPACE/FPSPACE) to operators in Analysis [Kapron&Cook’96], [Kawamura&Cook’12]. The degree subclassifies ordinary polynomial growth into linear, quadratic, cubic, etc. To similarly classify second-order polynomials, we (well-)define their degree by structural induction as an “arctic” first-order polynomial: a term/expression over integer variable D and operations + and and binary max(). This generalized degree turns out to transform nicely under (now two kinds of) polynomial composition. As examples, we collect and determine the degrees of previous and new asymptotic analyses of algorithms and operators receiving function/oracle arguments. Then we motivate and introduce third-order polynomials and their degrees as arctic second-order polynomials, along with their transformations under three kinds of composition. Proceeding to fourth order and beyond yields a hierarchy, with characterization in Simply Typed Lambda Calculus.

Keywords and phrases:
Logic in Computer Science, Higher Order Program Analysis, Asymptotic Type Theory
Copyright and License:
[Uncaptioned image] © Donghyun Lim and Martin Ziegler; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Mathematics of computing
; Theory of computation Higher order logic ; Theory of computation Type theory
Related Version:
arXiv Version: http://arXiv.org/abs/2305.03439 [21]
Acknowledgements:
We thank anonymous reviewers for feedback and guidance.
Funding:
This work was supported by the National Research Foundation of Korea and by the Korean Ministry of Science and ICT with grants NRF-2017R1E1A1A03071032 and NRF-2016K1A3A7A03950702 and by KAIST in-house grant.
Editors:
C. Aiswarya, Ruta Mehta, and Subhajit Roy

1 Motivating Examples and Overview

Polynomial – as opposed to, say, exponential – growth is investigated in areas such as Chemistry (reaction kinetics) and Mathematics (Gromov’s theorem) and of course Computer Science (Cobham–Edmonds Thesis). The degree of polynomial growth provides a refined classification into linear, quadratic, cubic, quartic, quintic, etc. We focus on univariate polynomials over . For example 15D3+2D+4 is of degree 3 in variable D.

So-called second-order polynomials, involving an additional variable ranging over functions on natural numbers (instead of values, i.e., one step up the type hierarchy), arise naturally in many areas: including but not limited to characterizations of computational complexity classes and reductions on higher types [30, 13, 15, 7, 25, 2].

Example 1.

𝚽(𝚽3(𝚽5(N)))(𝚽(N2)+N9)N4++N999𝚽(3N5+4𝚽8(N+2)𝚽(7N)+𝚽6(1))+𝚽50(N9)
is a second-order polynomial 𝚷 in first-order variable N and second-order variable 𝚽.
The degree of this second-order polynomial turns out to be the following expression P~(D)=

max{D(3D)(5D)+max{2D,9}+4, 999+Dmax{5,8D+D}, 450D} (1)

Other than classical polynomials, it involves the (binary) max operation and is thus called “arctic”: see Remark 2a) below. However, whenever D has value d6, Expression (1) semantically coincides with the above simple cubic polynomial 15D3+2D+4.  

In Section 2 below, Definition 5 formally recalls second-order polynomials; and Subsection 2.3 collects both previous and new examples and applications from Complexity Theory and Analysis. In Subsection 2.1, Definition 9 introduces the notion of second-order polynomial degree; and Proposition 12 records some of its properties as well as connections to ordinary (=first-order) polynomial degrees. Theorem 7 asserts semantic completeness.

Section 3 climbs further up the type hierarchy: first to third-order polynomials, whose degrees are arctic second-order polynomials (Subsection 3.2); and then (Subsection 3.3) to the higher-order cases, including a characterization in terms of a certain fragment of Simply Typed Lambda Calculus in Subsection 3.4. Proofs are deferred to Appendices A and B; those omitted due to page constraints can be found in [21].

Our notions of higher-order degrees offer sub-classifications of higher-degree polynomial growth to various levels of detail; cf. Table 2 in Subsection 2.1. Such a sub-classification had been envisioned/requested by Akitoshi Kawamura (personal conversation, ca. 2015).

 Remark 2.
  1. a)

    “Tropical” historically refers to expressions over (min,+,,0) instead of classical (+,,0,1) [26], “arctic” dually to (max,+,,0): used in Definition 3 below. Both are instances of so-called “exotic” semi-rings [5, §2].

  2. b)

    First-order polynomials are commonly defined syntactically as a family of well-formed expressions over + and and 1: over one or several (M) variables X=(X1,,XM), with or without (=“pure”) additional constants from some semi/ring , with or without (=“positive”) subtraction. Logically speaking, they are precisely the elements of a suitable term language. Each syntactic polynomial P[X] gives rise semantically to a unique total function P¯=p:M.

  3. c)

    Regarding the converse direction – namely translating certain functions (semantics) to syntactic polynomials – existence and uniqueness questions can be challenging depending on the particular setting. [28] for example investigates which multivariate functions over a ring with zero-divisors can be represented as polynomials at all. And Hilbert’s famous Nullstellensatz characterizes the non-uniqueness of polynomial representations of a multivariate partial function, defined on some algebraic variety over =.

  4. d)

    By virtue of Commutative and Associative and Distributive Laws, any classical multivariate polynomial can be rewritten – see Equation (3) – as a linear combination of monomials X1d1XMdM of lexicographically strictly increasing multidegrees (d1,,dM). And for =, this syntactic normal form is also semantically unique:

  5. e)

    Let P(X),Q(X) denote two ordinary syntactically non-equivalent (Equation 3) positive pure polynomials in variables X=(X1,,XM) over . Then there exists an assignment x=(xm)mM that makes them evaluate differently: P¯(x)Q¯(x).

Item e) follows for instance from the (DeMillo-Lipton-) Schwartz-Zippel Lemma, based on monomial normal form. Theorem 7 generalizes Item e) to the second-order case.

Introducing second-order polynomial degrees had been attempted in [31]: a brief note summarizing a spontaneous short Dagstuhl idea without (explicit) definitions nor proofs, which furthermore wrongly claims that the second-order degree is a (non-arctic) polynomial – rendering the remaining claims moot. Section 2 puts said ideas from [31] on a sound foundation with definitions and proofs and elaborate examples; and Section 3 takes a new perspective on the first and second-order case, in order to then generalize to third and higher-order polynomials and degrees.

Table 1: List of symbols and notational conventions.
N,M,D first-order variables
N¯=n,M¯=m,D¯=d values of said variables
P=P(N),Q=Q(M) pure positive multi/uni-variate 1st-order polynomials
P¯=p,Q¯=q: induced monotonic functions
d=deg(P) (total) degree of non-zero first-order polynomial
P~,Q~ arctic first-order polynomials
Q=limQ~ induced asymptotic first-order polynomial
𝚽,𝚿 second-order variables
𝚽¯=ϕ,𝚿¯=ψ: values of said variables
𝚷=𝚷(𝚽,N),𝚵(𝚿,N) (multi/uni-variate) second-order polynomials
𝚷¯:()×m induced monotonic mixed functionals
𝚵¯=𝒬:()() Curry-ed monotonic operator
P~=Deg(𝚷) arctic first-order polynomial as second-order degree
P=limDeg(𝚷) 1st-order polynomial as asymptotic 2nd-order degree
d=deg(limDeg(𝚷)) nesting depth of second-order polynomial 𝚷
𝚷~,𝚵~ arctic second-order polynomials
𝕱,𝕲 third-order variables
𝕱¯=,𝕲¯=𝒢:()() values of said variables
𝕻=𝕻(𝕱,𝚽,N),𝕼(𝕲,𝚿,M) third-order polynomials
𝕻¯:(()())×()× induced monotonic mixed hyper-functional
𝕻¯:(()())×()() Curry-ed monotonic mixed operator
𝕻¯:(()())(()()) Curry-ed monotonic hyper-operator
𝚷~=DEG(𝕻) arctic second-order polynomial as third-order degree

1.1 Arctic First-Order Polynomials

Definition 9 below defines the degree Deg(𝚷) of a second-order polynomial to be an ordinary polynomial, but one involving max().

Definition 3.

An arctic (first-order) polynomial P~(X) in variables X is a well-formed expression over X and constant symbols 0,1 (unary) and binary +,,max().

Recall Example 1 and Remark 2a). As opposed to Definition 5, the constant 0 is permitted here. We refrain from spelling out the obvious semantics P¯ of an arctic polynomial P~. Note that, when evaluating P~(x) on an arbitrary fixed integer vector x, any occurrence of max() evaluates to at least one of its two arguments. Moreover, in the univariate case X=X and as X¯, the role of the dominant argument in max() may switch only finitely often, as one can see by structural induction:

Lemma 4.
  1. a)

    For any two distinct univariate positive ordinary polynomials P=P(N) and Q=Q(N), their associated polynomial functions p=P¯ and q=Q¯ satisfy

    N:(nN:p(n)>q(n))(nN:p(n)<q(n)). (2)
  2. b)

    Fix univariate arctic polynomial P~=P~(D). Its value coincides, for all sufficiently large arguments d, with P¯(d) for a unique ordinary (positive pure) polynomial P=P(D).

Call P[D] from Lemma 4b) the asymptotic polynomial induced by univariate arctic P~, written P=limP~. There is no risk of confusing the polynomial limP~ with the “value” =limdP~(d). We record that lim(P~+Q~)=(limP~)+(limQ~) and lim(P~Q~)=(limP~)(limQ~). Lemma 4 is limited to the univariate case: multivariate arctic terms like max(XY2,X2Y) may not asymptotically coincide with an ordinary one; see also Example 19.

2 Second-Order Polynomials

We consider “positive pure” (univariate) second-order polynomials, that is, with syntactically well-formed expressions involving – in addition to operations +, and 1 as only constant and classical variables N=(N1,,NM) – some unary function-type variable 𝚽 [13]:

Definition 5.

Second-order polynomials, like 𝚷=𝚷(𝚽,N) and 𝚵=𝚵(𝚽,N), are syntactically generated by the Backus-Naur rules

𝚷,𝚵::=1N1NM𝚷+𝚵𝚷𝚵𝚽(𝚷).

In other words, second-order polynomials are the least class of formal expressions (=terms)

  • that include constant 1 and variables (N1,,NM)=N

  • and are closed under binary addition + and product

  • Moreover, when 𝚷 is a second-order polynomial, then so is 𝚽(𝚷):

Regarding semantics, we continue using overline to denote the interpretation of an expression as a mapping: Each variable N may take values N¯=n ranging over ; and 𝚽¯ ranges over (), the set of nondecreasing total unary functions ϕ:. Extended by structural induction to compound expressions, let 𝚽(𝚷)¯ evaluate to ϕ(𝚷¯(ϕ,n)) and 1¯=1.

Recall Example 1, note that we prohibit the constant 0. Exponentiation (only to a natural number power) abbreviates repeated multiplication: N3=NNN and 𝚽2(𝚵)=𝚽(𝚵)𝚽(𝚵), as opposed to repeated composition 𝚽𝚽=𝚽(2). Commutative, associative, distributive laws extend from numbers to (both first and) second-order polynomials pointwise:

Definition 6.

Let “” denote syntactic equivalence of terms up to Associative, Commutative, and Distributive Laws; formally the equivalence relation generated by the following rules:

𝚷+𝚵𝚵+𝚷,(𝚷+𝚵)+𝚲𝚷+(𝚵+𝚲), (3)
𝚷𝚵𝚵𝚷,(𝚷𝚵)𝚲𝚷(𝚵𝚲),𝚷1𝚷,𝚷(𝚵+𝚲)𝚷𝚵+𝚷𝚲
(𝚷𝚷𝚵𝚵)𝚷+𝚵𝚷+𝚵𝚷𝚵𝚷𝚵𝚽(𝚷)𝚽(𝚷)

Syntactic equivalence is semantically sound for 2nd-order polynomials: 𝚷𝚵𝚷¯𝚵¯. Generalizing Remark 2e), the converse – semantic completeness – is also true, but less obvious:

Theorem 7.

Let 𝚷(𝚽,N),𝚵(𝚽,N) be syntactically non-equivalent second-order polynomials. There exists an assignment n and ϕ() such that 𝚷¯(ϕ,n)𝚵¯(ϕ,n).

See [20, 21] for a proof, omitted here due to space limitations. A similar result has been shown for Simply Typed Lambda Calculus (see also Subsection 3.4 below) modulo integer arithmetic [27, Theorems 5.2+5.6], with two caveats: function variable 𝚽 is supposed bi-variate [27, p.684] and runs over all (not just monotonic) total integer mappings [27, Definition 4.11].

2.1 Second-Order Polynomial Degree

The total degree deg(P) of a classical multivariate polynomial P=P(X)0 is commonly defined first for monomials, and then for linear combinations of the latter: relying on the monomial normal form, recall Remark 2d+e). An alternative equivalent definition proceeds by structural induction, for instance for positive pure polynomials as follows:

deg(1)=0,deg(P+Q)=max{deg(P),deg(Q)}, (4)
deg(Xm)=1,deg(PQ)=deg(P)+deg(Q).

The former approach builds on monomial normal form (Remark 2d) while the latter needs to separately establish well-definition, namely invariance under syntactic equivalence (3):

PQdeg(P)=deg(Q), (5)

which we generalize in Remark 10 below. Either way, the Rule of Composition then follows, in the univariate case expressed concisely as: deg(PQ)=deg(P)deg(Q).

 Remark 8.

Strictly speaking, PQ needs to be defined syntactically: for instance by structural induction on P, essentially replacing each occurrence of variable X in P with Q. And said inductive definition then gets justified semantically by concluding PQ¯=P¯Q¯, where (only) the right-hand side means composition of functions. Definition 11 and Proposition 12 below proceed in this very way, for second-order polynomials.

For univariate polynomials, the integer total order on degrees “deg(P)deg(Q)” captures Landau’s pre-order of asymptotic growth “P(N)=𝒪(Q(N))”; recall Lemma 4a). This suggests extending Equation (4) from ordinary to second-order polynomials:

Definition 9.

The (second-order) degree of a second-order polynomial 𝚷 in 𝚽 and N=(N1,,Nm) is an arctic polynomial Deg(𝚷) in D, given inductively by

Deg(1):= 0,Deg(Nm):= 1,Deg(𝚷+𝚵):=max{Deg(𝚷),Deg(𝚵)},
Deg(PQ):=Deg(P)+Deg(Q),andDeg(𝚽(𝚷)):=DDeg(𝚷). (6)

We write “D=Deg(𝚽)” to emphasize that first-order variable D in Deg(𝚷) corresponds to second-order argument 𝚽 in 𝚷, particularly when later generalizing to several second-order variables; see Remark 13b+e).

Related work [16] had investigated linear second-order polynomials: defined by omitting/prohibiting multiplication from Definition 5 (but still allowing for addition + and nesting 𝚽). These are precisely those having as degree an arctic polynomial without addition + (but still with multiplication and max); recall that Definition 5 allows only the constant 1.

 Remark 10.

Definition 9 is well-defined, namely it respects syntactic equivalence (3): Arithmetical commutativity and associativity of + and translate to “arctic” commutativity and associativity of max() and +, respectively; multiplication by 1 translates to addition of 0; and distributivity 𝚷(𝚵+𝚲)𝚷𝚵+𝚷𝚲 translates to

Deg(𝚷)+max{Deg(𝚵),Deg(𝚲)}=max{Deg(𝚷)+Deg(𝚵),Deg(𝚷)+Deg(𝚲)}. (7)

Reflecting that every ordinary polynomial is a fortiori also a second-order polynomial, Definition 9 extends the classical degree: Deg(P)=deg(P) for any (positive pure) multivariate first-order polynomial P0.

According to Lemma 4b), the degree Deg(𝚷) of a second-order polynomial induces an ordinary univariate polynomial limDeg(𝚷) – which we call 𝚷’s asymptotic degree.

Table 2: Stating “second-order polynomial growth” in various levels of detail.
        Growing as … Example
a given second-order polynomial 𝚷=𝚷(𝚽,N) (complicated) 𝚷 from Example 1
(some unspecified second-order polynomial) having a given arctic first-order polynomial as degree (simpler) P~(D) from Example 1
(some unspecified second-order polynomial) having a given first-order polynomial as asymptotic degree 15D3+2D+4” (Example 1)
(some unspecified second-order polynomial) having a given nesting depth according to Proposition 12d) 3” in Example 1
some unspecified second order polynomial [15, Definition 3.2]

2.2 Second-Order Polynomial Compositions

Second-order polynomials naturally compose in two different ways, here denoted and :

Definition 11.

Let 𝚷=𝚷(𝚽,N) and 𝚵=𝚵(𝚽,N) be univariate second-order polynomials. Define their compositions 𝚷𝚵 and 𝚷𝚵 by structural induction as follows:

1𝚵:= 1, 1𝚵:= 1, N𝚵:=𝚵, N𝚵:=N,
(𝚷1+𝚷2)𝚵:= (𝚷1𝚵)+(𝚷2𝚵), (𝚷1+𝚷2)𝚵:= (𝚷1𝚵)+(𝚷2𝚵)
(𝚷1𝚷2)𝚵:= (𝚷1𝚵)(𝚷2𝚵), (𝚷1𝚷2)𝚵:= (𝚷1𝚵)(𝚷2𝚵)
𝚽(𝚷)𝚵:= 𝚽(𝚷𝚵), 𝚽(𝚷)𝚵:= 𝚵(𝚷𝚵)

𝚷(𝚽,𝚵(𝚽,N)):=(𝚷𝚵)(𝚽,N) essentially replaces in 𝚷 every occurrence of first-order variable N with 𝚵(𝚽,N); and 𝚷(𝚵(𝚽,),N):=(𝚷𝚵)(𝚽,N) replaces in 𝚷 every occurrence of second-order variable 𝚽 with 𝚵(𝚽,).
Note that 𝚽(N)=𝚽; and P=PN for first-order polynomials P: justifying the common notation P=P(N). In the second-order case, there is no danger of confusing the notation 𝚷=𝚷(𝚽,N) with a composition, since the pair (𝚽,N) is not a single second-order polynomial.

Like in the classical case, the notion of degree translates composition “” to multiplication “”. The other kind “” of composition, new to the second-order case, translates as ordinary composition “” of first-order (arctic) polynomials:

Proposition 12.

Fix univariate second-order polynomials 𝚷=𝚷(𝚽,N) and 𝚵=𝚵(𝚽,N).

  1. a)

    (𝚷𝚵) is again a second-order polynomial in (𝚽,N), with semantics (𝚷𝚵)¯(ϕ,n)=𝚷¯(ϕ,𝚵¯(ϕ,n)) for all n and all ϕ(). Furthermore

    Deg(𝚷𝚵)(D)=Deg(𝚷)(D)Deg(𝚵)(D).
  2. b)

    (𝚷𝚵)(𝚽,N) is again a second-order polynomial in (𝚽,N), with semantics 𝚷(𝚵(𝚽,),N)¯(ϕ,n)=𝚷¯(𝚵¯(ϕ,),n) for n and ϕ(). Here 𝚵¯(ϕ,)() denotes the monotonic mapping λn:.𝚵¯(ϕ,n). Furthermore

    Deg(𝚷𝚵)(D)=(Deg(𝚷)Deg(𝚵))(D)=Deg(𝚷)(Deg(𝚵)(D)).
  3. c)

    Moreover, if 𝚵 is an ordinary polynomial, then so is 𝚷𝚵. For 𝚵mm the family of constant ordinary polynomials, 𝚷𝚵M is a bivariate polynomial in (M,N).

  4. d)

    deg(limDeg(𝚷)) is well-defined, and coincides with the (nesting) depth of 𝚽 in 𝚷 according to [13, Definition 5.9].

The proofs proceed by straight-forward structural induction and are omitted.

 Remark 13.
  1. a)

    Proposition 12a) extends and recovers the first-order case, when 𝚷 and 𝚵 are ordinary polynomials. When 𝚵=Q is first-order, then Deg(𝚷𝚵)=Deg(𝚷)deg(Q): an integer multiple of Deg(𝚷); analogously when 𝚷 is first-order.

  2. b)

    In Proposition 12c), when 𝚵=Q is first-order, then Deg(𝚷𝚵)=Deg(𝚷)(degQ): evaluating the arctic first-order polynomial Deg(𝚷)(D) at the argument D¯:=deg(Q). This semantic coincidence justifies our syntactic convention “D=Deg(𝚽)” at the end of Definition 9.

  3. c)

    Regarding Proposition 12d), recall Lemma 4b) that limDeg(𝚷) denotes the unique ordinary polynomial coinciding with arctic Deg(𝚷) on all sufficiently large arguments. In view of Proposition 12d), second-order polynomial asymptotic growth can be stated with various decreasing degrees of detail and increasing conciseness, as illustrated in Table 2.

  4. d)

    Regarding the multivariate case, Definition 9 already covers second-order polynomials involving several first-order variables N=(N1,,NM). Composition “𝚷𝚵” then becomes “𝚷m𝚵”: We refrain from spelling out the inductive replacement of Nm in 𝚷 with 𝚵. Proposition 12a) adapts immediately – but of course not Lemma 4.

  5. e)

    Definition 5 naturally generalizes to several unary second-order variables 𝚽m. The degree (Definition 9) then becomes a multivariate arctic first-order polynomial: Replace Equation (6) with Deg(𝚽m(𝚷)):=DmDeg(𝚷), where Dm=Deg(𝚽m); recall Item b). Composition “𝚷𝚵” becomes “𝚷m𝚵”, and Proposition 12b) adapts accordingly.

  6. f)

    𝚷:=𝚽2(N3) and 𝚵:=𝚽(N6) both have same degree 6D, but neither 𝚷¯𝒪(𝚵¯) nor 𝚵¯𝒪(𝚷¯); see also Example 19.

2.3 Examples and Applications

Polynomial bounds capture “tame” (as opposed to, say, exponential) growth in many areas:

  • In classical Complexity Theory, P(N) denotes the amount of resources used to process inputs of length N¯=n.

  • In Geometric Group Theory, P(N) denotes the number of distinct group elements expressible by words of length N¯=n over a fixed symmetric set of generators [9].

  • In statistical physics / probability theory, P(N) denotes the mixing time of a dynamical system or stochastic process over a 2N element universe [19].

Generally, establishing polynomially bounded growth is followed by further investigating the (least) degree of said polynomial [29, 8, 6]. Recall (before Definition 9) that the integer total order on degrees captures Landau’s preorder of asymptotic growth.

The present work enables similarly refined analyses of higher-type problems: Extending the Cobham-Edmonds Thesis, asymptotic growth of a functional depending on (first-order N¯ and on) a second-order parameter 𝚽¯ is commonly considered “tame” iff it is bounded by (the values of) some second-order polynomial 𝚷=𝚷(𝚽,N). And its degree Deg(𝚷) captures, and allows to concisely compare, second-order asymptotic growth; recall Remark 13c) and see Table 2. When its argument 𝚽¯ itself grows exponentially, then 𝚷(𝚽,N) as a relative polynomial bound [24, §4] may grow like an exponential tower of height deg(limDeg(𝚷)), recall Proposition 12d). We collect here some old and new examples, proofs in Appendix B.

Example 14 (String Functionals).
  1. i)

    Suppose traditional Turing machine computes function f:{0,1}{0,1} in polynomial time P=P(M) and machine 𝒩 computes g:{0,1}{0,1} in polynomial time Q=Q(N). Then executing on input y=g(x) of length mQ(n), obtained by executing 𝒩 on input x, results in a Turing machine computing fg in total running time 𝒪(Q(N)+P(Q(N))): a polynomial of degree max{deg(Q),deg(P)deg(Q)}=deg(P)deg(Q) for non-constant P. This simple observation appears ubiquitously, often implicitly.

  2. ii)

    An oracle Turing machine ? computing F=F(φ,x) is said [13] to run in second-order polynomial time 𝚷(𝚽,N) if the following holds: On input of any string x{0,1} and for any string function oracle φ:{0,1}{0,1}, φ(x) outputs F(φ,x) and makes at most 𝚷(|φ|,|x|) steps, where |φ|(m):=max{|φ(b)|:|b|m}.

  3. iii)

    Similarly to (i), let us analyze the running time of oracle Turing machine composition in (iv)+(v). Indeed, second-order string functionals naturally compose in two distinct ways, similarly to second-order polynomials in Subsection 2.2: For F,G:({0,1}){0,1}×{0,1}{0,1}, let FGλφ.λx.F(φ,G(φ,x)) and FGλφ.λx.F(G(φ,),x), where G(φ,)λy.G(φ,y).

  4. iv)

    Let ? and 𝒩? denote oracle Turing machines computing F and G, respectively, in second-order running time bounds 𝚷=𝚷(𝚿,M) and 𝚵=𝚵(𝚽,N). Then FG can be computed by an oracle Turing machine in second-order polynomial time 𝒪(𝚵+𝚷𝚵) of degree max{Deg(𝚵),Deg(𝚷)Deg(𝚵)}=Deg(𝚷)Deg(𝚵) for non-constant 𝚵.

  5. v)

    Let ?,𝒩? and F,G and 𝚷,𝚵 be as in (iv). Then FG can be computed by an oracle Turing machine in second-order polynomial time 𝒪((𝚷𝚵)(𝚵(𝚷𝚵))) of degree Deg(𝚷)Deg(𝚵)+Deg(𝚵)(Deg(𝚷)Deg(𝚵)).

  6. vi)

    [14] designs and analyzes running times of oracle Turing machines computing certain other mixed functionals H:({0,1}){0,1}×{0,1}{0,1}. Specifically, [14, Proposition 2.8] establishes a time bound (P𝚽)[r](P(N))+P(N), where P[N] denotes some (unspecified, cf.Table 2) ordinary polynomial and r indicates how often to iterate P𝚽. The degree of the this second-order polynomial is Dr(deg(P))r+1=𝒪(D)r.

The second-order running time bound in Example 14vi) is already rather concise to begin with, hence here considering its second-order degree does not yield as much further simplification as in, say, Example 1. Asymptotic growth w.r.t. N of a second-order polynomial depends additionally on that of its second-order argument 𝚽¯, and the second-order degree captures both: cf. Remark 13. In Example 14, the second-order parameter 𝚽¯=|φ|: measures the “size” of function-type argument φ:{0,1}{0,1}. Other applications, like in Examples 14 above and 17 below, assign other meanings to the second-order parameter:

Example 15.
  1. a)

    To any continuous real function f:[0;1] (as argument to an operator in Analysis, say) assign as size its modulus of uniform continuity [17, Definition 2.12]: μ: pointwise minimal such that |xx|2μ(n)|f(x)f(x)|2n.

  2. b)

    To any pre-compact metric space (X,d) assign as size its Kolmogorov entropy [23]: η: pointwise minimal such that there exist 2η(n) balls of radius 2n covering X.

  3. c)

    For p1, to any p-summable sequence z¯ assign as size its modulus of convergence: σ: pointwise minimal such that 2npK2σ(n)|zK|p.

  4. d)

    These and more second-order “size” parameters 𝚽¯ arise generically from Skolemizing classical statements [4]. We consider moduli as mappings from/to integer exponents w.r.t. base two, see [22, §2.4] and cf. [3, p.186].

Example 16 (1D Real Function Inversion).

Recall Example 15a) and record [17, Theorem 2.19] that any polynomial-time computable bijection f:[0;1][0;1] has a polynomial modulus of uniform continuity; and its inverse f1 is again polynomial-time computable – provided that it, too, admits a polynomial modulus of continuity [17, Corollary 4.7].

More generally and more precisely, let 𝒞μ,ν[0;1] denote the set of bijections f:[0;1][0;1] having modulus μ and whose inverse f1 has modulus ν. Note that f1f=id: the identity on , with modulus idμν and similarly νμ(n)n.

  1. i)

    By the proof of [17, Theorem 4.6], there exists an oracle Turing machine computing the family of inversion operators λf:𝒞μ,ν[0;1].f1:𝒞μ,ν[0;1] in time 𝒪(μ(ν(n))+3)2: a second-order polynomial in first-order variable111The kind reader may generously forgive us for relaxing the distinction between syntax and semantics. n and in two independent second-order variables μ and ν. This polynomial has degree 2EF: a bivariate first-order polynomial in E=Deg(μ) and F=Deg(ν) according to Remark 13e).

  2. ii)

    Trisection (Appendix A) yields another oracle Turing machine computing the same family of inversion operators in time 𝒪(nν(n+3)+nμ(3+ν(n+3))): a second-order polynomial of degree max{1+F,1+EF}max{EF+F,2EF} since EF=Deg(μν)1 by the above considerations.

  3. iii)

    Combining μ and ν in the single second-order parameter ϕ:=max{μ,ν}, the runtime bound from (i) becomes 𝒪(ϕ(ϕ(n))+3)2 of univariate degree 2D2 in D=Deg(ϕ); the bound from (ii) becomes 𝒪(nϕ(3+ϕ(n+3))) of univariate degree 1+D2.

In Example 16, the degree captures concisely that Trisection (ii) is asymptotically more efficient – and thus preferable over – the algorithm from (i) whenever EF>F, i.e., when μν grows faster than ν.

Example 17 (Continuous Operator in Functional Analysis).

Fix p,q1 and recall that p={z¯:k|zk|p<} denotes the space of p-summable complex sequences z¯=(zk). Write Rpp for the sphere with radius R>0, that is, the subset of those sequences having p-norm z¯pR. For σ: let furthermore R,σpRp denote the subset of all sequences having modulus of convergence σ.

We record that R,σp is compact and, conversely, any compact subset of p is contained in R,σp for some R and some σ:.

  1. i)

    Consider some continuous (but not necessarily linear) 𝕆:1pq. By continuity, 𝕆 maps compact subsets of p to compact subsets of q. In particular it maps every 1,σp to R,τ for some minimal R=R(σ) and some minimal τ: which also depends on σ. Let =𝕆:()() denote the thus well-defined mapping λσ.τ associated with 𝕆. Note that is non-decreasing: σσ implies ττ. The case p=2=q of continuous (linear) operators on Fourier series is particularly relevant [18, Remark 26].

  2. ii)

    The identity operator pp has λσ.σ the identity. The “repetition” operator λz¯=(zK)K:1.(zK/2)K:1 is linear and 2-Lipschitz and has λσ:().(λn:.σ(n+1)+1):.

  3. iii)

    For any bijection (aka infinite permutation) π:, the linear operator λz¯=(zK)K:p.(zπ1(K))K:p is isometric. Its associated =π is bounded by a second-order polynomial iff mM<2m:π(M)<2q(m) for some ordinary polynomial q.

We close this subsection with some further, sporadic examples:

  1. i)

    [22, Example 2.23i] involves an expression m=0n+1η(m+1), where η denotes the Kolmogorov entropy from Example 15b). This expression in (η,n) itself is not a second-order polynomial, but it is bounded by the second-order polynomial (n+1+1)η(n+1+1) of degree 1+D with convention D=deg(η).

  2. ii)

    [22, Corollary 3.6a] uses the expression 𝒫ϕ𝒫, where 𝒫 denotes the class of univariate ordinary polynomials. Its degree is 𝒪(D); here the constant hidden in 𝒪 captures (the degrees of) the particular ordinary polynomials.

  3. iii)

    [3, §3] establishes rates of convergence, which turn out to be (bounded by) multivariate second-order polynomials 𝚷 in (certain first-order parameters and in) two second-order parameters η and ω; see [3, p.186 ll.8ff]. See also [1]

2.4 Arctic Second-Order Polynomials

Definition 23d) below considers the degree of a third-order polynomial to be an arctic second-order polynomial.

Definition 18.
  1. a)

    Arctic second-order polynomials in first-order variables N=(N1,..NM) and one second-order variable 𝚽 are generated by

    𝚷~,𝚵~::=01N1NM𝚷~+𝚵~𝚷~𝚵~𝚽(𝚷~)max(𝚷~,𝚵~).

    with obvious semantics similar to (non-arctic) second-order polynomials.

  2. b)

    Regarding syntactic equivalence, extend Rules (3) to max() capturing monotonicity:

    max{𝚷~,𝚵~}max{𝚵~,𝚷~},max{max{𝚷~,𝚵~},𝚲~}max{𝚷~,max{𝚵~,𝚲~}}, (8)
    𝚷~+max{𝚵~,𝚲~}max{𝚷~+𝚵~,𝚷~+𝚲~},𝚷~max{𝚵~,𝚲~}max{𝚷~𝚵~,𝚷~𝚲~},
    max{𝚷~,0}𝚷~,(𝚷~𝚷~𝚵~𝚵~)max{𝚷~,𝚵~}max{𝚷~,𝚵~}

Lemma 4 about the asymptotic behaviour of arctic first-order polynomials does not extend to the second-order case:

Example 19.

Consider 𝚷(𝚽,N):=𝚽2(𝚽(N))+𝚽(𝚽(N2)) and 𝚵(𝚽,N):=2𝚽(𝚽2(N)). They both have the same degree Deg(𝚷)(D)=2D2=Deg(𝚵)(D). For all integers a,c,d2 and for all sufficiently large n, they evaluate

𝚷¯(λm.amd,n)>𝚵¯(λm.amd,n) but 𝚷¯(λm.md+c,n)<𝚵¯(λm.md+c,n).

In particular the arctic univariate second-order polynomial max{𝚷(𝚽,N),𝚵(𝚽,N)} cannot reasonably be said to “asymptotically” coincide with any ordinary second-order polynomial.  

See Appendix B. Due to the semantic completeness Theorem 7, 𝚷(𝚽,N) and 𝚵(𝚽,N) are the only candidates for max{𝚷(𝚽,N),𝚵(𝚽,N)} to “asymptotically” coincide with.

3 Higher-Order Polynomials and Degrees

We now climb further up in the type hierarchy: by one step to the third-order case in Subsection 3.2, and then to the general case in Subsection 3.3. But first revisit and take a new perspective on the first and second-order case:

3.1 First and Second-Order Case Revisited

Section 2 had regarded compositions and as operators on previously defined second-order polynomials, and the algebraic properties of these operators were consequences. This is the traditional perspective [13, 15]. In order to proceed to third and higher order polynomials, we now take a new but equivalent perspective on the same families of traditional first and second-order polynomials, considering compositions as part of their syntactic definition:

 Remark 20 (First-Order Polynomials, Revisited).

Note that the semantics of ordinary polynomials is based on “values”, namely starting with 1 and N¯ and proceeding inductively via + and . Alternatively, ordinary polynomials can be considered as certain mappings

P¯=pλN¯:.P¯(N¯):.

Here, + and are tacitly “overloaded” to denote pointwise addition and multiplication of functions instead of values.

  1. a)

    A univariate first-order polynomial in N is syntactically generated by the rules

    P,Q::=1NP+QPQPQ.
  2. b)

    The semantics of P is the canonical interpretation as map P¯=p:.

  3. c)

    Syntactic equivalence is generated by the Rules (3), together with these for :

    1P 1,NPPPN,(PQ)RP(QR),
    (P+Q)R(PR)+(QR),(PQ)R(PR)(RR)
  4. d)

    The degree of P is defined inductively by

    deg(1)=0,deg(N)=1,deg(P+Q)=max{deg(P),deg(Q)},
    deg(PQ)=deg(P)+deg(Q),deg(PQ)=deg(P)deg(Q).

    Well-definition follows from (c), together with Commutative/Associative/ Distributive Laws of max() captured in (h).

  5. e)

    For any first-order polynomial according to (a), there exists a syntactically equivalent first-order polynomial devoid of composition symbol .

  6. f)

    Every classical univariate polynomial (function) can be expressed in the form (a) with semantics (b). Conversely every polynomial according to (a) without composition symbol (e) amounts to a classical polynomial with same semantics.

  7. g)

    An arctic first-order polynomial in M is syntactically generated by the rules

    P~,Q~::=01MP~+Q~P~Q~P~Q~max(P~,Q~).
  8. h)

    Arctic syntactic rules extend (c) with: max{0,P~}P~, 0+P~P~, 0P~0, 0P~0,

max{P~,Q~}max{Q~,P~},max{P~,max{Q~,R~}}max{max{P~,Q~},R~}},
P~+max{Q~,R~}max{P~+Q~,P~+R~},P~max{Q~,R~}max{P~Q~,P~R~}
P~max{Q~,R~}max{P~Q~,P~R~},
(P~P~Q~Q~)max{P~,Q~}max{P~,Q~}

Item e) follows from c) by structural induction, which also implies PQPQ.

 Remark 21 (Second-Order Polynomials, Revisited).

Curry-ing (Schönfinkel-ing) suggests considering a second-order polynomial 𝚷 as family of first-order polynomials, parameterized by an additional variable 𝚽 ranging over ϕ():  𝚷¯(ϕ,)λN¯:.𝚷¯(ϕ,N¯):.
Second-order polynomials can alternatively be interpreted as operators ()():

𝚷¯λϕ:().(λn:.𝚷¯(ϕ,n)):().

Let us re-introduce to denote the composition of operators, for composition of functions.

  1. a)

    A univariate second-order polynomial in (𝚽,N) is syntactically generated by

    𝚷,𝚵::=1N𝚽𝚷+𝚵𝚷𝚵𝚷𝚵𝚷𝚵.
  2. b)

    The semantics is given as follows, subject to implicit Curry-ing:

    1¯λϕ:().λn:.  1:,N¯λϕ.λn.n:,
    𝚽¯λϕ.ϕ(),𝚷+𝚵¯and𝚷𝚵¯ pointwise
    𝚷𝚵¯λϕ.λn.𝚷¯(ϕ,𝚵¯(ϕ,n)):,𝚷𝚵¯λϕ:().𝚷¯(𝚵¯(ϕ)):()
  3. c)

    Regarding syntactic equivalence we record, in addition to Remark 20c):

    1𝚷1,N𝚷N,𝚽𝚷𝚷𝚷𝚽,(𝚷+𝚵)𝚲(𝚷𝚲)+(𝚵𝚲)
    (𝚷𝚵)𝚲(𝚷𝚲)(𝚵𝚲),(𝚷𝚵)𝚲(𝚷𝚲)(𝚵𝚲)
    (𝚷𝚷𝚵𝚵)𝚷𝚵𝚷𝚵. (9)
  4. d)

    The degree of 𝚷=𝚷(𝚽,N) is an arctic first-order polynomial in variable D=Deg(𝚽), defined inductively as in Remark 20d) and, additionally, Deg(𝚷𝚵)=Deg(𝚷)Deg(𝚵).

  5. e)

    To any 2nd-order polynomial 𝚷 according to (a) there is a syntactically equivalent one
    (i) devoid of composition symbol and (ii) whenever occurs, its left argument is 𝚽.

  6. f)

    Any second-order polynomial according to Definition 5 can be expressed in the form (a) with semantics (b). Conversely any polynomial according to (a) satisfying (i)+(ii) from (e) amounts to a 2nd-order polynomial according to Definition 5 with same semantics.

  7. g)

    An arctic univariate second-order polynomial in (𝚿,M) is syntactically generated by

    𝚷~,𝚵~::=01M𝚿𝚷~+𝚵~𝚷~𝚵~𝚷~𝚵~𝚷~𝚵~max(𝚷~,𝚵~).
  8. h)

    Arctic syntactic rules extend (c), Remark 20h), and (8) in Definition 18b) with:
    𝚷~max{𝚵~,𝚲~}max{𝚷~𝚵~,𝚷~𝚲~}.

Items e+f) record that this new perspective coincides with Definition 5. Note that now both 𝚽 and N are of type () but, other than for composition “”, the type of its two arguments tacitly gets Curry-ed for composition “”; and Proposition 12 is now axiomatized in Item d). Again, Item e) follows from structural induction using Item c), and implies congruence w.r.t. ; but congruence w.r.t. now needs to be postulated as Rule (9). Regarding the first part of Item f), rewrite 𝚽(𝚷) as 𝚽𝚷. Second-order polynomials according to Remark 21 use brackets only to express priority, not anymore to express “application”.

3.2 Third-Order Polynomials and Degrees

Second-order polynomials describe “tame” dependencies on both integer arguments n and integer function arguments ϕ:. Third-order polynomials should additionally take into account dependency on integer operator arguments :()(). Recall Example 17 where continuous operators between Banach spaces give rise to all possible such . In addition to variable N ranging over and 𝚽 ranging over (), now introduce indeterminate 𝕱 to range over the set (()()) of total monotonic integer operators.

 Remark 22.

Curry-ing respects monotonicity: f:× is non-decreasing iff f:() is non-decreasing and well-defined regarding its co-domain. Write f:.

A third-order polynomial can thus be considered as a certain family of monotonic first-order polynomials, parameterized monotonically by two variables 𝚽 and 𝕱 that range over second-order and third-order arguments ϕ() and (()()), respectively; or alternatively as a family of monotonic second-order polynomials, parameterized monotonically by ; or as monotonic “hyper”-operator of type (()())(()()). We introduce # to denote the composition of such hyper-operators.

After first and second-order Remarks 20 and 21, the following Definition 23 and Theorem 25 about third-order polynomials and their degrees follow naturally:

Definition 23.
  1. a)

    A third-order polynomial in (𝕱,𝚽,N) is syntactically generated by

    𝕻,𝕼::=1N𝚽𝕱𝕻+𝕼𝕻𝕼𝕻𝕼𝕻𝕼𝕻#𝕼.
  2. b)

    Its semantics is 𝕻#𝕼¯λ:(()()).𝕻¯(𝕼¯()):(()()),

    1¯ λ:(()()).λϕ:().λn:.  1:
    N¯ λ:(()()).λϕ:().λn.n:
    𝚽¯ λ:(()()).λϕ:().ϕ:()
    𝕱¯ λ:(()()).:(()())

    all of (or Curry-ed to) type (()())(()()). Moreover

    𝕻+𝕼¯(,ϕ,n) = 𝕻¯(,ϕ,n)+𝕼¯(,ϕ,n)
    𝕻𝕼¯(,ϕ,n) = 𝕻¯(,ϕ,n)𝕼¯(,ϕ,n)
    𝕻𝕼¯(,ϕ,n) = 𝕻¯(,ϕ,𝕼¯(,ϕ,n)):
    𝕻𝕼¯(,ϕ) = 𝕻¯(,𝕼¯(,ϕ)):()

  3. c)

    In addition to Remark 20c) and Remark 21c), we have syntactic equivalence rules

    1#𝕻 1,N#𝕻N,𝚽#𝕻𝚽,𝕱#𝕻𝕻𝕻#𝕱
    (𝕻𝕼)#𝕽(𝕻#𝕽)(𝕼#𝕽),(𝕻𝕼)#𝕽(𝕻#𝕽)(𝕼#𝕽),
    (𝕻+𝕼)#𝕽(𝕻#𝕽)+(𝕼#𝕽),(𝕻𝕼)#𝕽(𝕻#𝕽)(𝕼#𝕽)
    (𝕻𝕻𝕼𝕼)𝕻𝕼𝕻𝕼.
  4. d)

    The degree of third-order polynomial 𝕻 is an arctic second-order polynomial in first-order variable D=Deg(𝚽) and second-order variable 𝚿=DEG(). It is defined inductively as in Remark 20d) and Remark 21d) and, additionally, DEG(𝕻#𝕼):=DEG(𝕻)DEG(𝕼).

  5. e)

    An arctic third-order polynomial in (𝕲,𝚿,M) is syntactically generated by

    𝕻~,𝕼~::=01M𝚿𝕲𝕻~+𝕼~𝕻~𝕼~𝕻~𝕼~𝕻~𝕼~𝕻~#𝕼~max(𝕻~,𝕼~).
  6. f)

    Syntactic rules extend (c) and Remark 21h) with 𝚷~#max{𝚵~,𝚲~}max{𝚷~#𝚵~,𝚷~#𝚲~}.

Example 24.
  1. a)

    Consider the following third-order polynomial

    𝕻(𝕱,𝚽,N):=(𝕱𝕱4(𝚽2𝚽(2N6+7)))+(𝕱3(𝚽𝚽3𝚽5N4)),

    where “𝕼3” abbreviates (𝕼𝕼𝕼). 𝕻 has degree

    DEG(𝕻)(𝚿,D)=max{𝚿(4𝚿(12D2)), 3𝚿(60D3)}

    and semantics  𝕻¯λ.λϕ.(ϕ4(λn.ϕ2(ϕ(2n6+7))))+3(λn.ϕ(ϕ3(ϕ5(n4))))

  2. b)

    By Remark 30g) in Subsection 3.4 below, the following mapping of type (()())(()()) is not (the semantics of) a third-order polynomial:

    λ:(()()).λϕ:().λn:.(λm: .4m3+5)(n2+n+1):
  3. c)

    A first-order polynomial is a second-order polynomial 𝚷(𝚽,N) which does not “depend” on 𝚽, i.e., whose semantics of type ()() is a constant of type (); recall Theorem 7. A second-order polynomial is a third-order polynomial whose semantics of type (()())(()()) is a constant of type (()()).

Theorem 25.
  1. a)

    Every third-order polynomial as in Definition 23a) can be syntactically transformed, using Definition 23c), into an equivalent form in which (i) # does not occur; (ii) whenever occurs, its left argument is 𝕱; (iii) whenever occurs, its left argument is either 𝕱 or 𝚽 or of the form (𝕻𝕼).

  2. b)

    The degree of third-order polynomials is well-defined, namely invariant under the syntactic congruence relations from Definition 23c)+e).

Example 26.

Consider the third-order polynomial 𝕻+𝕼 in (𝕱,𝚿,D)

𝕻+𝕼=𝕱𝕱(𝚿𝚿)+𝕱(𝕱𝕱)(𝕱𝕱)(𝕱𝕱)

with implicit default operator precedence + after after after . Noting that 𝕱(𝚿)=𝕱, the semantics 𝕻+𝕼¯ of 𝕻+𝕼 means mapping argument pairs ψ:() and :(()()) to the value ((ψψ))+((ψ)(ψ))((ψ))((ψ)).DEG(𝕻+𝕼) here coincides with the arctic second-order polynomial from Example 19.

3.3 Polynomials and Degrees of Arbitrary Order

Motivated by [11] and [10, §3.3.1], we are now ready to treat the general case:

Definition 27.

Let δ denote the order of the polynomials under consideration.

  1. a)

    With “δ” we abbreviate the type (δ1)(δ1) in case δ1; “0” means , and “1” is {1}. Let “0” mean multiplication “” and 1=+” addition and, for δ1, “𝛿” denotes the typed composition gf of f,g:(δ).
    In the sequel, variable V(δ) ranges over values V¯(δ)=V(δ):δ1;   V(0)=1.

  2. b)

    Univariate order-δ polynomials in variables (V(δ),,V(1)) are syntactically generated by

    𝚷,𝚵::=1V(1)V(δ)𝚷+𝚵𝚷𝚵𝚷1𝚵𝚷𝛿𝚵.
  3. c)

    The semantics is 𝚷¯:δ=(δ1)(δ1), where

    V¯(δ) (λV(δ).V(δ)) V¯(2) (λV(δ)λV(2).V(2))
    V¯(1) (λV(δ)λV(1).V(1)) 1¯ (λV(δ)λV(1). 1)

    are all understood via Curry-ing as of type (δ). Moreover, as structural induction:

    𝚷+𝚵¯(V(δ),,V(1)) = 𝚷¯(V(δ),,V(1))+𝚵¯(V(δ),,V(1)):
    𝚷𝚵¯(V(δ),,V(1)) = 𝚷¯(V(δ),,V(1))𝚵¯(V(δ),,V(1)):
    𝚷1𝚵¯(V(δ),,V(1)) = 𝚷¯(V(δ),V(2),𝚵¯(V(δ),V(1))):=0
    𝚷2𝚵¯(V(δ),,V(2)) = 𝚷¯(V(δ),,V(3),𝚵¯(V(δ),,V(2))):(1)
    𝚷δ1𝚵¯(V(δ),V(δ1)) = 𝚷¯(V(δ),𝚵¯(V(δ),V(δ1))):(δ2)
    𝚷𝛿𝚵¯(V(δ)) = 𝚷¯(𝚵¯(V(δ))):(δ1)
  4. d)

    Syntactic rules are: 𝚷+𝚵𝚵+𝚷,  𝚷𝚵𝚵𝚷,

    1𝚷𝚷,11𝚷 1,1𝛿𝚷 1
    V(1)1𝚷𝚷,V(1)2𝚷V(1),V(1)𝛿𝚷V(1)
    V(δ1)δ1𝚷𝚷,V(δ1)𝛿𝚷V(δ1),V(δ)𝛿𝚷𝚷
    (𝚷+𝚵)+𝚲𝚷+(𝚵+𝚲),(𝚷+𝚵)𝜀𝚲(𝚷𝜀𝚲)+(𝚵𝜀𝚲)(ε=0δ)
    (𝚷𝚵)𝚲𝚷(𝚵𝚲),(𝚷𝚵)𝜀𝚲(𝚷𝜀𝚲)(𝚵𝜀𝚲)(ε=1δ)
    (𝚷1𝚵)1𝚲𝚷1(𝚵1𝚲),(𝚷1𝚵)𝜀𝚲(𝚷𝜀𝚲)1(𝚵𝜀𝚲)(ε=2δ)
    (𝚷δ1𝚵)δ1𝚲𝚷δ1(𝚲δ1𝚵),(𝚷δ1𝚵)𝛿𝚲(𝚷𝛿𝚲)δ1(𝚵𝛿𝚲)
    (𝚷𝚷𝚵𝚵)𝚷𝜀𝚵𝚷𝜀𝚵(ε=1,0δ1).
  5. e)

    A univariate arctic order-δ polynomial in (W(δ),,W(1)) is syntactically generated by

    𝚷~,𝚵~::=01W(1)W(δ)𝚷~+𝚵~𝚷~𝚵~𝚷~1𝚵~𝚷~𝛿𝚵~max(𝚷~,𝚵~).
  6. f)

    Syntactic equivalence among arctic order-δ polynomials extends (d) with these rules:

    max{0,𝚷~}𝚷~,0+𝚷~𝚷~,0𝜀𝚷~ 0(ε=0δ)
    max{𝚷~,𝚵~}max{𝚵~,𝚷~},max{𝚷~,max{𝚵~,𝚲~}}max{max{𝚷~,𝚵~},𝚲~}},
    𝚷~𝜀max{𝚵~,𝚲~}max{𝚷~𝜀𝚵~,𝚷~𝜀𝚲~}(ε=1,0δ)
    (𝚷~𝚷~𝚵~𝚵~)max{𝚷~,𝚵~}max{𝚷~,𝚵~}.
  7. g)

    The degree Deg(𝚷) of (non-arctic) order-δ polynomial 𝚷=𝚷(V(δ),,V(1)) is the arctic order-(δ1) polynomial in (W(δ1),,W(1)) defined inductively by

    Deg(1)= 0,Deg(V(1))= 1,Deg(V(2))=W(1),Deg(V(δ))=W(δ1)
    Deg(𝚷+𝚵)=max{Deg(𝚷),Deg(𝚵)},Deg(𝚷𝚵)=Deg(𝚷)+Deg(𝚵),
    Deg(𝚷1𝚵)=Deg(𝚷)Deg(𝚵),Deg(𝚷𝛿𝚵)=Deg(𝚷)δ1Deg(𝚵).
Theorem 28.
  1. a)

    Every δ-order polynomial as in Definition 27b) can be syntactically transformed, using Definition 27d), into an equivalent form in which (i) 𝛿 does not occur; (ii) whenever δ1 occurs, its left argument is V(δ); (iii) whenever δ2 occurs, its left argument is V(δ) or V(δ1) or of the form (𝚷δ1𝚵); (iv) whenever δ3 occurs, its left argument is V(δ) or V(δ1) or V(δ2) or of the form (𝚷δ1𝚵) or of the form (𝚷δ2𝚵).

  2. b)

    The degree of δ-order polynomials is well-defined, namely invariant under syntactic equivalences according to Definition 27d+f).

Proofs proceed as in the third-order case. We hope that Remark 2e) and Theorem 7 generalize:

Conjecture 29.

Let 𝚷𝚵 denote two syntactically non-equivalent order-δ polynomials. Then there exists an assignment V¯(1)=V(1):=(0), V¯(2)=V(2):(1), …V¯(δ)=V(δ):(δ1) such that 𝚷¯(V(δ),,V(1))𝚵¯(V(δ),,V(1)).

3.4 Simply Typed Lambda Calculus Perspective

We have already employed Lambda notation, for instance when expressing the semantics of higher-order polynomials in Remark 21b) and in Definitions 23b) and 27c). A reader familiar with Type Theory might appreciate the following alternative characterization of order-δ polynomials, here for simplicity only in the non-arctic case.

 Remark 30.
  1. a)

    Let V(1),,V(δ) denote variables, and V(0) a constant symbol. For each ε=1,0,1,,δ let 𝜀 denote an associative binary function symbol.

  2. b)

    Write 𝒫(δ) for the set of syntactically valid expressions 𝚷(δ) over said variables and symbols. Order-δ polynomials are Lambda Terms of the form

    λV(1).λV(δ).𝚷(δ). (10)
  3. c)

    Towards the semantics of such a Lambda Term, impose initial types as follows:

    V(0)=1:{1}=(1),V(1):=(0),V(2):(),
    V(3):(()()),V(δ):δ1.
  4. d)

    Let 1=+: and 0=: and

    𝜀=:(ε)(ε)(ε),ε=1,,δ

    where gf denotes the polymorphic composition of f,g:(ε)(ε).

  5. e)

    Next consider 1,0,,δ1 extended pointwise to type (δ)(δ)(δ). And, for ε<δ, consider 𝚷(ε) of type ε as constant mapping of type

    δ=(δ1)(δ2)(ε)(ε).
  6. f)

    Structural induction on the expression built-up according to (b) thus well-defines the semantics of Equation (10) of type δ. And said family of mappings coincides with the family of order-δ polynomials according to Definition 27c).

  7. g)

    This fragment of Simply Typed Lambda Calculus allows only terms in “head” normal form (10) without inner bound variables, cmp. Example 24b). Item e) employs two kinds of type coercion: i) Extending each binary operation +,,, pointwise from its initial XXY to a higher type (ZX)(ZX)(ZY). And ii) considering an element y of some type Y as constant function of type ZY. Thus any (sub-)expression 𝚵 semantically induces an operator of same pure input and output type.

References

  • [1] Aras Bacho and Martin Ziegler. Second-order parameterizations for the complexity theory of integrable functions. arXiv CoRR, 2506.11210, 2025. doi:10.48550/arXiv.2506.11210.
  • [2] Patrick Baillot, Ugo Dal Lago, Cynthia Kop, and Deivid Vale. On basic feasible functionals and the interpretation method. In Naoki Kobayashi and James Worrell, editors, Proc.II of 27th Int. Conf. Foundations of Software Science and Computation Structures (FoSSaCS2024), held as part of the European Joint Conferences on Theory and Practice of Software (ETAPS2024) in Luxembourg, volume 14575 of Lecture Notes in Computer Science, pages 70–91. Springer, 2024. doi:10.1007/978-3-031-57231-9_4.
  • [3] Eyvind Martol Briseid. Fixed point of generalized contractive mappings. Journal of Nonlinear and Convex Analysis, 9:2:181–204, 2008.
  • [4] Eyvind Martol Briseid. Logical aspects of rates of convergence in metric spaces. The Journal of Symbolic Logic, 74(4):1401–1428, 2009. doi:10.2178/jsl/1254748697.
  • [5] Michael Codish, Yoav Fekete, Carsten Fuhs, Jürgen Giesl, and Johannes Waldmann. Exotic Semiring Constraints. In SMT 2012. 10th International Workshop on Satisfiability Modulo Theories, volume 20 of EasyChair Proceedings in Computing, pages 88–97. EasyChair, 2013. doi:10.29007/QQVT.
  • [6] Martin Dietzfelbinger. Primality Testing in Polynomial Time, volume 3000 of Lecture Notes in Computer Science. Springer, 2004. doi:10.1007/B12334.
  • [7] Hugo Férée and Mathieu Hoyrup. Higher-order complexity in analysis. HAL Archive, July 2013. Proc 10th Int.Conf. Computability and Complexity in Analysis (CCA). URL: https://hal.inria.fr/hal-00915973.
  • [8] Anka Gajentaan and Mark H Overmars. On a class of O(n2) problems in computational geometry. Computational Geometry, 5(3):165–185, 1995. doi:10.1016/0925-7721(95)00022-2.
  • [9] Mikhail Gromov. Groups of polynomial growth and expanding maps. Publications Mathématiques de L’Institut des Hautes Scientifiques, 53:53–78, 1981. doi:10.1007/BF02698687.
  • [10] Emmanuel Hainry, Bruce M. Kapron, Jean-Yves Marion, and Romain Péchoux. Declassification policy for program complexity analysis. In Pawel Sobocinski, Ugo Dal Lago, and Javier Esparza, editors, Proc. 39th Annual ACM/IEEE Symposium on Logic in Computer Science, LICS 2024, Tallinn, Estonia, pages 41:1–41:14. ACM, 2024. doi:10.1145/3661814.3662100.
  • [11] Emmanuel Hainry and Romain Péchoux. Higher order interpretation for higher order complexity. In Thomas Eiter and David Sands, editors, LPAR-21, 21st International Conference on Logic for Programming, Artificial Intelligence and Reasoning, Maun, Botswana, May 7-12, 2017, volume 46 of EPiC Series in Computing, pages 269–285. EasyChair, 2017. doi:10.29007/1TKW.
  • [12] Peter Hertling. Topological complexity with continuous operations. Journal of Complexity, 12(4):315–338, 1996. doi:10.1006/jcom.1996.0021.
  • [13] Bruce M. Kapron and Stephen A. Cook. A new characterization of type-2 feasibility. SIAM J. Comput., 25(1):117–132, 1996. doi:10.1137/S0097539794263452.
  • [14] Bruce M. Kapron and Florian Steinberg. Type-two polynomial-time and restricted lookahead. In Proceedings of the 33rd Annual ACM/IEEE Symposium on Logic in Computer Science, LICS ’18, pages 579–588, New York, NY, USA, 2018. Association for Computing Machinery. doi:10.1145/3209108.3209124.
  • [15] Akitoshi Kawamura and Stephen A. Cook. Complexity theory for operators in analysis. ACM Trans. Comput. Theory, 4(2):5:1–5:24, 2012. doi:10.1145/2189778.2189780.
  • [16] Akitoshi Kawamura, Florian Steinberg, and Holger Thies. Second-order linear-time computability with applications to computable analysis. In Proc. 15th Conf. on Theory and Applications of Models of Computation (TAMC), pages 337–358, Berlin, Heidelberg, 2019. Springer-Verlag. doi:10.1007/978-3-030-14812-6_21.
  • [17] Ker-I Ko. Complexity Theory of Real Functions, volume 3 of Progress in theoretical computer science. Birkhäuser / Springer, 1991. doi:10.1007/978-1-4684-6802-1.
  • [18] Ivan Koswara, Gleb Pogudin, Svetlana Selivanova, and Martin Ziegler. Bit-complexity of classical solutions of linear evolutionary systems of partial differential equations. Journal of Complexity, 76:101727, 2023. doi:10.1016/j.jco.2022.101727.
  • [19] David A. Levin and Yuval Peres. Markov chains and mixing times. American Mathematical Society, Providence, Rhode Island, 2009.
  • [20] Donghyun Lim. Degrees of second and higher-order polynomials. 4th Workshop on Mathematical Logic and its Applications, March 2021. URL: http://jaist.ac.jp/event/mla2021.
  • [21] Donghyun Lim and Martin Ziegler. Degrees of second and higher-order polynomials. arXiv CoRR, 2305.03439, 2023. doi:10.48550/arXiv.2305.03439.
  • [22] Donghyun Lim and Martin Ziegler. Quantitative coding and complexity theory of Continuous data: Part I. J. ACM, 72(1):4:1–4:39, 2025. doi:10.1145/3705609.
  • [23] George G. Lorentz. Metric entropy and approximation, volume 72. AMS, 1996.
  • [24] Kurt Mehlhorn. Polynomial and abstract subrecursive classes. Journal of Computer and System Sciences, 12(2):147–178, 1976. doi:10.1016/S0022-0000(76)80035-9.
  • [25] Eike Neumann and Florian Steinberg. Parametrised second-order complexity theory with applications to the study of interval computation. Theor. Comput. Sci., 806:281–304, 2020. doi:10.1016/j.tcs.2019.05.009.
  • [26] Jürgen Richter-Gebert, Bernd Sturmfels, and Thorsten Theobald. First steps in tropical geometry. Idempotent Mathematics and Mathematical Physics, 377:289–317, 2005.
  • [27] Jon G. Riecke and Ramesh Subrahmanyam. Conditions for the completeness of functional and algebraic equational reasoning. Mathemat.Structures Computer Science, 9(6):651–685, 1999. doi:10.1017/S0960129599002807.
  • [28] Ernst Specker, Norbert Hungerbühler, and Micha Wasem. Polyfunctions over commutative rings. J. Algebra and Applications, 23(01):2450014, 2024. doi:10.1142/S0219498824500142.
  • [29] Volker Strassen. Gaussian elimination is not optimal. Numer.Mathematik, 13:354–356, 1969.
  • [30] Mike Townsend. Complexity for type-2 relations. Notre Dame Formal Logic, 31(2):241–262, 1990. doi:10.1305/NDJFL/1093635419.
  • [31] Martin Ziegler. Hyper-degrees of 2nd-order polynomial-time reductions. Technical report, Dagstuhl Seminar #15392, 2016. abstract §3.20. doi:10.4230/DagRep.5.9.77.

Appendix A Proof of Example 16b

Recall [12, bottom of p.336] the Trisection Algorithm 1 below, approximating f1(y) up to error 2n. Traditional bisection in [a;b] for x with f(x)=y fails in case f(a+b2)=y, since test for equality is impossible reliably. Inequalities f(a+b2)<y and f(a+b2)>y on the other hand can be verified reliably, subject to the promise f(a+b2)y. Trisection instead performs both tests f(a)<y and f(b)>y simultaneously, for a:=23a+13b and b:=13a+23b: Whichever test succeeds reliably, is taken to proceed either to [a;b] or to [a;b], respectively.

Algorithm 1 Trisection.

In Line 6 of the Pseudo-code 1, xorif indicates that both comparisons “v>y” and “u<y” are conducted in parallel such that, non-deterministically, precisely one of the two assignments gets executed. Since f is guaranteed strictly increasing, at least one of the two conditions holds; possibly both. To find out which one, take approximations u~ to u=f(a) and v~ to v=f(b) up to sufficient precision. For that in turn take approximations to a and b up to sufficient precision. This incurs total bit-cost 𝒪(ν(m)+μ(ν(m)+2)), as argued in the sequel:

Indeed, ν being a modulus of continuity of f1 implies vu>2ν(m) since f1(v)f1(u)=ba=(23)k+1>2m for m:=(k+1)log2(32). Hence dyadic approximations u~ to u=f(a) and v~ to v=f(b) and y~ to y, all up to error 2ν(m)3, will confirm at least one of the two inequalities

v~>y~+2ν(m)2,u~<y~2ν(m)2

satisfied as witnesses to v>y or u<y, respectively; to which in turn approximations to a,b suffice up to error 2μ(ν(m)+2). Hence Lines 6 and 4 and 5 incur bit-cost

𝒪(ν(m)+μ(ν(m)+2))𝒪(ν(n+2)+μ(ν(n+2)+3)).

And these lines are repeated 𝒪(n) times according to Line 3. ∎

Appendix B Selected Further Deferred Proofs

Proof of Example 19.

Calculate

𝚷¯(mamd,n) = (a2d+2+ad+1)n2d2
𝚵¯(mamd,n) = 2a2d+1n2d2
𝚷¯(mmd+c,n) = ((nd+c)d+c)2+(n2d+c)d
(nd2+cdnd(d1)+)2+N2d2+cdn2d(d1)+
2n2d2+ 2cdnd2+2d(d1)+
𝚵¯(mmd+c,n) = 2(nd+c)2d+ 2c
2n2d2+ 2(2d)cnd(2d1)+

where “” means first (few) terms in the Taylor expansion w.r.t. n.

Proof of Example 14iv+v.

  1. iv)

    By definition of 𝚷, running φ(x) makes at most 𝚷¯(|φ|,|x|) steps. In particular its output y has length at most 𝚷¯(|φ|,|x|). By definition of 𝚵, 𝒩φ(y) in turn makes at most 𝚵¯(|φ|,|y|) steps.

  2. v)

    ψ(x) makes at most 𝚷(|ψ|,|x|) steps and in particular makes at most that many queries “G(φ,y)=?” to oracle ψ=𝒩φ, each of bounded length m=|y|𝚷(|ψ|,|x|). Similarly, ψ=𝒩φ answering any such query y takes time at most 𝚵(|φ|,m) and in particular returns an answer z=ψ(y) of length |z|𝚵(|φ|,m): hence |ψ|(m)𝚵(|φ|,m).

Proof of Example 17iii.

For one direction, suppose that π satisfies

mM<2m:π(M)< 2q(m). (11)

Then π1[2q(m);)[2m;) and therefore

L2q(m)|zπ1(L)|pK2m|zK|p 2pn

for m:=σ(n) by hypothesis. Hence τ:=qσ is a (not necessarily minimal, i.e. an upper bound on the) modulus of convergence of the image sequence.

Conversely suppose τ=𝚷(σ,) is some (upper bound on the minimal) modulus of convergence of the image sequence whenever σ is for the original sequence: Since 𝚷 is monotone, also σ need not be minimal. Fix m3 and note that σ:m constitutes a joint modulus of convergence to all sequences z¯(M)=(0,,0,𝟏,0,)p with value 1 only at one index M<2m. The image of z¯(M) is the sequence z¯(π(M)), which by hypothesis satisfies 12L2τ(1)|zπ1(L)(M)|p1 unless π(M)<2τ(1)=2q(m) for all M<2m, with q(m):=𝚷(λn.m,1) a first-order polynomial according to Proposition 12c).