Abstract 1 Introduction 2 Preliminaries and notation 3 Our Oracle Separation 4 Missing Proofs References

Toward Separating QMA from QCMA with a Classical Oracle

Mark Zhandry ORCID NTT Research, Sunnyvale, CA, USA
Abstract

QMA is the class of languages that can be decided by an efficient quantum verifier given a quantum witness, whereas QCMA is the class of such languages where the efficient quantum verifier only is given a classical witness. A challenging fundamental goal in quantum query complexity is to find a classical oracle separation for these classes. In this work, we offer a new approach towards proving such a separation that is qualitatively different than prior work, and show that our approach is sound assuming a natural statistical conjecture which may have other applications to quantum query complexity lower bounds.

Keywords and phrases:
Quantum, Oracle Separations, QMA, QCMA
Copyright and License:
[Uncaptioned image] © Mark Zhandry; licensed under Creative Commons License CC-BY 4.0
2012 ACM Subject Classification:
Theory of computation Quantum complexity theory
Related Version:
Full Version: https://arxiv.org/abs/2411.01718
Editors:
Raghu Meka

1 Introduction

Do quantum witnesses offer more power than classical witnesses? Slightly more precisely, there are two natural ways to generalize 𝖭𝖯 from the classical setting to the quantum setting: 𝖰𝖬𝖠 (for Quantum Merlin-Arthur) is the set of languages decidable by efficient quantum algorithms with quantum witnesses, whereas 𝖰𝖢𝖬𝖠 (for Quantum Classical Merlin-Arthur) is the set of languages decidable by efficient quantum algorithms with classical witnesses. A long-standing fundamental question, first raised by [2], is whether or not these two generalizations of 𝖭𝖯 are the same.

As an unconditional separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠 is out of reach given the state of complexity theory, the community has focused on proving oracle separations. The first such separation [1] gives a quantum oracle; that is, an oracle that implements a unitary operation and which can be queried on quantum states. A major open question has been whether there is a classical oracle separation; that is, an oracle that implements a classical function, but is accessible in superposition. Classical oracle separations are considered more standard in the community.

An early candidate classical oracle separation was given by [9], but no proof was given. More recently, there have been several results making progress towards this goal by proving separations under different restrictions on how the oracle is accessed. [5] show a separation assuming the classical oracle is an “in-place permutation oracle”, a non-standard modeling where the oracle irreversibly permutes the input state. [10] show a separation, assuming the witness is required to be independent of certain choices made in constructing the oracle. A very recent line of work has used quantum advantage relative to unstructured oracles [13] to separate 𝖰𝖬𝖠 from 𝖰𝖢𝖬𝖠[8, 7] give a separation assuming the verifier can only make classical oracle queries, and more recently [3] give a separation which allows the verifier quantum queries, but assumes the adaptivity of the queries is sub-logarithmic. A standard classical oracle separation that makes no constraints on how the oracle is accessed or how the witness is created still remains open.

The central challenge in separating 𝖰𝖬𝖠 from 𝖰𝖢𝖬𝖠 relative to a classical oracle seems to be the following. Consider a language in 𝖰𝖬𝖠𝖰𝖢𝖬𝖠, and consider measuring the 𝖰𝖬𝖠 witness in the computational basis. The resulting classical string must not be accepted by the 𝖰𝖬𝖠 verifier, since otherwise we would then have a classical witness for the language, putting it in 𝖰𝖢𝖬𝖠. Therefore, in some sense, the 𝖰𝖬𝖠 verifier needs to verify that the witness is in superposition. In order to allow for such verification using only a classical oracle, existing approaches require highly structured oracles. But then to actually prove the language is outside of 𝖰𝖢𝖬𝖠, we need a quantum query complexity lower-bound, and unfortunately the techniques we have are often not amenable to highly structured oracles. Additionally, any witness would naturally be treated as a form of oracle-dependent advice about the oracle, and most quantum query complexity techniques are not very good at distinguishing between quantum advice and classical advice. In other words, if a typical technique succeeded at proving a language is outside of 𝖰𝖢𝖬𝖠, then if it cannot distinguish quantum vs classical advice, it would likely also show that the language is outside 𝖰𝖬𝖠 as well, thus failing to give a separation.

Our Work

We give a new approach for separating 𝖰𝖬𝖠 from 𝖰𝖢𝖬𝖠 relative to a classical oracle. Like prior work, we are unable to prove our oracle separation unconditionally. However, our separation appears much less structured than the prior work (though this is an intuitive statement rather than a formal one), and appears much more amenable to existing quantum query complexity techniques. In particular, we prove under a natural conjecture about k-wise independent distributions that our separation indeed works. We believe our work adds to the evidence that 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠 are indeed distinct relative to classical oracles, and may offer a new path toward a proof.

1.1 Our Separating Oracles

Our basic idea is the following. An instance in our language will correspond to a subset S[N] where N is exponentially-sized. S will be chosen to only contain a negligible fraction of [N], but still be super-polynomial sized. We will provide a classical oracle (accessible in superposition) that decides membership in S. We will often simply call this oracle S.

Next, we choose a random state |ψ=ySαy|y with support on the set S. The state |ψ will be our witness state for the 𝖰𝖢𝖬𝖠 instance. An incomplete verification for |ψ proceeds by simply checking that |ψ has support contained in S. Essentially, |ψ is acting as a 𝖰𝖬𝖠 witness that S is non-empty. But there is also a simple 𝖰𝖢𝖬𝖠 witness for this fact: any classical value yS.

We will instead attempt to turn |ψ into a witness that S is super-polynomial sized. To do so, we will add a second oracle U which essentially attests to |ψ being a superposition over super-polynomially-many points. Intuitively, we want to show that U can distinguish between |ψ and any state whose support is only polynomial-sized.

To construct U, let |ψ^ denote the quantum Fourier transform (QFT) of |ψ. We observe that if |ψ has support on a single point y, then |ψ^ will have uniform amplitude on all points in [N] (though with complex phases on these points). On the other hand, for random |ψ with support on the large set S, the amplitudes on different points will vary. Concretely, while the expected squared-amplitude on any point z[N] is 1/N, there is a reasonable chance that it could be, say, smaller than 1/2N or larger than 2/N.

We will choose U to be a subset of [N] consisting of points where |ψ^ has squared-amplitude somewhat larger than 1/N. We can then have, say, the total squared-amplitude of |ψ^ on points in U be roughly 3/4 while |U|/N is only roughly 1/2. In this case, the QFT of a classical string y will have squared-amplitude on U of only 1/2. Thus, U enables distinguishing |ψ from a classical input. We will therefore give out an oracle for deciding membership in U. The verifier will first confirm that |ψ has support only on S using the oracle for S. Then it will compute |ψ^ via the QFT, and check that the support is in U. Overall the verifier accepts with probability 3/4. Instances not in the language will consist of S,U pairs where S is very small but non-empty. We show that, for a certain way of choosing U, that there is no 𝖰𝖬𝖠 witness in the case of such small S. Thus, our language is in 𝖰𝖬𝖠 relative to the oracles for S,U.

1.2 𝗤𝗖𝗠𝗔 hardness

We now need a way to argue that our language does not have 𝖰𝖢𝖬𝖠 witnesses. While we showed that a classical string yS cannot serve as a witness, this alone does not preclude some more clever way of attesting to S being large. In particular, the witness w could contain several points in S. Worse, perhaps queries to U may reveal a significant amount of information about S, which may help deciding if S is large or small. We make progress toward showing 𝖰𝖢𝖬𝖠 hardness of our oracle problem, as we now describe.

Consider a hypothetical 𝖰𝖢𝖬𝖠 verifier V which is given a classical witness w and makes quantum queries to S,U, and accepts in the case S is large. We want to show that we can replace S with a small set S, and V will still accept with too-high a probability, meaning it incorrectly claims that (S,U) is in the language, despite S being small.

Toward that end, we will choose S to be all points in S that are also “heavy” among the queries V makes to S. That is, points yS such that the query amplitude in V’s quantum queries to S is above some inverse-polynomial threshold. As the total query amplitude of all points is just the number of queries of V and hence polynomial, the number of heavy y is polynomial. Hence, S is small. We can also construct S efficiently: for each heavy y, running V and measuring a random query will have an inverse polynomial chance of producing y. By repeating this process a polynomial number of times, we can collect all heavy queries.

But why should S and S be indistinguishable to V? By standard quantum query analysis, if V can distinguish S from S, then it’s queries must place significant amplitude on SS. By measuring a random query, we therefore obtain with significant probability a ySS. But since y is not heavy, repeating this process many times will produce many different y. This means that if V can distinguish S from S, it must actually be able to generate essentially arbitrarily large (polynomial) numbers of yS. Denote the number of y by L.

𝑽 that do not query 𝑼

Let us first assume that V makes no queries to U. In this case, we can argue that any distinguishing V actually violates known query complexity results for multiple Grover search. In particular, [6] show that an algorithm making polynomially-many queries to a random sparse S cannot produce L points in S except with probability bounded by 2L (see Lemma 8 for precise statement). Now, this result assumes no advice is provided about S, but the witness w counts as advice. Fortunately, we can handle the advice using the strong exponential lower bound provided by [6]. Consider running the process above with a random w instead of w. In the event w=w, the process will produce L points in S. Moreover, w=w with probability 2|w|. By setting L|w| (recall that we can make L an arbitrarily large polynomial), we therefore obtain an algorithm with no advice which produces L points in S with probability 2|w|2L, contradicting the hardness of multiple Grover search.

 Remark 1.

The above strategy inherently uses the fact that w is classical. If V had a quantum witness/advice, running it even once and measuring a random query to find a yS would potentially destroy the witness, meaning further runs of V are not guaranteed to produce any points in S. This is the key place in the proof where we distinguish between classical and quantum witnesses, hopefully indicating a promising route toward proving a separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠.

𝒌-wise independent 𝑼

The above strategy does not work for handling queries to U. The problem is that U takes potentially N bits (which is exponential) to describe, meaning treating U as advice would require setting LN, at which point the bounds from [6] do not apply.

We will for now assume that U is k-wise independent for a super-polynomial k, and return to justifying this assumption later. We will assume such k-wise independence holds even conditioned on S (but not conditioned on |ψ, whose correlation with U is crucial for the correctness of our 𝖰𝖬𝖠 verifier). A result of [14] (formally described in Lemma 7) shows that a k-wise independent U is actually perfectly indistinguishable from a uniform U, for all quantum query algorithms making at most k/2 queries. Since k is super-polynomial, we thus obtain perfect indistinguishability against all polynomial-query algorithms, including our process above for generating points in S. Consequently, the process above succeeds in generating L points in S even if U is replaced by a uniformly random U independent of S. But such a uniform U can be simulated without knowledge of S at all, and hence the lower-bound of [6] actually applies to algorithms making queries to uniform U. Thus under the assumption that U is k-wise independent, we can justify 𝖰𝖢𝖬𝖠 hardness.

Our 𝑼 are “close” to 𝒌-wise independent

We show that, by choosing U carefully in a probabilistic way, U is “close” to k-wise independent, even conditioned on S. By “close”, we concretely mean that for every subset T[N] of size at most k, that 2|T|Pr[TU=](1+ϵ)×2|T|, for some very small ϵ which depends on k,|S|,N. Note that true k-wise independence is equivalent to Pr[TU=]=2|T| for all T of size at most k.

Is this “close” enough?

Unfortunately, we do not know how to prove that U which are close to k-wise independent are sufficient to make our approach work. The issue is that [14] only applies to perfect k-wise independence, and there are counterexamples that show that the result does not hold when replaced with some approximate notions of k-wise independence.

The good news is that our notion of closeness is quite different from the usual notion of “biased” or “almost” k-wise independence used in the literature. Specifically, those notions allow for an additive error in any of the marginal probabilities, whereas we impose a strong multiplicative error bound. This gives us hope that our distribution of U, despite not being truly k-wise independent, may still be close enough to get a separation.

We make progress toward justifying this claim. We make a conjecture that any distribution over U which is “close” to k-wise independent (in our sense) can be turned into a distribution U that is truly k-wise independent. Importantly, U and U will agree on almost all points. More precisely, for any z, the probability that U and U differ on z is negligible. See Conjecture 10 for the formal statement of this conjecture. Observe that this conjecture is simply a statement about distributions, and has nothing on the surface to do with quantum query complexity.

Under this conjecture, we complete the full oracle separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠. Instead of giving out the oracle U, we simply give out the oracle U, and prove 𝖰𝖢𝖬𝖠 hardness following the above approach. Our statistical conjecture is then used to show that replacing U with U does not break our 𝖰𝖬𝖠 verifier. Concretely, by standard query complexity arguments, we show that if our verifier works on U, then it must also work (with negligibly larger error) on U.

 Remark 2.

Our statistical conjecture gives one way to prove an oracle separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠 following our approach. Our conjecture could of course turn out to be false. Even in this case, our oracles still seem likely to give a separation, and there may be many other paths toward proving it. Perhaps if the general conjecture is false, our particular U can still be converted into U as needed. Or maybe being “close” to k-wise independent is directly sufficient for a separation and can be proven via quantum query complexity arguments. Possibly there is a different distribution over |ψ and associated U where U actually is perfectly k-wise independent. Thus, independent of our particular statistical conjecture, we believe our new approach at a separation gives a promising new approach toward separating 𝖰𝖬𝖠 from 𝖰𝖢𝖬𝖠 relative to classical oracles.

2 Preliminaries and notation

A function f(n)nO(1) is polynomial and f(n)nO(1) is inverse polynomial. Functions f(n)nω(1) are superpolynomial and f(n)nω(1) are negligible.

Let 𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂p denote the distribution over {0,1} which outputs 1 with probability p. Let 𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂pN denote the distribution over {0,1}N consisting of N iid samples from 𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂p. We will associate {0,1}N with subsets of [N], where S[N] is associated with the vector 𝐯 such that vx=1 if xS. We will also associate {0,1}N (and hence also subsets of [N]) with functions from [N] to {0,1}, where S is associated with its indicator function f, where f(x) is 1 if and only if xS.

A joint distribution X1,Xn is k-wise independent if, for each subset T of size at most k, (Xi)iT are independent random variables. X1,,Xn is k-wise uniform independent if each (Xi)iT are independent uniform random variables over their respective domains.

Complex Normal Distribution

Let 𝒩μ,σ denote complex normal distribution with width σ. The probability density function of this distribution is given by Pr[x𝒩μ,σ]=1πσ2e|xμ|2/σ2.

Two basic identities that will be useful when computing integrals involving complex normal distributions are the following. Let 𝐯 is a vector of n complex numbers, 𝐌 is a complex n×n matrix, and 𝑑𝐯 means to integrate over all complex vectors 𝐯. Then

e𝐯𝐌𝐯𝑑𝐯 =πdet(𝐌) |v1|2|v2|2e𝐯𝐌𝐯𝑑𝐯 =π2𝖳𝗋(𝐌)24det(𝐌)3 for n=2

Quantum Computation

We assume the reader is familiar with the basics of quantum computation and quantum query models. Recall that in the standard model for making quantum queries to a classical oracle 𝒪, the algorithm submits a state x,y,zαx,y,z|x,y,z, and receives back x,y,zαx,y,z|x,y𝒪(x),z. We will make use of the quantum Fourier tranform, denoted 𝖰𝖥𝖳N, defined on computational basis states as |y1NzNei2πyz/N|z for yN. We will usually drop the subscript N as it will be clear from context. For a quantum state |ψ, we will typically let |ψ^ be shorthand for 𝖰𝖥𝖳|ψ.

2.1 Defining QMA and QCMA relative to Oracles

We can consider two types of oracle versions of complexity classes, and in particular QMA/QCMA. The first, and most common, is to specify an infinite oracle 𝒪:{0,1}{0,1}, and define the classes QMA/QCMA relative to 𝒪. The second version, which is typically easier to work with, is to consider a variant of QMA/QCMA where the instance itself is an exponentially-sized oracle 𝒳:{0,1}n{0,1}. Fortunately, we show that a QMA/QCMA separation for one variant immediately gives such a separation for the other variant. Thus, it suffices to prove a separation for whichever variant is most convenient.

Definition 3 (Oracle-Aided QMA/QCMA).

For a function 𝒪:{0,1}{0,1}, an oracle decision problem is a subset 𝖫𝒪{0,1} which depends on 𝒪. We say that 𝖫𝒪 is in 𝖰𝖬𝖠𝒪 if there exists a polynomial-time oracle-aided quantum algorithm V𝒪 and polynomial p such that:

  • For every x𝖫𝒪 of length n, there exists a state |ψ on p(n) qubits such that Pr[V𝒪(x,|ψ)=1]2/3. In this case, we say that V𝒪 accepts x.

  • For every x𝖫𝒪 of length n, and for any state |ψ on p(n) qubits, Pr[V𝒪(x,|ψ)=1]1/3. In this case, we say that V𝒪 rejects x.

𝖰𝖢𝖬𝖠𝒪 is defined analogously, except that the states |ψ are required to be classical.

Definition 4 (Oracle-Input QMA/QCMA).

Let 𝒰={𝒰n}n+ where 𝒰n are sets of strings 𝒳 of length 2nΘ(1), interpreted as functions from 𝒳:[nΘ(1)]{0,1}. An oracle-input promise language is a subset 𝖮𝖨-𝖫𝒰. An oracle-input promise language 𝖮𝖨-𝖫𝒰 is in 𝖮𝖨-𝖰𝖬𝖠 if there exists a polynomial-time oracle-aided quantum algorithm V and polynomial p such that:

  • For every 𝒳𝖮𝖨-𝖫𝒰n, there exists a |ψ on p(n) qubits such that Pr[V𝒳(|ψ)=1]2/3.

  • For every 𝒳𝒰n𝖮𝖨-𝖫, and for any state |ψ on p(n) qubits, Pr[V𝒳(|ψ)=1]1/3.

𝖮𝖨-𝖰𝖢𝖬𝖠 is defined analogously, except that the states |ψ are required to be classical.

Note that the constants 1/3,2/3 in Definitions 3 and 4 are arbitrary, and can be replaced with a,b for any a,b such that a2𝗉𝗈𝗅𝗒(n),b12𝗉𝗈𝗅𝗒(n), and ba1/𝗉𝗈𝗅𝗒(n).

Given any countable collection of oracles 𝒪1,𝒪2, which may have finite or infinite domains, we can construct a single oracle 𝒪:{0,1}{0,1} by setting 𝒪(j,x)=𝒪i(x), where (j,x) is some encoding of pairs (j,x){0,1}×{0,1} into strings in {0,1}. We can likewise convert 𝒪 back into 𝒪1,𝒪2,. Therefore, we will take the definitions of 𝖰𝖬𝖠,𝖰𝖢𝖬𝖠,𝖮𝖨-𝖰𝖬𝖠,𝖮𝖨-𝖰𝖢𝖬𝖠 to allow for verifiers making queries to countable collections of oracles.

This next theorem is proved in Section 4 following a standard diagonalization argument, and shows that is suffices to give a separation for either variant of 𝖰𝖬𝖠,𝖰𝖢𝖬𝖠.

Theorem 5.

There exists a classical oracle 𝒪 such that 𝖰𝖢𝖬𝖠𝒪𝖰𝖬𝖠𝒪 if and only if 𝖮𝖨-𝖰𝖢𝖬𝖠𝖮𝖨-𝖰𝖬𝖠.

The style of oracle separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠 given in [1] follows that of Definition 3, except that they use a quantum oracle instead of a classical oracle. They do not define the oracle-input versions of 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠 or a general result like Theorem 5, but their proof implicitly uses similar concepts. In particular, they first define a universe of quantum oracles: namely, those that are either the identity or reflect around a Haar random state. They then show that the two cases can be efficiently distinguished via a quantum witness, but not a classical witness. This is effectively showing a separation between 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠, except using quantum oracles instead of classical oracles. They then extend this to give a quantum oracle 𝒬 separating 𝖰𝖬𝖠𝒬 from 𝖰𝖢𝖬𝖠𝒬. This can be seen as roughly corresponding to a transformation like what we prove in Theorem 5.

One slight non-triviality in generalizing their techniques to give a general equivalence is that a separation between 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠 only needs to show that, for any potential 𝖰𝖢𝖬𝖠 verifier, there is some instance that the verifier answers incorrectly. This is indeed how our separation is constructed. In contrast, [1] show that almost all instances will fool any 𝖰𝖢𝖬𝖠 verifier. This stronger separation is crucially used when constructing the oracle 𝒬 separating 𝖰𝖬𝖠𝒬 from 𝖰𝖢𝖬𝖠𝒬, as they can basically choose 𝒬 to be random from the appropriate universe of oracles. In order to get a general equivalence for arbitrary separations, including those like ours where the instance depends on the verifier, we have to work a bit harder and incorporate a diagonalization argument. Fortunately, this is standard.

2.2 Some Useful Quantum Lemmas

For an oracle algorithm A making queries to an oracle O and an oracle input r, let the state x,y,zαx,y,z(i)|x,y,z denote the ith oracle query, and let Mx(i)=y,z|αx,y,z(i)|2, which we will call the query mass of x in the i-th query. Let Mx=iMx(i), the total query mass of x over all q queries, and for a subset V let MV=xVMx be the total query mass of points in V.

Lemma 6 ([4] Theorem 3.1+3.3).

Let A be a quantum algorithm running making q queries to an oracle O. Let ϵ>0 and let V be a set of inputs. If we modify O into an oracle O which is identical to O except possibly on inputs in V, then |Pr[AO()=1]Pr[AO()=1]|4qMV.

Lemma 7 ([14] Theorem 3.1).

Let A be a quantum algorithm making q queries to an oracle O. For any output z, the probability A outputs z when O is 2q-wise independent is identical to the probability A outputs z when O is uniformly random.

Lemma 8 ([6] Theorem 5.5).

Let p[0,1]. There is a constant C48e such that the following is true. The success probability of finding K marked items in a random function S:[N]{0,1} where S(x)=1 with probability p for each x[N] is at most (Cp(Q/K)2)K for any algorithm making QK quantum queries to S.

3 Our Oracle Separation

Here, we give our conjectured oracle separation between 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠. Following Theorem 5, it suffices to focus on the oracle-input variants of 𝖰𝖬𝖠 and 𝖰𝖢𝖬𝖠. We first define our new statistical conjecture. Then we will define a certain “nice” type of distribution, which we call Fourier Independent (FI). We show that our statistical conjecture leads to the existence of such a FI distribution. Finally, we show that an FI distribution gives a separation between 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠, and hence an oracle 𝒪 such that 𝖰𝖢𝖬𝖠𝒪𝖰𝖬𝖠𝒪 (via Theorem 5).

3.1 Our Statistical Conjecture

Definition 9 (Substitution Distance).

Consider two distributions X0,X1 over Σ for some alphabet Σ. The substitution distance between X0 and X1, denoted X0X1𝗌𝗎𝖻, is the minimum value of ϵ0 such that there is a joint distribution (Z0,Z1) over (Σ)2 where:

  • The marginal distribution Z0 is equal to X0 and the marginal distribution Z1 is equal to X1.

  • For each i[], Pr[Z0,iZ1,i]ϵ, where Zb,i means the ith entry of Zb.

Intuitively, a small X0X1𝗌𝗎𝖻 means that, by changing a few positions X0 – and each position with tiny probability – we can turn X0 into X1.

Conjecture 10.

There exist functions r(N),k(N),ζ(N),η(N) subject to the constraints k(N)(logN)ω(1), η(N)(logN)ω(1), and Nζ(N)3/r(N)6(logN)ω(1) such that the following is true. Suppose X0 is a distribution over {0,1}N such that for all sets T[N] of size of size at most r(N), 2|T|Pr𝐱X0[xi=0iT](1+ζ(N))×2|T|. Then there exists a k(N)-wise uniform independent distribution X1 such that X0X1𝗌𝗎𝖻η(N).

Think of logN as the instance size, so that N is exponential. Conjecture 10 starts with a distribution X0 that is in some sense very close to r-wise uniform independent, and concludes that X0 must be negligibly-close in substitution error to an actual k-wise uniform independent distribution, for k that may be different than r but is still super-polynomial. Note that without the constraint Nζ(N)3/r(N)6(logN)ω(1), the conjecture is trivially true by setting ζ=0 and X0=X1. The exact constraint we stipulate makes the conjecture non-trivial, and arises for technical reasons in our separation.

3.2 Fourier Independent Distributions

Definition 11.

Let N+ and S[N]. We say that a distribution 𝒟S over pairs (|ψ,U) is (k,δ,γ)-Fourier-Independent (FI) if the following hold:

  • |ψ is a normalized superposition ySαy|y over elements yS.

  • U[N], and the marginal distribution of U is k-wise uniform independent.

  • Let |ψ^=𝖰𝖥𝖳|ψ be the quantum Fourier transform of |ψ. Then except with probability δ over the choice of |ψ, ψ^|ΠU|ψ^12+γ, where ΠU is the projection operator zU|zz|.

We want k to be large (say super-polynomial in logN), δ to be small (say negligible in logN), and γ to be not-too-small (non-negligible in logN). Then a Fourier Independent distribution is one where (1) |ψ has support on S, (2) U looks like a random set to query-bounded quantum algorithms (by Lemma 7), but (3) |ψ^ is biased toward elements in U.

We now show the existence of a FI distribution for certain k,δ,γ, assuming Conjecture 10.

Theorem 12.

Suppose Conjecture 10 holds. Then there exists functions p,ϵ,δ,γ:+[0,1] and functions N,k:++ such that (1) p(n),ϵ(n),δ(n)nω(1), (2) N(n)2nO(1) (3) k(n)nω(1), (4) γnO(1), and (5) except with probability ϵ(n) over the choice of S𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂p(n)N(n), there exists a distribution 𝒟S that is (k,δ,γ)-Fourier-Independent.

Proof.

Let N,+ be positive integers. For a subset SN of size , let 𝒟S be the distribution over pairs (|ψ,U) where |ψ is a quantum state and UN, obtained as follows:

  • For each yS, sample a complex number αy𝒩(0,σ) where σ=1/. Let |ψ=ySαy|y

  • For each zN, let βz=ySei2πyz/Nαy.

  • For each zN, place z into the output set U with independent probability 1e|βz|2.

Intuition

By choosing σ=1/, we will show that |ψ is approximately normalized, so we can think of |ψ as being essentially a random state with support on S. Let |ψ^=𝖰𝖥𝖳|ψ be the QFT applied to |ψ. Then |ψ^=zN(βz/N)|z. Thus, the set U will be biased toward containing the points z where βz is large. We will also show that U is close to k-wise independent in substitution distance, for an appropriate k. Via Conjecture 10, this allows us to replace U with an appropriate U, giving a distribution 𝒟S that is truly Fourier Independent.

We state some useful lemmas about 𝒟S; the proofs will be given in Section 4. Define τTS:=PrU𝒟S[TU=], or equivalently, the probability U(z)=0 for all zT, once S is chosen.

Lemma 13.

For any subsets S,T, 1+|T|(τTS)12|T|

Lemma 13 holds for any S,T. In particular, for |T|=1, we have that τTS=1/2. This means each z is placed in U with probability 1/2; by linearity of expectation, 𝔼[|U|]=N/2. We can also get a tighter lower-bound for larger T with high probability over the choice of S:

Lemma 14.

For any ϵ>0, except with probability at most 2N2eϵ2/2 over the choice of random subset S of size , for all subsets T, (τTS)12|T|(1|T|2ϵ). In this event, as long as |T|2ϵ1/2, we can bound τTS2|T|(1+2|T|2ϵ).

Now we bound |ψ2, showing that |ψ is approximately normalized.

Lemma 15.

Fix any set S of size and ϵ(0,1). Then except with probability 2eϵ2/8, |ψ2[1ϵ,1+ϵ], where |ψ is generated as in 𝒟S.

Now, we bound the probability that (the normalization of) |ψ^ is accepted by U. Note that ||ψ|2=||ψ^|2.

Lemma 16.

Except with probability at most 3(N1+2N2)ϵ2+4N2eϵ2/32 over the choice of S,U, we have |ψ^|ΠU|ψ^|ψ23/4|ϵ. Recall ΠU is the projection operator zU|zz|.

We now return to the proof of Theorem 12. 𝒟S is almost Fourier Independent, except that the distributions over U are not k-wise uniform independent. However, Lemmas 13 and 14 show, in some sense, that U is very close to being k-wide uniform independent, for somewhat large k. We will then invoke the assumed Conjecture 10 to replace U with a distribution over U that is actually k-wise uniform independent, for a sufficiently large k, and is close in substitution error to U. We then show that the small substitution error between U and U implies that the statements of Lemma 16 still approximately holds, even for U.

In more detail, let X0 be the distribution over U stemming from 𝒟S. Let r(N), k(N), ζ(N), η(N) be the functions guaranteed by Conjecture 10. Define N=Θ(2n) and let p=r(N)4ζ(N)2N1log2N. By the conditions Conjecture 10 places on r(N),k(N),ζ(N),η(N), we therefore have that pnω(1)log2Nnω(1). By standard concentration inequalities, the size of S sampled from 𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂pN is very close to pN=r(N)4ζ(N)2log2N, except with negligible probability. Then set ϵ=ζ(N)/r(N)2, which by the conditions of Conjecture 10 gives that N1ϵ2, 2N2ϵ2, and N2eϵ2/32 are all negligible. By Lemma 13 and by invoking Lemma 14 with ϵ=ζ(N)/r(N)2, we have except with negligible probability over the choice of S, that 2|T|τST2|T|(1+ζ) for all sets T of size at most r(N). Conjecture 10 then implies for “good” S where the bounds on τST hold, there is a distribution X1 that is k(N)-wise uniform independent and such that X0X1𝗌𝗎𝖻η(N), with k(N),1/η(N)(logN)ω(1)=nω(1).

Let S be a good set. Now consider the following distribution 𝒟S. It first uses the fact that X0X1𝗌𝗎𝖻nω(1) to derive a joint distribution (Z0,Z1) with the marginal Z0 being equivalent to X0 and Z1 being k-wise uniform independent for knω(1). Then we sample (|ψ,U)𝒟S and sample U from the distribution Z1 conditioned on Z0=U. Let |ψ=|ψ/|ψ. Output (|ψ,U). We then have that U is distributed according to Z1, and is therefore k-wise uniform independent. We also have by Lemma 16 that except with negligible probability, ψ^|ΠU|ψ^2/3. In order to justify Fourier Independence, we just need to show that, e.g. ψ^|ΠU|ψ^7/12.

Toward that end, write |ψ^=1NzNβz|z where z|βz|2=1. Then deinfe

E:=ψ^|ΠU|ψ^ψ^|ΠU|ψ^=zU|βz|2zU|βz|2zUU|βz|2

Now let ξz denote the variable that is 1 if zUU and is 0 otherwise. Then Ezξz|βz|2. Each ξz is a 0/1 random variable with negligible expectation. Therefore, since z|βz|2=1, we have that 𝔼[E] is negligible. Then by Markov’s inequality, we have that Pr[E𝔼[E]]𝔼[E]. Therefore, since 𝔼[E] and hence 𝔼[E] are negligible, we have that E is negligible except with negligible probability. This means in particular that ψ^|ΠU|ψ^7/12, except with negligible probability. Thus 𝒟S is (k,δ,γ)-Fourier-Independent, thereby proving Theorem 12.

3.3 From FI Distributions to An Oracle Separation

We now show that FI distributions as guaranteed by Theorem 12 give a separation between 𝖮𝖨-𝖰𝖢𝖬𝖠 and 𝖮𝖨-𝖰𝖬𝖠.

Theorem 17.

Suppose Conjecture 10 holds. Then 𝖮𝖨-𝖰𝖢𝖬𝖠𝖮𝖨-𝖰𝖬𝖠.

Proof.

We first invoke Theorem 12 to obtain distributions 𝒟S satisfying properties (1) through (5) in the statement of Theorem 12. We now use this to construct our separation. We will invoke the definition of 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠 with a=1/2+γ(n)/2 and b=1/2+γ(n). Since ba=γ(n)/2 is inverse polynomial, this is equivalent to the standard definition of 𝖮𝖨-𝖰𝖬𝖠 and 𝖮𝖨-𝖰𝖢𝖬𝖠. Thus, a valid verifier will accept YES instances of size n (given a correct witness) with probability at least 1/2+γ(n), and accept NO instances with probability at most 1/2+γ(n)/2.

An instance will be a pair of oracles (S,U) where S,U[N(n)]. Our verifier VS,U(|ψ) will do the following: V will make a query to S on the witness state |ψ and measuring the output. If it accepts, then V will apply the 𝖰𝖥𝖳 to the witness state (which may have changed due to the measurement), and make a query to U, measuring the output. If both queries accept, then V will output 1; if either measurement rejects, then V will output 0.

We define the universe 𝒰 as the set of pairs (S,U) for which either (1) there exists a state |ψ such that Pr[VS,U(|ψ)=1]1/2+γ(n), or (2) for all states |ψ, Pr[VS,U(|ψ)=1]<1/2+γ(n)/2. Then 𝖮𝖨-𝖫𝒰 is the set such that Pr[VS,U(|ψ)=1]1/2+γ(n). By definition, 𝖮𝖨-𝖫𝖮𝖨-𝖰𝖬𝖠.

We now show that 𝖮𝖨-𝖫𝖮𝖨-𝖰𝖢𝖬𝖠. We can always assume without loss of generality that there is, say, a fixed quadratic running time t such that the running time of any 𝖮𝖨-𝖰𝖢𝖬𝖠 verifier is bounded by t(|x|+|w|) where |x| is the instance length and |w| is the witness length. This is accomplished by padding the witness length with 0’s that just get ignored by the verifier.

Now let q=q(n) be a sufficiently small super-polynomial function, which we will take as an upper bound on witness length. Let Q(n)=q(n)2, which we take to be an upper bound on the number of queries when the witness length is at most q(n). Let v=v(n) be another super-polynomial. We will need the following constraints on q,Q,v:

Q γp1/2 v qQ4γ4
v γN1/12 Qk/v nω(1)

These can be satisfied for a sufficiently-small super-polynomial q,v and for sufficiently large n.

Suppose toward contradiction that there is a 𝖮𝖨-𝖰𝖢𝖬𝖠 verifier V. Sample S𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂p(n)N(n) and (|ψ,U)𝒟S, where 𝒟S is (k(n),δ(n),γ(n))-Fourier-Independent. Then we have that with overwhelming probability over the choice of S,U,|ψ, Pr[VS,U(|ψ)=1]1/2+γ(n). Hence (S,U)𝖮𝖨-𝖫. Therefore, under the assumption that V is a verifier for 𝖮𝖨-𝖫, V must accept (S,U), meaning there is a classical witness w such that Pr[VS,U(w)=1]1/2+γ(n).

We will now construct a different instance S,U, where S is constructed from the following algorithm 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w): initialize S={}, and then repeat the following loop for i=1,,v:

  • Run VS,U(w) until a randomly chosen query to S, and measure the query, obtaining a string yi[N].

  • If yiSS, add yi to S.

The following is proved in Section 4:

Lemma 18.

If U is sampled from a k-wise uniform independent function and S is potentially correlated to U but has size at most v, then except with probability 2N2(ekϵN)k over the choice of U,S, it holds that, for any normalized state |ϕ with support on S, ϕ^|ΠU|ϕ^1/2+vϵ, where |ϕ^=𝖰𝖥𝖳|ϕ.

Corollary 19.

Except with negligible probability over the choice of S,U,S, (S,U)𝒰𝖮𝖨-𝖫.

Proof.

Set ϵ=γ/3v, and set G:=2N2(3vekγN)k for a yet-unspecified k. By Lemma 18, except with probability at most G, Pr[VS,U(|ϕ)=1]1/2+γ/3<1/2+γ/2 for any state |ϕ. In this case, (S,U)𝒰𝖮𝖨-𝖫. This event holds regardless of what S is, just using the fact that it consists of at most v elements. Setting k=5 and using that vγN1/12 we have that G=O(N1/12), which is negligible.

We now show, however, that V fails to reject S,U:

Lemma 20.

Except with negligible probability over the choice of S,U,w,S, Pr[VS,U(w)=1]>1/2+γ(n)/2

Proof.

Observe that the process 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w) for constructing S always generates SS. Now consider running S𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w), where w is a random string and U is a random boolean function, with both w,U independent of S. This is an algorithm which makes vQ queries to S (and also to U, but U us simulatable on its own since it is independent of S). S in turn sampled from 𝖡𝖾𝗋𝗇𝗈𝗎𝗅𝗅𝗂pN. Finally, the algorithm outputs some subset S of S. By Lemma 8, there is a universal constant C such that

Pr[|S|K:w,U are uniform and independent of S](Cp(vQ/K)2)K.

Now consider running S𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w), replacing U with U. Recall that U is k-wise independent even conditioned on S, for k2vQ where vQ is the number of queries made by 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍. By Lemma 7, the output distribution of 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w) is identical to that of 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w). Thus, we still have

Pr[|S|K:U=U, while w is uniform and independent of S](Cp(vQ/K)2)K.

Finally, consider running S𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w). Since Pr[w=w]=2q, this means that with probability 2q, 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w) is actually running 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍S,U(w). Therefore,

Pr[|S|K:U=U,w=w](Cp(vQ/K)2)K×2q.

We now set K=vQ2Cp+q+log2(v). Then we have that Pr[|S|K:U=U,w=w]1/v. Then in particular since |S|v always, we have that 𝔼[|S|](K1)Pr[|S|<K]+vPr[|S|K](K1)+1K.

Let ej be the probability that 𝖦𝖾𝗇𝖲𝗆𝖺𝗅𝗅𝖲𝖾𝗍 adds an element yi to S in the ith iteration. Then j=1vej=𝔼[|S|]K. We also have that the ej are monotonically decreasing since the yi are identically distributed and thus the probability mass outside of the growing S can only shrink. Thus evK/v.

For an input yS, let My denote the total magnitude squared of y in all queries made by VS,U(w) to oracle S. Then measuring a random choice of the Q queries by V, we will obtain y with probability at least My/Q. Since evK/v, this means that by the end of the loop, the expected total query weight of all points in S but not in S is at most QK/v. By Markov’s inequality, we therefore have that the query weight of points in SS is at most QK/v, except with probability at most QK/v. Recall that QK/v is negligible. Therefore, since this probability is negligible, we will therefore assume the total query weight of points in SS is at most QK/v.

Lemma 6 shows that the difference in acceptance probability between VS,U(w) and VS,U(w)) is at most 4Q×QK/v=4Q3K/v4. Observe that Q3K/v=Q42Cp+Q3(q+log2(v))/v. Using that Qγp1/2 and vqQ4/γ4, we therefore have that Q3K/vγ4/(12)4. Hence the difference in acceptance probability is at most γ/3, and hence Pr[VS,U(w))=1]>1/2+γ/2.

Corollary 19 and Lemma 20 shows that V fails to decide 𝖮𝖨-𝖫, contradicting it being a 𝖰𝖢𝖬𝖠 verifier. Hence, 𝖮𝖨-𝖫𝖰𝖢𝖬𝖠. This completes the proof of Theorem 17

4 Missing Proofs

We now prove Lemmas 131415, and 16 as well as Theorem 5. To do so, we introduce some extra notation. For a subset SN, let 𝐌S be the N×N matrix defined as 𝖰𝖥𝖳ΠS𝖰𝖥𝖳. Define τTS:=PrU𝒟S[TU=], or equivalently, the probability U(z)=0 for all zT, once S is chosen. Let TS be the |T|×|T| sub-matrix of 𝐌S consisting of rows and columns columns whose indices are in T. The following lemmas will be useful.

Lemma 21.

For any ϵ>0, except with probability at most 2N2eϵ2N2/8 over the choice of random S of size , maxzz|𝐌z,zS|ϵ

Proof.

Fix any zz, and consider the random variable Mz,zS where S is a random set of size . We write:

Mz,zS=1NySei2π(zz)y/N=1Nj=1ei2π(zz)yj/N

where y1,y range over the elements of S, and are therefore random distinct values in N.

We first look at the real part of 𝐌z,zS, namely 1Ni=1Yi where Yi=cos(2π(zz)yi/N). For the moment, imagine the yi being uniform without the distinctness requirement, in which case since zz0 the Yi all become independent random variables bounded to the range [1,1]. Moreover, the means are zero since zz0modN. Then by Hoeffding’s inequality, we have

Pr[|i=1Yi|t]2et2/4

We then observe that switching to distinct yi cannot make the inequality worse. This is because Hoeffding’s inequality still holds when sampling is performed without replacement; in fact even better bounds are possible [11].

We now look at the imaginary part 1Ni=1Yi where Yi=sin(2π(zz)yi/N). By identical logic, we have that

Pr[|i=1Yi|t]2et2/4

Combining the two inequalities with the fact that the real and imaginary parts are orthogonal gives Pr[|Mz,zS|2t/N]4et2/4. Setting t=ϵN/2 gives that

Pr[|Mz,zS|ϵ]4eϵ2N2/8

Taking a union bound over all (N2) off-diagonal terms111Since MS is Hermitian, we only need to bound, say, the terms above the diagonal. we obtain the lemma.

Lemma 22.

Fix subsets S,T with |S|=. Then

τTS=1det(𝐈+N𝐌ST)=1det(𝐈+N𝐌TS)
Proof.

Recall that U is sampled by first sampling the state |ψ with support on S where each coefficient αy is Gaussian distributed from 𝒩(0,σ). Then each z is excluded from U with probability e|βz|2, where βz/N is the Fourier coefficient of z in |ψ. Thus, the probability that TU=, conditioned on |ψ is just

Pr[TU=|ψ]=ezT|βz|2=eNψ|𝖰𝖥𝖳ΠT𝖰𝖥𝖳|ψ=eNψ|𝐌T|ψ

Now let 𝐯 be the vector of the αy as y varies in S. Then |ψ is just 𝐯 with zeros inserted in each position outside of S. Then we can write

Pr[TU=|ψ]=eN𝐯𝐌ST𝐯

We now average over the choice of 𝐯, which is simply distributed as 𝒩(0,σ). This gives us

τTS =Pr[𝐯]eN𝐯𝐌ST𝐯𝑑𝐯
=1(πσ2)e|𝐯|2σ2N𝐯𝐌ST𝐯𝑑𝐯
=1(πσ2)e𝐯(σ2𝐈+N𝐌ST)𝐯𝑑𝐯
=1(σ2)det(σ2𝐈+N𝐌ST)=1det(𝐈+Nσ2𝐌ST)=1det(𝐈+N𝐌ST)

where in the last inequality we plugged in σ=1/. This gives us the first part of Lemma 22. Now, we observe that 𝐌ST=AA, where A is the |T|× sub-matrix of 𝖰𝖥𝖳 restricted to column indices in S and row indices in T. Then by the Weinstein–Aronszajn identity, det(𝐈+N𝐌ST)=det(𝐈+NAA)=det(𝐈+NAA)=det(𝐈+N𝐌TS). This gives the second part of Lemma 22. Going forward, we will use τ¯TS as shorthand for det(𝐈+N𝐌TS). Lemma 22 says that τTS=(τ¯TS)1.

We can now prove Lemmas 131415, and 16.

4.1 Proof of Lemma 13

Lemma 23.

For any subsets S,T, 1+|T|τ¯TS2|T|

Proof.

We first observe that the diagonal entries in 𝐈+N𝐌S are exactly 2. Indeed, the zth diagonal entry is 1+(N/)(1NxSei2πzxei2πzx)=2. Moreover, N𝐌S and hence 𝐈+N𝐌S is PSD. Since 𝐈+N𝐌TS is just a principle minor of 𝐈+N𝐌S, it is also PSD with diagonal entries also equal to 2. The determinant is then bounded by the product of the diagonal entries, giving the upper bound.

For the lower bound, we have that the eigenvalues of 𝐈+N𝐌TS sum to 2|T|, and each of the |T| eigenvalues is at least 1. The determinant is the product of the eigenvalues, which is minimized when one of the eigenvalues is |T|+1 and the remaining |T|1 eigenvalues are 1. This gives the lower bound.

4.2 Proof of Lemma 14

Lemma 24.

For any ϵ>0, except with probability at most 2N2eϵ2/2 over the choice of S, for all subsets T, τ¯TS2|T|(1|T|2ϵ). In this event, as long as |T|2ϵ1/2, we can bound τTS2|T|(1+2|T|2ϵ).

Proof.

Assume all the off-diagonal entries of MS are bounded by 2ϵ/N, which by Lemma 21 holds except with probability 2N2eϵ2/2. We have already seen that the diagonal entries of 𝐈+N𝐌TS are exactly 2. The off-diagonal entries of 𝐈+N𝐌TS are off-diagonal entries from 𝐌S but scaled by N/, and are therefore bounded by 2ϵ. By Gershgorin’s circle theorem, the eigenvalues are therefore lower-bounded by 2(1|T|ϵ). The determinant is therefore lower-bounded by this quantity raised to the |T|. We obtain the lemma by bounding (1|T|ϵ)|T|(1|T|2ϵ).

4.3 Proof of Lemma 15

Lemma 25.

Fix any set S of size and ϵ(0,1). Then except with probability 2eϵ2/8, ||ψ|2[1ϵ,1+ϵ], where |ψ is generated as in 𝒟S.

Proof.

First, 𝔼[||ψ|2]=yS𝔼[|αy|2]. Since αy𝒩𝒞(0,1/), the real and imaginary parts are mean-0 normal variables with variance 1/2. |αy|2 is therefore distributed as the Chi-squared distribution with two degrees of freedom, scaled by 1/2, which therefore has expectation 1/. Summing over all yS gives 𝔼[||ψ|2]=1. We also see that ||ψ|2 is distributed as a Chi-squared distribution with 2 degrees of freedom, scaled by 1/2. Via concentration inequalities for Chi-squared, we have that

Pr[|||ψ|21|4x/2]2ex

Setting ϵ=4x/2 gives the lemma.

4.4 Proof of Lemma 16

Lemma 26.

Except with probability at most 3(N1+2N2)ϵ2+4N2eϵ2/32 over the choice of S,U, we have |ψ^|ΠU|ψ^||ψ|23/4|ϵ. Recall ΠU is the projection operator zU|zz|.

Proof.

Fix |ψ. We first compute the expectation of ψ^|ΠU|ψ^ (as U varies) given |ψ. We will actually compute the complement ψ^|(𝐈ΠU)|ψ^

𝔼[ψ^|(𝐈ΠU)|ψ^] =1N𝔼[zU|βz|2]
=1NzNPr[zU]|βz|2
=1NzN|βz|2e|βz|2

Now we include the expectation as we vary |ψ, giving:

𝔼[ψ^|(𝐈ΠU)|ψ^]=1NzN𝔼[|βz|2e|βz|2]

Next, we bound 𝔼[|βz|2e|βz|2]. Since the distribution of αy are invariant under phase change, we see that βz is just the sum of iid variables distributed as 𝒩𝒞(0,1/). This means each βz is distributed as 𝒩𝒞(0,1). Breaking out the real and imaginary parts lets us write

𝔼[|βz|2e|βz|2] =|β|2e|β|2×1πe|β|2𝑑β
=1π|β|2e2|β|2𝑑β=1π(x2+y2)e2(x2+y2)𝑑x𝑑y=14

Thus, we have that 𝔼[ψ^|(𝐈ΠU)|ψ^]=1/4. Now we bound the variance. By carrying out a similar calculation as before, we have:

𝔼[ψ^|(𝐈ΠU)|ψ^2] =1N2𝔼[(zU|βz|2)]
=1N2z,zNPr[z,zU]|βz|2|βz|2
=1N2(zPr[zU]|βz|4+zzPr[zU]Pr[zU]|βz|2|βz|2)
=1N2(z|βz|4e|βz|2+zz|βz|2|βz|2e|βz|2|βz|2)

We include the expectation as we vary |ψ. The expectation of |βz|4e|βz|2 becomes

𝔼[|βz|4e|βz|2] =|β|4e|β|2×1πe|β|2=34

Meanwhile, to compute the expectation of |βz|2|βz|2e|βz|2|βz|2, we use that the co-variance matrix of βz,βz is exactly 𝐌{z,z}S. Thus

𝔼[|βz|2|βz|2e|βz|2|βz|2]
=|β|2|β|2e|β|2|β|2π2det(𝐌{z,z}S)2×e(β(β))(𝐌{z,z}S)1(ββ)𝑑β𝑑β
=1π2det(𝐌{z,z}S)2|β|2|β|2e(β(β))[𝐈+(𝐌{z,z}S)1](ββ)𝑑β𝑑β
=1π2det(𝐌{z,z}S)2×π2𝖳𝗋(𝐈+(𝐌{z,z}S)1)24det(𝐈+(𝐌{z,z}S)1)3
=det(𝐌{z,z}S)𝖳𝗋(𝐈+(𝐌{z,z}S)1)24det(𝐈+{z,z}S)3

Now write 𝐌{z,z}S=(1ϵz,zϵz,z1). By Lemma 21, we can now bound |ϵz,z| by /4N<1/2, except with probability 2N2e/32. Then we have that

𝔼[|βz|2|βz|2e|βz|2|βz|2]=(2|ϵz,z|2)2(1|ϵz,z|2)(4|ϵz,z|2)3116(1+|ϵz,z|2)

where the last inequality used that |ϵz,z|1/2.

We therefore have that 𝔼[ψ^|(𝐈ΠU)|ψ^2]34N+116+116N2zz|ϵz,z|. Since the mean is 1/4, the variance is therefore at most 34N+116N2zz|ϵz,z|234N+116N2zz(4N)234N+2256N2. We now apply Chebyshev’s inequality, to get that

Pr[|ψ^|(𝐈ΠU)|ψ^1/4|ϵ/2]34N+264N2(ϵ/2)2+2N2e/32

Now we have that

Pr[|ψ^|ΠU|ψ^||ψ|23/4|ϵ] =Pr[|ψ^|(𝐈ΠU)|ψ^||ψ|21/4|ϵ]
=Pr[ψ^|(𝐈ΠU)|ψ^||ψ|2×[14ϵ,14+ϵ]]
Pr[ψ^|(𝐈ΠU)|ψ^[14ϵ/2,14+ϵ/2]]
+Pr[||ψ|2[1ϵ/2,1+ϵ/2]]
(34N+264N2(ϵ/2)2+2N2e/32)+2eϵ2/32
3(N1+2N2)ϵ2+4N2eϵ2/32

4.5 Proof of Lemma 18

Lemma 27.

If U is sampled from a k-wise uniform independent function and S is potentially correlated to U but has size at most v, then except with probability 2N2(ekϵN)k over the choice of U,S, it holds that, for any normalized state |ϕ with support on S, ϕ^|ΠU|ϕ^1/2+vϵ, where |ϕ^=𝖰𝖥𝖳|ϕ.

Proof.

For a set U, let 𝐌U=𝖰𝖥𝖳ΠU𝖰𝖥𝖳. Then (𝐌U)z,z=1NyNei2π(zz)y/Nξy, where ξy is the boolean value that is 1 if yU. Then we have that (𝐌U)z,z=|U|/N. In expectation, |U|/N is 1/2. We now bound how far |U|/N can deviate from 1/2. Recall that |U|/N=1NyNξy. The ξy are not truly independent so we cannot use standard concentration inequalities such as Hoeffding. However, we can use the following somewhat standard bound (e.g. [12]) for the [1,1]-weighted sum of k-wise independent boolean random variables:

Pr[|1NyNξy12|ϵ/2]2(ekϵN)k

On the other hand, for zz, taking the expectation over U, we see that 𝔼U[(𝐌U)z,z]=0. We now try to bound the deviation from the expectation, by bounding the real and imaginary parts separately. We see that [(𝐌U)z,z]=1NyNcos(2π(zz)y/N)ξy, which is the weighted sum of boolean random variables ξy, where the weights are all in [1,1]. Using the [1,1]-weighted sum of k-wise independent boolean random variables again, we have:

Pr[1NyNcos(2π(zz)y/N)ξyϵ/2]2(ekϵN)k

Combining with an identical bound on the imaginary part of (𝐌U)z,z, we have that

Pr[|(𝐌U)z,z|ϵ]4(ekϵN)k

By union-bounding over all entries of 𝐌U (which only needs to count entries on the diagonal and above since 𝐌 is Hermitian), we have except for probability at most 2N2(ekϵN)k, both (1) for all z that (𝐌U)z,z[1/2ϵ,1/2+ϵ] and (2) for all zz that |(𝐌U)z,z|ϵ.

Now suppose (1) and (2) hold. Now consider a supposed set S of size v. Let 𝐌SU be the v×v sub-matrix whose row and column indices are in S. Then by the Gershgorin circle theorem, all eigenvalues of 𝐌SU are bounded from above by 1/2+vϵ.

4.6 Proof of Theorem 5

Theorem 5.

There exists a classical oracle 𝒪 such that 𝖰𝖢𝖬𝖠𝒪𝖰𝖬𝖠𝒪 if and only if 𝖮𝖨-𝖰𝖢𝖬𝖠𝖮𝖨-𝖰𝖬𝖠

Proof.

In one direction, assume a classical oracle 𝒪 such that 𝖰𝖢𝖬𝖠𝒪𝖰𝖬𝖠𝒪. Let 𝖫𝒪 be the separating language, and V a verifier for 𝖫𝒪.

We construct a language 𝖮𝖨-𝖫 as follows. Let Q(n) be a (polynomial) upper bound on the length of queries that V makes to 𝒪 when given an instance x of length n. Let 𝒪n be the portion of 𝒪 corresponding to queries of length at most Q(n). Then |𝒪n|2nΘ(1).

Let 𝒰n consist of strings of the form (x,𝒪n) where x has size n, and let 𝖮𝖨-𝖫 be the set of (x,𝒪n) where x𝖫𝒪. We can decide membership in 𝖮𝖨-𝖫 as follows: given a witness state |ψ, first recover x by making n queries to (x,𝒪n). Then run V𝒪n(x,|ψ). By our choice of 𝒪n containing all of 𝒪 that gets queried by V, we therefore have that V𝒪n(x,|ψ) is identical to V𝒪(x,|ψ). As such, if V correctly decides if x𝖫𝒪, then our verifier correctly decides in (x,𝒪n)𝖮𝖨-𝖫. Thus, 𝖮𝖨-𝖫𝖮𝖨-𝖰𝖬𝖠.

On the other hand, suppose there is a 𝖮𝖨-𝖰𝖢𝖬𝖠 verifier V that decides 𝖮𝖨-𝖫. We can then readily obtain a 𝖰𝖢𝖬𝖠 verifier for 𝖫𝒪. On input instance x and witness w, simulate V(x,𝒪n)(w) by answering queries to x with the bits of x, and queries to 𝒪n by forwarding the queries to 𝒪. If V decides membership in 𝖮𝖨-𝖫, this exactly decides if x𝖫𝒪.

We now turn to the other direction in the statement of Theorem 5. Assume that 𝖮𝖨-𝖰𝖢𝖬𝖠𝖮𝖨-𝖰𝖬𝖠. Let 𝒰 be the universe and 𝖮𝖨-𝖫𝒰 be the separating language, and V the 𝖮𝖨-𝖰𝖬𝖠 verifier for 𝖮𝖨-𝖫.

We construct our oracle 𝒪 and associated language L𝒪 as follows. 𝒪 will be interpreted as a countably-infinite family of oracles (𝒳ni)i+ for integers ni+. Let 𝒪j=(𝒳ni)ij. By padding the witness with 0’s size appropriately, we can assume that any potential 𝖰𝖢𝖬𝖠 verifier runs in quadratic time. Let T1,T2, be an enumeration over all oracle-aided quadratic-time quantum algorithms. 𝒪 and 𝖫𝒪 will be constructed by constructing 𝒳ni for i=1,2, as follows: Consider the 𝖮𝖨-𝖰𝖢𝖬𝖠 verifier Vi𝒳(w) which has 𝒪i1 hard-coded, and runs Ti𝒪i1,𝒳(w). Since 𝒪i1 is constant-sized, Vi𝒳(w) runs in quadratic time (though with a large constant overhead coming from 𝒪i1). Let ni be an integer and 𝒳ni𝒰ni be an instance such that both:

  • Vi incorrectly decides 𝒳ni given classical witnesses/inputs. That is, either 𝒳ni𝖮𝖨-𝖫 and Vi𝒳ni(w) rejects for all w, or 𝒳ni𝖮𝖨-𝖫 and there exists a w such that Vi𝒳ni(w) accepts.

  • ni is large enough so that the inputs to the function 𝒳ni are longer than the running time of Tj𝒪j on inputs of length nj for all j<i, meaning Tj𝒪j, and hence Vj, on inputs of length nj,j<i never query any input that is an input to 𝒳ni.

Such an 𝒳ni is guaranteed to exist: that some ni,𝒳ni exist satisfying the first criteria follows immediately from the fact that 𝖮𝖨-𝖫𝖮𝖨-𝖰𝖢𝖬𝖠. Suppose that there is no ni,𝒳ni satisfying the second criteria. This means there are only a finite number of 𝒳 where Vi fails to correctly decide. But by hard-coding these bad instances along with the correct solutions, we can obtain a new verifier Vi which correctly decides 𝖮𝖨-𝖫, contradicting that 𝖮𝖨-𝖫𝖰𝖢𝖬𝖠.

We then let 𝖫𝒪 consist of the strings 0ni such that 𝒳ni𝖮𝖨-𝖫. We immediately see that 𝖫𝒪𝖰𝖬𝖠𝒪: by making appropriate queries to 𝒪, we can simulate the 𝖮𝖨-𝖰𝖬𝖠 verifier V𝒳ni, thereby deciding membership of 0ni in 𝖮𝖨-𝖫.

We now show that 𝖫𝒪𝖰𝖢𝖬𝖠𝒪. Consider a supposed 𝖰𝖢𝖬𝖠 verifier V. This corresponds to some Ti according to our enumeration. Then we argue that V incorrectly decides membership for 0ni. Indeed, we know that Ti𝒪 in instance 0ni never queries on 𝒳nj for j>i, by our choice of nj. Hence, it can be simulated as Ti𝒪i, or equivalently Ti𝒪i1,𝒳ni. Thus, V corresponds exactly to the verifier Vi. But we know that Vi incorrectly decides membership for 𝒳ni. Hence, V is not a valid 𝖰𝖢𝖬𝖠 verifier.

References

  • [1] Scott Aaronson and Greg Kuperberg. Quantum versus classical proofs and advice. In Twenty-Second Annual IEEE Conference on Computational Complexity (CCC’07), pages 115–128, 2007. doi:10.1109/CCC.2007.27.
  • [2] Dorit Aharonov and Tomer Naveh. Quantum NP – A survey, 2002.
  • [3] Shalev Ben-David and Srijita Kundu. Oracle separation of QMA and QCMA with bounded adaptivity, 2024.
  • [4] Charles H. Bennett, Ethan Bernstein, Gilles Brassard, and Umesh Vazirani. Strengths and weaknesses of quantum computing. SIAM J. Comput., 26(5):1510–1523, October 1997. doi:10.1137/S0097539796300933.
  • [5] Bill Fefferman and Shelby Kimmel. Quantum vs. classical proofs and subset verification. In 43rd International Symposium on Mathematical Foundations of Computer Science (MFCS 2018), 2018. doi:10.4230/LIPIcs.MFCS.2018.22.
  • [6] Yassine Hamoudi and Frédéric Magniez. Quantum time-space tradeoff for finding multiple collision pairs. ACM Trans. Comput. Theory, April 2023. doi:10.1145/3589986.
  • [7] Xingjian Li, Qipeng Liu, Angelos Pelecanos, and Takashi Yamakawa. Classical vs quantum advice and proofs under classically-accessible oracle. In Venkatesan Guruswami, editor, ITCS 2024, volume 287, pages 72:1–72:19. LIPIcs, January / February 2024. doi:10.4230/LIPIcs.ITCS.2024.72.
  • [8] Qipeng Liu. Non-uniformity and quantum advice in the quantum random oracle model. In Carmit Hazay and Martijn Stam, editors, EUROCRYPT 2023, Part I, volume 14004 of LNCS, pages 117–143. Springer, Cham, April 2023. doi:10.1007/978-3-031-30545-0_5.
  • [9] Andrew Lutomirski. Component mixers and a hardness result for counterfeiting quantum money, 2011.
  • [10] Anand Natarajan and Chinmay Nirkhe. A distribution testing oracle separating qma and qcma. In Proceedings of the Conference on Proceedings of the 38th Computational Complexity Conference, CCC ’23, Dagstuhl, DEU, 2023. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. doi:10.4230/LIPIcs.CCC.2023.22.
  • [11] R. J. Serfling. Probability Inequalities for the Sum in Sampling without Replacement. The Annals of Statistics, 2(1):39–48, 1974. doi:10.1214/aos/1176342611.
  • [12] Terry Tao. 254a, notes 1: Concentration of measure. https://terrytao.wordpress.com/2010/01/03/254a-notes-1-concentration-of-measure/, 2010.
  • [13] Takashi Yamakawa and Mark Zhandry. Verifiable quantum advantage without structure. In 63rd FOCS, pages 69–74. IEEE Computer Society Press, October / November 2022. doi:10.1109/FOCS54457.2022.00014.
  • [14] Mark Zhandry. Secure identity-based encryption in the quantum random oracle model. In Reihaneh Safavi-Naini and Ran Canetti, editors, CRYPTO 2012, volume 7417 of LNCS, pages 758–775. Springer, Berlin, Heidelberg, August 2012. doi:10.1007/978-3-642-32009-5_44.