Optimal Randomized Clustering of Matrices
Abstract
If is a unitarily invariant normed space, i.e., for every matrix and every two orthogonal matrices , then we evaluate up to universal constant factors the smallest for which there is a probability distribution over partitions of into clusters of diameter at most yet for every two matrices the probability that they fall into distinct clusters is at most times the -distance between and . Specifically, we prove that this infimal , which is called the separation modulus of and is denoted , satisfies:
| (1) |
where is the -by- identity matrix and is the diameter with respect to the standard Euclidean metric on of the unit ball of . Our proof of (1) proceeds through an asymptotic evaluation of the spectral gap of the Laplacian with Dirichlet boundary conditions on , which we achieve by exact computations for a Jacobi orthogonal random matrix ensemble. Assuming oracle access to norm evaluations in , by combining (1) with a new deterministic algorithm for a -approximation of the diameter of convex bodies in that are given by a weak membership oracle and are symmetric with respect to coordinate permutations and reflections about the standard axes (this task is famously known to be impossible in the absence of such symmetries), we get an oracle polynomial time algorithm whose output is the separation modulus of up to universal constant factors. Another example of a consequence of (1) is that for each the separation modulus of the ’th Ky Fan norm on is bounded from above and from below by universal constant multiples of if , and of if . We also deduce from (1) an upper bound on the Lipschitz extension modulus of that improves over the previously best-known bound even in the special case when is equipped with the operator norm.
Keywords and phrases:
Clustering, Unitarily Invariant Matrix Norms, Oracle Polynomial Time Approximation Algorithms for Radii of Convex Bodies, Extension of Lipschitz Functions, Random Matrices, Spectrum of the Laplacian with Dirichlet Boundary Conditions, Reverse IsoperimetryFunding:
Assaf Naor: supported by NSF grant DMS-2453936, BSF grant 2018223, and a Simons Investigator award.Copyright and License:
2012 ACM Subject Classification:
Theory of computation Computational geometry ; Mathematics of computing Mathematical analysis ; Theory of computation Design and analysis of algorithmsEditors:
Hee-Kap Ahn, Michael Hoffmann, and Amir NayyeriSeries and Publisher:
Leibniz International Proceedings in Informatics, Schloss Dagstuhl – Leibniz-Zentrum für Informatik
1 Introduction
For , a metric space is said to admit a -separating random partition if for every there is a distribution over random partitions of into clusters of diameter at most with the property that for every two points the probability that and belong to distinct clusters is at most times the distance between and . The smallest for which this is possible is called the separation modulus of and it is denoted .
Separating random partitions are a well studied clustering primitive which was introduced and investigated in [10] (precursors that considered it implicitly, with a variety of applications, appear in [49, 7, 1, 40]); see e.g. [54, 55] for more on the history. By [10], every -point metric space satisfies , and there are metric spaces for which this bound is sharp. In [45], a randomized polynomial time algorithm was designed that takes as input a finite metric space and outputs a factor approximation to . See [11, 20, 41, 31, 46, 24, 47, 45, 8, 54, 55, 43, 56, 44, 57] for an indication of the literature on this topic. The investigation of separating random partitions of finite-dimensional normed spaces, which is what we study herein, originates in [58], motivated by applications to network routing and distributed computing. The work [20] sharpened and generalized the bounds of [58], and influenced later research, e.g. [47, 4, 55]; similar partitioning schemes appeared implicitly in the earlier work [37] on SDP-based algorithms for graph colorings. Applications of separating random partitions to pure mathematics have also been found, notably to metric embeddings [11, 24, 56] and extension of vector-valued Lipschitz functions [47, 55].
In Theorem 1 below we obtain an asymptotic formula (up to universal constant factors) for the separation modulus of equipped with an arbitrary unitarily invariant matrix norm;111Formally, when dealing with infinite metric spaces (in particular, in the case of unitarily invariant matrix norms that we study herein), one must impose some measurability requirement for the definition of the separation modulus to make sense. At the very least, one has to demand that for every the aforementioned event “ and belong to distinct clusters” is measurable with respect to the underlying probability measure on the space of partitions of . For the purpose of the present article, it suffices to assume this “minimal” measurability. However, it is beneficial for applications to impose stronger measurability assumptions; such a foundational treatment of random partitions of infinite spaces has been carried out in [47, 55]. One of the applications of Theorem 1 is to deduce an improved extension result for Lipschitz functions (Theorem 2 below), for which the aforementioned stronger measurability assumptions are needed. However, this will be achieved by substituting the ensuing reasoning into the framework of [55], which is shown in [55] to indeed yield the desired measurability. Thus, we do not need to recall stronger measurability requirements as they do not directly pertain to the ensuing discussion. Alternatively, our results are meaningful and new even if one only treats random partitions of finite subsets of equipped with a unitarily invariant matrix norm rather than random partitions of all of , a setting to which measurability considerations are irrelevant. we will spell out all of its (standard) notation and terminology right after stating it:
Theorem 1.
Let be a unitarily invariant normed space. Then222In addition to the usual notation, we will use throughout this text the following conventions for asymptotic notation: Given , by writing or we mean that for some universal constant , and stands for ; when we will need to allow for dependence on parameters, we will indicate it by subscripts.
| (2) |
where is the diameter with respect to the standard Euclidean metric on of the unit ball of , and is the -by- identity matrix.
A norm on the space of -by- matrices with real entries is said to be unitarily invariant if for every and every two matrices that belong to the orthogonal group . Norms with this property [71, 64] form a rich class of ways to measure the size of matrices in an intrinsic manner that does not depend on the choice of orthogonal bases of with respect to which the matrix representation of the corresponding linear operator is formed. As such, unitarily invariant norms are of great importance and utility to a wide range of disciplines, ranging from multiple areas of pure mathematics and theoretical physics, to algorithm design, signal processing, quantum information theory, numerical linear algebra, shape analysis and imaging, statistics, machine learning and data analysis; we point to this selection [73, 50, 75, 13, 67, 62, 32, 28, 22, 59, 70, 69, 72, 63, 68] of sources for part of the massive and varied literature on this (examining the references therein and those that arise from internet search leads to a cornucopia of additional relevant works).
Non-examples of unitarily invariant norms on matrices include those that consider a matrix to merely be a collection of numbers, e.g., the norms
| (3) |
for ; such measurements of the size of a matrix are of course highly valuable even though they ignore the operator meaning of the arrangement of those numbers as an -by- array, and they are not what we study herein (for the aforementioned norm, the separation modulus has been evaluated up to universal constant factors in [20] when and in [55] when ). Examples of unitarily invariant norms include the Schatten von-Neumann trace class for every , which are given by setting
where are the singular values of , i.e., they are the (decreasing rearrangement of the) eigenvalues of the positive semidefinite matrix . If , then coincides with the space of -by- matrices equipped with their operator (a.k.a. spectral) norm, when they are viewed as linear operators from to itself, i.e.,
where denotes the unit ball of a normed space . Often is called the nuclear norm on , and is the standard Euclidean (a.k.a. Hilbert–Schmidt or Frobenius) norm on , i.e., it coincides with the case of (3). Additional examples are furnished [25] by the Ky Fan norms that are defined by:
| (4) |
More generally, let be a symmetric normed space, i.e., the following requirement holds for every vector , every choice of permutation , and every choice of signs :
| (5) |
The unitary ideal of is defined to be equipped with the norm that is given by:
| (6) |
A norm on is unitarily invariant iff there is a symmetric norm on such that ; see e.g. [53] or [12, Chapter IV] for a justification of this classical fact.
The novel content of Theorem 1 is the upper bound on in (2), i.e., Theorem 1 provides an improved randomized clustering of . The matching impossibility result is due to [55, Corollary 79], where it was proved that in the setting of Theorem 1. Therefore, what Theorem 1 achieves is removing the last redundant unbounded lower-order factor, thus obtaining an asymptotic evaluation of that is optimal up universal constant factors.
For the operator norm, the aforementioned bounds from [55] are , and these were the previously best-known estimates on . By Theorem 1, we now know that .
As another example, it is straightforward to check from (4) that for each the -diameter of the unit ball of the ’th Ky Fan norm equals , so Theorem 1 demonstrates that is bounded from above and from below by positive universal constant multiples of if , and of if , thus providing an interpolation between the operator norm and the nuclear norm that somewhat curiously stabilizes (up to universal constant factors) at .
Theorem 1 implies progress on the important and extensively studied classical topic of extending vector-valued Lipschitz functions; see e.g. [19, 55] and the references therein. The Lipschitz extension modulus of a metric space , denoted or simply when the underlying metric is clear from the context, is the infimum over those such that for every subset , every Banach space , and every -Lipschitz function , there exists an -Lipschitz function whose restriction to coincides with . By [47] we have , and the forthcoming work [15] demonstrates that , so if and only if . A substitution of the former upper bound on provides the following extension theorem:
Theorem 2.
If is a unitarily invariant normed space, then:
The special case of Theorem 2 asserts that for every subset of and every Banach space , if is -Lipschitz with respect to the operator norm (and the given norm on the target ), then it can be extended to a -valued function that is defined on all of and is -Lipschitz with respect to the operator norm, where . The previously best-known [55] upper bound on here was , and the corresponding best impossibility result that is currently available [55] is that there exist suitably chosen as above for which necessarily . Thus, we now know that:
| (7) |
Problem 3.
It remains an interesting open question to determine the growth rate of as . For that matter, there is no unitarily invariant normed space for which the value of is known up to factors, or even up to lower-order factors. Since , Theorem 2 does not provide an upper bound on that is . At the same time, the general lower bound on in [55, Theorem 96] is at most , since the Banach–Mazur distance between and an -dimesnional Hilbert space is at most , as seen by applying John’s theorem [33] to the symmetric space for which . Thus, the bounds in (7) are the best one could hope for using the current state of the art even when is replaced by any unitarily invariant norm on . It seems that a substantial new idea will be needed in order to improve either the upper or lower estimate in (7).
As another application of Theorem 1, if we are given oracle access to (approximate) norm computations in a unitarily invariant normed space , then we obtain a (deterministic) algorithm that evaluates its separation modulus up to universal constant factors in oracle polynomial time.333A weak membership oracle suffices here (one can obtain from such a membership oracle a norm evaluation oracle by binary search of possible upper bounds on the norm of the queried vector). See [30] for the relevant (standard) background in algorithmic convex geometry. In particular, “oracle polynomial time” means that the algorithm consists of a binary Turing machine that is augmented by the given oracle, and its running time is polynomial in the usual sense, with the understanding that the time required by each call to the oracle is only what is needed to write the question onto, and read the answer from, a tape of the Turing machine. Thus, here we demand that the algorithm outputs a number that is guaranteed to be bounded from above and from below by positive universal constant multiples of , yet it performs only norm evaluations.
Theorem 1 reduces the above task to devising an algorithm that outputs a -factor approximation to in oracle polynomial time. Write for a symmetric normed space . The -diameter of is equal to the diameter of in . And, has the desired oracle if and only if does.444We will use here only the trivial direction of this equivalence, which is simply restricting the oracle for to diagonal matrices. The reverse direction incurs the - time overhead of computing the singular values of the query matrix. So, the goal is obtaining an oracle polynomial time -factor approximation algorithm to .
A reduction to efficient Euclidean diameter estimation should give one pause, as the latter task cannot be achieved for general convex bodies, i.e., there is no oracle polynomial time algorithm that outputs a -factor approximation to the -diameter of an arbitrary convex body in that is given by a weak membership oracle; for deterministic algorithms, this impossibility result was proved in [9], and randomized algorithms were ruled out in [17, 18]. Such hardness of approximation is also proved in [18] for the problem of computing the diameter in for every (see Remark 10 below for a description of the known inapproximability factors). Nevertheless, in the presence of additional symmetries, we will prove the following theorem, which yields the aforementioned algorithm for approximating using Theorem 1:
Theorem 4.
For every , and , there is satisfying
| (8) |
such that for every there exists a deterministic algorithm that takes as input and a symmetric normed space whose unit ball is given by a weak membership oracle and satisfies
| (9) |
The algorithm outputs in oracle time a number that satisfies
| (10) |
1.1 Reverse Faber–Krahn
The new ingredient of our proof of Theorem 2 is an asymptotic evaluation of the spectral gap of the Laplacian with Dirichlet boundary conditions on the unit ball of any unitarily invariant norm . We will next describe this; all of the relevant (classical and rudimentary) background on the spectral properties of the Dirichlet Laplacian can be found in [60, 21].
Fix . For a bounded domain , let be the smallest such that there exists a function that is smooth on the interior of , vanishes on the boundary of , and satisfies on the interior of , where is the standard Laplacian on . Set for each normed space . Here, we obtain the following result:
Theorem 5.
Every unitarily invariant normed space satisfies:
| (11) |
In the setting of Theorem 5, the following asymptotic equivalence is a different way to express (11):
| (12) |
where for and the -dimensional Hausdorff measure on is denoted ; the only values of that occur herein are (Lebesgue measure and surface area measure, respectively). To see that (12) and (11) coincide, note that and by [65, equation (2.2)] we have:
| (13) |
The Faber–Krahn inequality [23, 42] (originally conjectured in [61]) states that the left hand side of (12) is minimized when is replaced by the unit ball of the standard Euclidean metric (in our case , though the analogous statement holds if is replaced by of any dimension). By a direct computation (see e.g. [55, page 32]), this classical extremal statement implies that the left hand side of (12) is bounded from below by a positive universal constant multiple of .
The new content of (12) is thus the reverse inequality, i.e., the estimate in Theorem 5. This confirms for (unit balls of) unitarily invariant matrix norms the following much more general (and still open) reverse Faber–Krahn phenomenon that was conjectured in [55]:
Conjecture 6 (reverse Faber–Krahn).
For every origin-symmertric convex body (thus, if and only if ) there exists a volume-preserving linear transformation with .
1.2 Weak isomorphic reverse isoperimetry
It was proved in [55] that Theorem 5 implies Theorem 1. The link between these two results is Theorem 7 below. For its formulation, recall that the isoperimetric quotient of a convex body is defined to be .
Theorem 7.
For every , if is a unitarily invariant normed space, then there exists an origin-symmetric convex body such that:
| (14) |
It was proved in [55, Section 1.6.2] that for each unitarily invariant normed space , the validity of Theorem 5 for is equivalent to the validity of Theorem 7 for ; see specifically the explanation why [55, Conjecture 49] and [55, Conjecture 50] are equivalent that appears in [55, page 43], for which equation (1.62) of [55] is crucial input, as well as the convexity and uniqueness of the so-called Cheeger body (see page 31 of [55]), per [2]. Therefore, by proving Theorem 5 we will also establish Theorem 7, but we will next briefly explain the meaning of Theorem 7 and its utility for proving Theorem 1.
For , the isoperimetric theorem implies that the isoperimetric quotient of a convex body is at least the isoperimetric quotient of the -ball. Direct computation shows that the latter is bounded from above and from below by positive universal constant multiples of . Thus, Theorem 7 says that one can inscribe in an origin-symemtric convex body that is large in the sense that the first inequality in (14) holds, yet its isoperimetric quotient is as small as possible up to universal constant factors, i.e., has the same order of magnitude as the isoperimetric quotient of the Hilbert–Schmidt unit ball in . This confirms for (unit balls of) unitarily invariant matrix norms the following much more general (and still open) phenomenon that was conjectured in [55]:
Conjecture 8 (weak isomorphic reverse isoperimetry).
555The adjective “weak” was used in [55] to describe this conjecture because in [55] a stronger phenomenon was also conjectured; we do not need to recall that stronger conjecture because the present work does not address it, and furthermore its weaker variant that we establish herein suffices for proving Theorem 1.For every origin-symmetric convex body there exist and an origin-symmetric convex body that satisfies:
Analogously to the discussion in Section 1.1, Theorem 7 demonstrates that Conjecture 8 holds for any unitarily invariant norm on with the matrix being the identity on ; this too was conjectured in [55] (see specifically Conjecture 49 there).
By [55], the upper bound on of Theorem 1 (which, as we explained earlier, is the part of Theorem 1 that remained to be proved because the matching lower bound is due to [55]) follows from Theorem 7; specifically, combine [55, Corollary 79] with equation (2.2) of [65], which is reproduced as equation (6.131) in [55]. The resulting construction in [55] of the random partition of can be illustrated informally as follows. Let be the auxiliary convex body that Theorem 1 provides. Iteratively remove random translates666One must define a suitable distribution of those random shifts here; for the purpose of the present sketch, one could aim instead to obtain a separated partition of an arbitrarily large bounded domain in , in which case the shifts can be chosen Lebesgue-uniformly at random. of from ; this yields almost surely a random partition of into sets (translates of minus the union of those translates from the preceding steps of this random iterative removal) that are of -diameter at most , as , and [55] demonstrates that the desired estimate on the separation probability holds thanks to the upper bound on the isoperimetric quotient of in (14).
Remark 9.
While the above procedure yields a random partition of whose separation modulus is optimal up to universal constant factors, it is not entirely constructive. From the algorithmic perspective it suffices to bound from above, per Theorem 4 and the discussion that precedes its statement, as by [45] there is a randomized polynomial time algorithm that takes as input any finite subset of and outputs a -separating partition of . One could hope to extract more algorithmic information by assuming that has a weak membership oracle and aiming to obtain a convex body as in Theorem 1 which also has a weak membership oracle that is allowed to make calls to the oracle of and additional Turing machine operations. We do not currently have this because the body of Theorem 1 is defined implicitly as the solution of a variational problem. We expect that the aforementioned task could be achieved by computing in oracle polynomial time a sufficiently good approximation to the first nontrivial eigenfunction of the Dirichlet Laplacian on , i.e., is smooth on the interior of , it vanishes on , and point-wise. By [14] we know that is a log-concave function, whence its sub-level sets are convex. We could then repeat the above procedure with replaced a suitable sub-level set of . We conjecture that this will yield an optimal separating partition of (a large bounded domain of) , and it remains open to implement the above strategy efficiently.
The above proposal is an (especially interesting) instance of a general program to estimate efficiently (in oracle polynomial time) solutions of geometrically meaningful partial differential equations; another important example is the first nontrivial eigenfunction of the Laplacian on a convex body with Neumann boundary conditions, which controls the Kannan–Lovász–Simonovits conjecture [36]; see [52, 48].
2 Proof of Theorem 5
Proof.
Fix . It was proved in [55, Remark 172] that if Theorem 7 holds for , then Theorem 7 holds for every unitarily invariant normed space . By the equivalence of Theorem 5 and Theorem 7 that was proved in [55] and we discussed in Section 1.2, it therefore suffices to prove Theorem 5 when , where we recall that is equipped with the operator norm. So, our goal in the rest of this section will be to demonstrate that . Only the upper bound
| (15) |
remains to be proved, thanks to the Faber–Krahn inequality, as we explained in Section 1.1.
For every define a function by setting:
| (16) |
Then, is smooth (in fact, it is a polynomial in the entries of ), and the second equality in (16) makes it evident that vanishes on . The standard (see e.g. [21]) Rayleigh quotient characterization of the smallest nonzero Dirichlet eigenvalue of therefore gives:
| (17) |
Theorem 5 will thus be proven if we will evaluate exactly the right hand side of (17) as follows:
| (18) |
Indeed, the right hand side of (18) is bounded from above and from below by positive universal constant multiples of . Therefore, up to universal constant factors setting minimizes the right hand side of (18). For this choice of , the Rayleigh quotient estimate (17) becomes , which is our current goal (15). Observe that the above reasoning shows that any choice of other than does not yield the desired estimate (15) . The rest of this section will be devoted to establishing (18).
Given , we will denote by the following (Vendermunde determinant) function:
| (19) |
Define a probability density by setting:
| (20) |
where denotes the normalization factor such that , i.e.,
| (21) |
The second equality in (21) is a special case of the classical Selberg integral formula [66]. The parameter is commonly denoted in the literature (see e.g. [27]) as for the setting of parameters ; using the ad hoc shorter notation is beneficial here since we will not need to consider probability densities other than . Also, we chose to use the letter for the probability density on in (20) to indicate that it belongs to the -parameter family of densities of Jacobi random -by- matrix ensembles; specifically, using the parametrization of [3, equation (4.1.5)], the relevant setting of parameters in the present case are .
There exists such that for every Borel-measurable function that is invariant under permutations of the coordinates, i.e., for every permutation and every point , the following identity holds:
| (22) |
(22) is a special case of the Weyl integration formula [74]; see e.g. [3, Proposition 4.1.3]. The exact value of the parameter will not have any role in the ensuing reasoning (it will cancel out in our computations), but it is worthwhile to note in passing that ; see e.g. [26] for much more on such matters. Thanks to (22), the denominator in the left hand side of (18) can be evaluated as follows:
| (23) |
where for the last step of (23) we applied the change of variable , whose Jacobian is .
We need to understand the Hilbert–Schmidt norm of the gradient of . For this, as a special case of [51, Theorem 7.1] we see that if we define by
| (24) |
then for any matrix in the interior of there are such that
By substituting the definition (24) of , we thus have:
Since and are orthogonal matrices, we therefore have:
| (25) |
Consequently, the numerator in the left hand side of (18) can be evaluated as follows:
| (26) | ||||
where the second step of (26) makes the same change of variable as above. By combining (23) and (26) we obtain the following expression for the Rayleigh quotient in (18):
| (27) | ||||
To evaluate the right hand side of (27), consider the following symmetric polynomial :
| (28) |
where in (28), and throughout, we use the common notation . Thus,
| (29) | ||||
The final integral that appears in (29) can be evaluated as follows:
| (30) |
where the second equality that appears in (30) is an instantiation of the Aomoto integral formula [6] (see also e.g. [5, Theorem 8.1.2]). To evaluate the integral that appears in the left hand side of (29), observe that the polynomial that is defined in (28) coincides with the Jack polynomial that is denoted in [27] by , where and is the vector in whose first coordinates equal and the whose last coordinate equals ; this is seen by substituting the aforementioned parameters into equations (3.2) and (3.10) of [27]. The Kadell integral formula [35], which appears in [27] as equation (3.13) thus gives:
| (31) |
The first integral that appears in the right hand side of (27) is therefore evaluated as follows:
| (32) | ||||
Now, the second integral that appears in the right hand side of (27) can be evaluated as follows:
| (33) |
where the second step of (33) is another instantiation of the Aomoto integral formula. The desired identity (18) follows by substituting (32) and (33) into (27), and then simplifying the resulting expression.
3 Proof of Theorem 4
Proof.
Observe that every satisfies the following estimate:
| (34) | ||||
where the penultimate step of (34) is an application of the covexity of . Furthermore:
| (35) |
where the first step of (35) is an application of the triangle inequality for and last step of (35) is an application of Cauchy–Schwarz. Therefore:
| (36) |
Using the terminology of [30], the inclusions (36) mean that is well–bounded and centered. Since in Theorem 4 we are assuming that is given by a weak membership oracle, the Judin–Nemirovskiĭ theorem [34] (see [30, Section 4.3]), which is a striking application of the Shallow-Cut Ellipsoid Method [34] (see [30, Section 3.3]), implies it is possible to optimize linear functionals efficiently on . In particular, since the dual norm is given by for every , where denotes the standard scalar product on , it follows that there is an algorithm which takes as input and outputs in oracle time that is polynomial in both and a number that is guaranteed to satisfy the following estimates:
| (37) |
Define if , and if . By [29, Lemma 2], if we denote
| (38) |
then for every there exists a subset of such that:
| (39) |
i.e., is -dense in with respect to the norm, yet its size satisfies:
| (40) |
So, by (40) for fixed the size of grows like a fixed power of , in marked contrast to the fact (which is a straightforward consequence of volume comparison) that every -dense subset of a unit ball of an -dimensional normed space must have size at least .
The algorithm of Theorem 4 evaluates for each and outputs the number:
| (41) |
The oracle running time of this simple procedure is a polynomial in both and times the size of , so by (40) it is at most where the degree satisfies the desired bound (8). Furthermore:
| (42) |
Since is a subset of , this implies in particular that the following a priori upper bound on the output of holds, which gives the second inequality in the desired conclusion (10) of Theorem 4:
Define by:
| (43) | ||||
Then, is -dense in . Indeed, for each fix a permutation such that . Denoting for each , the vector belongs , by (39). Now, use (39) to get a point with , so that the point belongs to by (43), and satisfies .
Observe that the convex hull of satisfies the following inclusion:
| (44) |
In fact, more generally, for any normed space , if is -dense in with respect to the metric induced by , then . Indeed, suppose contrapositively that there exists . Then, by the separation theorem we can fix with such that for every . By the Hahn–Banach theorem, we can fix such that . Finally, because is -dense in , we can fix such that . We now arrive at the desired contradiction as follows:
| (45) |
where the second and the penultimate steps of (45) use the fact that has norm as a linear functional in , the first step of (45) uses the assumption , the third step of (45) uses the assumed property of the separating functional for , and the final step of (45) uses the choice of .
| (46) | ||||
| (47) | ||||
where (46) is the step in which the assumption that is a symmetric norm is used, as this implies (by definition) that its dual is also a symmetric norm, and (47) holds since is a convex function.
Remark 10.
In the Introduction we stated the contrast between Theorem 4 and the known nonexistence of any oracle polynomial time algorithm that computes a -factor approximation to the -diameter of an arbitrary (so, not necessarily symmetric, as in Theorem 4) convex body in that is given by a weak membership oracle, where is fixed. This contrast is even more severe because the known impossibility results rule out approximation factors that tend to with , as we will next recall.
For , and , let be the smallest for which there is a deterministic algorithm that takes as input a convex body given by a weak membership oracle, and outputs in oracle time at most a number satisfying . Similarly, let denote the smallest for which there is a randomised algorithm that outputs in oracle time at most a number satisfying with probability at least, say, .
Using the above notations, for we have ; when these bounds on are due to [9], and these bounds for both and , and arbitrary , are due to [17, 18]. If , then by [38, 39], improving by unbounded polylog factor over the corresponding bounds of [17, 18]. For deterministic algorithms, when we have by [17, 18], and the best-known lower bound is , which follows from the trivial lower bound and the aforementioned asymptotic evaluation of . Thus, for fixed there remains a gap of , which tends to with , between the best-known upper and lower bounds on the deterministic approximation ratio . While it seems reasonable to expect that this gap (noted in [17, 18, 16]) could be closed using available methods, to the best of our knowledge this has not yet been carried out, even though it would be worthwhile to do so.
References
- [1] Noga Alon, Richard M. Karp, David Peleg, and Douglas B. West. A graph-theoretic game and its application to the -server problem (extended abstract). In On-Line Algorithms, Proceedings of a DIMACS Workshop, New Brunswick, New Jersey, USA, February 11-13, 1991, pages 1–10, 1991. doi:10.1090/DIMACS/007/01.
- [2] François Alter and Vicent Caselles. Uniqueness of the Cheeger set of a convex body. Nonlinear Anal., 70(1):32–44, 2009. doi:10.1016/j.na.2007.11.032.
- [3] Greg W. Anderson, Alice Guionnet, and Ofer Zeitouni. An introduction to random matrices, volume 118 of Cambridge Studies in Advanced Mathematics. Cambridge University Press, Cambridge, 2010.
- [4] Alexandr Andoni and Piotr Indyk. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS 2006), 21-24 October 2006, Berkeley, California, USA, Proceedings, pages 459–468, 2006. doi:10.1109/FOCS.2006.49.
- [5] George E. Andrews, Richard Askey, and Ranjan Roy. Special functions, volume 71 of Encyclopedia of Mathematics and its Applications. Cambridge University Press, Cambridge, 1999. doi:10.1017/CBO9781107325937.
- [6] K. Aomoto. Jacobi polynomials associated with Selberg integrals. SIAM J. Math. Anal., 18(2):545–549, 1987. doi:10.1137/0518042.
- [7] Baruch Awerbuch and David Peleg. Sparse partitions (extended abstract). In 31st Annual Symposium on Foundations of Computer Science, St. Louis, Missouri, USA, October 22-24, 1990, Volume II, pages 503–513, 1990. doi:10.1109/FSCS.1990.89571.
- [8] Nikhil Bansal, Uriel Feige, Robert Krauthgamer, Konstantin Makarychev, Viswanath Nagarajan, Joseph Naor, and Roy Schwartz. Min-max graph partitioning and small set expansion. SIAM J. Comput., 43(2):872–904, 2014. doi:10.1137/120873996.
- [9] Imre Bárány and Zoltán Füredi. Computing the volume is difficult. Discrete Comput. Geom., 2(4):319–326, 1987. doi:10.1007/BF02187886.
- [10] Yair Bartal. Probabilistic approximation of metric spaces and its algorithmic applications. In Proceedings of 37th Conference on Foundations of Computer Science, pages 184–193. IEEE, 1996. doi:10.1109/SFCS.1996.548477.
- [11] Yair Bartal. On approximating arbitrary metrices by tree metrics. In STOC ’98 (Dallas, TX), pages 161–168. ACM, New York, 1999.
- [12] Rajendra Bhatia. Matrix analysis, volume 169 of Graduate Texts in Mathematics. Springer-Verlag, New York, 1997. doi:10.1007/978-1-4612-0653-8.
- [13] Stephen Boyd and Lieven Vandenberghe. Convex Optimization. Cambridge University Press, Cambridge, 2004.
- [14] Herm Jan Brascamp and Elliott H. Lieb. On extensions of the Brunn-Minkowski and Prékopa-Leindler theorems, including inequalities for log concave functions, and with an application to the diffusion equation. J. Functional Analysis, 22(4):366–389, 1976. doi:10.1016/0022-1236(76)90004-5.
- [15] Mark Braverman and Assaf Naor. Quantitative Wasserstein rounding. Preprint, 2025.
- [16] Andreas Brieden. Geometric optimization problems likely not contained in . Discrete Comput. Geom., 28(2):201–209, 2002. doi:10.1007/s00454-002-2756-x.
- [17] Andreas Brieden, Peter Gritzmann, Ravi Kannan, Victor Klee, László Lovász, and Miklós Simonovits. Approximation of diameters: Randomization doesn’t help. In 39th Annual Symposium on Foundations of Computer Science, FOCS 1998, Palo Alto, California, USA, November 8-11, 1998, pages 244–251. IEEE Computer Society, 1998. doi:10.1109/SFCS.1998.743451.
- [18] Andreas Brieden, Peter Gritzmann, Ravindran Kannan, Victor Klee, László Lovász, and Miklós Simonovits. Deterministic and randomized polynomial-time approximation of radii. Mathematika, 48(1-2):63–105, 2001. doi:10.1112/S0025579300014364.
- [19] Alexander Brudnyi and Yuri Brudnyi. Methods of geometric analysis in extension and trace problems. Volume 2, volume 103 of Monographs in Mathematics. Birkhäuser/Springer Basel AG, Basel, 2012.
- [20] M. Charikar, C. Chekuri, A. Goel, S. Guha, and S. Plotkin. Approximating a finite metric by a small number of tree metrics. In Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280), pages 379–388, 1998. doi:10.1109/SFCS.1998.743488.
- [21] Isaac Chavel. Eigenvalues in Riemannian geometry, volume 115 of Pure and Applied Mathematics. Academic Press, Inc., Orlando, FL, 1984. Including a chapter by Burton Randol, With an appendix by Jozef Dodziuk.
- [22] John P. Cunningham and Zoubin Ghahramani. Linear dimensionality reduction: Survey, insights, and generalizations. Journal of Machine Learning Research, 16(89):2859–2900, 2015. doi:10.5555/2789272.2912091.
- [23] G. Faber. Beweis, daß unter allen homogenen Membranen von gleicher Fläche und gleicher Spannung die kreisförmige den tiefsten Grundton gibt. Münch. Ber. 1923, 169-172 (1923)., 1923.
- [24] Jittat Fakcharoenphol, Satish Rao, and Kunal Talwar. A tight bound on approximating arbitrary metrics by tree metrics. J. Comput. System Sci., 69(3):485–497, 2004. doi:10.1016/j.jcss.2004.04.011.
- [25] Ky Fan. Maximum properties and inequalities for the eigenvalues of completely continuous operators. Proc. Nat. Acad. Sci. U.S.A., 37:760–766, 1951. doi:10.1073/pnas.37.11.760.
- [26] P. J. Forrester. Log-gases and random matrices, volume 34 of London Mathematical Society Monographs Series. Princeton University Press, Princeton, NJ, 2010. doi:10.1515/9781400835416.
- [27] Peter Forrester and Ole Warnaar. The importance of the Selberg integral. Bulletin of the American Mathematical Society, 45:489–534, October 2008. doi:10.1090/S0273-0979-08-01221-4.
- [28] Gene H. Golub and Charles F. Van Loan. Matrix Computations. Johns Hopkins University Press, Baltimore, MD, 4 edition, 2013.
- [29] W. T. Gowers. Symmetric block bases in finite-dimensional normed spaces. Israel J. Math., 68(2):193–219, 1989. doi:10.1007/BF02772661.
- [30] Martin Grötschel, László Lovász, and Alexander Schrijver. Geometric algorithms and combinatorial optimization, volume 2 of Algorithms and Combinatorics. Springer-Verlag, Berlin, second edition, 1993. doi:10.1007/978-3-642-78240-4.
- [31] Anupam Gupta, Robert Krauthgamer, and James R. Lee. Bounded geometries, fractals, and low-distortion embeddings. In 44th Symposium on Foundations of Computer Science (FOCS 2003), 11-14 October 2003, Cambridge, MA, USA, Proceedings, pages 534–543, 2003. doi:10.1109/SFCS.2003.1238226.
- [32] Roger A. Horn and Charles R. Johnson. Matrix Analysis. Cambridge University Press, Cambridge, 2 edition, 2012.
- [33] Fritz John. Extremum problems with inequalities as subsidiary conditions. In Studies and Essays Presented to R. Courant on his 60th Birthday, January 8, 1948, pages 187–204. Interscience Publishers, Inc., New York, N. Y., 1948.
- [34] D. B. Judin and A. S. Nemirovskiĭ. Informational complexity and effective methods for the solution of convex extremal problems. Èkonom. i Mat. Metody, 12(2):357–369, 1976.
- [35] Kevin W. J. Kadell. The Selberg-Jack symmetric functions. Adv. Math., 130(1):33–102, 1997. doi:10.1006/aima.1997.1642.
- [36] R. Kannan, L. Lovász, and M. Simonovits. Isoperimetric problems for convex bodies and a localization lemma. Discrete Comput. Geom., 13(3-4):541–559, 1995. doi:10.1007/BF02574061.
- [37] David Karger, Rajeev Motwani, and Madhu Sudan. Approximate graph coloring by semidefinite programming. J. ACM, 45(2):246–265, 1998. doi:10.1145/274787.274791.
- [38] Subhash Khot and Assaf Naor. Linear equations modulo 2 and the diameter of convex bodies [extended abstract]. In 48th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2007, Providence, RI, USA, October 20-23, 2007, Proceedings, pages 318–328. IEEE Computer Society, 2007. doi:10.1109/FOCS.2007.20.
- [39] Subhash Khot and Assaf Naor. Linear equations modulo 2 and the diameter of convex bodies. SIAM J. Comput., 38(4):1448–1463, 2008. doi:10.1137/070691140.
- [40] Philip N. Klein, Serge A. Plotkin, and Satish Rao. Excluded minors, network decomposition, and multicommodity flow. In Proceedings of the Twenty-Fifth Annual ACM Symposium on Theory of Computing, May 16-18, 1993, San Diego, CA, USA, pages 682–690, 1993. doi:10.1145/167088.167261.
- [41] Goran Konjevod, R. Ravi, and F. Sibel Salman. On approximating planar metrics by tree metrics. Inform. Process. Lett., 80(4):213–219, 2001. doi:10.1016/S0020-0190(01)00161-2.
- [42] E. Krahn. Über Minimaleigenschaften der Kugel in drei und mehr Dimensionen. Acta Univ. Dorpat A 9, 1-44 (1926)., 1926.
- [43] Robert Krauthgamer and Nir Petruschka. Lipschitz decompositions of finite metrics. In Oswin Aichholzer and Haitao Wang, editors, 41st International Symposium on Computational Geometry, SoCG 2025, June 23-27, 2025, Kanazawa, Japan, volume 332 of LIPIcs, pages 66:1–66:14. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2025. doi:10.4230/LIPIcs.SOCG.2025.66.
- [44] Robert Krauthgamer, Nir Petruschka, and Shay Sapir. The Power of Recursive Embeddings for Metrics. To appear in 66th IEEE Symposium on Foundations of Computer Science (FOCS 2025). Preprint available at https://arxiv.org/pdf/2503.18508, 2025.
- [45] Robert Krauthgamer and Tim Roughgarden. Metric clustering via consistent labeling. Theory Comput., 7:49–74, 2011. doi:10.4086/toc.2011.v007a005.
- [46] J. R. Lee and A. Naor. Metric decomposition, smooth measures, and clustering. Unpublished manuscript, available at https://web.math.princeton.edu/˜naor/homepage%20files/cluster.pdf, 2003.
- [47] James R. Lee and Assaf Naor. Extending Lipschitz functions via random metric partitions. Invent. Math., 160(1):59–95, 2005. doi:10.1007/s00222-004-0400-5.
- [48] Yin Tat Lee and Santosh S. Vempala. The Kannan-Lovász-Simonovits conjecture. In Current developments in mathematics 2017, pages 1–36. Int. Press, Somerville, MA, 2019.
- [49] Frank Thomson Leighton and Satish Rao. An approximate max-flow min-cut theorem for uniform multicommodity flow problems with applications to approximation algorithms. In 29th Annual Symposium on Foundations of Computer Science, White Plains, New York, USA, 24-26 October 1988, pages 422–431, 1988. doi:10.1109/SFCS.1988.21958.
- [50] Adrian S. Lewis. The convex analysis of unitarily invariant matrix functions. Journal of Convex Analysis, 2(1-2):173–183, 1995.
- [51] Adrian S. Lewis and Hristo S. Sendov. Nonsmooth analysis of singular values. part i: Theory. Set-Valued Analysis, 13:213–241, 2005. URL: https://api.semanticscholar.org/CorpusID:36823342.
- [52] Emanuel Milman. On the role of convexity in isoperimetry, spectral gap and concentration. Invent. Math., 177(1):1–43, 2009. doi:10.1007/s00222-009-0175-9.
- [53] L. Mirsky. Symmetric gauge functions and unitarily invariant norms. Quart. J. Math. Oxford Ser. (2), 11:50–59, 1960. doi:10.1093/qmath/11.1.50.
- [54] Assaf Naor. Probabilistic clustering of high dimensional norms. In Proceedings of the Twenty-Eighth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 690–709. SIAM, Philadelphia, PA, 2017. doi:10.1137/1.9781611974782.44.
- [55] Assaf Naor. Extension, separation and isomorphic reverse isoperimetry, volume 11 of Memoirs of the European Mathematical Society. European Mathematical Society (EMS), Berlin, 2024. doi:10.4171/mems/11.
- [56] Assaf Naor and Kevin Ren. Euclidean embedding, randomized clustering, and Lipschitz extension for finite and doubling subsets of when . Preprint available at https://arxiv.org/pdf/2410.21931, 2025.
- [57] Assaf Naor and Kevin Ren. Optimal randomized clustering for subsets of when . To appear in 37th ACM-SIAM Symposium on Discrete Algorithms (SODA 2026), 2026.
- [58] David Peleg and Eilon Reshef. Deterministic polylog approximation for minimum communication spanning trees (extended abstract). In Automata, languages and programming (Aalborg, 1998), volume 1443 of Lecture Notes in Comput. Sci., pages 670–681. Springer, Berlin, 1998. doi:10.1007/BFb0055092.
- [59] Michal Pešta. Unitarily invariant errors-in-variables estimation. Statistical Papers, 57:1041–1057, 2016. doi:10.1007/s00362-016-0800-9.
- [60] G. Pólya and G. Szegö. Isoperimetric Inequalities in Mathematical Physics. Annals of Mathematics Studies, No. 27. Princeton University Press, Princeton, N. J., 1951.
- [61] John William Strutt Rayleigh, Baron. The Theory of Sound. Dover Publications, New York, 1945. 2d ed.
- [62] Benjamin Recht, Maryam Fazel, and Pablo A. Parrilo. Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Review, 52(3):471–501, 2010. doi:10.1137/070697835.
- [63] Arvind K. Saibaba. Randomized subspace iteration: Analysis of canonical angles and unitarily invariant norms. SIAM Journal on Matrix Analysis and Applications, 40(1):23–48, 2019. doi:10.1137/18M1179432.
- [64] Robert Schatten. A Theory of Cross-Spaces, volume No. 26 of Annals of Mathematics Studies. Princeton University Press, Princeton, NJ, 1950.
- [65] Carsten Schütt. On the volume of unit balls in Banach spaces. Compositio Math., 47(3):393–407, 1982. URL: http://www.numdam.org/item?id=CM_1982__47_3_393_0.
- [66] Atle Selberg. Remarks on a multiple integral. Norsk Mat. Tidsskr., 26:71–79, 1944.
- [67] Barry Simon. Trace Ideals and Their Applications, volume 120 of Mathematical Surveys and Monographs. American Mathematical Society, Providence, RI, 2 edition, 2005. doi:10.1090/surv/120.
- [68] Martin Stoll. A literature survey of matrix methods for data science. GAMM-Mitteilungen, 43(3):e202000013, 2020. doi:10.1002/gamm.202000013.
- [69] David Sutter, Mario Berta, and Marco Tomamichel. Multivariate trace inequalities. Communications in Mathematical Physics, 352(1):37–58, 2017. doi:10.1007/s00220-016-2778-5.
- [70] Marco Tomamichel. Quantum Information Processing with Finite Resources: Mathematical Foundations, volume 5 of SpringerBriefs in Mathematical Physics. Springer, Cham, 2016. doi:10.1007/978-3-319-21891-5.
- [71] J. von Neumann. Some matrix inequalities and metrization of matric space. Mitt. Forschungsinst. Math. Mech. Kujbyschew-Univ. Tomsk 1, 286-300 (1937), 1937.
- [72] John Watrous. The Theory of Quantum Information. Cambridge University Press, Cambridge, 2018. doi:10.1017/9781316848142.
- [73] G. A. Watson. The solution of orthogonal procrustes problems for a family of orthogonally invariant norms. Advances in Computational Mathematics, 2:393–405, 1994. doi:10.1007/BF02521606.
- [74] Hermann Weyl. The Classical Groups. Their Invariants and Representations. Princeton University Press, Princeton, NJ, 1939.
- [75] Kemin Zhou, John C. Doyle, and Keith Glover. Robust and Optimal Control. Prentice Hall, Upper Saddle River, NJ, 1996.
