Computational Optimal Transport XI: For p = 1, 2 the p-Wasserstein Distance on ℝ^d with d ≥ 2 Is Not HilbertianTextbook
Why ask whether a Wasserstein distance is Hilbertian
Kernel methods, multidimensional scaling and low-distortion embeddings all work best on data whose distance comes from a Hilbert space. A distance on a set is Hilbertian when can be mapped into a Hilbert space so that becomes the norm distance; for such a , the kernel is positive definite for and (Berg, Christensen and Ressel, 1984), and the classical Euclidean toolbox applies. Optimal transport distances are popular for comparing probability measures, so it is natural to ask whether they are Hilbertian. In dimension one the answer is yes for : the map sending a measure to its quantile function is an isometry into , and between univariate Gaussians is the Euclidean distance between (mean, standard deviation). Peyré and Cuturi, Computational Optimal Transport (FnT ML 2019), §8.3, show that this does not extend to the plane: for and the -Wasserstein distance on is not Hilbertian (Proposition 8.2, p. 507).
The tool is a classical characterization. Schoenberg (1938) proved that a distance is Hilbertian exactly when its square is conditionally negative definite; Berg, Christensen and Ressel (1984, Prop. 3.2) give the modern form. The easy direction turns non-embeddability into a finite check, and the book's proof of Proposition 8.2 performs that check numerically on 35 measures supported on the four corners of the unit square (Figure 8.6, p. 508). Stronger, quantitative statements are known: planar does not even embed into with bounded distortion (Naor and Schechtman, 2007), and Andoni, Naor and Neiman (2018) study which powers of Wasserstein distances embed.
Setting
Let be a set. A function is negative definite (Definition 8.3, p. 501, in the conditional form used in §8.3) if it is symmetric and, for every , every and every with ,
A function is Hilbertian (Definition 8.4, p. 506) if there are a real Hilbert space and a map with for all .
On with the Euclidean norm , let be the Borel probability measures with . A coupling of and is a measure on whose two marginals are and , and the -Wasserstein distance (2.18) is
finite on . For points and a histogram (nonnegative, summing to one) the discrete measure is ; for two histograms , is the set of nonnegative matrices with row sums and column sums , and (2.11).
The configuration of the book's proof consists of the corners , , , of the unit square, the 35 histograms of with entries in , and the centering matrix .
Formalization targets
Goal: Proposition 8.2
For and ,
Milestones
- Proposition 8.1, proved direction (pp. 506–507): if is Hilbertian then is negative definite.
- Squared distance (p. 507): on is not negative definite, , .
- Reduction to the plane (proof of Prop. 8.2): if on , , were negative definite, so would be on .
- Discrete measures (Remark 2.13, p. 375): with .
- Centering criterion (proof of Prop. 8.2): a matrix admits a zero-sum with if and only if has a positive eigenvalue.
- The grid counterexample (proof of Prop. 8.2, Figure 8.6): for there are grid histograms and a zero-sum with
Significance
A Hilbertian distance gives positive definite Gaussian and Laplace kernels, Euclidean multidimensional scaling and Johnson–Lindenstrauss dimension reduction for free. Proposition 8.2 says none of these can be obtained for or on , , by an isometric embedding; this is why the literature turned to approximate embeddings, sliced distances and entropic surrogates (pp. 507–508). The negative-definiteness test of milestone 1 is a reusable certificate for non-embeddability of any finite metric.
The result is known, and the book's proof is a floating-point eigenvalue computation. The formal content of this mission is a machine-checked proof with an exact certificate: rational or algebraic Wasserstein distances between explicit discrete measures and an explicit zero-sum vector. As far as this mission is aware, no formal proof of the statement exists in Mathlib or on the platform. Schoenberg's converse is cited by the book and is not part of the mission.
Difficulty
The abstract part is short: expanding and using gives milestone 1. The obstacle is the certificate. The book observes that has a positive top eigenvalue (about for and for ), but a proof needs exact transport costs between the chosen measures, each the value of a small linear program whose optimality has to be established (for instance by a dual certificate), together with a vector for which the quadratic form is provably positive. For the costs involve , the diagonal of the square. A second, separate difficulty is connecting the measure-theoretic to the discrete program (milestone 4) and transporting a counterexample from into (milestone 3), both of which require working with couplings as measures on a product space.
Formalization scope
- is
EuclideanSpace ℝ (Fin d); is the published definitionWassersteinDRO.Duality.wassersteinDistance(an -valued infimum over all measures with the two marginals, raised to ), converted to a real number. The distance is considered on , the set where it is finite; outside it the real conversion is a junk . The book names no domain; since the counterexample consists of finitely supported measures, the finite computation gives non-Hilbertianity on and on every smaller set containing those measures. - Negative definiteness is conditional. Definition 8.3 as printed quantifies over all ; under that reading no nonzero squared distance is negative definite, so Proposition 8.1 would be false and "not negative definite" trivially true. The zero-sum condition, used by the book in the proof of Proposition 8.1, is part of the definition; this rules out the trivial formalization.
- Hilbert spaces are real, complete inner-product spaces in the universe of . Indices are 0-based (
Fin n). Histograms are real vectors; the reduction milestone is stated for every . - Discrete transport objects (, ) are redefined in this mission's namespace
CompOT.NotHilbertian, duplicating chunk II of the series.
Contributions welcome: the forward direction of Schoenberg's characterization, the discrete-measure bridge (reusable wherever discrete optimal transport meets measure-theoretic couplings), the isometric-embedding invariance of , and exact certificates for the grid computation.
Selected references
- G. Peyré and M. Cuturi, Computational Optimal Transport, Foundations and Trends in Machine Learning 11(5–6):355–607, 2019. https://doi.org/10.1561/2200000073
- I. J. Schoenberg, Metric spaces and positive definite functions, Transactions of the AMS 44(3):522–536, 1938. https://doi.org/10.1090/S0002-9947-1938-1501980-0
- C. Berg, J. P. R. Christensen and P. Ressel, Harmonic Analysis on Semigroups, Graduate Texts in Mathematics 100, Springer, 1984. https://doi.org/10.1007/978-1-4612-1128-0
- A. Naor and G. Schechtman, Planar earthmover is not in , SIAM Journal on Computing 37(3):804–826, 2007. https://doi.org/10.1137/05064206X
- A. Andoni, A. Naor and O. Neiman, Snowflake universality of Wasserstein spaces, Annales scientifiques de l'École normale supérieure 51(3):657–700, 2018. https://arxiv.org/abs/1509.08677