High-Dimensional Probability VII: Slepian's Inequality for Gaussian ProcessesTextbook
Motivation
A Gaussian process is a family of jointly Gaussian real random variables indexed by an arbitrary set — not necessarily time. The canonical example is for ranging over a subset and a standard Gaussian vector in ; this single family already encodes questions as varied as the operator norm of a random matrix, the size of a random projection, and the metric complexity of a convex body. In every one of these applications the object of interest reduces to the same quantity: , the expected supremum of the process.
Bounding directly is hard — computing it exactly is possible only in special cases, such as the reflection principle for Brownian motion. Slepian's inequality (David Slepian, 1962) sidesteps this by comparison: if a second Gaussian process has matching variances and at-least-as-large pairwise increments as , then 's supremum stochastically dominates 's. This turns a hard direct estimate into a search for a simpler comparison process — the technique that Sudakov and Fernique later sharpened by dropping the equal-variance hypothesis (Theorem 7.2.11), and that Sudakov used to derive a purely geometric lower bound on from the covering numbers of (Theorem 7.4.1, Sudakov's minoration inequality). Together these results are the entry point to the theory of Gaussian width and generic chaining that occupies the rest of the book (Chapters 7–9, 11), and they underlie sharp bounds on random matrices (Section 7.3), random projections (Chapter 9), and high-dimensional geometry more broadly (Adler and Taylor, Random Fields and Geometry, Springer, 2007; Talagrand, Upper and Lower Bounds for Stochastic Processes, Springer, 2014).
Setting
Fix a probability space . A random process indexed by a set is a family of real random variables on . It is a Gaussian process if every finite linear combination ( finite, ) is a (possibly degenerate) normal random variable — equivalently, every finite marginal is a multivariate Gaussian vector. A process is mean zero if for every .
For a mean zero process, the increments always define a (pseudo)metric on — the canonical metric — turning the otherwise unstructured index set into a metric space. For a metric space and $\varepsilon
0N(T,d,\varepsilon)N\subseteq TT\varepsilonN\varepsilonN(T,d,\varepsilon) := \infty$ if no finite net exists.
Because need not be countable, need not be a measurable function of . Following the book's own convention, every quantity built from this supremum — and — is instead defined through the process's finite-dimensional marginals: as the supremum, over finite nonempty , of (respectively ). This sidesteps the measurability question entirely, at the cost of the quantity possibly being .
Formalization targets
Slepian's inequality (Theorem 7.2.1, goal)
Let and be mean zero Gaussian processes with and for all . Then for every ,
and consequently .
Sudakov-Fernique's inequality (Theorem 7.2.11, milestone)
Under only the increment hypothesis (no equal-variance hypothesis),
This is the weaker-hypothesis, strictly more applicable form: it is what Sudakov's minoration inequality and the sharp Gaussian random matrix bound of Section 7.3 both invoke.
Sudakov's minoration inequality (Theorem 7.4.1, milestone)
Let be a mean zero Gaussian process with canonical metric . For every at which is finite,
for an absolute constant . This is the weakest, most stable form of the bound: it names no numerical value for , so it survives any later sharpening of the constant.
Slepian's inequality, finite-dimensional case (Theorem 7.2.9, milestone)
The vector-indexed special case of Theorem 7.2.1 ( finite), proved first by Gaussian interpolation and then extended to the general index set.
Significance
The results themselves. Slepian's inequality is the founding comparison theorem for Gaussian processes; Sudakov-Fernique's inequality is its practically indispensable generalization, used routinely to bound suprema of Gaussian processes without needing to track variances explicitly. Sudakov's minoration inequality is the first bridge from the probability of a Gaussian process to the metric geometry of its index set, complementing Dudley's upper bound (Chapter 8) and together giving matching bounds — up to a logarithmic factor, and exactly in many cases of interest — on purely from the covering numbers of . Downstream, this machinery gives the sharp bound on Gaussian random matrices (Section 7.3), underlies the Gaussian width used throughout convex geometry and compressed sensing (Chapters 9, 11), and bounds the covering numbers of polytopes and other convex sets (Corollary 7.4.4).
Formalizing it. All three inequalities are proved by the book (Gaussian interpolation and integration by parts for Slepian/Sudakov-Fernique; a direct application of Sudakov-Fernique to a well-chosen comparison process for Sudakov's minoration), so this mission's work is formalizing the statements faithfully and precisely — including the finite-marginal convention needed to make and meaningful for an uncountable index set without begging the underlying measurability question. The Gaussian interpolation technique itself (Lemmas 7.2.3, 7.2.5, 7.2.7) is not part of this mission's formalization scope; it is the proof method for the milestones and belongs to solvers closing them.
Difficulty
The obvious first idea — bound by controlling each separately, e.g. via a union bound over a net — throws away exactly the structure Slepian-type comparisons exploit: the joint Gaussianity across , not marginal tail behavior at each fixed . A union bound needs a net and a modulus of continuity to begin with; Slepian's and Sudakov-Fernique's inequalities need neither — they compare two processes directly through their covariance structure, which is what makes the technique (Gaussian interpolation: continuously deform the covariance of one process into the other's, and track how a smooth, nearly-indicator functional behaves along the path) work with no assumption on beyond the two hypotheses stated. The genuine difficulty is the smooth-interpolation argument itself — showing that is monotone in for the right choice of test function — which is exactly the part left as a milestone for solvers to formalize, not sketched here per the mission format's own rule against proof ideas.
Formalization scope
(ProcessESup) is valued in EReal, not ℝ: the finite-marginal supremum a
real-valued definition would silently default to the junk value when the set of finite-marginal
expectations is unbounded above — exactly the case the book itself records as (Exercise 7.4.2, a non-relatively-compact index set). P\{\sup_{t\in T}X_t\ge\tau\}
(ProcessTailProb) stays real-valued, since it is always bounded in and so carries no
such risk. Both are defined through finite nonempty subsets of , per the book's own footnote
to Section 7.2; no separability, continuity, or countability assumption is placed on itself.
Gaussianity is Mathlib's ProbabilityTheory.IsGaussianProcess — every finite restriction of the
process has a Gaussian law — which is definitionally the book's Definition 7.1.10 ("every finite
linear combination is Gaussian"); mean-zero is stated as an explicit hypothesis alongside it.
Integrability of every quantity appearing under an expectation is not stated as a separate
hypothesis: Fernique's theorem (already in Mathlib for general Gaussian measures) guarantees a
Gaussian process has finite moments of every order, exactly as the book takes for granted.
Sudakov's minoration inequality (Theorem 7.4.1) is formalized for the case the book's own proof
actually covers — finite, taken as a hypothesis = (N : ℕ) rather than as a
case split inside the conclusion — since the book itself defers the infinite-covering-number case
to a separate, unproved exercise (7.4.2). This keeps fully general (still possibly
uncountable) at every fixed where the net is finite, which rules out a trivializing
reading of the theorem: nothing here forces itself to be finite or countable, only the
covering number at the scale in play, which is the book's own hypothesis.
Definitions reusable beyond this mission: ProcessESup, ProcessTailProb, CanonicalMetric,
and CoveringNumber are exactly the substrate Chapters 8 ("Dudley's Integral Inequality"), 9
("The Matrix Deviation Inequality"), and 11 ("Dvoretzky-Milman's Theorem") need for Gaussian
width and generic chaining; per this series' plan those missions restate them locally (drafts
cannot import another draft's definitions), using this chunk's forms as the faithful reference.
Contributions closing the Gaussian-interpolation machinery (Lemmas 7.2.3–7.2.8) as a reusable
definitions layer, beyond what any one milestone needs, are welcome.
Selected references
- Vershynin, High-Dimensional Probability: An Introduction with Applications in Data Science, Cambridge University Press, 2018. https://www.math.uci.edu/~rvershyn/papers/HDP-book/HDP-book.pdf
- D. Slepian, "The one-sided barrier problem for Gaussian noise", Bell System Technical Journal 41 (1962), 463–501.
- V. N. Sudakov, "Gaussian random processes and measures of solid angles in Hilbert space", Soviet Mathematics Doklady 12 (1971), 412–415.
- X. Fernique, "Regularité des trajectoires des fonctions aléatoires gaussiennes", in École d'Été de Probabilités de Saint-Flour IV-1974, Springer Lecture Notes in Mathematics 480 (1975), 1–96.
- M. Talagrand, Upper and Lower Bounds for Stochastic Processes: Modern Methods and Classical Problems, Springer, 2014.