Concentration of Measure and Isoperimetric Inequalities in Product Spaces XIV: Sums of Vector-Valued Independent Random Variables — a Tail Bound for ‖Σ ε_i X_i‖Textbook
Motivation
Many limit theorems of probability in Banach spaces, among them the strong law of large numbers and the law of the iterated logarithm for vector-valued random variables, reduce to sharp estimates of the tail probability
for independent random variables with values in a Banach space . For many years these estimates were obtained with martingale methods, and they were not optimal. Chapter 13 of M. Talagrand, Concentration of measure and isoperimetric inequalities in product spaces (Publ. Math. IHÉS 81, 1995), explains how the isoperimetric inequalities of the earlier chapters, in particular control by points (Theorem 3.1.1), give such estimates with explicit constants.
Timeline. M. Ledoux observed (unpublished note on Gaussian randomization, reference [L] of the paper) that for Gaussian sums one may split into its conditional mean given plus a deviation, and that the conditional mean has a monotonicity property that replaces positivity arguments ([L], Eq. (13.1)–(13.2) of the paper). Ledoux and Talagrand used this to characterize the Banach-valued random variables satisfying the law of the iterated logarithm (1988). The resulting conviction that an isoperimetric principle was at work led to Talagrand's 1989 isoperimetric theorem (Ann. Probab. 17), superseded in the 1995 paper by Theorem 3.1.1. Ledoux–Talagrand, Probability in Banach Spaces (1991), Theorem 6.17, proves a variant of the bound formalized here that also allows truncation of the variables.
Setting
Let be a real Banach space with dual , and let be independent (not necessarily identically distributed) -valued random variables. Let be Rademacher signs: independent, independent of , with . Following the paper, write
where is expectation in the signs only. The conditional mean is . The weak variance of a point is
The decreasing rearrangement is the -th largest norm, and is the sum of the largest norms.
For sets , the -point distance of is
For let and with copies of .
Formalization targets
Goal: Theorem 13.4 (p. 200)
With and , for all integers , and ,
Milestones
- Proposition 13.1 (p. 197): for , .
- Proposition 13.3 (p. 199): for fixed and ,
- Eq. (13.14) (p. 200): the joint bound at level combining the two.
The goal keeps the paper's explicit constants.
Significance
The result. Theorem 13.4 bounds the tail of a Rademacher sum in an arbitrary Banach space using three quantities only: the mean , the weak variance , and the law of the largest summands. No moment assumption on the beyond these is needed, and are free parameters to optimize. By symmetrization, such bounds are the main input for the law of large numbers and the law of the iterated logarithm in Banach spaces, for the integrability of sums, and for comparison of moments.
Formalizing it. The result is proved in the paper (and in a different form in Ledoux–Talagrand 1991). It is not formalized: Mathlib has independence, product measures and the dual of a normed space, but no Rademacher sums in Banach spaces and none of Talagrand's isoperimetric inequalities. The mission yields a machine-checked statement of the vector-valued tail bound with explicit constants, connected to the -point inequality (Theorem 3.1.1, posed in mission IV of this series) and to the concentration of for bounded (Theorem 13.2, posed in mission IX).
Difficulty
The obvious approach controls by its mean plus a concentration term. Bounded-difference (martingale) inequalities do not work here: the increments are , which can be unbounded and heavy-tailed, so the resulting bound depends on rather than on the much smaller weak variance . Concentration for the signs conditionally on (Theorem 13.2) gives the weak variance, but at scale , a random quantity. The difficulty is to make both the conditional mean and uniformly controlled on most of the space, at the cost of discarding only a few large summands; a single-point isoperimetric inequality does not supply this.
Formalization scope
- is a real normed space with
CompleteSpace W,MeasurableSpace WandBorelSpace W; isW →L[ℝ] ℝwith the operator norm. is a real⨆over the dual unit ball, which is nonempty and bounded above by . - The are realized canonically on =
Fin N → Wwith =Measure.pi μfor lawsμ i(independent, not identically distributed). Signs areFin N → Boolunder the platform's uniform measureKomlos.spMeasure N(referenced). The joint law is the product of the two. Coordinates are 0-based; the rearrangement index is 1-based as in the paper. - is the finite average over sign patterns. and are lower Lebesgue integrals (
∫⁻) in , so they need no integrability hypothesis, and makes the goal hold with an empty event. Probabilities are in , so or makes the corresponding term . - The paper ignores measurability (pp. 81–82). Here measurability of (each sign pattern) and of is an explicit hypothesis; it is automatic for separable .
- The paper writes ; statements take , the range of Theorem 3.1.1, and all bounds are trivial for .
- The paper calls the "non-decreasing rearrangement", but its formula gives the -th largest norm; the formula is formalized.
- Trivializing formalizations are ruled out: and cannot take junk values (bounded nonempty supremum, finite average), the -point distance is
ℕ∞-valued, and no Bochner integral of a possibly non-integrable function appears.
Needed infrastructure: Rademacher sums in Banach spaces, order statistics of finitely many reals, the -point inequality on general product spaces, and Theorem 13.2 for Bernoulli variables. The rearrangement and the -point distance can be reused elsewhere. Contributions are welcome on any milestone, and on proving Proposition 13.3 from a stated form of Theorem 13.2.
Selected references
- M. Talagrand, Concentration of measure and isoperimetric inequalities in product spaces, Publ. Math. IHÉS 81 (1995), 73–205. https://doi.org/10.1007/BF02699376
- M. Ledoux, M. Talagrand, Characterization of the law of the iterated logarithm in Banach spaces, Ann. Probab. 16 (1988), 1242–1264. https://doi.org/10.1214/aop/1176991688
- M. Ledoux, M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes, Springer, 1991. https://doi.org/10.1007/978-3-642-20212-4
- M. Talagrand, Isoperimetry and integrability of the sum of independent Banach-space valued random variables, Ann. Probab. 17 (1989), 1546–1570. https://doi.org/10.1214/aop/1176991174