(47) — Hölder bound on the deviation of a reweighted mean from E_{P₀}[ℓ]
ProvedGenEmpLik.Consistency.eq_47Let and set , (conjugate exponents: ). Let , let be real numbers (the losses ), (standing for ), and let be a weight vector in the ball , i.e. a distribution with likelihood ratio . Writing and ,
In the paper's notation this is ; taking suprema over the ball gives the printed form of (47). It splits the robust deviation into a reweighting term, controlled by Lemma 13 and Assumption E, and the ordinary empirical deviation, controlled by the Glivenko–Cantelli property.
Formalization Note The paper's exponent is called here to avoid a clash with the weights. The middle term uses : the page prints , a typo (the bound fails for signed otherwise). The statement is per distribution; the printed version takes the supremum over the ball on both sides.
import Mathlib import Definitions.Def_PhiDivRobust_Counterpart_uncertaintySet import Definitions.Def_VarianceRegularization_Expansion_empMean
namespace GenEmpLik.Consistency
/-- Inequality (47) (arXiv:1610.03425v3, App. E.1, p. 46), for one distribution `P` of the
ball `𝒫_{n,ρ}`. Let `ε > 0`, `q = min{2, 1 + ε}`, `r = max{2, 1 + 1/ε}` (the paper's `p`), let
`z = (ℓ(x; ξ₁), …, ℓ(x; ξₙ))` and `m` a real number (standing for `E_{P₀}[ℓ(x; ξ)]`). For every
weight vector `w` in the ball, with likelihood ratio `L(ξᵢ) = n wᵢ`,
`|E_P[ℓ] − m| ≤ E_{P̂n}[|L − 1| |ℓ|] + |E_{P̂n}[ℓ] − m|
≤ E_{P̂n}[|L − 1|^r]^{1/r} E_{P̂n}[|ℓ|^q]^{1/q} + |E_{P̂n}[ℓ] − m|`. -/
theorem eq_47 (f : ℝ → EReal) (ρ ε : ℝ) (hε : 0 < ε) (n : ℕ) (hn : 0 < n)
(z : Fin n → ℝ) (m : ℝ)
(w : Fin n → ℝ) (hw : w ∈ PhiDivRobust.Counterpart.probUncertaintySet f
(fun _ : Fin n => (1 : ℝ) / n) (ρ / n)) :
|∑ i, w i * z i - m| ≤
(1 / (n : ℝ)) * ∑ i, |(n : ℝ) * w i - 1| * |z i|
+ |VarianceRegularization.Expansion.empMean z - m| ∧
(1 / (n : ℝ)) * ∑ i, |(n : ℝ) * w i - 1| * |z i|
+ |VarianceRegularization.Expansion.empMean z - m| ≤
((1 / (n : ℝ)) * ∑ i, |(n : ℝ) * w i - 1| ^ max 2 (1 + 1 / ε)) ^ (1 / max 2 (1 + 1 / ε))
* ((1 / (n : ℝ)) * ∑ i, |z i| ^ min 2 (1 + ε)) ^ (1 / min 2 (1 + ε))
+ |VarianceRegularization.Expansion.empMean z - m| := by sorry
end GenEmpLik.Consistency
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.