Lemma 13 β weights in the f-divergence ball satisfy βnp β πββ β€ β(Ο C_f)
ProvedGenEmpLik.Consistency.lemma_13Let satisfy Assumption A and let . Then there are constants , depending only on (and ), such that
Precisely: every and every feasible satisfy , and some and feasible satisfy .
The lemma says that the likelihood ratios of every distribution in the ball stay within a fixed -distance of the all-ones vector, uniformly in ; it is the quantitative input to the uniform convergence in Theorem 7.
Formalization Note The feasible set is the published probUncertaintySet f (1/n,β¦,1/n) (Ο/n), equal to the set displayed above. The page says "depending only on "; the constants are allowed to depend on as well, as the proof does (it defines through ). The upper bound as proved is ; the factor 2 is absorbed into the existential constant. The lower bound is stated with an attained witness, which implies the bound on the supremum. Mission 2 of this series states the same lemma in its own namespace.
import Mathlib import Definitions.Def_PhiDivRobust_Counterpart_uncertaintySet import Definitions.Def_GenEmpLik_Coverage_AssumptionA
namespace GenEmpLik.Consistency
/-- Lemma 13 (arXiv:1610.03425v3, p. 34): under Assumption A, for every `Ο β₯ 0` there are
constants `C_f β₯ c_f > 0` (depending only on `f` and `Ο`) such that
`β(Ο c_f) β€ sup_n sup_p βn p β πββ β€ β(Ο C_f)`, the supremum running over `n β₯ 1` and
`p β ββΏ` with `pα΅π = 1`, `p β₯ 0`, `βα΅’ f(n pα΅’) β€ Ο`. The feasible set is written as the
Ο-divergence ball `probUncertaintySet f (1/n, β¦, 1/n) (Ο/n)`; the upper bound holds for every
feasible `p`, and the lower bound is witnessed by some `n` and feasible `p`. -/
theorem lemma_13 (f : β β EReal) (hf : GenEmpLik.Coverage.AssumptionA f) (Ο : β) (hΟ : 0 β€ Ο) :
β cf Cf : β, 0 < cf β§ cf β€ Cf β§
(β n : β, 0 < n β β p β PhiDivRobust.Counterpart.probUncertaintySet f
(fun _ : Fin n => (1 : β) / n) (Ο / n),
Real.sqrt (β i, ((n : β) * p i - 1) ^ 2) β€ Real.sqrt (Ο * Cf)) β§
(β n : β, 0 < n β§ β p β PhiDivRobust.Counterpart.probUncertaintySet f
(fun _ : Fin n => (1 : β) / n) (Ο / n),
Real.sqrt (Ο * cf) β€ Real.sqrt (β i, ((n : β) * p i - 1) ^ 2)) := by sorry
end GenEmpLik.Consistency
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.