Proposition 1, proof p. 24 — from sample weights to support weights
ProvedEmpiricalDRO.Discrete.w_to_p_feasibleburg-entropydiscrete-reductiondistributionally-robust-optimizationjensen-inequalityp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1
Let observations be classified among support points, with empirical proportions , and let be any real loss at point . For a feasible weight vector in the empirical Burg ball , aggregate the weights within each class: . Then
This is the reverse reduction. Jensen's inequality bounds the divergence of the aggregated vector, while aggregation preserves its objective value.
Formalization Note The source uses radius ; the statement allows any real . The finite-support ball enforces zero mass at unobserved support points and positive mass at observed points.
Preamble
import Mathlib import Definitions.Def_EmpiricalDRO_Discrete_Setting
Formal statement
namespace EmpiricalDRO.Discrete
/-- Proof of Proposition 1, p. 24: aggregate observation weights by support point;
Jensen's inequality gives feasibility and the objective value is preserved. -/
theorem w_to_p_feasible {n k : ℕ} (hn : 0 < n) (c : Fin n → Fin k)
(a : Fin k → ℝ) (η : ℝ) (w : Fin n → ℝ)
(hw : w ∈ PhiDivRobust.Counterpart.probUncertaintySet EmpiricalDRO.Coverage.burg
(fun _ => (1 : ℝ) / n) η) :
let p : Fin k → ℝ := fun i =>
∑ j ∈ Finset.univ.filter (fun j => c j = i), w j
p ∈ burgBall (phat c) η ∧
∑ i, p i * a i = ∑ j, w j * a (c j) := by sorry
end EmpiricalDRO.Discrete
Source
Lam, Recovering Best Statistical Guarantees via the Empirical DRO, arXiv:1605.09349v1, p. 24, proof of Proposition 1, paragraph beginning ‘On the other hand’
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.