Theorem 10 — convex loss and : on Borel (mission IV goal)
ProvedWassersteinDRO.Regularization.convex_loss_p1_v2Let with an arbitrary norm (a finite-dimensional real normed space) and its Borel -algebra, take (no support constraints), let , and let be the empirical distribution of training samples. If the loss function is convex (and -integrable, which is automatic), then for the worst-case risk coincides with the Lipschitz-regularized empirical loss,
an identity in : when and both sides are (mass can be pushed to infinity at bounded transport cost), and when both sides equal (the radius- ball is and ).
Formalization Note. The retired version was false because its -algebra on was a free parameter: with the -algebra generated by on , every under which is integrable is concentrated at , so the guarded worst-case risk was while the right-hand side was . The new statement does the following differently. (i) is a finite-dimensional real normed space (the paper's with an arbitrary norm) carrying its Borel -algebra ([FiniteDimensional ℝ E] [BorelSpace E]); the retired version quantified over every MeasurableSpace E, including -algebras unrelated to the norm, for which the Wasserstein cost is a lower integral and non-constant losses are integrable under no measure. (ii) The worst-case risk is the paper's with the paper's p. 2 convention for non-integrable losses (worstCaseRisk/nominalRisk v2, valued in ) instead of a supremum that silently discarded every under which is not integrable. Standing assumptions made explicit: closed (p. 6); a probability distribution; and (p. 3, 6); the loss is convex on all of (the theorem's hypothesis), hence continuous, so the standing measurability and upper-semicontinuity conventions (p. 1; Assumption 1, p. 9) hold automatically and are not repeated; -integrability (Assumption 1) is carried for fidelity although automatic for the empirical distribution; is the theorem's own assumption. Losses are taken real-valued, a special case of the paper's extended-real-valued losses that the retired version already made. No correction to the printed source. This statement lives in mission IV's own namespace WassersteinDRO.Regularization and mirrors WassersteinDRO.Duality.convex_loss_p1_v2 with this chapter's own (identically defined) v2 definitions.
import Mathlib import Definitions.Def_WassersteinDRO_Regularization_worstCaseRisk_v2 import Definitions.Def_WassersteinDRO_Regularization_empiricalDistribution import Definitions.Def_WassersteinDRO_Regularization_nominalRisk_v2 import Definitions.Def_WassersteinDRO_Regularization_lipschitzModulus open MeasureTheory
namespace WassersteinDRO.Regularization
/-- Theorem 10 (Convex loss and p = 1), Kuhn, Mohajerin Esfahani, Nguyen & Shafieezadeh-Abadeh,
*Wasserstein Distributionally Robust Optimization*, INFORMS TutORials 2019
(arXiv:1908.08729v2), p. 14 (proof in [61, Theorem 6.3]): assume `Ξ = ℝ^m` and that the loss
function `ℓ(ξ)` is convex. If `p = 1` and `PN` is the empirical distribution, then the
worst-case risk (6) coincides with the Lipschitz-regularized empirical loss,
`Rε,1(PN,ℓ) = R(PN,ℓ) + ε·Lip(ℓ)`. Stated in this chapter's own namespace, mirroring
`WassersteinDRO.Duality.convex_loss_p1_v2`; see
`Def_WassersteinDRO_Regularization_wassersteinDistance` for why.
Setting: `E` is `ℝ^m` with an arbitrary norm (finite-dimensional real normed space) with its
Borel σ-algebra; `Ξ = E` (`Set.univ`); `ε ≥ 0`; `N ≥ 1`. The loss is a real-valued convex
function on all of `E` (`ConvexOn ℝ Set.univ ℓ`), hence continuous — so the standing
measurability and upper-semicontinuity conventions are automatic and not repeated — and
`PN`-integrable (Assumption 1, p. 9; automatic for the empirical `PN`, carried for fidelity).
Both sides live in `EReal`: for `ε > 0` and `Lip(ℓ) = ∞` both equal `+∞`; for `ε = 0` the
ball is `{PN}` and `0·∞ = 0`, so both sides equal `R(PN,ℓ)`.
Corrected from the retired `convex_loss_p1`: the σ-algebra was a free `[MeasurableSpace E]`
(with a coarse σ-algebra every `Q` making `ℓ` integrable had risk `0`, so the guarded supremum
fell below `R(PN,ℓ) + ε·Lip(ℓ)`), `E` was not finite-dimensional, and the worst-case risk
dropped non-integrable `Q` instead of using the paper's convention (now
`worstCaseRisk`/`nominalRisk` v2). -/
theorem convex_loss_p1_v2 {E : Type*} [NormedAddCommGroup E] [NormedSpace ℝ E]
[FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E]
(ε : ℝ) (hε : 0 ≤ ε) {N : ℕ} (hN : 0 < N) (ξhat : Fin N → E)
(ℓ : E → ℝ) (hconv : ConvexOn ℝ Set.univ ℓ)
(hℓ : Integrable ℓ (empiricalDistribution ξhat)) :
worstCaseRisk ε 1 Set.univ (empiricalDistribution ξhat) ℓ =
nominalRisk (empiricalDistribution ξhat) ℓ +
((ENNReal.ofReal ε * lipschitzModulus ℓ : ENNReal) : EReal) := by sorry
end WassersteinDRO.Regularization