Proposition 1(iii), p. 12 — the relative entropy I(ℙ′,ℙ) is lower semicontinuous on 𝒫 × 𝒫
ProvedDROOptimal.Predictor.proposition_1_iiiinformation-theoryp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1relative-entropysemicontinuity
Let be the probability simplex on , with the topology inherited from , and the relative entropy (Definition 5, with and for ). Then
Lower semicontinuity makes the relative entropy balls closed, hence compact, which is why the supremum defining in (10) is attained.
Formalization Note The function is EReal-valued and carries the product of the subspace topologies.
Preamble
import Mathlib import Definitions.Def_DROOptimal_Predictor_Setting
Formal statement
namespace DROOptimal.Predictor
/-- Proposition 1(iii) (Lower semicontinuity), p. 12: the relative entropy I(ℙ′, ℙ) is lower
semicontinuous in (ℙ′, ℙ) ∈ 𝒫 × 𝒫 (product of the relative topologies of 𝒫). -/
theorem proposition_1_iii {d : ℕ} :
LowerSemicontinuous (fun q : Δ d × Δ d => relEntropy q.1 q.2) := by sorry
end DROOptimal.Predictor
Source
Van Parys, Mohajerin Esfahani & Kuhn, From Data to Decisions: Distributionally Robust Optimization is Optimal, arXiv:1704.04118v3, p. 12, Proposition 1(iii)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.