App. A, Notation, p. 13 —
ProvedKernelDRO.Duality.reproducing_identitykernel-mean-embeddingp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1rkhs
Let be a compact metric space with its Borel -algebra, a real Hilbert space and a continuous feature map. For every and every Borel probability measure on ,
The expectation of any RKHS function is thus the inner product with the mean embedding; the paper uses this identity throughout its proofs, in particular to rewrite the Lagrangian (13).
Formalization Note Both integrals are Bochner integrals; continuity of on the compact makes them genuine.
Preamble
import Mathlib import Definitions.Def_WassersteinDRO_Duality_erealExpectation import Definitions.Def_KernelDRO_Duality_Setting open MeasureTheory
Formal statement
namespace KernelDRO.Duality
open WassersteinDRO.Duality
/-- **Reproducing identity** `∫ f dP = ⟨f, µ_P⟩_ℋ` for `f ∈ ℋ` and `P ∈ 𝒫` (Zhu, Jitkrittum, Diehl &
Schölkopf, Kernel Distributionally Robust Optimization, arXiv:2006.06981v3, App. A, Notation, p. 13):
integrating the RKHS function `ξ ↦ f(ξ) = ⟪f, φ ξ⟫` against a Borel probability measure `P` on the
compact space `𝒳` gives the inner product of `f` with the mean embedding `µ_P = ∫ φ dP`.
**Formalization Note.** `𝒳` is a compact metric space with its Borel σ-algebra (a compact
`𝒳 ⊂ ℝᵈ` is an instance) and the feature map `φ` is continuous (equivalently, the kernel
`k(x, y) = ⟪φ x, φ y⟫` is continuous), so both integrals are genuine Bochner integrals. -/
theorem reproducing_identity {X : Type*} [MetricSpace X] [CompactSpace X] [MeasurableSpace X]
[BorelSpace X] {H : Type*} [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]
(φ : X → H) (hφ : Continuous φ) (f : H) (P : ProbabilityMeasure X) :
∫ ξ, rkhsEval φ f ξ ∂(P : Measure X) = inner ℝ f (meanEmbedding φ P) := by sorry
end KernelDRO.Duality
Source
Zhu, Jitkrittum, Diehl & Schölkopf, Kernel Distributionally Robust Optimization, arXiv:2006.06981v3, App. A, Notation, p. 13
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.