Le Cam's Cauchy–Schwarz inequality for the Hellinger affinity
ProvedBanditAlgorithm.le_cam_cauchy_affinityinformation-theoryprobability
For probability measures P and Q, let ν=P+Q and p=dP/dν, q=dQ/dν. Le Cam’s Cauchy–Schwarz inequality states that one half of the squared Hellinger affinity is at most the overlap integral: . This includes mutually singular and identical measures.
Preamble
import Mathlib.InformationTheory.KullbackLeibler.Basic open MeasureTheory InformationTheory open scoped ENNReal
Formal statement
theorem BanditAlgorithm.le_cam_cauchy_affinity {Ω : Type} {mΩ : MeasurableSpace Ω}
(P Q : Measure Ω) [IsProbabilityMeasure P] [IsProbabilityMeasure Q] :
(2 : ℝ≥0∞)⁻¹ *
(∫⁻ ω, (P.rnDeriv (P + Q) ω * Q.rnDeriv (P + Q) ω) ^ (2⁻¹ : ℝ)
∂(P + Q)) ^ 2 ≤
∫⁻ ω, min (P.rnDeriv (P + Q) ω) (Q.rnDeriv (P + Q) ω) ∂(P + Q) := by sorrySource
Lattimore--Szepesvari, Bandit Algorithms (CUP 2020), proof of Theorem 14.2, Eq. (14.9), printed p. 191 / PDF p. 200.