Monotonicity of Bernoulli divergence in its second parameter
ProvedExploreFirst.Absolute.kl_monotone_rightkullback-leiblermulti-armed-banditsp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1regret-lower-bound
Fix . Bernoulli divergence is nondecreasing in its second parameter to the right of :
This is the monotonicity statement used on page 11 to replace the alternative problem's expected arm fraction by . The boundary value is included.
Preamble
import Mathlib import Definitions.Def_ExploreFirst_Absolute_Setting
Formal statement
namespace ExploreFirst.Absolute
/-- Monotonicity used in the proof of Theorem 2, p. 11. -/
theorem kl_monotone_right (p q q' : ℝ)
(hp : 0 ≤ p) (hpq : p ≤ q) (hqq' : q ≤ q') (hq' : q' ≤ 1) :
ExploreFirst.FundIneq.klBer p q ≤ ExploreFirst.FundIneq.klBer p q' := by sorry
end ExploreFirst.Absolute
Source
Garivier, Ménard, Stoltz, Explore First, Exploit Next, arXiv:1602.07182v3, p. 11, proof of Theorem 2, monotonicity sentence
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.