Corollary 1, p. 57 — conditional variant: 𝔼[max{X + φ(X,·), 0}] ≥ 𝔼[max{𝔼(X|ℋ) + φ(X,·), 0}]
ProvedInfoRelaxTS.Monotone.corollary_1conditional-expectationjensen-inequalityp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1probability
Let be a probability space, a sub--field, an integrable random variable, and such that
- is non-decreasing for each ;
- is -measurable for each ( is a deterministic function given ).
Then
This is Lemma 1 conditioned on ; Corollary 2 applies it to a maximum of affine functions of .
Formalization Note Added, disclosed: is jointly measurable for , so that is a random variable, which the page's expectations presuppose and (i)–(ii) do not imply. is inherited from Lemma 1. Both sides are lower Lebesgue integrals in . "Increasing" means non-decreasing.
Preamble
import Mathlib import Definitions.Def_InfoRelaxTS_Monotone_Setting
Formal statement
namespace InfoRelaxTS.Monotone
open MeasureTheory ProbabilityTheory
/-- Corollary 1, p. 57, (133): the conditional version of Lemma 1. `φ(x, ω)` is non-decreasing in
`x` for each `ω`, `ℋ`-measurable in `ω` for each `x`, and (disclosed) jointly measurable for
`Borel(ℝ) ⊗ ℋ`; `X` is integrable. Then
`𝔼[max{X + φ(X, ·), 0}] ≥ 𝔼[max{𝔼(X|ℋ) + φ(X, ·), 0}]`, both sides in `[0, ∞]`. -/
theorem corollary_1 {Ω : Type*} {mH mΩ : MeasurableSpace Ω} (hmH : mH ≤ mΩ)
(μ : @Measure Ω mΩ) [@IsProbabilityMeasure Ω mΩ μ]
(φ : ℝ → Ω → ℝ) (hmono : ∀ ω, Monotone fun x => φ x ω)
(hmeas : ∀ x, Measurable[mH] (φ x))
(hjoint : @Measurable (ℝ × Ω) ℝ (@Prod.instMeasurableSpace ℝ Ω _ mH) _ (Function.uncurry φ))
(X : Ω → ℝ) (hX : Integrable X μ) :
∫⁻ ω, ENNReal.ofReal (max ((μ[X | mH]) ω + φ (X ω) ω) 0) ∂μ
≤ ∫⁻ ω, ENNReal.ofReal (max (X ω + φ (X ω) ω) 0) ∂μ := by sorry
end InfoRelaxTS.Monotone
Source
Min, Maglaras, Moallemi, Thompson Sampling with Information Relaxation Penalties, arXiv:1902.04251v2, p. 57, Corollary 1, (133)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.