Theorem 7.3.4 (Verification Theorem) — the contracting-model sharpening of Theorem 7.1.7
ProvedMDPFinance.Contracting.theorem_7_3_4banach-spacemarkov-decision-processverification-theorem
Under a genuine bounding function with , the verification theorem (Theorem 7.1.7) sharpens: the hypothesis "" is no longer needed. Any fixed point of automatically satisfies once a maximizer of is exhibited — contraction alone forces uniqueness, so there is no need to separately verify dominates the true value. This is the direct predecessor of the goal (Theorem 7.3.5), isolating exactly the "single fixed point" case before the goal generalizes to an entire closed invariant class .
Preamble
import Mathlib import Definitions.Def_MDPFinance_Contracting_Model import Definitions.Def_MDPFinance_Contracting_Value import Definitions.Def_MDPFinance_Contracting_Bounding open MeasureTheory ProbabilityTheory
Formal statement
namespace MDPFinance.Contracting
/-- Theorem 7.3.4 (Verification Theorem) (Bäuerle–Rieder, p. 207, PDF 218). Let `b` be a bounding
function, `\beta\alpha_b < 1` and `v \in IB_b` be a fixed point of `T : IB_b \to IB_b`. If `f^*`
is a maximizer of `v` (of the `EReal`-valued `T`, `v` cast up via the coercion), then
`v = J_\infty = J` and `(f^*,f^*,\dots)` is an optimal stationary policy. -/
theorem theorem_7_3_4 {E A : Type*} [MeasurableSpace E] [MeasurableSpace A] (M : MarkovDecisionModel E A)
(b : E → ℝ) (cr αb : ℝ) (hb : IsBoundingFunction M b cr αb) (hαb : M.β * αb < 1)
(v : E → ℝ) (hvIBb : v ∈ IBb b) (hvfix : ∀ x, T M (fun y => (v y : EReal)) x = (v x : EReal))
(fstar : E → A) (hfstar : IsMaximizerOf M (fun y => (v y : EReal)) fstar) :
(∀ x, (v x : EReal) = Jinf M x) ∧ (∀ x, (v x : EReal) = Jlim M x) ∧
∀ x, Jinfpi M M.r (fun _ => fstar) x = Jinf M x := by sorry
end MDPFinance.Contracting
Source
Bäuerle and Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer 2011, DOI 10.1007/978-3-642-18324-9, p. 207, Theorem 7.3.4
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.