Proposition 9.8, Eq. (21) — the (DM) optimality equation
ProvedBertsekasShreve.BorelInfinite.optimality_equation_DMLet (SM) be an infinite horizon stochastic optimal control model on nonempty Borel spaces (Definitions 8.1, 9.1), with optimal cost over all universally measurable policies, and let (DM) be the associated deterministic model on (Definition 9.4) with optimal cost and operator . Assume one of (P) on , (N) on , (D) and on .
Then the optimal cost of (DM) satisfies the optimality equation
The book obtains this from the abstract monotone-mapping theory (Propositions 4.2(a), 5.2, 5.3), since (DM) is a deterministic model with no measurability restrictions on policies; combined with Propositions 9.5 and 9.7 it yields the optimality equation for (SM) (Eq. (22)).
Formalization Note The equation is stated at probability measures , the states of (DM).
import Mathlib import Definitions.Def_BertsekasShreve_BorelInfinite_Analytic import Definitions.Def_BertsekasShreve_BorelInfinite_ExtArith import Definitions.Def_BertsekasShreve_BorelInfinite_Model import Definitions.Def_BertsekasShreve_BorelInfinite_Policy import Definitions.Def_BertsekasShreve_BorelInfinite_DetModel open MeasureTheory ProbabilityTheory Filter Topology
namespace BertsekasShreve.BorelInfinite
/-- **Proposition 9.8**, Eq. (21) (p. 225). (P)(N)(D) The optimal cost of (DM) satisfies the
optimality equation `J̄* = T̄(J̄*)` on `P(S)`. -/
theorem optimality_equation_DM {S C W : Type*}
[TopologicalSpace S] [BertsekasShreve.AnalyticSelection.IsBorelSpace S] [MeasurableSpace S] [BorelSpace S] [Nonempty S]
[TopologicalSpace C] [BertsekasShreve.AnalyticSelection.IsBorelSpace C] [MeasurableSpace C] [BorelSpace C] [Nonempty C]
[TopologicalSpace W] [BertsekasShreve.AnalyticSelection.IsBorelSpace W] [MeasurableSpace W] [BorelSpace W] [Nonempty W]
(M : Model S C W)
(hcase : M.CaseP ∨ M.CaseN ∨ M.CaseD) (p : Measure S) [IsProbabilityMeasure p] :
M.Jbarstar p = M.Tbar M.Jbarstar p := by sorry
end BertsekasShreve.BorelInfinite