Sign and boundedness of under (P), (N), (D)
ProvedBertsekasShreve.BorelInfinite.Jstar_signborel-modeldynamic-programming
Let (SM) be an infinite horizon stochastic optimal control model on nonempty Borel spaces (Definitions 8.1, 9.1), with costs (Eq. (1)) and optimal cost (Eq. (2)). Then
- under (P) ( on ): for all ;
- under (N) ( on ): for all ;
- under (D) (, on ): there is with for all .
These are the sign conditions that allow Proposition 9.7 to be applied with in the proof of Proposition 9.8 (p. 226).
Preamble
import Mathlib import Definitions.Def_BertsekasShreve_BorelInfinite_Analytic import Definitions.Def_BertsekasShreve_BorelInfinite_ExtArith import Definitions.Def_BertsekasShreve_BorelInfinite_Model import Definitions.Def_BertsekasShreve_BorelInfinite_Policy import Definitions.Def_BertsekasShreve_BorelInfinite_DetModel open MeasureTheory ProbabilityTheory Filter Topology
Formal statement
namespace BertsekasShreve.BorelInfinite
/-- Section 9.1, Definition 9.3 and Eq. (2) (pp. 214–215), as used in the proof of
Proposition 9.8 (p. 226): `J* ≥ 0` under (P), `J* ≤ 0` under (N), and `J*` is bounded under (D). -/
theorem Jstar_sign {S C W : Type*}
[TopologicalSpace S] [BertsekasShreve.AnalyticSelection.IsBorelSpace S] [MeasurableSpace S] [BorelSpace S] [Nonempty S]
[TopologicalSpace C] [BertsekasShreve.AnalyticSelection.IsBorelSpace C] [MeasurableSpace C] [BorelSpace C] [Nonempty C]
[TopologicalSpace W] [BertsekasShreve.AnalyticSelection.IsBorelSpace W] [MeasurableSpace W] [BorelSpace W] [Nonempty W]
(M : Model S C W) :
(M.CaseP → ∀ x, 0 ≤ M.Jstar x) ∧ (M.CaseN → ∀ x, M.Jstar x ≤ 0) ∧
(M.CaseD → ∃ c : ℝ, ∀ x, -(c : EReal) ≤ M.Jstar x ∧ M.Jstar x ≤ (c : EReal)) := by sorry
end BertsekasShreve.BorelInfinite
Source
Bertsekas & Shreve, Stochastic Optimal Control: The Discrete-Time Case, Athena Scientific 1996, pp. 214–215, Definitions 9.2–9.3 and Eqs. (1)–(2) of Chapter 9, as used in the proof of Proposition 9.8 (p. 226)