Proposition 7.5.3 — a standard policy gives (SEN1–2)
ProvedSennottDP.BOR.sen12_of_standardaverage-costmarkov-chainp2o-batch-b23ap2o-gran-per-chapterp2o-plan-bookp2o-v1
If there exists a standard (randomized stationary) policy , then (SEN1) and (SEN2) hold for the distinguished state : is bounded for , and there is a nonnegative finite function with for all and .
This is the book's standard method for verifying (SEN1–2).
Preamble
import Mathlib import Definitions.Def_SennottDP_BOR_Assumptions open scoped ENNReal NNReal open Filter Topology
Formal statement
namespace SennottDP.BOR
/-- Sennott (1999), Proposition 7.5.3, p. 143. If there exists a `z` standard (randomized
stationary) policy `d`, then (SEN1) and (SEN2) hold for `z`. -/
theorem sen12_of_standard {S Act : Type} [Countable S] (M : SennottDP.Discounted.MDC S Act) (z : S)
(hd : ∃ d : RandStationaryPolicy M, IsZStandard d.toPolicy z) :
SEN1 M z ∧ ∃ Mf : S → ℝ, SEN2 M z Mf := by sorry
end SennottDP.BOR
Source
Sennott, Stochastic Dynamic Programming and the Control of Queueing Systems (Wiley, 1999), p. 143, Proposition 7.5.3
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.